1.1.2.What Do Data Scientists Do? - sj50179/IBM-Data-Science-Professional-Certificate GitHub Wiki

What Makes Someone a Data Scientist?

Now that you know what is in the book, it is time to put down some definitions. Despite their ubiquitous use, consensus evades the notions of big data and data science. The question, "Who is a data scientist?" is very much alive and being contested by individuals, some of whom are merely interested in protecting their discipline or academic turfs. In this section, I attempt to address these controversies and explain Why a narrowly construed definition of either big data or data science will result in excluding hundreds of thousands of individuals who have recently turned to the emerging field.

"Everybody loves a data scientist", wrote Simon Rogers (2012) in the Guardian. Mr. Rogers also traced the newfound love for number crunching to a quote by Google's Hal Varian, who declared that "the sexy job in the next ten years Will be statisticians."

Whereas Hal Varian named statisticians sexy, it is widely believed that what he really meant were data scientists. This raises several important questions:

  • What is data science?
  • How does it differ from statistics?
  • What makes someone a data scientist?

In the times of big data, a question as simple as, "What is data science?" can result in many answers. In some cases, the diversity of opinion on these answers borders on hostility.

I define data scientist as someone who finds solutions to problems by analyzing big or small data using appropriate tools and then tells stories to communicate her findings to the relevant stakeholders. (์ €๋Š” ๋ฐ์ดํ„ฐ ๊ณผํ•™์ž๋ฅผ ์ ์ ˆํ•œ ๋„๊ตฌ๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ๋น… ๋ฐ์ดํ„ฐ๋‚˜ ์†Œ๊ทœ๋ชจ ๋ฐ์ดํ„ฐ๋ฅผ ๋ถ„์„ํ•˜์—ฌ ๋ฌธ์ œ์— ๋Œ€ํ•œ ํ•ด๊ฒฐ์ฑ…์„ ์ฐพ์€ ๋‹ค์Œ, ๊ด€๋ จ ์ดํ•ด ๊ด€๊ณ„์ž๋“ค์—๊ฒŒ ์ž์‹ ์˜ ์—ฐ๊ตฌ ๊ฒฐ๊ณผ๋ฅผ ์ „๋‹ฌํ•˜๋Š” ์ด์•ผ๊ธฐ๋ฅผ ํ•˜๋Š” ์‚ฌ๋žŒ์œผ๋กœ ์ •์˜ํ•ฉ๋‹ˆ๋‹ค.) I do not use the data size as a restrictive clause. A data below a certain arbitrary threshold does not make one less of a data scientist. Nor is my definition of a data scientist restricted to particular analytic tools, such as machine learning. As long as one has a curious mind, fluency in analytics, and the ability to communicate the findings, I consider the person a data scientist.

I define data science as something that data scientists do. Years ago, as an engineering student at the University of Toronto I was stuck With the question: What is engineering? I wrote my master's thesis on forecasting housing prices and my doctoral dissertation on forecasting homebuilders' choices related to What they build, when they build, and where they build new housing. In the civil engineering department, others were working on designing buildings, bridges, tunnels, and worrying about the stability of slopes. My work, and that of my supervisor, was not your traditional garden-variety engineering. Obviously, I was repeatedly asked by others whether my research was indeed engineering.

When I shared these concerns with my doctoral supervisor, Professor Eric Miller, he had a laugh. Dr. Miller spent a lifetime researching urban land use and transportation, and had earlier earned a doctorate from MIT. "Engineering is what engineers do," he responded. Over the next 17 years, I realized the wisdom in his statement. You first become an engineer by obtaining a degree and then registering with the local professional body that regulates the engineering profession. Now you are an engineer. You can dig tunnels; write software codes; design components of an iPhone or a supersonic jet. You are an engineer. And when you are leading the global response to financial crisis in your role as the chief economist of the International Monetary Fund (IMF), as Dr. Raghuram Rajan did, you are an engineer.

Professor Raghuram Rajan did his first degree in electrical engineering from the Indian Institute Of Technology. He pursued economics in graduate studies, later became a professor at a prestigious university, and eventually landed at the IMF. He is currently serving as the 23rd Governor of the Reserve Bank of India. Could someone argue that his intellectual prowess is rooted only in his training as an economist and that the fundamentals he learned as an engineering student played no role in developing his problem-solving abilities?

Professor Rajan is an engineer. So are Xi Jinping, the President of the People's Republic of China, and Alexis Tsipras, the Greek prime Minister who is forcing the world to rethink the fundamentals of global economics. They might not be designing new circuitry, distillation equipment, or bridges, but they are helping build better societies and economies and there can be no better definition of engineering and engineersโ€”that is, individuals dedicated to building better economies and societies.

So briefly, I would argue that data science is what data scientists do.

Others have much different definitions. In September 2015, a co-panelist at a meetup organized by BigDataUniversity.com in Toronto confined data science to machine learning. There you have it. If you are not using the black boxes that make up machine learning, as per some experts in the field, you are not a data scientist. Even if you were to discover the cure to a disease threatening the lives of millions, turf-protecting colleagues will exclude you from the data science club.

Dr. Vincent Granville (2014), an author On data science, offers certain thresholds to meet to be a data scientist. On pages 8 and 9 in Developing Analytic Talent Dr. Granville describes the new data science professor as a non-tenured instructor at a non-traditional university, who publishes research results in online blogs, does not waste time writing grants, works from home, and earns more money than the traditional tenured professors. Suffice it to say that the thriving academic community of data scientists might disagree with Dr. Granville.

Dr. Granville uses restrictions on data size and methods to define what data science is. He defines a data scientist as one who can "easily process a 50-million-row data set in a couple of hours," and who distrusts (statistical) models. He distinguishes data science from statistics. Yet he lists algebra, calculus, and training in probability and statistics as necessary background "to understand data science" (page 4).

Some believe that big data is merely about crossing a certain threshold on data size or the number of observations, or is about the use of a particular tool, such as Hadoop. Such arbitrary thresholds on data size are problematic because with innovation, even regular computers and off-the-shelf software have begun to manipulate very large data sets. Stata, a commonly used software by data scientists and statisticians, announced that one could now process between 2 billion to 24.4 billion rows using its desktop solutions. If Hadoop is the password to the big data club, Stata's ability to process 24.4 billion rows, under certain limitations, has just gatecrashed that big data party.

It is important to realize that one who tries to set arbitrary thresholds to exclude others is likely to run into inconsistencies. The goal should be to define data science in a more exclusive, discipline- and platform-independent, size-free context where data-centric problem solving and the ability to weave strong narratives take center Stage.

Given the controversy, I would rather consult others to see how they describe a data scientist. Why don't we again consult the Chief Data Scientist of the United States? Recall Dr. Patil told the Guardian newspaper in 2012 that a "data scientist is that unique blend of skills that can both unlock the insights of data and tell a fantastic story via the data."(๋ฐ์ดํ„ฐ ๊ณผํ•™์ž๋Š” ๋ฐ์ดํ„ฐ์— ๋Œ€ํ•œ ํ†ต์ฐฐ๋ ฅ์„ ํ™•๋ณดํ•˜๊ณ  ๋ฐ์ดํ„ฐ๋ฅผ ํ†ตํ•ด ํ™˜์ƒ์ ์ธ ์ด์•ผ๊ธฐ๋ฅผ ๋“ค๋ ค์ค„ ์ˆ˜ ์žˆ๋Š” ๋…ํŠนํ•œ ๊ธฐ์ˆ ์˜ ์กฐํ•ฉ์ด๋‹ค.) What is admirable about Dr. Patil's definition is that it is inclusive of individuals of various academic backgrounds and training, and does not restrict the definition of a data scientist to a particular tool or subject it to a certain arbitrary minimum threshold of data size.

The other key ingredient for a successful data scientist is a behavioral trait: curiosity. A data scientist has to be one with a very curious mind, willing to spend significant time and effort to explore her hunches. In journalism, the editors call it having the nose for news. Not all reporters know where the news lies. Only those Who have the nose for news get the Story. Curiosity is equally important for data scientists as it is for journalists.

Rachel Schutt is the Chief Data Scientist at News Corp. She teaches a data science course at Columbia University. She is also the author Of an excellent book, Doing Data Science. In an interview With the New York Times, Dr. Schutt defined a data scientist as someone who is part computer scientist, part software engineer, and part statistician (Miller, 2013). But that's the definition of an average data scientist. "The best," she contended, "tend to be really curious people, thinkers who ask good questions and are O.K. dealing with unstructured situations and trying to find structure in them."(์ตœ๊ณ ๋Š” ํ˜ธ๊ธฐ์‹ฌ์ด ๋งŽ์€ ์‚ฌ๋žŒ๋“ค, ์ข‹์€ ์งˆ๋ฌธ์„ ํ•˜๋Š” ์‚ฌ๋žŒ๋“ค์ด๊ณ , ๊ตฌ์กฐํ™”๋˜์ง€ ์•Š์€ ์ƒํ™ฉ์„ ๋‹ค๋ฃจ๊ณ  ๊ทธ ์•ˆ์—์„œ ๊ตฌ์กฐ๋ฅผ ์ฐพ์œผ๋ ค ์• ์“ฐ๋Š” ๊ดœ์ฐฎ์€ ์‚ฌ๋žŒ๋“ค์ด์—ˆ๋‹ค.)


Lesson Summary

In this lesson, I have learned:

  • The typical work day for a Data Scientist varies depending on what type of project they are working on. ๋ฐ์ดํ„ฐ ์‚ฌ์ด์–ธํ‹ฐ์ŠคํŠธ์˜ ์ผ๋ฐ˜์ ์ธ ๊ทผ๋ฌด์ผ์€ ์ž‘์—… ์ค‘์ธ ํ”„๋กœ์ ํŠธ์˜ ์œ ํ˜•์— ๋”ฐ๋ผ ๋‹ฌ๋ผ์ง„๋‹ค.

  • Many algorithms are used to bring out insights from data. ๋ฐ์ดํ„ฐ์—์„œ ํ†ต์ฐฐ๋ ฅ์„ ์–ป๊ธฐ ์œ„ํ•ด ๋งŽ์€ ์•Œ๊ณ ๋ฆฌ์ฆ˜์ด ์‚ฌ์šฉ๋œ๋‹ค.

  • Accessing algorithms, tools, and data through the Cloud enables Data Scientists to stay up-to-date and collaborate easily. ํด๋ผ์šฐ๋“œ๋ฅผ ํ†ตํ•ด ์•Œ๊ณ ๋ฆฌ์ฆ˜, ๋„๊ตฌ ๋ฐ ๋ฐ์ดํ„ฐ์— ์•ก์„ธ์Šคํ•˜๋ฉด ๋ฐ์ดํ„ฐ ์‚ฌ์ด์–ธํ‹ฐ์ŠคํŠธ๊ฐ€ ์ตœ์‹  ์ƒํƒœ๋ฅผ ์œ ์ง€ํ•˜๊ณ  ์‰ฝ๊ฒŒ ํ˜‘์—…ํ•  ์ˆ˜ ์žˆ๋‹ค.


Quiz