Startups

How To Stem The Global Shortage Of Data Scientists

Comment

Image Credits:

Amy Gershkoff

Contributor

Amy Gershkoff is the chief data officer at Zynga and an adjunct professor at the University of California, Berkeley, where she teaches data science.

Data scientist might be considered the “sexiest job of the 21st century,” with many companies eager to hire data science talent. But 20 years ago the term was barely used, save for a few academic articles.

Even a decade ago, explaining data science to employers was challenging. Few people understood the value of a skill set that combines computer science, statistics, operations research, engineering, business insights and strategy — and the impact it can have on a business.

But things have changed over the last five years. Not only has the term “data science” become commonplace, but data scientists have become highly sought after in the marketplace and lauded in the press.

After all, it was data science that gave consumers personalized shopping recommendations on websites like eBay and Amazon, customized entertainment recommendations on Netflix and Spotify and tailored content and advertising on Facebook, Twitter and Pinterest — all at tens of millions of dollars (if not more) of revenue upside for these businesses.

Over time, organizations started to see the value of data science as the volume of data they had to analyze increased dramatically. For instance, today an estimated 2.5 quintillion bytes of data are created daily. Within this voluminous quantity of data lie insights that could enable companies to gain a competitive edge and provide a better consumer experience, which is why many organizations have now made data science a top priority.

In a KPMG survey of C-suite executives, 99 percent said that analysis of big data was important to their strategy for next year. As the study stated, “Today, the issue is no longer about owning the most data but rather … how to turn data into insights.”

Which is where data scientists come in. The role of a data scientist is to mine enormous volumes of data and pull out key insights. In an era where enterprise-generated data is expected to exceed 240 exabytes daily by 2020, the need for experts trained in extracting insights from data is more important than ever.

So what’s the problem? We have a global talent shortage, and the demand for data scientists continues to grow rapidly, far outpacing the anemic growth in supply. A McKinsey study predicts that by 2018 the number of data science jobs in the United States alone will exceed 490,000, but there will be fewer than 200,000 available data scientists to fill these positions. Globally, demand for data scientists is projected to exceed supply by more than 50 percent by 2018.

The global talent drought may be partially caused by the dearth of universities that offer data science programs dedicated to preparing the next generation of data scientists. Fewer than one-third of U.S. News & World Report’s Top 100 Global Universities offer degrees in data science. Of the 29 universities that offer data science programs, a mere six make them available to undergraduates (the rest are reserved for graduate students).

Moreover, the average cohort size for one of these data science programs is just 23 students. The small cohort size may be partially attributed to the fact that most of these data science programs tend to be offered to graduate students, and sizes of graduate programs tend to be smaller. Still, at 23 students per cohort, we are unlikely to make a meaningful dent in closing the global data science talent gap.

An analysis of the curricula for these data science programs also suggests cause for concern. Most are focused almost exclusively on the computer engineering aspects of data science, with course titles such as Software Design, Parallel Computing and Software Development.

Largely missing from the data science curricula at many of these universities are courses in statistical analysis, insights and strategy. This oversight may have serious consequences for graduating students and their future employers.

Without training in these other areas, data scientists may be capable of designing an algorithm that is mathematically elegant, but doesn’t make strategic sense for the business. They also may not know how to design an experiment to determine whether the algorithm is effective. In other words, computer science skills alone are insufficient for success as a data scientist in today’s marketplace.

Furthermore, many data science programs lack courses that help students apply their technical data science skills to fields such as marketing, operations, product development and supply chain, and industries such as energy, bioinformatics, transportation and healthcare.

While there are some universities that have distinguished themselves for having curricula that focus on the multi-faceted aspects of data science, such as New York University, there are still far too few universities producing enough graduates to meet today’s growing demand for data scientists.

There are three steps we can take to help stem this talent shortage:

  • Increase the number of universities offering data science degrees: To accelerate this, employers can partner with universities to help design and fund the creation of these programs. Accenture’s recent partnership with the University of California, Berkeley to create a new Big Data and Data Science curriculum is one such example. As part of the partnership, Berkeley’s Haas School of Business collaborated with Accenture to create new classes and a lecture series to equip MBA students with the skills needed to analyze big data, including a new course on data analytics.
  • Offer data science programs for undergraduates: Enrollment in data science programs must radically increase — cohort sizes of 23 students simply will not close the talent gap fast enough. Offering data science degree programs to undergraduates as well as graduate students can significantly expand enrollment. Universities also should consider offering courses online and during evenings and weekends in an effort to reach non-traditional students.
  • Launch programs that train analysts to become data scientists: Many organizations are flush with analysts who typically have some data science skills in key areas such as statistics. Zynga, for example, recently started a Data Science Transition Program, which enables high-performing analysts to be apprenticed to a data scientist for twelve months, during which time they learn data science skills on the job while taking online data science courses. At the end of the program, the participant becomes an Associate Data Scientist at the company.

Closing the global data science talent gap won’t be easy, but it’s critical to ensure companies have the ability to make data-driven strategic decisions. If companies and universities work together to address the problem, we can better prepare both students and employers for success.

More TechCrunch

When Jeffrey Wang posted to X asking if anyone wanted to go in on an order of fancy-but-affordable office nap pods, he didn’t expect the post to go viral.

With AI startups booming, nap pods and Silicon Valley hustle culture are back

A new crop of early-stage startups — along with some recent VC investments — illustrates a niche emerging in the autonomous vehicle technology sector. Unlike the companies bringing robotaxis to…

VCs and the military are fueling self-driving startups that don’t need roads

When the founders of Sagetap, Sahil Khanna and Kevin Hughes, started working at early-stage enterprise software startups, they were surprised to find that the companies they worked at were trying…

Deal Dive: Sagetap looks to bring enterprise software sales into the 21st century

Keeping up with an industry as fast-moving as AI is a tall order. So until an AI can do it for you, here’s a handy roundup of recent stories in the world…

This Week in AI: OpenAI moves away from safety

After Apple loosened its App Store guidelines to permit game emulators, the retro game emulator Delta — an app 10 years in the making — hit the top of the…

Adobe comes after indie game emulator Delta for copying its logo

Meta is once again taking on its competitors by developing a feature that borrows concepts from others — in this case, BeReal and Snapchat. The company is developing a feature…

Meta’s latest experiment borrows from BeReal’s and Snapchat’s core ideas

Welcome to Startups Weekly! We’ve been drowning in AI news this week, with Google’s I/O setting the pace. And Elon Musk rages against the machine.

Startups Weekly: It’s the dawning of the age of AI — plus,  Musk is raging against the machine

IndieBio’s Bay Area incubator is about to debut its 15th cohort of biotech startups. We took special note of a few, which were making some major, bordering on ludicrous, claims…

IndieBio’s SF incubator lineup is making some wild biotech promises

YouTube TV has announced that its multiview feature for watching four streams at once is now available on Android phones and tablets. The Android launch comes two months after YouTube…

YouTube TV’s ‘multiview’ feature is now available on Android phones and tablets

Featured Article

Two Santa Cruz students uncover security bug that could let millions do their laundry for free

CSC ServiceWorks provides laundry machines to thousands of residential homes and universities, but the company ignored requests to fix a security bug.

1 day ago
Two Santa Cruz students uncover security bug that could let millions do their laundry for free

OpenAI’s Superalignment team, responsible for developing ways to govern and steer “superintelligent” AI systems, was promised 20% of the company’s compute resources, according to a person from that team. But…

OpenAI created a team to control ‘superintelligent’ AI — then let it wither, source says

TechCrunch Disrupt 2024 is just around the corner, and the buzz is palpable. But what if we told you there’s a chance for you to not just attend, but also…

Harness the TechCrunch Effect: Host a Side Event at Disrupt 2024

Decks are all about telling a compelling story and Goodcarbon does a good job on that front. But there’s important information missing too.

Pitch Deck Teardown: Goodcarbon’s $5.5M seed deck

Slack is making it difficult for its customers if they want the company to stop using its data for model training.

Slack under attack over sneaky AI training policy

A Texas-based company that provides health insurance and benefit plans disclosed a data breach affecting almost 2.5 million people, some of whom had their Social Security number stolen. WebTPA said…

Healthcare company WebTPA discloses breach affecting 2.5 million people

Featured Article

Microsoft dodges UK antitrust scrutiny over its Mistral AI stake

Microsoft won’t be facing antitrust scrutiny in the U.K. over its recent investment into French AI startup Mistral AI.

1 day ago
Microsoft dodges UK antitrust scrutiny over its Mistral AI stake

Ember has partnered with HSBC in the U.K. so that the bank’s business customers can access Ember’s services from their online accounts.

Embedded finance is still trendy as accounting automation startup Ember partners with HSBC UK

Kudos uses AI to figure out consumer spending habits so it can then provide more personalized financial advice, like maximizing rewards and utilizing credit effectively.

Kudos lands $10M for an AI smart wallet that picks the best credit card for purchases

The EU’s warning comes after Microsoft failed to respond to a legally binding request for information that focused on its generative AI tools.

EU warns Microsoft it could be fined billions over missing GenAI risk info

The prospects for troubled banking-as-a-service startup Synapse have gone from bad to worse this week after a United States Trustee filed an emergency motion on Wednesday.  The trustee is asking…

A US Trustee wants troubled fintech Synapse to be liquidated via Chapter 7 bankruptcy, cites ‘gross mismanagement’

U.K.-based Seraphim Space is spinning up its 13th accelerator program, with nine participating companies working on a range of tech from propulsion to in-space manufacturing and space situational awareness. The…

Seraphim’s latest space accelerator welcomes nine companies

OpenAI has reached a deal with Reddit to use the social news site’s data for training AI models. In a blog post on OpenAI’s press relations site, the company said…

OpenAI inks deal to train AI on Reddit data

X users will now be able to discover posts from new Communities that are trending directly from an Explore tab within the section.

X pushes more users to Communities

For Mark Zuckerberg’s 40th birthday, his wife got him a photoshoot. Zuckerberg gives the camera a sly smile as he sits amid a carefully crafted re-creation of his childhood bedroom.…

Mark Zuckerberg’s makeover: Midlife crisis or carefully crafted rebrand?

Strava announced a slew of features, including AI to weed out leaderboard cheats, a new ‘family’ subscription plan, dark mode and more.

Strava taps AI to weed out leaderboard cheats, unveils ‘family’ plan, dark mode and more

We all fall down sometimes. Astronauts are no exception. You need to be in peak physical condition for space travel, but bulky space suits and lower gravity levels can be…

Astronauts fall over. Robotic limbs can help them back up.

Microsoft will launch its custom Cobalt 100 chips to customers as a public preview at its Build conference next week, TechCrunch has learned. In an analyst briefing ahead of Build,…

Microsoft’s custom Cobalt chips will come to Azure next week

What a wild week for transportation news! It was a smorgasbord of news that seemed to touch every sector and theme in transportation.

Tesla keeps cutting jobs and the feds probe Waymo

Sony Music Group has sent letters to more than 700 tech companies and music streaming services to warn them not to use its music to train AI without explicit permission.…

Sony Music warns tech companies over ‘unauthorized’ use of its content to train AI

Winston Chi, Butter’s founder and CEO, told TechCrunch that “most parties, including our investors and us, are making money” from the exit.

GrubMarket buys Butter to give its food distribution tech an AI boost