Data Science Job Market in the Age of COVID-19

Posted on Jun 29, 2020
The skills the author demoed here can be learned through taking Data Science with Machine Learning bootcamp with NYC Data Science Academy.

According to California University of Pennsylvania β€œData science was named the fastest-growing job in 2017 by LinkedIn, and in 2018 Glassdoor ranked data scientist as the best job in the United States.” In the age of COVID-19, we wonder how this trend is standing against the gruesome repercussions of COVID-19 on the economy. This projectΒ  aims at investigating the following questions.

  • What is the distribution of data science jobs per State?Β 
  • What industries are prominent in each State?
  • Which sector/industry holds the most Data Science jobs?
  • IsΒ  the salary stillΒ  three figures?
  • How fastΒ  are these positions being filled ?

Data Acquisition

Data used in the project was scrapped from Glassdoor using scrapy and selenium. A total of 864 jobs were scraped.Β  After cleaning and filtering, 634 unique jobs were used. Jobs scraped were the result of the query β€œdata science” with location and all other fields left blank. The screenshot below shows a sample of theΒ  cleaned data.

Data Science Job Market in the Age of COVID-19
  • Company: Name of the company recruiting
  • City,State: Address of the position being filled
  • Β Year_founded: Year the company was founded
  • Job_title: Title of the positionΒ 
  • Days_posted: Number of days the position has been on Glassdoor
  • Started_salary and Max_salary: Estimate of the minimum and maximum yearly salary by Glassdoor.Β 
  • Industry and Sector: The industry and sector of the company that is recruiting.

Exploratory Data Analysis

A first look into the data shows the distribution of jobs by states. As shown below, we can see that major tech hub States still hold quite a lot of positions in this industry.

Data Science Job Market in the Age of COVID-19

A dive into the data slices it into sectors to understand which one is offering most positions.This is further grouped by State to show principal sector per State. This will give job seekers an inside look on howΒ  their interestΒ  match up with their preferred industry and location, so that they have a better idea of how to center their job search.

Data Science Job Market in the Age of COVID-19

Salary

A look at salary estimate columns shows median, mean, minimum and maximum estimated lower and upper bound yearly salary per State. This valuable insight helps understand the pay rate of data scientists and whatΒ  new data scientists can expect. The two figures below show the minimum and maximum yearly salary of the top 20 States ordered by median income. It is worth noting that NH had a single position in the data set, so even though it is in the top tier it does not have enough data to show the spread of its income.

These figures show us the median of the lower bound salary for data science positions is above $100,000 per year. Therefore, we can safely suggest that even though some junior positions may not have a 6 figure salary, it is very likely that with experience they will achieve this pay scale in their career.

Average Positions Closed or Posted

To close our investigation, we take a look at how quick positions were filling up by comparing the average posted duration of opened positions versus filled positions. Two days after the initial data were collected using scrappy, we ran the second script and recorded which positions were already filled or were not available anymore. The figure below shows that tech hub states like California, New York, Virginia,Β  filled their positions very quickly while other non-tech have trouble filling up positions. This is further illustrated on the average days a position stays open.

We can see Nevada, Nebraska, etc. have the highest average posted days. We mayΒ  infer from this observations that non-tech oriented States have difficulties filling their positions. However these States could be an alternative for people who have trouble finding jobs in the most competing States -- their plan B when plan A doesn’t work out.. Even Though the salary might not be as high as in the high tier States, the lower cost of living in these StatesΒ  may make up for that disparity.

Conclusion

In summary, we can say that data scientists still have a fair chance of finding a good paying job in the age of COVID-19. The job searchΒ  might not be easy, depending on which state and industry you are targeting. However, if one is open to expanding the search, it is worth considering the jobs inΒ  locationsΒ  with less competition.

About Author

Patrice Kontchou

Certified Data Scientist with a Masters in Software Engineering (concentration in Artificial Intelligence). Enthusiastic and self-motivated, backed by professional experience driving business insight from terabytes of data using visualization, statistical analysis and machine learning. Strong discipline and leadership...
View all posts by Patrice Kontchou >

Leave a Comment

No comments found.

View Posts by Categories


Our Recent Popular Posts


View Posts by Tags

#python #trainwithnycdsa 2019 2020 Revenue 3-points agriculture air quality airbnb airline alcohol Alex Baransky algorithm alumni Alumni Interview Alumni Reviews Alumni Spotlight alumni story Alumnus ames dataset ames housing dataset apartment rent API Application artist aws bank loans beautiful soup Best Bootcamp Best Data Science 2019 Best Data Science Bootcamp Best Data Science Bootcamp 2020 Best Ranked Big Data Book Launch Book-Signing bootcamp Bootcamp Alumni Bootcamp Prep boston safety Bundles cake recipe California Cancer Research capstone car price Career Career Day citibike classic cars classpass clustering Coding Course Demo Course Report covid 19 credit credit card crime frequency crops D3.js data data analysis Data Analyst data analytics data for tripadvisor reviews data science Data Science Academy Data Science Bootcamp Data science jobs Data Science Reviews Data Scientist Data Scientist Jobs data visualization database Deep Learning Demo Day Discount disney dplyr drug data e-commerce economy employee employee burnout employer networking environment feature engineering Finance Financial Data Science fitness studio Flask flight delay gbm Get Hired ggplot2 googleVis H20 Hadoop hallmark holiday movie happiness healthcare frauds higgs boson Hiring hiring partner events Hiring Partners hotels housing housing data housing predictions housing price hy-vee Income Industry Experts Injuries Instructor Blog Instructor Interview insurance italki Job Job Placement Jobs Jon Krohn JP Morgan Chase Kaggle Kickstarter las vegas airport lasso regression Lead Data Scienctist Lead Data Scientist leaflet league linear regression Logistic Regression machine learning Maps market matplotlib Medical Research Meet the team meetup methal health miami beach movie music Napoli NBA netflix Networking neural network Neural networks New Courses NHL nlp NYC NYC Data Science nyc data science academy NYC Open Data nyc property NYCDSA NYCDSA Alumni Online Online Bootcamp Online Training Open Data painter pandas Part-time performance phoenix pollutants Portfolio Development precision measurement prediction Prework Programming public safety PwC python Python Data Analysis python machine learning python scrapy python web scraping python webscraping Python Workshop R R Data Analysis R language R Programming R Shiny r studio R Visualization R Workshop R-bloggers random forest Ranking recommendation recommendation system regression Remote remote data science bootcamp Scrapy scrapy visualization seaborn seafood type Selenium sentiment analysis sentiment classification Shiny Shiny Dashboard Spark Special Special Summer Sports statistics streaming Student Interview Student Showcase SVM Switchup Tableau teachers team team performance TensorFlow Testimonial tf-idf Top Data Science Bootcamp Top manufacturing companies Transfers tweets twitter videos visualization wallstreet wallstreetbets web scraping Weekend Course What to expect whiskey whiskeyadvocate wildfire word cloud word2vec XGBoost yelp youtube trending ZORI