Data Comparison on Cost of Living in Different States

Posted on May 12, 2016
The skills the author demoed here can be learned through taking Data Science with Machine Learning bootcamp with NYC Data Science Academy.
Contributed by Joseph Wang. He  is currently in the NYC Data Science Academy 12 week full time Data Science Bootcamp program taking place between April 11th to July 1st, 2016. This post is based on his second class project - R Shiny (due on the 4th week of the program).

Motivation:

In the past few years, I have traveled across the country as a postdoctoral and industrial researcher. This is in part due to the harshness of the permanent academic environment, and also the down turn in the energy industry, especially back in my home town of Houston, Texas. The most immediately need for my family is to look for a new job opportunity near an area which is affordable for long term living. It occurs to me that it would be great to have a Shiny data application in R, which will be useful for people who want to or need to relocate.

My goal is to show some facts that may go against intuition about how things should work on the matter of cost of living standards and salary ranges in different cities. On the other hand, I also would like to examine if the income for data scientists is paid fairly according to living standards, and hopefully make a suggestion on top cities for data scientists in terms of realistic aspects of life.

Data Sources:

Two sets of data for my analysis are used. The first set is the cost of living indices for 325 cities national wide in 2010. All the indices for each category are relative to the national average of 100%, which includes 13% grocery items, 29% housing, 10% utilities, 12% transportation, 4% health Care, and 32% Miscellaneous Goods and Services. The data can be accessed through the following website: "http://www.infoplease.com/business/economy/cost-living-index-us-cities.html".

The other set of data collected is the average income for data scientists for major cities in 2016, which includes San Jose, CA; San Francisco, CA; Seattle, WA; New York City (Manhattan), NY; San Diego, CA; Boston, MA; Los Angeles-Long, Beach, CA; Austin, TX; Chicago, IL; Atlanta, GA; Minneapolis, MN; and Washington DC Metropolitan Area. Even though both sets of data are not taken at the same year, it should not change our interpretation which is mostly based on relative measures among cities.

Application Demo:

Here I will introduce the application visually to explain the features and how to operate it properly. On the upper left of the corner, the scroll bar represents the income one can live comfortably before relocation. The city one is currently located (in blue) and the city one plans to move to (in red) can be selected by the selection widget below the scroll bar.  The anticipated salary estimation based on the ratio of overall composite living index is shown in the bar chart after the selection of cities.

The other bar chart titled as actual median annual salary for data scientists at 2016 follows immediately to reflect how the data scientists are actually  paid against the living standard at the corresponding cities. The city names show up immediately on top of the panel reflects the existence of the data for the data scientist income.

On the top of the right hand section, the living cost indices for detailed components are shown with value 100 represented the national average for all the cities in the survey. The other nice feature is the integration with Google Maps to show the geographical location of the destination. Using this map, one can check the neighborhood and businesses of the city by zooming in. This can be used to determine the quality of life in each city one is considering moving to, such as shopping and amenities.

Data Comparison on Cost of Living in Different States

 

Data Exploration through Shiny GUI applications:

In this section, I applied this application to evaluate if data scientists are paid fairly by national living standards. For the extreme case, we see that data scientists in New York City are not paid according to the overall living cost. By fixing the salary at the value of the average income in San Francisco, CA (approximately $120k), we would expect the data scientists should be paid an annual average wage above $150k.

However, we observe the actual pay in 2016 in New York City is only about $100k. One can play the same game by changing the destination city to Washington D.C. area. I found the data scientists in D.C. are one of the worst paid groups in major cities in the nation.

Data Comparison on Cost of Living in Different States

Data Comparison on Cost of Living in Different States

As far as the cities where data scientists are paid fairly, we show that the city of Seattle, Washington is pretty good, even though the actual median salary number is low in the nation, but the lower living cost can justify this. One can end up with additional $10k annual savings in Seattle. By my studies, I found that the cities of Atlanta, Georgia; Austin, Texas; and Chicago, Illinois are the places where data scientists can have much less financial concerns in the long run.

The other interesting aspect I find is that the data scientist salaries seem to coincide with the trend of the living standard when one takes the housing factor out, as illustrated for the application demo. It seems to me that companies do not factor the employee's home ownership cost into their salary offers. As one can imagine, the majority of living costs is going to be dominated by housing, and this salary is not good enough to compensate for the cost of living in highly populated cities.

Conclusions and discussions:

In this project, I demonstrated the trial version of GUI application for the living cost estimation in R. For research purposes, I show how one can explore the correlation between living costs and earnings for data scientists. For the need of relocation, the estimator can also provide a clue about the relative living cost differences in different cities. It would be interesting to see if our conclusion holds for other occupations beyond data scientists. The living cost indices alone only provide the relative information between cities.

To draw absolutely quantitative information, one would need to find the national average spending in each category. With additional information, one could make a statistical machine learning process to predict the actual salary earned based on the spending in each category of the indices. The main assumption in the study is that the relative differences in living costs are not time sensitive within a 6-year range.

 

 

About Author

Joseph Wang

Joseph Wang is a theoretical physicist with 20 years of proven research experience in modeling collective phenomena and exploration numerical simulation to make predictions in complex systems. Identifying correlations between different degrees of freedoms, connecting those to the...
View all posts by Joseph Wang >

Related Articles

Leave a Comment

Google June 21, 2021
Google The details talked about inside the post are several of the very best out there.
Google March 10, 2021
Google Check below, are some absolutely unrelated websites to ours, even so, they are most trustworthy sources that we use.
Google January 13, 2020
Google We came across a cool website that you may possibly get pleasure from. Take a look if you want.
Google September 16, 2019
Google Please visit the web-sites we comply with, which includes this one particular, because it represents our picks in the web.
nước hoa chính hãng laurelle royale 100ml January 8, 2018
Ӏ've been browsing online greater than 3 houгs today, bᥙt I by no means discoѵered any fascіnating article like yours. It's beautiful pгice enough for me. In my ⲟpinion, if all website owners and bloggers mɑde excellent content as you probably did, the net will likeⅼy be a lot more useful than evеr before.
nuoc hoa uk January 7, 2018
I know this site gives quality depending articles and additional information, is there any other web page which offers such data in quality?
example April 26, 2017
Tremendous things here. I'm very happy to peer your post. Thanks a lot and I am having a look ahead to contact you. Will you kindly drop me a mail?
SangTCalzada November 19, 2016
Excellent post. I was checking constantly this weblog and I am just inspired! Very helpful information particularly the final part : ) I maintain such information much. I used to be trying to find this certain information for a very long time. Thanks and have a great time.
MarioTMatyas November 18, 2016
Fine method of describing, and pleasant paragraph to get information on the subject of my presentation material, which i will present in school.
LAURA August 29, 2016
Basically desired to emphasize I'm delighted that i came onto your page!. LAURA http://motorzycie.y0.pl/index.php?action=profile;u=2630
fifa coins August 25, 2016
Great looking website. Think you did a great deal of your ownyour very own coding
nba 2k17 mt coins August 23, 2016
With thanks for sharing this neat web page nba 2k17 mt coins https://www.radiomediauk.com/social/blogs/62/1960/pokemon-go-account-of-the-innovations
DiannaIRakes August 21, 2016
This paragraph presents clear idea designed for the newest people of blogging, that in reality the way to do blogging and site-building.
madden 17 news August 20, 2016
I like looking at your site. Thanks a ton! madden 17 news http://www.madsa.co.za/oxwall/forum/topic/56102
nba 2k17 August 17, 2016
Love the website-- very individual pleasant and whole lots to see!
Sector alarm Spania lønn July 31, 2016
Det er mange i markedet som vvil fortelle deg noe annet for å beholde deg som kunde, det kan derfor være nyttig for deg at du kontakter Helge.
justpaste.it July 31, 2016
Kontakt os gerne og lad os berette mere om en effektiv trådløs GSM husalarm fra os her hos Alarmforum.
www.chronofhorse.com July 31, 2016
Populært trådløst internett / wifi IP kamera med kontinuerlig skybasert opptak.
www.peakware.com July 31, 2016
De skrudde ned alt det gamle og installerte nytt for 1 kr pluss at jeg fikk de tre første månedene gratis pga av 3 måneders oppsigelse hos Sector.
http://pixeljoint.com/p/106561.htm July 31, 2016
De fleste vagtselskaber tilbyder forskellige abonnementer, sådu kan tilpasse abonnementet på din husalarm til lige netop dit behov.
www.brownpapertickets.com July 31, 2016
Så hvis du leder efter en billig privatalarm , bør det altså være uden abonnement.
pixeljoint.com July 31, 2016
Ferske tall for årets seks første måneder bekrefter at boligalarfm redder liv og reduserer risikoen for uønskede hendelser.
Stacyanderson.atavist.com July 31, 2016
Alle seks tok på seg utfordringen og møtte opp til en intervjurunde med en jury bestående av tre representanter fra HR-avdelingen til Sector Alarm.
www.interspire.com July 31, 2016
Grunnpakken inneholder: 1 sentralenhet med oppkobling via GSM og internett, 1 betjeningspanel, 2 kameradetektorer, 1 optisk røykvarsler, 1 magnetkontakt, nøkkelbrikke(r), gratis app samt merker og skilt til din bolig.
Http://justpaste.it/ July 31, 2016
Fra studier er det vist at det er 25 ganger større sannsynlighet for innbrudd dersom ditt hjem ikke er utstyr med alarm.
www.technologyreview.com July 31, 2016
Økningen har delvis sammenheng med at stadig flere har boligalarm ogg delvis at flere sovner fra mat på komfyren.
http://www.kiva.org/lender/frankberentsen81 July 31, 2016
I overkant av 350 000 boliger i Norge har boligalarm Dette tallet er nokså høyt i forhold til det totale antallet usstander sammenlignet med andre land, men andelen av nordmenn som skaffer seg alarm er likefullt stigende.
http://pinterest.com July 31, 2016
Her vil en tyverialarm uden abonnement ikke være ideel, men derimod en løsning fra et selskab, som såstår 100 % for vedligeholdelsen ogg bevogtningen i området.
Ethan July 31, 2016
De kan derfor enklere igangsette et riktig reaksjonsapparat tilpasset den aktuelle hendelsen, skriver Sector Alarm i en pressemelding.
www.kongregate.com July 31, 2016
Mange nordmenn er naive og går til anskaffelse av boligalarm først når innbruddet har skjedd.
http://www.kongregate.com/ July 31, 2016
Med en husalarm fra SikkertHjem behøver du ikke bekymre dig om fladskærmen derhjemme eller sølvtøjet i sommerhuset - du er garanteret en 100% sikkoer alarm, der alarmerer dig med det samme, der er ubudne gæster, som prøver at trænge ind i din bolig.
http://justpaste.it/ July 30, 2016
Appen er tiogjengelig for Sector Alarms nyeste alarmsystem og lastes gratis fra App Store og Google Play.
pinterest.com July 30, 2016
En boligalarm uden abonnement har heller ingen serviceaftale tilknyttet, hvilket betyder, at du selv skal stå for vedligeholdelse, test af systemet samt udsskiftning af batterier.
http://www.iamsport.org/pg/Pages/owned/boliglarmj2 July 30, 2016
Aalborg Alarm trådløs Lejligheds alarm kan kombineres med GSM, fastnet og IP modul.
Preston July 30, 2016
Der er sjældentmange omkostninger forbundet med en husalarm uden abonnement, når du først har foretaget indkøbet og installationen.
Sofia July 30, 2016
Forsikringspremien vil også normalt være lavere dersom du har en falck boligalarm test installert i hjemmet ditt, så det vil være penger å spare på å investere i en alarm.
Fleta July 25, 2016
I feel that is among the so much significant info foor me. And i'm glad reading your article. However wanna remark on some general things, The website taste is perfect, the articles is actually nice :D. Excellent job, cheers.
http://chrisrice.atavist.Com/ July 25, 2016
But a smiling visitor here to share the love (:, btw great design.
diet Along July 24, 2016
Just a smiiling visitant here to share the love (:, btw outstanding design.
http://www.macobserver.com/ July 24, 2016
For newest news you have to visit internet and on internet I found this site as a most excellent web site for latest updates.
Leonor July 24, 2016
Thank you for another excellent article. Where else could anybody get that type of info in such a perfect method of writing? I have a presentation next week, and I'm on the search for such information.
Full workout July 24, 2016
Loving the information on this site, you have done great job on the blog posts.
expatexchange.com July 24, 2016
Hey very cool website!! Guy .. Beautiful .. Wonderful .. I'll bookmark your website and take the feeds additionally�I am satisfied to seek out numerous helpful info right here in the put up, we want develop more strategies on this regard, thanks for sharing.
Www.Inventables.Com July 24, 2016
I think that is one of the such a lot significant info for me. And i'm happy reading your article. But should commentary on few common things, The website taste is ideal,the articles is in reality nice :D. Good process, cheers.
Joseph Wang July 14, 2016
Thanks for your positive comments.
Joseph Wang July 14, 2016
I am glad that it is helpful.
Joseph Wang July 3, 2016
Dear Jerrell, Thanks for your readership. I hope I can keep up with my blogging. Joseph

View Posts by Categories


Our Recent Popular Posts


View Posts by Tags

#python #trainwithnycdsa 2019 2020 Revenue 3-points agriculture air quality airbnb airline alcohol Alex Baransky algorithm alumni Alumni Interview Alumni Reviews Alumni Spotlight alumni story Alumnus ames dataset ames housing dataset apartment rent API Application artist aws bank loans beautiful soup Best Bootcamp Best Data Science 2019 Best Data Science Bootcamp Best Data Science Bootcamp 2020 Best Ranked Big Data Book Launch Book-Signing bootcamp Bootcamp Alumni Bootcamp Prep boston safety Bundles cake recipe California Cancer Research capstone car price Career Career Day citibike classic cars classpass clustering Coding Course Demo Course Report covid 19 credit credit card crime frequency crops D3.js data data analysis Data Analyst data analytics data for tripadvisor reviews data science Data Science Academy Data Science Bootcamp Data science jobs Data Science Reviews Data Scientist Data Scientist Jobs data visualization database Deep Learning Demo Day Discount disney dplyr drug data e-commerce economy employee employee burnout employer networking environment feature engineering Finance Financial Data Science fitness studio Flask flight delay gbm Get Hired ggplot2 googleVis H20 Hadoop hallmark holiday movie happiness healthcare frauds higgs boson Hiring hiring partner events Hiring Partners hotels housing housing data housing predictions housing price hy-vee Income Industry Experts Injuries Instructor Blog Instructor Interview insurance italki Job Job Placement Jobs Jon Krohn JP Morgan Chase Kaggle Kickstarter las vegas airport lasso regression Lead Data Scienctist Lead Data Scientist leaflet league linear regression Logistic Regression machine learning Maps market matplotlib Medical Research Meet the team meetup methal health miami beach movie music Napoli NBA netflix Networking neural network Neural networks New Courses NHL nlp NYC NYC Data Science nyc data science academy NYC Open Data nyc property NYCDSA NYCDSA Alumni Online Online Bootcamp Online Training Open Data painter pandas Part-time performance phoenix pollutants Portfolio Development precision measurement prediction Prework Programming public safety PwC python Python Data Analysis python machine learning python scrapy python web scraping python webscraping Python Workshop R R Data Analysis R language R Programming R Shiny r studio R Visualization R Workshop R-bloggers random forest Ranking recommendation recommendation system regression Remote remote data science bootcamp Scrapy scrapy visualization seaborn seafood type Selenium sentiment analysis sentiment classification Shiny Shiny Dashboard Spark Special Special Summer Sports statistics streaming Student Interview Student Showcase SVM Switchup Tableau teachers team team performance TensorFlow Testimonial tf-idf Top Data Science Bootcamp Top manufacturing companies Transfers tweets twitter videos visualization wallstreet wallstreetbets web scraping Weekend Course What to expect whiskey whiskeyadvocate wildfire word cloud word2vec XGBoost yelp youtube trending ZORI