Visualizing New York City 3-1-1 Calls

Yisong Tao
Posted on Oct 23, 2016

In 2014, University of British Columbia researchers declared New York City as the unhappiest city in America. Well over a hundred million calls have been logged on 311, the city’s complaint hotline since its launch in 2003. New York City has made all 311 requests data since 2010 available online through the city’s OpenData portal. In this exercise of exploratory data analysis, I’ll try to find and analyze some of New Yorkers’ most complained issues.

First the dataset was downloaded from here.  A quick glance at the data and we can see the top 10 complaints from the entire city and its individual boroughs from 2010 to 2013. Filtering the data by years was necessary here because this data set logged the last heating complaint, which was the second most complained about issue, on 3/10/2014. I only used the entries before 2014 for a fair comparison. Noise (including both residential and commercial sources) is clearly the most complained issue, accounting for 11.8% of all the complaints. It is also the most complained issue in 4 out of 5 boroughs, Manhattan, Brooklyn, Queens and the Bronx. It is the second most complaint in Staten Island, where street condition is a bigger concern.

Top 10 Complaints of New York City and its individual boroughs from 2010 to 2013

https://gist.github.com/yisongtao/79631752cadf3d1c864f9b09a72f3cef

Now that we know noise is the top complaint, let's figure out its pattern.

There are 35 different descriptors for noises in the data set. I grouped them into 8 types: Music/TV/Talking, Banging/Pounding, Construction, Vehicle, Dog and other animals, Air Conditioner , Alarm and Other to simplify the analysis. The figure below shows that Music/TV/Talking is the most common source of noise, it accounts for 48% of all the noise complaints.

Types of NoisesWhen do noises complaints occur? The figure below plots the number of complaints against hour. It shows noise complaints peak after 8pm until 2am on weekdays, with even more complaints on weekends. It is not surprising since the main sources of noise complaints, loud music or parties, peaks at late night when people who are trying to sleep are most likely to complain.

Number of Noise Complaints vs Hour

https://gist.github.com/yisongtao/9c06f0afe99a17a84c7e9f34cf285f17

Where are the nosiest parts in New York? To answer this question, it is necessary to normalize total number of complaints against the population in the corresponding area. In the choropleth map of New York City below, each zip code is colored according to the number of noise complaints per resident in the same zip code. As a general rule, noise complaints occur most in Manhattan and declines as you leave Manhattan.

Choropleth Map of All Noise Complaints per Capita in New York City

https://gist.github.com/yisongtao/18400826add3b7d86661d20a67fb4087

It is important to know that each type of noise has its own spatial pattern.  Even though loud music contributes nearly 50% of all noise complaints, it does not explain the noise situation in all neighborhoods. For example, Battery Park City suffers mostly from vehicle noises and Kew Gardens suffers from unusually high alarm noises. Consequently, different solutions are necessary for government agency to resolve the noise issues in different neighborhoods.

yisongtao_plot1_5

yisongtao_plot1_6yisongtao_plot1_7

yisongtao_plot1_8Other common complaints such as heating and street condition can also be visualized in similar ways. These two complaints both demonstrate time pattern, which are not surprising because people are likely to complain about heating issues in winter and street conditions are worst in late winter after snowstorms.

yisongtao_plot1_9

From this data visualization exercise, we have looked at New Yorker's most common complaints. 'The city that never sleeps' is not only a poetic nick name but also is a realistic picture of the sounds New Yorkers hear in different neighborhoods.

Joe Eckert, a student from previous bootcamp also visualized 311 noise complaints of NYC, his findings are posted here.

About Author

Yisong Tao

Yisong Tao

Yisong Tao graduated from Columbia University with a PhD degree in Chemistry, after which he worked as a research associate at Albert Einstein College of Medicine for 6 years. He’s shown good judgement in developing projects, ability to...
View all posts by Yisong Tao >

Leave a Comment

No comments found.

View Posts by Categories


Our Recent Popular Posts


View Posts by Tags

#python #trainwithnycdsa 2019 airbnb Alex Baransky alumni Alumni Interview Alumni Reviews Alumni Spotlight alumni story Alumnus API Application artist aws beautiful soup Best Bootcamp Best Data Science 2019 Best Data Science Bootcamp Best Data Science Bootcamp 2020 Best Ranked Big Data Book Launch Book-Signing bootcamp Bootcamp Alumni Bootcamp Prep Bundles California Cancer Research capstone Career Career Day citibike clustering Coding Course Demo Course Report D3.js data Data Analyst data science Data Science Academy Data Science Bootcamp Data science jobs Data Science Reviews Data Scientist Data Scientist Jobs data visualization Deep Learning Demo Day Discount dplyr employer networking feature engineering Finance Financial Data Science Flask gbm Get Hired ggplot2 googleVis Hadoop higgs boson Hiring hiring partner events Hiring Partners Industry Experts Instructor Blog Instructor Interview Job Job Placement Jobs Jon Krohn JP Morgan Chase Kaggle Kickstarter lasso regression Lead Data Scienctist Lead Data Scientist leaflet linear regression Logistic Regression machine learning Maps matplotlib Medical Research Meet the team meetup Networking neural network Neural networks New Courses nlp NYC NYC Data Science nyc data science academy NYC Open Data NYCDSA NYCDSA Alumni Online Online Bootcamp Open Data painter pandas Part-time Portfolio Development prediction Prework Programming PwC python python machine learning python scrapy python web scraping python webscraping Python Workshop R R language R Programming R Shiny r studio R Visualization R Workshop R-bloggers random forest Ranking recommendation recommendation system regression Remote remote data science bootcamp Scrapy scrapy visualization seaborn Selenium sentiment analysis Shiny Shiny Dashboard Spark Special Special Summer Sports statistics streaming Student Interview Student Showcase SVM Switchup Tableau team TensorFlow Testimonial tf-idf Top Data Science Bootcamp twitter visualization web scraping Weekend Course What to expect word cloud word2vec XGBoost yelp