Visualizing New York City 3-1-1 Calls

Posted on Oct 23, 2016

In 2014, University of British Columbia researchers declared New York City as the unhappiest city in America. Well over a hundred million calls have been logged on 311, the city’s complaint hotline since its launch in 2003. New York City has made all 311 requests data since 2010 available online through the city’s OpenData portal. In this exercise of exploratory data analysis, I’ll try to find and analyze some of New Yorkers’ most complained issues.

First the dataset was downloaded from here.  A quick glance at the data and we can see the top 10 complaints from the entire city and its individual boroughs from 2010 to 2013. Filtering the data by years was necessary here because this data set logged the last heating complaint, which was the second most complained about issue, on 3/10/2014. I only used the entries before 2014 for a fair comparison. Noise (including both residential and commercial sources) is clearly the most complained issue, accounting for 11.8% of all the complaints. It is also the most complained issue in 4 out of 5 boroughs, Manhattan, Brooklyn, Queens and the Bronx. It is the second most complaint in Staten Island, where street condition is a bigger concern.

Top 10 Complaints of New York City and its individual boroughs from 2010 to 2013

Now that we know noise is the top complaint, let's figure out its pattern.

There are 35 different descriptors for noises in the data set. I grouped them into 8 types: Music/TV/Talking, Banging/Pounding, Construction, Vehicle, Dog and other animals, Air Conditioner , Alarm and Other to simplify the analysis. The figure below shows that Music/TV/Talking is the most common source of noise, it accounts for 48% of all the noise complaints.

Types of NoisesWhen do noises complaints occur? The figure below plots the number of complaints against hour. It shows noise complaints peak after 8pm until 2am on weekdays, with even more complaints on weekends. It is not surprising since the main sources of noise complaints, loud music or parties, peaks at late night when people who are trying to sleep are most likely to complain.

Number of Noise Complaints vs Hour

Where are the nosiest parts in New York? To answer this question, it is necessary to normalize total number of complaints against the population in the corresponding area. In the choropleth map of New York City below, each zip code is colored according to the number of noise complaints per resident in the same zip code. As a general rule, noise complaints occur most in Manhattan and declines as you leave Manhattan.

Choropleth Map of All Noise Complaints per Capita in New York City

It is important to know that each type of noise has its own spatial pattern.  Even though loud music contributes nearly 50% of all noise complaints, it does not explain the noise situation in all neighborhoods. For example, Battery Park City suffers mostly from vehicle noises and Kew Gardens suffers from unusually high alarm noises. Consequently, different solutions are necessary for government agency to resolve the noise issues in different neighborhoods.

yisongtao_plot1_5

yisongtao_plot1_6yisongtao_plot1_7

yisongtao_plot1_8Other common complaints such as heating and street condition can also be visualized in similar ways. These two complaints both demonstrate time pattern, which are not surprising because people are likely to complain about heating issues in winter and street conditions are worst in late winter after snowstorms.

yisongtao_plot1_9

From this data visualization exercise, we have looked at New Yorker's most common complaints. 'The city that never sleeps' is not only a poetic nick name but also is a realistic picture of the sounds New Yorkers hear in different neighborhoods.

Joe Eckert, a student from previous bootcamp also visualized 311 noise complaints of NYC, his findings are posted here.

About Author

Yisong Tao

Yisong Tao graduated from Columbia University with a PhD degree in Chemistry, after which he worked as a research associate at Albert Einstein College of Medicine for 6 years. He’s shown good judgement in developing projects, ability to...
View all posts by Yisong Tao >

Leave a Comment

No comments found.

View Posts by Categories


Our Recent Popular Posts


View Posts by Tags

#python #trainwithnycdsa 2019 2020 Revenue 3-points agriculture air quality airbnb airline alcohol Alex Baransky algorithm alumni Alumni Interview Alumni Reviews Alumni Spotlight alumni story Alumnus ames dataset ames housing dataset apartment rent API Application artist aws bank loans beautiful soup Best Bootcamp Best Data Science 2019 Best Data Science Bootcamp Best Data Science Bootcamp 2020 Best Ranked Big Data Book Launch Book-Signing bootcamp Bootcamp Alumni Bootcamp Prep boston safety Bundles cake recipe California Cancer Research capstone car price Career Career Day citibike classic cars classpass clustering Coding Course Demo Course Report covid 19 credit credit card crime frequency crops D3.js data data analysis Data Analyst data analytics data for tripadvisor reviews data science Data Science Academy Data Science Bootcamp Data science jobs Data Science Reviews Data Scientist Data Scientist Jobs data visualization database Deep Learning Demo Day Discount disney dplyr drug data e-commerce economy employee employee burnout employer networking environment feature engineering Finance Financial Data Science fitness studio Flask flight delay gbm Get Hired ggplot2 googleVis H20 Hadoop hallmark holiday movie happiness healthcare frauds higgs boson Hiring hiring partner events Hiring Partners hotels housing housing data housing predictions housing price hy-vee Income Industry Experts Injuries Instructor Blog Instructor Interview insurance italki Job Job Placement Jobs Jon Krohn JP Morgan Chase Kaggle Kickstarter las vegas airport lasso regression Lead Data Scienctist Lead Data Scientist leaflet league linear regression Logistic Regression machine learning Maps market matplotlib Medical Research Meet the team meetup methal health miami beach movie music Napoli NBA netflix Networking neural network Neural networks New Courses NHL nlp NYC NYC Data Science nyc data science academy NYC Open Data nyc property NYCDSA NYCDSA Alumni Online Online Bootcamp Online Training Open Data painter pandas Part-time performance phoenix pollutants Portfolio Development precision measurement prediction Prework Programming public safety PwC python Python Data Analysis python machine learning python scrapy python web scraping python webscraping Python Workshop R R Data Analysis R language R Programming R Shiny r studio R Visualization R Workshop R-bloggers random forest Ranking recommendation recommendation system regression Remote remote data science bootcamp Scrapy scrapy visualization seaborn seafood type Selenium sentiment analysis sentiment classification Shiny Shiny Dashboard Spark Special Special Summer Sports statistics streaming Student Interview Student Showcase SVM Switchup Tableau teachers team team performance TensorFlow Testimonial tf-idf Top Data Science Bootcamp Top manufacturing companies Transfers tweets twitter videos visualization wallstreet wallstreetbets web scraping Weekend Course What to expect whiskey whiskeyadvocate wildfire word cloud word2vec XGBoost yelp youtube trending ZORI