Data Study on Road Accident Fatality Likelihood

Posted on Sep 23, 2016
The skills the author demoed here can be learned through taking Data Science with Machine Learning bootcamp with NYC Data Science Academy.

Introduction:

The costs of fatalities and injuries due to traffic accidents have a great impact on the society. In recent years, researchers have paid increasing attention to determining factors that significantly affect severity of driver injuries caused by traffic accidents. Applying data mining techniques to model traffic accident data records can help to understand the characteristics of driver's behaviour, roadway condition and weather condition that were causally connected with different injury severity.

Why This Project :

Motor Vehicles Are Second-Leading Cause of Death Due to Injury.

Data Study on Road Accident Fatality Likelihood

The United States accounts for most number of road accidents when compared to other countries. The proportion is very high when compared to other countries.

Data Study on Road Accident Fatality Likelihood

Project Objective :

The objective of our project is as follows

  • Find the factors affecting the road accident fatality in Seattle and Boston
  • Build a model to predict the road accident based on climate and other important variables

About The Data :

The data for Seattle and Boston are scraped separately.

Data For Seattle :

Wunderground Historical Weather Data - The data was scraped using BeautifulSoup. The data consists of weather information such as temperature, fog, wind speed, humidity, precipitation. The code for scraping Wunderground data is as follows

Socrata 911 Response Data : The  911 response data consists of accident information such as type of incident, date, time, latitude, longitude, number of people injured. The code for scraping the 911 response data is as follows

Data For Boston:

Cambridge Accidents Data : This is a open source data.

picture

 

Predictive Data Modeling:

Visualizing The Workflow For Seattle:

picture44

The Wunderground Historical Weather Data and Socrata 911 Response Data are merged together by Date in the scrape modules. Once the data is transformed, Exploratory Data Analysis is performed in python. Then the machine learning algorithms are applied to the data.

Key Data Insights :

picture3

The plot shows that few variables have linear relationship between the variables. But most of them have a scattered points plot which means that there is randomness associated with the data. The randomness is a big concern when it comes to predictive with the data.

Model Summary :

The models performed are Logistic Regression, Random Forest and Gradient Boosting. The log of the best models in each category is as follows

picture4

The maximum accuracy is obtained from Random Forest.

Grid Search : Parameters that are not directly learnt within estimators can be set by searching a parameter space for the best Cross Validation with evaluating the estimator performance score. Using the GRID SEARCH for optimizing these hyperparameter of a Random Forest, the details of the model output is as follows

picture5

The accuracy increased from 65% to 72% by using grid search.

Visualizing The Workflow For Boston :

picture55

Cambridge Government Data is considered as bad data because it doesnot have any predictive variables present in it. The data such as latitude and longitude along with time can be used to find patterns. Exploratory Data Analysis is done with Tableau. The model building is done with R.

Exploratory Data Analysis :

Map based on Accidents Occurred In Boston:

The distribution of road accidents based on location is as follows

picture6

Based on the map, we can find that Massachusetts Avenue and Cambridge Street accounts for more accidents compared to other locations.

Distribution Of Accidents Based on Day:

The distribution of accidents occurred over the week is as follows

picture7

Thursday and Friday holds the most number of accident compared to other days. Sunday is the safest day. The reason may be because of the number of cars travelling might be less compared to other days or in other words traffic might be less.

Distribution Of Accidents Based on Time

picture8

The Auto, Passenger Car and Light Truck vehicles such as van and mini van are the most dangerous vehicles

Bubble Chart of Automobile Which Hit :

The Auto, Passenger Car and Light Truck vehicles such as van and mini van are the most dangerous vehicles

pic1

Bubble Chart of Automobile Which Got Hit :

The Auto, Parked Vehicle and Bicycle are the vehicles which gets most hit by accident.

pic2

 

Un-Supervised Learning Using Hierarchical Clustering:

pic3

Based on the Within Sum of Squares plot, we can decide the number of clusters to be 4. ( 4 clusters because we chose based on Knee Rule)

The hierarchical clustering dendogram plot with the percentage coverage is

pic4

The AU is nothing but Approximately Unbiased and BP is Bootstrap p value. The tree is constructed based on euclidean distance.

 

Time Series Forcasting – Number Of Accidents  Over The Years:

The model summary of the time series forecasting is as follows

picl1

The estimated forecast for the upcoming years is as follows

picl

 

Future Scope :

  • Build a live app for predicting the likelihood of road accident based on live data
  • Find ways to account for randomness

picture9

About Author

Leave a Comment

No comments found.

View Posts by Categories


Our Recent Popular Posts


View Posts by Tags

#python #trainwithnycdsa 2019 2020 Revenue 3-points agriculture air quality airbnb airline alcohol Alex Baransky algorithm alumni Alumni Interview Alumni Reviews Alumni Spotlight alumni story Alumnus ames dataset ames housing dataset apartment rent API Application artist aws bank loans beautiful soup Best Bootcamp Best Data Science 2019 Best Data Science Bootcamp Best Data Science Bootcamp 2020 Best Ranked Big Data Book Launch Book-Signing bootcamp Bootcamp Alumni Bootcamp Prep boston safety Bundles cake recipe California Cancer Research capstone car price Career Career Day citibike classic cars classpass clustering Coding Course Demo Course Report covid 19 credit credit card crime frequency crops D3.js data data analysis Data Analyst data analytics data for tripadvisor reviews data science Data Science Academy Data Science Bootcamp Data science jobs Data Science Reviews Data Scientist Data Scientist Jobs data visualization database Deep Learning Demo Day Discount disney dplyr drug data e-commerce economy employee employee burnout employer networking environment feature engineering Finance Financial Data Science fitness studio Flask flight delay gbm Get Hired ggplot2 googleVis H20 Hadoop hallmark holiday movie happiness healthcare frauds higgs boson Hiring hiring partner events Hiring Partners hotels housing housing data housing predictions housing price hy-vee Income Industry Experts Injuries Instructor Blog Instructor Interview insurance italki Job Job Placement Jobs Jon Krohn JP Morgan Chase Kaggle Kickstarter las vegas airport lasso regression Lead Data Scienctist Lead Data Scientist leaflet league linear regression Logistic Regression machine learning Maps market matplotlib Medical Research Meet the team meetup methal health miami beach movie music Napoli NBA netflix Networking neural network Neural networks New Courses NHL nlp NYC NYC Data Science nyc data science academy NYC Open Data nyc property NYCDSA NYCDSA Alumni Online Online Bootcamp Online Training Open Data painter pandas Part-time performance phoenix pollutants Portfolio Development precision measurement prediction Prework Programming public safety PwC python Python Data Analysis python machine learning python scrapy python web scraping python webscraping Python Workshop R R Data Analysis R language R Programming R Shiny r studio R Visualization R Workshop R-bloggers random forest Ranking recommendation recommendation system regression Remote remote data science bootcamp Scrapy scrapy visualization seaborn seafood type Selenium sentiment analysis sentiment classification Shiny Shiny Dashboard Spark Special Special Summer Sports statistics streaming Student Interview Student Showcase SVM Switchup Tableau teachers team team performance TensorFlow Testimonial tf-idf Top Data Science Bootcamp Top manufacturing companies Transfers tweets twitter videos visualization wallstreet wallstreetbets web scraping Weekend Course What to expect whiskey whiskeyadvocate wildfire word cloud word2vec XGBoost yelp youtube trending ZORI