Flight Delays R Shiny

Avatar
Posted on Dec 12, 2019

Shiny Dashboard 2018 flight delays:

https://huiminou.shinyapps.io/Flight_Delay/

 

Background

There are thousands of flight delays in the United States on a daily basis. Direct Aircraft Operating Cost is $74.2/min. Flight delays cost airlines billions of dollars every year. It is important for airlines to minimize flight delays. I have created an interactive visualization app to help airline operations better visualize fight delays.

 

Data

I used the 2018 flight delay data from Kaggle.com. The original dataset size for 2018 flights is more than 7 million rows. Because the free version of Shiny App has a capacity limitation, I created a subset of the data to include only flights from American airline and Delta Airlines. After the subsetting, the new dataset size includes 310,983 observations.

 

Definitions:

Carrier Delay: Delay caused by a carrier such as an aircraft cleaning, aircraft damage, and baggage loading.

Late Aircraft Delay: Delay caused by previous aircraft arriving late.

NAS Delay: Delay caused by National Aviation System.

Security Delay: Delay due security such as the evacuation of terminal and re-boarding due to security breach.

Weather Delay: Delay due to weather conditions.

 

Interactive Data Visualization:

  1. Airline Operations can use “Map” to visualize the average delay hours per flight for airports in different months.

Interesting findings:

In 2018, for Delta Airline, the highest average delay hours per flight is 3.69 hours at Bismarck Municipal Airport in Bismarck, ND. Direct Aircraft Operating Cost is $74.2/min.  On average, each delayed flight at Bismarck Municipal Airport cost Delta Airlines $16,437 in 2018.

For American Airlines, the average delay hours per flight is 2.8 hours at Ted Stevens Anchorage International Airport in Anchorage, AK. Each delayed flight cost American Airlines on average $12,448 at Ted Stevens Anchorage International Airport in 2018.

 

  1. Airline Operations can use a dodge bar chart to compare reasons for the delay

 

 

Interesting finding:

For American Airlines, average delay hours for late aircraft is often longer than average delay hours for carrier delay. For Delta Airlines, delay hours due to late aircraft are often shorter than delay hours due to carrier delay. In other words, in most months of the year, late aircraft delay costs American Airlines more than carrier delay. It is the opposite of Delta Airlines.

In addition, American Airlines experienced seven months of weather delays in 2018 while Delta Airlines has weather delays almost every month.

The delay caused by NAS is similar between the two airlines.

For both Delta and American Airlines, there is almost no delay caused by security.

 

  1. Airline Operations can use a dodge bar chart to compare the reason for delay by airport

 

In major airports such as BOS, LGA, ORD, passengers spend more time waiting for flight due to late aircraft delay compared to spending time for other reasons.

 

It is interesting that at JFK airport, flights are delayed longer due to National Aviation System compare to other flight delay reasons.

 

  1. Airline Operations can compare delay frequency by hours and weekdays

For American Airlines, flights are often delayed from 5PM to 8PM on Monday, 4PM to 9PM on Thursday, 3PM to 9PM on Friday, and 6PM to 8PM on Sunday.

AA flights are delayed more often on Monday and Friday compared to any other days of the week.

There are more flight delays occurring from 6AM to 12PM compared to flight delays from 12PM to 6AM. It makes sense because airlines only schedule late-night flights in a few popular traveling destinations.

For Delta Airlines, flights are often delayed from 3PM to 9PM on Thursday and Friday and 5PM and 8PM on Monday.

 

Compare two airlines:

American Airlines has more flight delays than Delta Airlines.

For both airlines, Monday and Friday are the two days with most flight delays. Saturday is the day with the least flight delays compared to the other days of the week.

 

  1. Compare Flight Delay Frequency by Hours and Weekdays in a different airport

For American and Delta flights, the flight delay situation in different airports varies. Below is an example of the flight delay for American and Delta Airlines at JFK. Feel free to play with the Shiny app if you are curious about American and Delta flight delays at other airports.

 

For JFK airport, American and Delta flights are frequently delayed at 5-8 PM on Friday,  4-6PM and 7-9PM on Thursday, 5-8PM on Wednesday, 7PM on Tuesday, 7PM on Monday, and 8PM on Sunday.

JFK Airport is not busy from 12AM to 6AM for American and Delta Airlines.

 

  1. Airline operations can visualize the peaks of the frequency of delay

 

For American Airline, there are not many flight delays from January to April. This may be due to the fact that people tend to travel less in winter.

Flight delay frequency increases from April to August and peaks on Aug 13. There are a lot of flight delays from May to August. This is possibly due to the fact that people start to travel more when the weather gets nicer, and families may plan more travel when students are off school. The flight delays occur less after students are back to school in September.

However, delays increase around holidays such as Columbus Day in October, Thanksgiving in November, and Christmas in December.

The second peak of flight delays is on Dec 28. This is probably due to people traveling for the New Year.

  1. Use boxplot for visualizing delay hours by month

 

For American Airlines and Delta Airlines, the median of flight delay for all months are similar. It is around 0.5 to 0.8 hours.

For extreme flight delays, a lot of American Airlines flights are delayed over 20 hours in multiple months, and three of them are delayed more than 30 hours. However, only  one Delta flight appears to have been delayed over 20 hours.

 

  1. Use boxplot for visualizing delay hour by weekday

 

In each day of the week, American and Delta Airlines often have flight delays for around .65 hours on average.

  1. Use boxplot for visualizing delay by the hour of the day for each airline

 

 

Interesting finding:

For American Airlines and Delta Airlines, from 12PM and 5AM, the median flight delay hours are 1 to 2.5 hours. It is significantly longer than the median of the average flight delay hours between 5AM and 12PM.

 

Resources:

2018 Flight Data: Data Source: https://www.kaggle.com/yuanyuwendymu/airline-delay-and-cancellation-data-2009-2018

Direct Aircraft Operating Cost per Minute: Information Source: https://www.airlines.org/dataset/per-minute-cost-of-delays-to-u-s-airlines/

 

If you are interested to see the code, please view my Github:

https://github.com/hmo99/Flight_Delay

 

 

 

About Author

Avatar

Huimin Ou

Huimin Ou is NYC Data Science Fellow with a Bachelor's Degree in Industrial Engineering from University of Wisconsin-Madison. Before coming to NYCDSA, Huimin is an industrial engineer with experience in business data analytics, process improvement and project management....
View all posts by Huimin Ou >

Related Articles

Leave a Comment

No comments found.

View Posts by Categories


Our Recent Popular Posts


View Posts by Tags

#python #trainwithnycdsa 2019 airbnb Alex Baransky alumni Alumni Interview Alumni Reviews Alumni Spotlight alumni story Alumnus API Application artist aws beautiful soup Best Bootcamp Best Data Science 2019 Best Data Science Bootcamp Best Data Science Bootcamp 2020 Best Ranked Big Data Book Launch Book-Signing bootcamp Bootcamp Alumni Bootcamp Prep Bundles California Cancer Research capstone Career Career Day citibike clustering Coding Course Demo Course Report D3.js data Data Analyst data science Data Science Academy Data Science Bootcamp Data science jobs Data Science Reviews Data Scientist Data Scientist Jobs data visualization Deep Learning Demo Day Discount dplyr employer networking feature engineering Finance Financial Data Science Flask gbm Get Hired ggplot2 googleVis Hadoop higgs boson Hiring hiring partner events Hiring Partners Industry Experts Instructor Blog Instructor Interview Job Job Placement Jobs Jon Krohn JP Morgan Chase Kaggle Kickstarter lasso regression Lead Data Scienctist Lead Data Scientist leaflet linear regression Logistic Regression machine learning Maps matplotlib Medical Research Meet the team meetup Networking neural network Neural networks New Courses nlp NYC NYC Data Science nyc data science academy NYC Open Data NYCDSA NYCDSA Alumni Online Online Bootcamp Open Data painter pandas Part-time Portfolio Development prediction Prework Programming PwC python python machine learning python scrapy python web scraping python webscraping Python Workshop R R language R Programming R Shiny r studio R Visualization R Workshop R-bloggers random forest Ranking recommendation recommendation system regression Remote remote data science bootcamp Scrapy scrapy visualization seaborn Selenium sentiment analysis Shiny Shiny Dashboard Spark Special Special Summer Sports statistics streaming Student Interview Student Showcase SVM Switchup Tableau team TensorFlow Testimonial tf-idf Top Data Science Bootcamp twitter visualization web scraping Weekend Course What to expect word cloud word2vec XGBoost yelp