Studying Data to Predict your next travel destination

and
Posted on Apr 2, 2017
The skills the author demoed here can be learned through taking Data Science with Machine Learning bootcamp with NYC Data Science Academy.

Introduction

We were interested in usingΒ customers' information to predict their purchasing behaviors on retail market and insurance industry. Β As we know the data for customers are confidential so it is hard to obtain suchΒ data. Β For the capstone project, we decidedΒ to use Airbnb dataset from kaggle to predict where will a new guest be booking their first travel destination based on the user booking behaviors and demographic information. Β We performed data cleaning, data process, exploratory data analysis, and machine learning on the project.

Exploratory Data Analysis

Let's look at the gender distribution to see if there is any relationship with the target (destination).

Studying Data to Predict your next travel destination

There is no difference between male and female for the booking rate. Β NDF (No Destination Found) have the highest rate. Β US has the highest booking rateΒ among all other known countries, from this we conclude people make booking for national trips more than international trips. Β The plot also showed the dataset is imbalanced clearly.

Next, we look at the age distribution.

Studying Data to Predict your next travel destination

The age is left skew. Β People made their first booking in the late 20s and early 30s more comparing with other age range.

We also look into their booking behaviors to see if there is any pattern.

Studying Data to Predict your next travel destination

People use website directly to book more than the other two social media platforms. Facebook brings in higher traffic than google overall. Its because of the ads in Facebook which drives a lot of traffic to Airbnb.

Studying Data to Predict your next travel destination

People who use web are more serious in making their booking than those who use other apps. Β Similarly, those people who use desktopΒ are more likely to book.

Studying Data to Predict your next travel destination

The top 10 first browser plot shows chrome as the number one browser used to book and which is true from our experience. Β Safari and Firefox are following it.

Let'sΒ look at the time frameΒ for the customers on makingΒ their first booking:

time

There were peaks in September for the years of 2010 and 2011. Β People made their first booking more on August for the years of 2012 and 2013. The booking for 2014 and 2015 are not quite normal. Β Starting from Jun 2014, bookings were dropped Β dramatically. Β In 2015, the bookings decreased at a constant rate. So this might be due to missing data during that period.

Feature Importance

We use extratrees classifier to do the feature importance. Β Extra-trees differ from classic decision trees in the way they are built. When looking for the best split to separate the samples of a node into two groups, random splits are drawn for each of theΒ max_featuresΒ randomly selected features and the best split among those is chosen. WhenΒ max_featuresΒ is set 1, this amounts to building a totally random decision tree.

Feature

The booking time elements play an important role in the prediction. Β Age is also another important factor for the prediction.

Data CleaningΒ 

Few of the columns in the dates had invalid value. We cleaned out the data to NaN. Age column had some noise so we chose to keep ageΒ range from 18-99 and transform the other values to NaN. For the sessions dataset we grouped the dataset by user and aggregated the seconds elapsed by action, action type, action detail and device type. Then the values were transposed to columns and finally merged to the User dataset.

Upsample and Downsample

Since the data was imbalanced we tried to upsample and downsample with SMOT but didn't yield good results so we decided to take the probabilities for each of the class and just use the top 5 class to make our predictions. Some algorithm allowed to input the weight parameter for each of the class as well.

Model Selection

We decided to go with tree based models since logistic regression doesn't work well if you don't have linearly separable boundaries. So we decide to use Random Forest, Ada Boost, Gradient Boosting & XGBoost. For all the model we did cross validation by splitting the train/test as 80/20 split. We did Grid Search to choose the optimized parameter.

With Random Forest we achieved an accuracy of 0.81870

Through AdaBoost we achieved an accuracy of 0.8439

With Gradient Boosting we achieved an accuracy of 0.8321

Finally using XGBoost we achieved an accuracy of 0.85359

ConclusionΒ 

From all the models we tested tree based models gave us the best accuracy.

About Authors

Yaxiong Huang

Tommy Huang received his Master of Arts in Statistics at Hunter College and Bachelor of Science in Mathematics and Economics at College of Staten Island. He has 7 years of experience in catastrophic modeling research for the insurance...
View all posts by Yaxiong Huang >

Amit Sahoo

Amit has 12 years of experience working with data, designing and implementing mission critical enterprise data solution for Retail, Healthcare, Finance and Pharmaceutical. Most recent experience involves implementing end to end data solution for Oakley from ground up....
View all posts by Amit Sahoo >

Related Articles

Leave a Comment

No comments found.

View Posts by Categories


Our Recent Popular Posts


View Posts by Tags

#python #trainwithnycdsa 2019 2020 Revenue 3-points agriculture air quality airbnb airline alcohol Alex Baransky algorithm alumni Alumni Interview Alumni Reviews Alumni Spotlight alumni story Alumnus ames dataset ames housing dataset apartment rent API Application artist aws bank loans beautiful soup Best Bootcamp Best Data Science 2019 Best Data Science Bootcamp Best Data Science Bootcamp 2020 Best Ranked Big Data Book Launch Book-Signing bootcamp Bootcamp Alumni Bootcamp Prep boston safety Bundles cake recipe California Cancer Research capstone car price Career Career Day citibike classic cars classpass clustering Coding Course Demo Course Report covid 19 credit credit card crime frequency crops D3.js data data analysis Data Analyst data analytics data for tripadvisor reviews data science Data Science Academy Data Science Bootcamp Data science jobs Data Science Reviews Data Scientist Data Scientist Jobs data visualization database Deep Learning Demo Day Discount disney dplyr drug data e-commerce economy employee employee burnout employer networking environment feature engineering Finance Financial Data Science fitness studio Flask flight delay gbm Get Hired ggplot2 googleVis H20 Hadoop hallmark holiday movie happiness healthcare frauds higgs boson Hiring hiring partner events Hiring Partners hotels housing housing data housing predictions housing price hy-vee Income Industry Experts Injuries Instructor Blog Instructor Interview insurance italki Job Job Placement Jobs Jon Krohn JP Morgan Chase Kaggle Kickstarter las vegas airport lasso regression Lead Data Scienctist Lead Data Scientist leaflet league linear regression Logistic Regression machine learning Maps market matplotlib Medical Research Meet the team meetup methal health miami beach movie music Napoli NBA netflix Networking neural network Neural networks New Courses NHL nlp NYC NYC Data Science nyc data science academy NYC Open Data nyc property NYCDSA NYCDSA Alumni Online Online Bootcamp Online Training Open Data painter pandas Part-time performance phoenix pollutants Portfolio Development precision measurement prediction Prework Programming public safety PwC python Python Data Analysis python machine learning python scrapy python web scraping python webscraping Python Workshop R R Data Analysis R language R Programming R Shiny r studio R Visualization R Workshop R-bloggers random forest Ranking recommendation recommendation system regression Remote remote data science bootcamp Scrapy scrapy visualization seaborn seafood type Selenium sentiment analysis sentiment classification Shiny Shiny Dashboard Spark Special Special Summer Sports statistics streaming Student Interview Student Showcase SVM Switchup Tableau teachers team team performance TensorFlow Testimonial tf-idf Top Data Science Bootcamp Top manufacturing companies Transfers tweets twitter videos visualization wallstreet wallstreetbets web scraping Weekend Course What to expect whiskey whiskeyadvocate wildfire word cloud word2vec XGBoost yelp youtube trending ZORI