Data Analyzing the Port Wine Using Python Scraping

Posted on Dec 18, 2019
The skills I demoed here can be learned through taking Data Science with Machine Learning bootcamp with NYC Data Science Academy.

Author: Bee Kim

Introduction

My interest in port wine began a few years ago when I visited a Long Island winery and had my first taste of very sweet red wine. Back then, I didn't know much about wines and thought all red wines are bitter, so I was pleasantly surprised to discover this sweet taste. I decided to buy that wine and saved it as a treat for my upcoming birthday. This was my introduction to port wine and it has since become one of my favorite wines. For the web scraping project, I used WineEnthusiast Magazine website to compare different port wines. 

Data

I used Python framework scrapy to scrape the Wine Enthusiast Magazine website that produced two different csv files: an 8.5 MB file with the entire wine dataset and a 1 MB file limited to the port wine dataset. They both included the following information: wine name, wine price, wine category, wine variety, wine origin country, wine origin region, points given by W.E. Magazine and description given to each wine by W.E. Magazine. The image below shows the original website and what kind of information is provided.

Analysis from entire wine dataset

First, I wanted to see what defines port wine and how it is different from other types of wines. In order to do that, I used the entire wine dataset. There are three features of wine that I used to compare different types of wines: average wine scores given by Wine Enthusiast Magazine, median price, and median alcohol content (%) in wine. The graphs below show the results.

From these graphs, it is evident that port wines tend to have higher prices, higher alcohol content and higher scores from W.E. Magazine. This original EDA from the scraped data for all wines shows that port wine seems to be very distinct and highly valued in the wine industry. At this point, I decided to take a more in-depth look at port wines.

Analysis from Port Wine Dataset

After the decision to focus on the port wine, I scraped the website again to obtain only the port wines information. From that, I eliminated the wine regions where fewer than 50 port wines are produced to focus my analysis only on the regions that produce a large number of port wines. As a result, there were 2216 port wines in total, out of which 1322 are from Portugal, 648 from the U.S. and the remaining 246 from Spain. By regions, Port and Douro from Portugal, California in the U.S. and Andalucia in Spain produce the most port wines.

While I was researching the different port wine production regions, the huge differences in production number made me curious to find any other differences between two Portugal regions: Port and Douro. 

I found that the price of port wines produced in two different regions were very comparable, and the points awarded by W.E. Magazines for port wines in two different regions were quite alike as shown in the graphs below. Geographically, these two regions are very close, so the question is: what accounts for the significant differences between them?

Another interesting thing I noticed while looking into the wines production distribution in different regions was that in Portugal and U.S. there are sub categories of 'port wine' inside the 'port/sherry' category of wine, in contrast to Spain, where 'port wine' does not appear under the 'port/sherry' category of wine, as shown below. 

Douro, Portugal  port/sherry wine       

Port, Portugal  port/sherry wine           

Andalucia, Spain port/sherry wine       

California, U.S port/sherry wine             

Result

As a result of my research on this, I found that under European Union Protected Designation of Origin guidelines, only products of Portugal may be labelled as "port" or "Porto". In the United States, wines labelled "port" may come from anywhere in the world, while the names "Oporto". "Porto" and "Vinho do Porto" have been recognized as foreign, non-generic names for port wines originating in Portugal. 

From above, it seems like port wines from Portugal, the original bithplace of that variety, remain very well-received. They are distinguished by their higher alcohol content and higher prices when compared to port wines from the U.S. and Spain, as shown in the graphs below.

Given that port wines are distinguished by higher prices and higher alcohol content than other wines, should we conclude that the higher alcohol content is what makes it expensive? According to the scatter plot below, that is not the case. Port wines usually contain about 20% alcohol content, and higher prices were all concentrated at 20%.

How about the ages of the port wine? Would that be a factor in the price? The scraped information didn’t include the produced year information; however I created another column using the year that was included in the name of some of the wines. Age does seem to elevate price when you look at the port wines from Portugal, though not necessarily for the ones from Spain and the United States. Below is the scatter plot of port wines produced in different years color coded by different countries. Portugal, which is represented by blue shows higher prices for the older wines. On the other hand, red and green colors that represent Spain and the United States do not.

Last step

Lastly, I created a word cloud using descriptions from both the entire wine dataset and the port wine scraped data. I felt the need to compare the word cloud of port wines to those of all wines for a proper comparison. In contrast to general wine descriptions, port wine descriptions had more words like ‘sweet,’ ‘port,’ ‘acidity,’ ‘sweetness’ and ‘chocolate’ which illustrate the sweet characteristics of port wine well.

Entire Wine

Port Wine     

Conclusion

From data analysis, it was clear that port wines are very distinct from other types of wines. Port wines usually refer the port/sherry wines from Portugal in the Douro and Porto regions that have alcohol content of about 20% and higher prices than their Spanish and American counterparts. However, the port wines from Douro seem to have a similar rating given by W.E.Magazines paired with a lower price compared to the ones from Porto. So if you want to taste sweet port wine but don't want to shell out too much for a bottle, you may consider the ones from Douro. I hope you enjoy your port wine!

About Author

Bee Kim

Bee holds a masters degree in Information Systems with concentration in data analysis and is very passionate about storytelling through data. She is skilled in communication and critical thinking, with 5+ years of experience in analyzing and processing...
View all posts by Bee Kim >

Related Articles

Leave a Comment

No comments found.

View Posts by Categories


Our Recent Popular Posts


View Posts by Tags

#python #trainwithnycdsa 2019 2020 Revenue 3-points agriculture air quality airbnb airline alcohol Alex Baransky algorithm alumni Alumni Interview Alumni Reviews Alumni Spotlight alumni story Alumnus ames dataset ames housing dataset apartment rent API Application artist aws bank loans beautiful soup Best Bootcamp Best Data Science 2019 Best Data Science Bootcamp Best Data Science Bootcamp 2020 Best Ranked Big Data Book Launch Book-Signing bootcamp Bootcamp Alumni Bootcamp Prep boston safety Bundles cake recipe California Cancer Research capstone car price Career Career Day citibike classic cars classpass clustering Coding Course Demo Course Report covid 19 credit credit card crime frequency crops D3.js data data analysis Data Analyst data analytics data for tripadvisor reviews data science Data Science Academy Data Science Bootcamp Data science jobs Data Science Reviews Data Scientist Data Scientist Jobs data visualization database Deep Learning Demo Day Discount disney dplyr drug data e-commerce economy employee employee burnout employer networking environment feature engineering Finance Financial Data Science fitness studio Flask flight delay gbm Get Hired ggplot2 googleVis H20 Hadoop hallmark holiday movie happiness healthcare frauds higgs boson Hiring hiring partner events Hiring Partners hotels housing housing data housing predictions housing price hy-vee Income Industry Experts Injuries Instructor Blog Instructor Interview insurance italki Job Job Placement Jobs Jon Krohn JP Morgan Chase Kaggle Kickstarter las vegas airport lasso regression Lead Data Scienctist Lead Data Scientist leaflet league linear regression Logistic Regression machine learning Maps market matplotlib Medical Research Meet the team meetup methal health miami beach movie music Napoli NBA netflix Networking neural network Neural networks New Courses NHL nlp NYC NYC Data Science nyc data science academy NYC Open Data nyc property NYCDSA NYCDSA Alumni Online Online Bootcamp Online Training Open Data painter pandas Part-time performance phoenix pollutants Portfolio Development precision measurement prediction Prework Programming public safety PwC python Python Data Analysis python machine learning python scrapy python web scraping python webscraping Python Workshop R R Data Analysis R language R Programming R Shiny r studio R Visualization R Workshop R-bloggers random forest Ranking recommendation recommendation system regression Remote remote data science bootcamp Scrapy scrapy visualization seaborn seafood type Selenium sentiment analysis sentiment classification Shiny Shiny Dashboard Spark Special Special Summer Sports statistics streaming Student Interview Student Showcase SVM Switchup Tableau teachers team team performance TensorFlow Testimonial tf-idf Top Data Science Bootcamp Top manufacturing companies Transfers tweets twitter videos visualization wallstreet wallstreetbets web scraping Weekend Course What to expect whiskey whiskeyadvocate wildfire word cloud word2vec XGBoost yelp youtube trending ZORI