Data Study on Taiwan Voting

Posted on Oct 20, 2018
The skills the author demoed here can be learned through taking Data Science with Machine Learning bootcamp with NYC Data Science Academy.

Exploratory Visualization and Shiny Project - You will build an interactive Shiny application that can create visual representations of data insights and trends.

Visit my project here: https://taipeifx.shinyapps.io/twvoteprojectshinyr/

INTRO:

This was the first project I did at the NYC Data Science Academy (Fall Cohort 2018). I browsed my way to https://data.gov.tw/ where they store a large variety of publicly shared data. I wanted to select a data set suitable for charting and mapping purposes; I also preferred to work with data which I had to translate from Mandarin Chinese into English, that is, data that might be less accessible to people who are not fluent in Chinese.

It was here that I found my project: transforming the raw voting data of Taiwan presidential elections into something visually appealing and informational as to present numerical data in a more engaging way. The votedata.zip file that I used is available at http://data.cec.gov.tw/ιΈθˆ‰θ³‡ζ–™εΊ«/votedata.zip

BACKGROUND:

The two main political parties in Taiwan are the Democratic Progressive Party (DPP) and the KuoMinTang (KMT). They have each won 3 elections in Taiwan's young democratic history. There have only been a total of six presidential elections that have taken place in Taiwan since 1996, and just like the United States, elections are held every four years with two-term limits. For each of these six election years there were five .csv files named elbase, elcand, elctks, elpaty, and elprof.csv. Each of these files contained specific information regarding each election, from district codes and candidate information to ballot totals and voting statistics.

Data Study on Taiwan Voting

raw data from the votedata.zip file

The files came without column names and were only decipherable by finding the key from GitHub user MISNUK at https://github.com/MISNUK/CECDataSet/blob/master/RawData_Format.md

Data Study on Taiwan Voting

data with added column names in Chinese

I used mySQL in order to create table templates to load the raw data into, then I used R to clean and combine the data. Tidyr's unite() and spread() functions came in handy here to combine the candidate names with their political parties as a column header (element), and then to have the received votes as the value (value).

Data Study on Taiwan Voting

unite() and spread() + English translations

six years, six charts

After creating final version charts for each of the six years that constituted the data which I was going to use for my project, I then proceeded to turn this data into charts, maps, and statistical information.

CHARTS:

Once the data was coherently sorted in tables, the actual charting of the data became pretty straightforward. My only decision here was which categorical selections to allow for visitors of my project. I decided on two different versions of the same chart, one allowed users to select different districts in Taiwan to compare them on a single election year (different districts for a certain year).Β  And a second chart compared a single district over time, which allowed users to select multiple years to compare a single given area to itself.

comparing multiple districts in 2016, the category selected is the percent of eligible voters that actually voted (PercAV)

comparing Taipei City's vote count over 20 years

In the project, the charts that I used were gvisBarChart(), gvisColumnChart(), and gvisComboChart(). The candidate information section below the charts is loaded as a table and populates depending on which years are selected. The gvisComboChart() I used in the "Select Years" chart to add a mean average line on certain categories where such a line would allow more meaning to be construed from the chart.

gvisComboChart() showing an average of 75.998% of eligible voters that actually voted (PercAV) throughout the 6 elections

The question that calls out to me when I look at this chart is: are any of these results statistically significant in any way, and if so, how can I use R to compute these statistical differences?

STATS and DATA:

I added a stats section where I performed t-tests, correlation plots, box plots, and a Chi-Squared Residuals plot.

From the t-test I used the 6 national vote averages to compute that the mean vote was 41.97% for the DPP vote across 6 elections, with a standard deviation of 11.93. The mean was higher at 44.33% for the KMT vote across 6 elections, standard deviation of 14.10.

There was one year in 2004 where the DPP and KMT each held 50.11% and 49.890% of the vote, respectively. I wanted to see if the true difference in these two means was equal to 0 (Null Hypothesis H0). To test this I used a Two Sample T-Test and tested the average vote of the 25 total voting regions (n=25) for each of the two parties.

##  Welch Two Sample t-test
## 
## data:  loc[loc$Year == "2004" & loc$Party == "KMT", ][6][[1]] and loc[loc$Year == "2004" & loc$Party == "DPP", ][6][[1]]
## t = -1.8157, df = 48, p-value = 0.07566
## alternative hypothesis: true difference in means is not equal to 0
## 95 percent confidence interval:
##  -15.894179   0.809539
## sample estimates:
## mean of x mean of y 
##  44.89052  52.43284

The p-value came back as 0.07566, which was not significant enough for us to reject the null hypothesis that the true difference between these two means was zero.

I'd like to finish the stats section by showing these two boxplots for the KMT and DPP political parties.

boxplot for KMT votes over 6 elections

boxplot for DPP votes over 6 elections

I think that two districts that stand out in these charts are Jinmen County and Lianjiang County. So I would like to show you these regions on the Maps that I created.

MAPS:

Compared to Taiwan being off the south west coast of China, Kinmen (Jinmen) and Lienkiang (Lianjiang) Counties are right on the coast of China, so their voting differences can likely be explained geographically as well as demographically by their small population.

choropleth map of Taiwan created with Shiny Leaflet

I used leaflet (renderLeaflet() ) to create a choropleth map of Taiwan. I know that some of you audience members out there might not know the exact location where Taiwan sits on the Pacific Ocean so I blew it up for you in the maps. Also, I especially like my large mini map.

OUTRO:

Overall it was a very fun project which I enjoyed working on and I hope you have time to look at it. There were some troubles using Chinese characters in my project as certain characters would kill the entire graph or render the code unreadable when uploaded to Shinyapps.io. Also, I'm guessing that throughout different administrations the vote data was compiled by different people or departments which led to there being discrepancies in data (a few values were just outright wrong).

I tried to make everything as interactive as possible while maintaining a certain level of visual appeal. I hope that this project was informative and educational. Thanks!

The actual project can be visited at https://taipeifx.shinyapps.io/twvoteprojectshinyr/

For actual code, all my work is stored at my GitHub https://github.com/taipeifx/vote_data_TW

About Author

Daniel Chen

Daniel Chen is the founder of multiple startups including foreign exchange brokerages. Managed cross-border development with international companies from Europe and Asia. Has even more experience now with data science and coding. Born in 1987's Los Angeles, California...
View all posts by Daniel Chen >

Leave a Comment

No comments found.

View Posts by Categories


Our Recent Popular Posts


View Posts by Tags

#python #trainwithnycdsa 2019 2020 Revenue 3-points agriculture air quality airbnb airline alcohol Alex Baransky algorithm alumni Alumni Interview Alumni Reviews Alumni Spotlight alumni story Alumnus ames dataset ames housing dataset apartment rent API Application artist aws bank loans beautiful soup Best Bootcamp Best Data Science 2019 Best Data Science Bootcamp Best Data Science Bootcamp 2020 Best Ranked Big Data Book Launch Book-Signing bootcamp Bootcamp Alumni Bootcamp Prep boston safety Bundles cake recipe California Cancer Research capstone car price Career Career Day citibike classic cars classpass clustering Coding Course Demo Course Report covid 19 credit credit card crime frequency crops D3.js data data analysis Data Analyst data analytics data for tripadvisor reviews data science Data Science Academy Data Science Bootcamp Data science jobs Data Science Reviews Data Scientist Data Scientist Jobs data visualization database Deep Learning Demo Day Discount disney dplyr drug data e-commerce economy employee employee burnout employer networking environment feature engineering Finance Financial Data Science fitness studio Flask flight delay gbm Get Hired ggplot2 googleVis H20 Hadoop hallmark holiday movie happiness healthcare frauds higgs boson Hiring hiring partner events Hiring Partners hotels housing housing data housing predictions housing price hy-vee Income Industry Experts Injuries Instructor Blog Instructor Interview insurance italki Job Job Placement Jobs Jon Krohn JP Morgan Chase Kaggle Kickstarter las vegas airport lasso regression Lead Data Scienctist Lead Data Scientist leaflet league linear regression Logistic Regression machine learning Maps market matplotlib Medical Research Meet the team meetup methal health miami beach movie music Napoli NBA netflix Networking neural network Neural networks New Courses NHL nlp NYC NYC Data Science nyc data science academy NYC Open Data nyc property NYCDSA NYCDSA Alumni Online Online Bootcamp Online Training Open Data painter pandas Part-time performance phoenix pollutants Portfolio Development precision measurement prediction Prework Programming public safety PwC python Python Data Analysis python machine learning python scrapy python web scraping python webscraping Python Workshop R R Data Analysis R language R Programming R Shiny r studio R Visualization R Workshop R-bloggers random forest Ranking recommendation recommendation system regression Remote remote data science bootcamp Scrapy scrapy visualization seaborn seafood type Selenium sentiment analysis sentiment classification Shiny Shiny Dashboard Spark Special Special Summer Sports statistics streaming Student Interview Student Showcase SVM Switchup Tableau teachers team team performance TensorFlow Testimonial tf-idf Top Data Science Bootcamp Top manufacturing companies Transfers tweets twitter videos visualization wallstreet wallstreetbets web scraping Weekend Course What to expect whiskey whiskeyadvocate wildfire word cloud word2vec XGBoost yelp youtube trending ZORI