Gapminder Data Visualization using GoogleVis and R
Contributed by David Comfort. David took NYC Data Science Academy 12 week full time Data Science Bootcamp program between Sept 23 to Dec 18, 2015. The post was based on his first class project(due at 2th week of the program).
Hans Rosling gave a famous TED talk in 2007, “The Best Stats You’ve Ever Seen”. Rosling is a Professor of International Health at the Karolinska Institutet in Stockholm, Sweden and founded the Gapminder Foundation.
[youtube http://www.youtube.com/watch?v=usdJgEwMinM?rel=0&controls=0&showinfo=0&w=560&h=315]
To visualise his talk, he and his team at Gapminder developed animated bubble charts, also known as motion charts. Gapminder developed the Trendalzyer data visualization software, which was subsequently acquired by Google in 2007.
The Gapminder Foundation is a Swedish NGO which promotes sustainable global development by increased use and understanding of statistics about social, economic and environmental development.
The purpose of my data visualization project was to visualize data about long-term economic, social and health statistics. Specifically, I wanted to extract data sets from Gapminder using an R package, googlesheets, munge these data sets, and combine them into one dataframe, and then use the GoogleVis R package to visualize these data sets using a Google Motion chart.
The finished product can be viewed at this page and a screen capture demonstrating the features of the interactive data visualization is at:
[youtube http://www.youtube.com/watch?v=t_2SopxTb_w?rel=0&controls=0&showinfo=0&w=560&h=315]
World Bank Databank
2) Data sets used for Data Visualization
The following Gapminder datasets, several of which were adapted from the World Bank Databank, were accessed for data visualization:
- Child mortality - The probability that a child born in a specific year will die before reaching the age of five if subject to current age-specific mortality rates. Expressed as a rate per 1,000 live births.
- Democracy score - Overall polity score from the Polity IV dataset, calculated by subtracting an autocracy score from a democracy score. It is a summary measure of a country's democratic and free nature. -10 is the lowest value, 10 the highest.
- Income per person - Gross Domestic Product per capita by Purchasing Power Parities (in international dollars, fixed 2011 prices). The inflation and differences in the cost of living between countries has been taken into account.
- Life expectancy at birth - Life expectancy at birth (years) with projections. The average number of years a newborn child would live if current mortality patterns were to stay the same. Observations after 2010 are based on projections by the UN.
- Population, Total - Population is available in Gapminder World in the indicator “population, total”, which contains observations between 1700 to 2012. It is also available in the indicator “population, with projections”, which also includes projections up to 2100 as well as data for several countries before 1700.
- Country and Dependent Territories Lists with UN Regional Codes - These lists are the result of merging data from two sources, the Wikipedia ISO 3166-1 article for alpha and numeric country codes, and the UN Statistics site for countries' regional, and sub-regional codes.
3) Reading in the Gapminder data sets using Google Sheets R Package
- The googlesheets R package allows one to access and manage Google spreadsheets from within R.
- googlesheets Basic Usage (vignette)
- Reference manual
- The registration functions
gs_title(),gs_key(), andgs_url()return a registered sheet as agooglesheetsobject, which is the first argument to practically every function in this package.
First, install and load googlesheets and dplyr, and access a Gapminder Google Sheet by the URL and get some information about the Google Sheet:
Note: Setting the parameter lookup=FALSE will block authenticated API requests.
A utility function, extract_key_from_url(), helps you get and store the key from a browser URL:
You can access the Google Sheet by key:
Once, one has registered a worksheet, then you can consume the data in a specific worksheet (“Data” in our case) within the Google Sheet using the gs_read() function (combining the statements with dplyr pipe and using check.names=FALSE so it deals with the integer column names correctly and doesn’t append an “x” to each column name):
You can also target specific cells via the range = argument. The simplest usage is to specify an Excel-like cell range, such asrange = “D12:F15” or range = “R1C12:R6C15”.
But a problem arises since check.names=FALSE does not work with this statement (problem with package?). So a workaround would be to pipe the data frame through the dplyr rename function:
However, for purposes, we will ingest the entire worksheet and not target by cells.
Let’s look at the data frame. We need to change the name of the first column from “GDP per capita” to “Country”.
We need to change the name of the first column from “GDP per capita” to “Country”.
Let’s download the rest of the datasets
4) Read in the Countries Data Set
We want to segment the countries in the data sets by region and sub-region. However, the Gapminder data sets do not include these variables. Therefore, one can download the ISO-3166-Countries-with-Regional-Codes data set from github which includes the ISO country code, country name, region, and sub-region.
Use rCurl to read in directly from Github and make sure you read in the “raw” file, rather than Github’s display version.
Note: The Gapminder data sets do not include ISO country codes, so I had to clean the countries data set with the corresponding country names used in the Gapminder data sets.
5) Reshaping the Datasets
We need to reshape the data frames. For the purposes of reshaping our data frames, we can divide the variables into two groups: identifier, or id, variables and measured variables. In our case, id variables include the Country and Years, whereas the measured variables are the GDP per capita, life expectancy, etc..
We can further abstract and “say there are only id variables and a value, where the id variables also identify what measured variable the value represents.”
For example, we could represent a data set, which has two id variables, subject and time:
where each row represents one observation of one variable. This operation is called melting (and can be achieved by using the melt function of the Reshape package).
Compared to the former table, the latter table has a new id variable “variable”, and a new column “value”, which represents the value of that observation. See the paper, Reshaping data with the reshape package, by Hadley Wickham, for more clarification.
We now have the data frame in a form in which there are only id variables and a value.
Let’s reshape the data frames ( child_mortality, democracy_score, life_expectancy, population):
6) Combining the Datasets
Whew, now we can finally all the datasets using a left_join:
7) What is GoogleVis
- The googleVis package provides an interface between R and the Google Chart Tools.
- Reference manual
- Gesmann, Markus, and Diego de Castillo. Using the Google visualisation API with R. The R Journal 3.2 (2011): 40-44.
- Using the Google Chart Tools with R: googleVis-0.5.10 Package Vignette
- googleVis examples
- Markdown example with knitr and googleVis
- google-motion-charts-with-r
An overview of a GoogleVis Motion Chart
8) Implementing GoogleVis
Implementing GoogleVis is fairly easy. The design of the visualization functions is fairly generic.
The name of the visualization function is gvis + ChartType. So for the Motion Chart we have:
9) Parameters for GoogleVis
- data: a data.frame
- idvar: the id variable , “Country” in our case.
- timevar: the time variable for the plot, “Years” in our case.
- xvar: column name of a numerical vector in data to be plotted on the x-axis.
- yvar: column name of a numerical vector in data to be plotted on the y-axis.
- colorvar: column name of data that identifies bubbles in the same series. We will use “Region” in our case.
- sizevar - values in this column are mapped to actual pixel values using the sizeAxis option. We will use this for “Population”.
The output of a googleVis function (gvisMotionChart in our case) is a list of lists (a nested list) containing information about the chart type, chart id, and the html code in a sub-list split into header, chart, caption and footer.
10) Data Visualization
Let’s plot the GoogleVis Motion Chart.
Gapminder Data Visualization using GoogleVis
Note: I had an issue with embedding the GoogleVis motion plot in a WordPress blog post, so I will subsequently feature the GoogleVis interactive motion plot on a separate page at http://adatascience.com/Gapminder_Data_Visualization.html
Here is a screen recording of the data visualization produced by GoogleVis of the Gapminder datasets:
[youtube http://www.youtube.com/watch?v=t_2SopxTb_w?rel=0&controls=0&showinfo=0&w=560&h=315]
11) What are the Key Lessons of the Gapminder Data Visualization Project?
- Hans Rosling and Gapminder have made a big impact on data visualization and how data visualization can inform the public about wide misperceptions.
- The
googlesheetsR package allows for easy extraction of data sets which are stored in Google Sheets. - The different steps involved in reshaping and joining multiple data sets can be a little cumbersome. We could have used dplyr pipes more.
- It would be a good practice for Gapminder to include the ISO country code in each of their data sets.
- There is a need for a data set which lists country names, their ISO codes, as well as other categorical information such as Geographic Regions, Income groups, Landlocked, G77, OECD, etc.
- It is relatively easy to implement a GoogleVis motion chart using R. However, it is difficult to change the configuration options. For instance, I was unable to make a simple change to the chart by adding a chart title.
- Google Motion Charts provide a great way to visualize several variables at once and be a great teaching tool for all sorts of data.
- For instance, one can visualize the Great Divergence between the Western world and China, India or Japan, whereby the West had much faster economic growth, with attendant increases in life expectancy and other health indicators.
About Author
