Federal Home Loan Bank Data

Posted on Nov 23, 2015

Contributed by Joe Eckert. Joe took NYC Data Science Academy 12 week full time Data Science Bootcampย program between Sept 23 to Dec 18, 2015.ย The post was based on his secondย class project(due at 4thย week of the program).

Introduction:

The goal of project two with the NYC Data Science Academy was to build an application using Shiny to visualize a dataset. I chose to use the Federal Home Loan Bank's loan level mortgage data.

The purpose of this app is to examine the distribution of mortgages that make up the FHLB portfolio in order to analyze the system's effectiveness. The Federal Home Loan Bank system is made up of 11 U.S. government-sponsored banks that provide stable, on-demand, low-cost funding to American financial institutions. This funding is used for home mortgage, small business, rural, agricultural, and economic development lending. With their members, the FHLBanks represents the largest collective source of home mortgage and community credit in the United States.

Click here to view a demo of the shiny app!

Overview of Application:

After working with R during the first couple of weeks in the bootcamp it was time to make my first web application with Shiny. My first task was to gain an understanding of the structure of a basic shiny app. R Studio's Shiny documentation proved to be a great resource in my learning process: Shiny Tutorial

A shiny app has two basic requirements, a ui.R and server.R file. The ui.R file controls the user interface as well as all design aspects of the application, whereas the server.R file handles the data processing and back end of the application. I also chose to use a global.R file to prepare the raw data sourced from the FHLB to be used for the application.

Data Preparation

I began the development process with 6 raw data files from the FHLB which each contained loan level data for each year from 2009 to 2014 (Source Data).

Below you can see the code that was used to clean and organize the data into a set of dataframes to be used by the server file.


#Load required libraries
library(dplyr)
library(choroplethr)
library(choroplethrMaps)
library(stringr)
library(ggplot2)
library(ggthemes)
library(scales)
library(maps)
library(mapproj)
library(plotly)

#Import data from Federal Home Loan Banks
fhlb09 fhlb10 fhlb11 fhlb12 fhlb13 fhlb14

#Import FIPS data
#https://www.census.gov/geo/reference/codes/cou.html
fips

#Create vector for state abbreviations and state names
states state=c("AK", "AL", "AR", "AZ", "CA", "CO", "CT", "DC", "DE", "FL", "GA",
"HI", "IA", "ID", "IL", "IN", "KS", "KY", "LA", "MA", "MD", "ME",
"MI", "MN", "MO", "MS", "MT", "NC", "ND", "NE", "NH", "NJ", "NM",
"NV", "NY", "OH", "OK", "OR", "PA", "PR", "RI", "SC", "SD", "TN",
"TX", "UT", "VA", "VT", "WA", "WI", "WV", "WY"),
full=c("alaska","alabama","arkansas","arizona","california","colorado",
"connecticut","district of columbia","delaware","florida","georgia",
"hawaii","iowa","idaho","illinois","indiana","kansas","kentucky",
"louisiana","massachusetts","maryland","maine","michigan","minnesota",
"missouri","mississippi","montana","north carolina","north dakota",
"nebraska","new hampshire","new jersey","new mexico","nevada",
"new york","ohio","oklahoma","oregon","pennsylvania","puerto rico",
"rhode island","south carolina","south dakota","tennessee","texas",
"utah","virginia","vermont","washington","wisconsin",
"west virginia","wyoming")
)

#Correct column names to allow for rbind()
names(fhlb09)[2] <- "Loan.Number"
fhlb09$FHLBankID names(fhlb14)[65] <- "Co.Borrower.Credit.Score"

#Bind yearly data sets into a single data frame
fhlb

#Join state and county data from FIPS to FHLB data
fhlb

#Create region code
fhlb$region

fhlb$STATE states$state

#Join full state name from manual states vector
fhlb

#Some minor cleanup
names(fhlb)[names(fhlb) == 'full'] <- "STATENAME"
fhlb$STATENAME fhlb$Seller fhlb$Amount

#Prepare Interest for Weighted Interest
fhlb$annInt

#Select relevant variables for analysis
portfolio

#Factorize Variables
portfolio$Purpose portfolio$Purpose

portfolio$First portfolio$First

portfolio$BoRace portfolio$BoRace labels = c("NativeAmerican", "Asian", "AfricanAmerican", "PacificIslander", "White", "NotSpecified"))

portfolio$BoGender portfolio$BoGender labels = c("Male", "Female", "NotSpecified"))

portfolio$Borrower.Credit.Score portfolio$Borrower.Credit.Score levels = c(1, 2, 3, 4, 5, 9),
labels = c("< 620", "620 - 660", "660 - 700", "700 - 760", "> 760", "NotSpecified"))

portfolio$BoAge[portfolio$BoAge == 99]

#Prepare data frame for map
mortByState mortByState mortByState mortByState names(mortByState) mortByState$WgtRate mortByState$TotalInt

mortByState$hover State, '
', "Total Mortgage Value: $",
prettyNum(TotalMortgage, big.mark = ","),
'
', "Weighted Avg Rate: ",
formatC(WgtRate * 100, digits = 4), "%"))

#Calculate total mortgage portfolio by county - used for state map
countySum

#Save data frame as Rda file for future loading
save(fhlb, fips, states, portfolio, mortByState, countySum, file = "data/data.Rds")

#Clear working memory
rm(list = ls())

load("data/data.Rds")

Creating the User Interface:
The next step was to create the user interface. The app contains four main sections, which allow the user to explore various aspects of the data.

The first section uses the plotly package to display a state level heat map. There is a drop down that allows the user to select which metric to map; either the total mortgage value or weighted average interest rate. One interesting observation is that roughly 17% of the entire mortgage portfolio is made up of mortgages originated in Ohio.

The second section allows the user to graph a variety of variables against the total mortgage value in the portfolio (year, age, credit score, gender, race, etc.)

The third section deals with state level information. The user is able to select a state. I then used the choroplethr mapping package to map the total value of mortgages by county in each state. There are also data tables below that show the amount of mortgages originated based on gender, race and credit score.

The final section shows the loan level data, allowing the user to filter and search within the data set.

The Backend:
After creating all the inputs required for the user to make their selections in the ui.R file I then moved onto the server.R file. Here is where I used the inputs collected from the user interface to generate output objects (maps, graphs and tables) to be returned to the user.

Conclusion:

Shiny is a great package that allows for some pretty interesting applications. This being my first Shiny app could definitely be developed further. If time had permitted, it would have been great to add additional functionality to allow the user to cut the data in more granular ways. In addition, it would be interesting to combine the FHLB data with other data sets related to lending to compare the effectiveness of the FHLB compared to the private market. The issue here is that private market loan level origination data is proprietary and hard to collect.

You can view the full code for my application on my GitHub.

About Author

Joe Eckert

Joe is currently studying with the NYC Data Science Academy to pursue his passion for big data. Joe previously worked for 3 years at JPMorgan's Corporate Bank. He graduated in 2012 with a BA in Financial Economics from...
View all posts by Joe Eckert >

Leave a Comment

Vickie Figueroa March 19, 2017
I was just looking at your Federal Home Loan Bank Data - NYC Data Science Academy BlogNYC Data Science Academy Blog website and see that your site has the potential to get a lot of visitors. I just want to tell you, In case you didn't already know... There is a website network which already has more than 16 million users, and most of the users are interested in websites like yours. By getting your site on this network you have a chance to get your site more visitors than you can imagine. It is free to sign up and you can read more about it here: http://smpl.city/events/7Yypu - Now, let me ask you... Do you need your site to be successful to maintain your way of life? Do you need targeted traffic who are interested in the services and products you offer? Are looking for exposure, to increase sales, and to quickly develop awareness for your site? If your answer is YES, you can achieve these things only if you get your website on the service I am talking about. This traffic network advertises you to thousands, while also giving you a chance to test the network before paying anything at all. All the popular sites are using this network to boost their traffic and ad revenue! Why arenโ€™t you? And what is better than traffic? Itโ€™s recurring traffic! That's how running a successful site works... Here's to your success! Find out more here: http://link.virtualrick.com/8u
GitaUErtel December 31, 2016
Great blog here! Also your website rather a good deal up fast! What hosting company are you the usage of? Can I have your affiliate link to the host? I wish my internet site loaded as fast as yours lol
MaiYNusser December 18, 2016
You need to be a part of a contest for starters of the very most useful sites on the internet. I'm going to recommend this website!
NoraMBagwill November 19, 2016
you're really a good webmaster. The website loading pace is incredible. It seems that you're doing any unique trick. In addition, The contents are masterwork. you have done a fantastic task in this topic!
DaronPMins July 12, 2016
Hello There. I stumbled upon your website using msn. This is an extremely well written article. I will make certain to bookmark it and revisit to read through more of your useful information. Many thanks for the post. I am going to definitely return.
jack February 11, 2016
Hi, I read your blogs regularly. Your story-telling style is awesome, keep it up!
Jason February 10, 2016
One example is, if your gross sales are going up and receivable degrees went down you will be generating that will positive managing cash flow we spoke connected with Practically it is actually beneficial in the shape of there is no need to go in any data or information when making a new payment or maybe purchase, and there is no commission to get voucher repair for primary 12 months after purchasing it.

View Posts by Categories


Our Recent Popular Posts


View Posts by Tags

#python #trainwithnycdsa 2019 2020 Revenue 3-points agriculture air quality airbnb airline alcohol Alex Baransky algorithm alumni Alumni Interview Alumni Reviews Alumni Spotlight alumni story Alumnus ames dataset ames housing dataset apartment rent API Application artist aws bank loans beautiful soup Best Bootcamp Best Data Science 2019 Best Data Science Bootcamp Best Data Science Bootcamp 2020 Best Ranked Big Data Book Launch Book-Signing bootcamp Bootcamp Alumni Bootcamp Prep boston safety Bundles cake recipe California Cancer Research capstone car price Career Career Day citibike classic cars classpass clustering Coding Course Demo Course Report covid 19 credit credit card crime frequency crops D3.js data data analysis Data Analyst data analytics data for tripadvisor reviews data science Data Science Academy Data Science Bootcamp Data science jobs Data Science Reviews Data Scientist Data Scientist Jobs data visualization database Deep Learning Demo Day Discount disney dplyr drug data e-commerce economy employee employee burnout employer networking environment feature engineering Finance Financial Data Science fitness studio Flask flight delay gbm Get Hired ggplot2 googleVis H20 Hadoop hallmark holiday movie happiness healthcare frauds higgs boson Hiring hiring partner events Hiring Partners hotels housing housing data housing predictions housing price hy-vee Income Industry Experts Injuries Instructor Blog Instructor Interview insurance italki Job Job Placement Jobs Jon Krohn JP Morgan Chase Kaggle Kickstarter las vegas airport lasso regression Lead Data Scienctist Lead Data Scientist leaflet league linear regression Logistic Regression machine learning Maps market matplotlib Medical Research Meet the team meetup methal health miami beach movie music Napoli NBA netflix Networking neural network Neural networks New Courses NHL nlp NYC NYC Data Science nyc data science academy NYC Open Data nyc property NYCDSA NYCDSA Alumni Online Online Bootcamp Online Training Open Data painter pandas Part-time performance phoenix pollutants Portfolio Development precision measurement prediction Prework Programming public safety PwC python Python Data Analysis python machine learning python scrapy python web scraping python webscraping Python Workshop R R Data Analysis R language R Programming R Shiny r studio R Visualization R Workshop R-bloggers random forest Ranking recommendation recommendation system regression Remote remote data science bootcamp Scrapy scrapy visualization seaborn seafood type Selenium sentiment analysis sentiment classification Shiny Shiny Dashboard Spark Special Special Summer Sports statistics streaming Student Interview Student Showcase SVM Switchup Tableau teachers team team performance TensorFlow Testimonial tf-idf Top Data Science Bootcamp Top manufacturing companies Transfers tweets twitter videos visualization wallstreet wallstreetbets web scraping Weekend Course What to expect whiskey whiskeyadvocate wildfire word cloud word2vec XGBoost yelp youtube trending ZORI