Increasing Support Forum User Engagement in SaaS Companies

Posted on Jul 18, 2020

A group of diverse people talking together

Image by YouNeedABudget.com

GitHub Repository | LinkedIn

Background

You Need a Budget is a personal budgeting Software-as-a-Service designed around a money management methodology containing 4 formal rules and a handful of informal guidelines. A subscription to YNAB includes access to its support forums, but many users prefer to use fan-led communities on Facebook and Reddit. While encouraging informal groups reduces the cost of official support, that cost is offset by the cost of gathering, integrating, and analyzing data from outside groups in combination with data generated from within the YNAB software.

Outsourcing community also reduces direct customer engagement, and relinquishes control of the company’s narrative to users rather than official moderators.

This project demonstrates how data from the forums can be better utilized to improve customer data collection, increase customer retention, control the company narrative, and enhance software features and other company offerings like educational materials and special events.

Web Scraping

There is a publicly-visible version and a full version of the YNAB support forums. In order to access the full version, one must have a paid subscription to YNAB. Therefore, this data excludes a subscription-only category of the forums, Journals, in order to protect the privacy of users. As of this scraping, the Journal category made up roughly 8% of the total number of forum posts.

For purposes of keeping this project within a reasonable scope, replies to each post were not scraped, although how users interact with each other would generate valuable insights. Were I an actual employee of YNAB, I would scrape and analyze the Journal category and the replies to each post.

Interaction Statistics

  • This data spans late October 2017 through mid July 2020 and contains over 7,300 posts.
  • 65% of the posts were generated by a unique user, roughly 4,700 people, averaging 1.5 posts per person.
  • Posts averaged less than one Like and less than 10 replies.
  • Views averaged roughly 10% of users IF one assumes that each view is from a unique user, which is unlikely - views by the user who created the post are included in the view count, and duplicate user views cannot be determined from a web-scraped data collection.
  • Posts also averaged 5 follows, but that number may not be accurate as it doesn’t include users who may have followed a post at one time but have since unfollowed it.

User Lifespan in Months

This graph shows in this first bubble, that the vast majority of users, by thousands, spend less than a month on the forums. They have a duration of zero.

YNAB could focus on improving the forum activity of all users, but the greatest benefit would come from encouraging new users to post on the forums through at least one monthly rollover (meaning the transition from July to August, for example), at which point the new users may be active enough to continue without prompt.

This could be done by automatically enrolling new subscribers into an email campaign that reminds them weekly to utilize the forums, prompting them with a topic to discuss or a question to ask. Alternatively or in addition, new users could be automatically tagged in a weekly or monthly forum Welcome post and asked to share their stories, goals, concerns, etc.

Non-Rollover Users by Post Count

This graph is an expansion of the duration zero bubble from the last graph and explores the activity of users who stop posting on the forums within their first month. The orange bubbles represent the number of users who only posted on one day. A small few of those users posted two or three times on that single day.

The blue bubbles represent users who posted throughout the first month, most of who only posted 2 or 3 times, although a small handful posted up to as many as 13 times. These repeat posters may be the most beneficial to target, as they engage at first, but fail to continue. If they can be encouraged to stay on the forums, they may have a higher likelihood of subscribing longer and participating in the forums more than other short-term users, those who only last one day or post a few times.

Rollover User Lifespan in Months

This graph contains all the bubbles from the first Lifespan graph except the duration zero bubble. The orange bubbles represent users who have participated in the forums beyond a year.

Of these Rollover Users, who are users that experience the transition from one month to the next in YNAB, which is a crucial point in the YNAB learning curve, most stop posting within about a year.

However, the truly long-term users are a high-value group, as they are the most likely to continue their subscriptions and forum participation. They can be targeted for testimonials and other marketing materials, asked to engage with new users informally or in special programs like YNAB bootcamps. They can also be used as formal or informal brand ambassadors - YNAB does not sell swag, but it does give it away to users that represent the brand well in the community groups.

User Join Date

With subscription data, which I did not have access to, this graph’s data could be further analyzed to see if its fluctuation trends with the fluctuation of new YNAB subscribers. If not, YNAB is missing an opportunity to draw new users into the forums at all, let alone for more than one or two posts. Subscription data analysis would also indicate if users stop participating in the forums because they have abandoned the software, or if they have simply stopped participating in the forums.

Engaging users who are still subscribed but not using the forums would boost overall forum participation and reduce the need for official support, since veteran users could be recruited to engage newcomers and answer support questions.

It is impossible to accurately pair all Facebook and Reddit users to their YNAB subscriptions, so subscription comparison data is largely or completely lost, despite the ability to web scrape Facebook and Reddit.

Interactions by Topic Category

The top six categories per post count have the highest interaction ratios, with the exception of Likes. These categories all regard either technical aspects of the software or the YNAB methodology in very general ways, while most of the other categories cover special topics, such as Investing & Retirement, Small Business, or Student Life.

Marketing those special topics specifically toward potential subscribers could bring in a broader variety of users by increasing exposure in new or under-tapped markets. This information is also useful for assessing current software features and educational materials. Common topics in the top six categories indicate areas for improvement.

Topic Category Outliers / Sentiment Analysis

This table of z-scores represents the limited variety of topics discussed in the forums given that Accounts & Transactions and Method & Budgeting have the most posts, replies, and follows by far. YNAB Wins is a dramatic outlier in Likes, and sentiment analysis below demonstrates that positive posts tend to garner more interactions, suggesting high desirability among users for more subjective content in the forums, particularly positive posts discussing success, particularly when they reveal tips for mastering YNAB.

The post with the most views is in the YNAB Wins category, titled "What did you do to improve your finances today?" The post that has the most likes, replies, and follows is in Community Challenges, titled "The Official 2020 Debt Smackdown" - an ongoing debt paydown gamification activity with informal group support.

Text Bigrams Word Cloud

Most posts discuss credit cards, so marketing could be targeted toward people looking to manage their credit cards or pay down credit card debt. It also indicates that credit cards are likely a source of confusion, and is a software feature to improve or provide more educational resources about.

Another common bigram is "fresh start," which is a feature of the YNAB software that users often utilize when they are confused by their budget or when they stop using their budget for weeks or months and have an overwhelming amount of transaction data to process. If users Fresh Start mostly out of frustration or complacency, the risk of losing users may increase.

Other topics of interest indicated by the word cloud include emergency funds, student loans, True Expenses, and goals. True Expenses are expenses that occur less often than monthly, but YNAB Rule 2 advises be budgeted for on a monthly basis regardless. Goals are a customizable software feature to support specific goals a user has, like funding an annual bill or a vacation. All of these topics can be areas for targeted marketing as well as educational content. For example, YNAB has a blog, videos, live classes, and bootcamps, so user success stories or content about how to handle these topics will likely be popular.

Posts per Month

This graph shows the number of posts per month, with April 2020 as the most dramatic outlier. The jump in posts from April 2020 to May 2020 may seem at first thought to be due to COVID-19 and its economic impacts, however the word cloud below indicates that it's most likely due to problems automatically importing transactions from banking institutions, Capital One and Wells Fargo in particular.

Summary

This project web-scraped the YNAB support forums and analyzed that data to discover insights on how the forums can be better utilized to improve customer data collection, increase customer retention, control the company narrative, and enhance software features and other company offerings like educational materials and special events. Recommended strategies for improving forum data use include retaining new users via email campaigns, community challenges, bootcamps, etc., and leveraging forum veterans to support newcomers, answer questions, and regularly post on the forums and provide other YNAB content.

About Author

Sita Thomas

Knowledge is power. I leverage fierce curiosity and creativity to deliver immediate and impactful results for mission-driven companies by weaving together 20 years of statistics, engineering, and business development. I've worn many hats across a variety of industries,...
View all posts by Sita Thomas >

Related Articles

Leave a Comment

No comments found.

View Posts by Categories


Our Recent Popular Posts


View Posts by Tags

#python #trainwithnycdsa 2019 2020 Revenue 3-points agriculture air quality airbnb airline alcohol Alex Baransky algorithm alumni Alumni Interview Alumni Reviews Alumni Spotlight alumni story Alumnus ames dataset ames housing dataset apartment rent API Application artist aws bank loans beautiful soup Best Bootcamp Best Data Science 2019 Best Data Science Bootcamp Best Data Science Bootcamp 2020 Best Ranked Big Data Book Launch Book-Signing bootcamp Bootcamp Alumni Bootcamp Prep boston safety Bundles cake recipe California Cancer Research capstone car price Career Career Day citibike classic cars classpass clustering Coding Course Demo Course Report covid 19 credit credit card crime frequency crops D3.js data data analysis Data Analyst data analytics data for tripadvisor reviews data science Data Science Academy Data Science Bootcamp Data science jobs Data Science Reviews Data Scientist Data Scientist Jobs data visualization database Deep Learning Demo Day Discount disney dplyr drug data e-commerce economy employee employee burnout employer networking environment feature engineering Finance Financial Data Science fitness studio Flask flight delay gbm Get Hired ggplot2 googleVis H20 Hadoop hallmark holiday movie happiness healthcare frauds higgs boson Hiring hiring partner events Hiring Partners hotels housing housing data housing predictions housing price hy-vee Income Industry Experts Injuries Instructor Blog Instructor Interview insurance italki Job Job Placement Jobs Jon Krohn JP Morgan Chase Kaggle Kickstarter las vegas airport lasso regression Lead Data Scienctist Lead Data Scientist leaflet league linear regression Logistic Regression machine learning Maps market matplotlib Medical Research Meet the team meetup methal health miami beach movie music Napoli NBA netflix Networking neural network Neural networks New Courses NHL nlp NYC NYC Data Science nyc data science academy NYC Open Data nyc property NYCDSA NYCDSA Alumni Online Online Bootcamp Online Training Open Data painter pandas Part-time performance phoenix pollutants Portfolio Development precision measurement prediction Prework Programming public safety PwC python Python Data Analysis python machine learning python scrapy python web scraping python webscraping Python Workshop R R Data Analysis R language R Programming R Shiny r studio R Visualization R Workshop R-bloggers random forest Ranking recommendation recommendation system regression Remote remote data science bootcamp Scrapy scrapy visualization seaborn seafood type Selenium sentiment analysis sentiment classification Shiny Shiny Dashboard Spark Special Special Summer Sports statistics streaming Student Interview Student Showcase SVM Switchup Tableau teachers team team performance TensorFlow Testimonial tf-idf Top Data Science Bootcamp Top manufacturing companies Transfers tweets twitter videos visualization wallstreet wallstreetbets web scraping Weekend Course What to expect whiskey whiskeyadvocate wildfire word cloud word2vec XGBoost yelp youtube trending ZORI