Improving Risk Tolerance Questionnaires for Better Financial Planning

Risk tolerance questionnaires are widely recognized as essential tools. These questionnaires assess a client's willingness to take risks and their ability to handle potential losses and market volatility. And they are used primarily to inform portfolio construction, to ensure alignment with the client’s risk profile and stated goals.

But, the effectiveness of this process depends on the questionnaire's validity and reliability. Building a portfolio from an inaccurate assessment may lead to poor outcomes and dissatisfied clients. Unfortunately, many of today's assessments prove ineffective. In this article, we’ll explore the current state of risk tolerance questionnaires, methods for improvement, and the benefits of using a software-based questionnaire.

The Current State of Risk Tolerance Questionnaires

The limitations of existing questionnaires

Current risk tolerance questionnaires often fail to accurately predict real-life investor behavior. This is usually due to several issues:

1. Inaccuracy in predicting real-life investor behavior: Most questionnaires rely too heavily on hypothetical scenarios. How someone says they will react is usually quite different than how they will react. This discrepancy can produce inaccurate assessment results. This is not to say that hypothetical scenarios aren’t useful; but that they should be factored in carefully.
2. Influence of arbitrary reference points on responses: The framing of questions can impact an investor’s response. For instance, questions about losses framed in terms of dollars or percentages may influence someone’s opinion. Recency bias is another example that can change responses, i.e. an investor’s current situation or recent market events. These factors can lead to inconsistent and potentially misleading results.

The necessity for improved questionnaire design

These limitations underscore the need for better risk tolerance questionnaire design. Developing more accurate and reliable questionnaires can help financial advisors better understand their clients’ true risk tolerance, leading to better portfolio design and, hopefully, improved client satisfaction.

So, how can risk tolerance questionnaires be improved to get more accurate and consistent results? The current leading approach focuses on incorporating the concept of psychometric validity.

Understanding Psychometric Validity

Psychometric validity is a crucial concept for risk tolerance questionnaires. It refers to how accurately a questionnaire measures the construct it is intended to assess. In this case, that construct is risk tolerance.

Definition and importance in questionnaire design

There are three main components of psychometric validity: content validity, construct validity, and criterion validity.

• Content validity assesses whether the questions in a questionnaire adequately cover the entire domain of the construct being measured.
  • Example: questions measuring different aspects of risk tolerance, such as willingness to take risks, ability to handle financial losses, and comfort with market volatility. It could also mean taking different asset classes into account like stocks, bonds, and real estate.
• Construct validity evaluates how well the questionnaire differentiates between related and unrelated constructs.
  • Example: asking questions that help to distinguish between risk tolerance and related constructs like investment knowledge, financial literacy, or even the difference between willingness to take risks and ability to handle losses.
• Criterion validity is the relationship between the questionnaire scores (i.e. the results) and relevant external criteria.
  • Example: the predictive ability of real-life investor behavior like reaction(s) to market volatility or satisfaction with investment returns.

Taking this approach helps to ensure that the questions asked are relevant, reliable, and accurate. High psychometric validity is ideal and this enables financial advisors to make well-informed investment recommendations, grounded in their clients’ true risk profile.

How psychometric validity can improve risk tolerance questionnaires: An example

Perhaps the best example of a risk tolerance questionnaire with high psychometric validity is the Risk Tolerance Scale (RTS) developed by Grable and Lytton in 1999. The RTS consists of 13 items that assess various aspects of risk tolerance, such as risk aversion, risk perception, and risk-taking behavior.

Here are three sample questions from the RTS:

1. I am willing to take a substantial financial risk to earn a substantial return.
   • Strongly Disagree
   • Disagree
   • Neither Agree nor Disagree
   • Agree
   • Strongly Agree
2. I would feel comfortable investing in a financial asset if I knew there was a chance I could lose some of my investment.
   • Strongly Disagree
   • Disagree
   • Neither Agree nor Disagree
   • Agree
   • Strongly Agree
3. I am willing to take above-average financial risks to achieve above-average returns.
   • Strongly Disagree
   • Disagree
   • Neither Agree nor Disagree
   • Agree
   • Strongly Agree

Taken as a whole, they found that the questionnaire demonstrated the ability to differentiate between the concepts and accurately measure risk tolerance. This was a major step forward in 1999 and helped lead to the creation of better assessments that produced more accurate, consistent, and reliable results.

Developing Better Risk Tolerance Questionnaires

So, to summarize, creating better risk tolerance questionnaires requires :

1. Incorporating real-life scenario/past investor behavior rather than relying heavily and/or solely on hypothetical scenarios,
2. Avoiding psychological bias in responses,
3. And ensuring that the questions contain a high degree of psychometric validity

Incorporating real-life scenarios and past investor behavior

Traditional risk tolerance questionnaires often rely just on hypothetical scenarios. As we now know, this approach probably doesn’t capture an investor's true risk tolerance. To mitigate these issues and improve questionnaires, assessments should take into account an investor’s actual investment experiences, past decisions, and, perhaps most importantly, their existing portfolio. In doing so, you can get objective data and then compare it with the subjective responses. This allows you to identify any discrepancies between the client’s stated risk tolerance and their actual investment behavior and leads to better empirical grounding to construct a portfolio from. Done within a software-based risk questionnaire, this analysis can be completed instantly (and can actually automate common next steps like IPS and proposal generation. More on that below).

Measuring abstract psychological traits related to risk tolerance

As mentioned earlier, an investor’s perception of risk tolerance can be influenced by various psychological biases, like recency bias. To avoid this, a good risk tolerance questionnaire should measure abstract psychological traits, such as risk aversion, loss aversion, and time preference. This can be done by including questions that assess an investor's attitudes and emotions related to risk, potential losses, and long-term investment horizons.

Ensuring reliability and validity in questionnaire results

Or, in other words, psychometric validity.

As we have seen, a risk tolerance questionnaire with high psychometric validity will produce accurate and reliable results by incorporating the three core concepts of (1) content validity, (2) construct validity and (3) criterion validity.

By focusing on these key aspects and taking an integrated approach, financial advisors can create more accurate, reliable, and comprehensive risk tolerance questionnaires. Or, you can take it a step further and leverage a good software-based risk tolerance questionnaire that comes with several other benefits.

The Advantages of Software-Based Risk Questionnaires

One significant advantage of using a well-designed software-based risk questionnaire, as opposed to a manually constructed one, is the ability to leverage technology to enhance accuracy, efficiency, and user experience. Here are some key benefits:

• Automated scoring and analysis: Software-based questionnaires can automatically calculate scores and analyze responses, eliminating the potential for human error in manual scoring and streamlining the process of interpreting results.
• Real-time updates and customization: Software-based questionnaires can be easily updated and customized to reflect changes in market conditions, regulatory requirements, or client preferences. This ensures that the questionnaire remains relevant and effective over time.
• Enhanced user experience: A well-designed software interface can make the process of completing a risk questionnaire more engaging and intuitive for clients, encouraging more thoughtful responses and reducing the likelihood of incomplete or inaccurate information.

Integration with other financial planning tools

Another key benefit of software-based risk tolerance questionnaires is the integration with other financial planning tools and platforms, streamlining the overall planning process.. One such integration is the generation of investment policy statements (IPS) and proposals based on the risk tolerance assessment results.

Connecting the risk questionnaire with IPS and proposal generation

By connecting risk questionnaire results with IPS and proposal generation tools, financial advisors can automatically create customized documents tailored to each client's risk profile, investment objectives, and constraints. This not only saves time but also ensures consistency and accuracy in the document creation process. With this streamlined process, advisors can move from risk assessment to presenting clients with a comprehensive investment plan, reducing the time it takes to convert prospects into clients, improving overall efficiency, and shortening the revenue recognition cycle.

A Word of Caution

While it’s important to acknowledge that risk tolerance questionnaires will never be perfect, incorporating the principles discussed above can significantly improve their accuracy and reliability. The complex nature of human behavior and the inherent challenges in measuring abstract psychological constructs mean that there will always be some degree of uncertainty and error in questionnaire results. However, focusing on incorporating real-life scenarios and/or past behavior, measuring relevant psychological traits, and a high degree of psychological validity can lead to better investment recommendations and more successful outcomes for clients.

Get a better risk tolerance questionnaire and automate your workflows

An advanced risk tolerance questionnaire like Investipal’s Risk Tolerance Questionnaire can give you better data, boost engagement on your website, and save you time.

It incorporates existing holdings to provide objective data that can then be compared to subjective questionnaire responses, so that you can get closer to the truth and construct a portfolio from firmer ground. It also integrates seamlessly with Investipal’s AI IPS generator and proposal generator, helping you automate your workflows and win more business.

You can embed it into your website, customize it to your brand, and start automating your key workflows in just minutes. Get in touch with us today to learn more.

‍