Helpfulness

The Helpfulness metric judges how useful, detailed and unambiguous a response is, with a higher score indicating the response is more helpful. Responses which refuse to answer the question receive lower Helpfulness scores.

Helpfulness will be increased by:

• Useful information
• Detailed responses
• Unambiguous language

Helpfulness will be decreased by text with:

• A lack of information or detail
• Ambiguity
• Refusal to provide an answer

FAQs

The response answers a different question to what I asked - why is the helpfulness score high?

The Helpfulness score judges how helpful an answer is, and does not consider the query posed. As such, some responses which do not answer the query may still score highly, even if they answer something totally different. For this case, it is usually beneficial to use Helpfulness in conjunction with Answer Relevancy, which judges whether a response answers the query posed (but conversely doesn't judge if the response is helpful). If a response has a high Answer Relevancy score and a high Helpfulness score, it answers the correct query and does so with a helpful answer.