Helpfulness
Learn how to evaluate this metric programmatically in the Trustwise SDK Documentation.
The Trustwise Helpfulness metric measures how useful a given text is. It gives higher scores to texts that fully explain a topic. Helpful responses provide clear, complete information.
Helpfulness will be increased by:
- Useful information
- Detailed responses
- Unambiguous language
Helpfulness will be decreased by text with:
- A lack of information or detail
- Ambiguity
- Refusal to provide an answer
FAQs
The response answers a different question to what I asked - why is the helpfulness score high?
The Helpfulness score judges how helpful an answer is, and does not consider the query posed. As such, some responses which do not answer the query may still score highly, even if they answer something totally different. For this case, it is usually beneficial to use Helpfulness in conjunction with Answer Relevancy, which judges whether a response answers the query posed (but conversely doesn't judge if the response is helpful). If a response has a high Answer Relevancy score and a high Helpfulness score, it answers the correct query and does so with a helpful answer.