Answer Relevancy

SDK Usage

Learn how to evaluate this metric programmatically in the Trustwise SDK Documentation.

The Trustwise Answer Relevancy metric measures how well a response addresses the specific question or request that was asked. To do this, we take the response and use the Question Generation Model¹ to try to generate a query that the response would be a good answer to. It gives higher scores to responses that directly tackle the main points of the query without going off-topic or missing key elements. It does not measure whether the answer is correct, only whether it attempts to address what was actually asked.

FAQs

How do I know if a response is good?

Generally, an answer relevancy score above 70 indicates the response answers the query.

Footnotes

1. Built with Llama ↩