Skip to main content

Answer Relevancy

SDK Usage

Learn how to evaluate this metric programmatically in the Trustwise SDK Documentation.

The Answer Relevancy metric judges whether a response attempted to answer the right query. To do this, we take the response and use the Question Generation Model1 to try to generate a query that the response would be a good answer to. This generated query is then compared to the original query to obtain an Answer Relevancy score.

answer-relevancy-flow

FAQs​

How do I know if a response is good?​

Generally, an answer relevancy score above 70 indicates the response answers the query.

Footnotes​

  1. Built with Llama ↩