Adherence
Learn how to evaluate this metric programmatically in the Trustwise SDK Documentation.
The Trustwise The Trustwise Adherence metric measures how well a response obeys specific rules or policies. It gives higher scores when the agent's response obeys the given policy, and lower scores when the agent breaks or ignores the policy. This metric helps ensure AI agents stay within their intended boundaries. metric measures how well a response obeys specific rules or policies.. It gives higher scores when the agent's response obeys the given policy, and lower scores when the agent breaks or ignores the policy. This metric helps ensure AI agents stay within their intended boundaries.
FAQs
Why is Adherence evaluation important?
It ensures that the agent maintains compliance with legal, ethical, or brand-specific guidelines in its responses.
How is the policy defined?
You provide the text of the policy the agent must adhere to when responding.
What is a good Adherence score?
A high score means the response clearly demonstrates alignment with the defined policy. A low score indicates deviation or omission.