Changelog
All notable changes to the Trustwise SDK will be documented in this file.
v1.0.0 (06-20-2025)
Features
Initial release of Trustwise Python SDK
Unified interface for evaluating AI-generated content across 14+ metrics: - Faithfulness - Answer Relevancy - Context Relevancy - Summarization - Prompt Injection Detection - PII Detection - Clarity - Helpfulness - Toxicity - Tone - Formality - Simplicity - Sensitivity - Cost Estimation - Carbon Emissions
Experimental guardrails system for multi-metric validation, threshold configuration, and block-on-failure functionality
Cost and carbon emissions estimation for model runs
Flexible configuration via environment variables or direct instantiation (API key, base URL, etc.)
Strong type definitions for all request and response objects
Serialization support: all responses can be converted to JSON and Python dicts for easy integration
Explicit and default API versioning with version switching and fallback
Designed for extensibility to support future metrics and features
Comprehensive documentation, including quickstart, usage, and API reference
Added async SDK (TrustwiseSDKAsync) for full asynchronous metric evaluation.
Added support for inline explanations for each metric evaluation call.
Metrics
Added support for context-based faithfulness, answer relevancy, and other metrics
Implemented query-response alignment scoring
Added cost and carbon evaluation for model runs
Added support for stability, adherence, completion and refusal metrics
Guardrails System (Experimental)
Added multi-metric guardrail system with configurable thresholds
Implemented block-on-failure functionality
Added support for comprehensive evaluation result aggregation
Introduced flexible threshold configuration per metric
Version Management
Added explicit version support for all API endpoints
Added version switching capabilities
Introduced version-aware evaluation methods
Configuration
Added environment variable based configuration
Implemented direct configuration through TrustwiseConfig
Added support for API key and base URL configuration
Introduced flexible configuration options for all features