Version: v3.3.0

Version 3.3.0 (2025-04-08)

Data Updates

Together AI Embedding Model Support
- Added support for Together AI embedding models, expanding the list of supported embedding providers.

Custom Reranker Model Registration
- Users can now register most reranker models available from supported providers (Cohere, Together AI, Azure).
Reranker Model Support in Scans
- Users can now apply registered reranker models in Optimize:ai scans to test and compare reranker performance for their specific use cases.
Tokenizer Upload
- Users can now upload custom tokenizer files. This unlocks compatibility with LLMs that previously lacked open tokenizer access.
Cost and Carbon Control Maps
- Introduced new Cost and Carbon maps that help users configure cost and carbon maps for their scans based on their own cost policies.
Airgapped Support
- Quickstart is now compatible with airgapped environments, allowing for fully offline deployments.
Custom LLM Gateway Support (beta)
- Added support for registering and routing through custom LLM gateways, enabling advanced enterprise configurations.

Cost Endpoint Release
- API endpoint that estimates usage costs based on the user's LLM and/or reranker configuration.

Various stability improvements and minor UI fixes across model registration and scan interfaces.