Custom LLM Providers

Enterprise customers can bypass Evnao"s standard models and bring their own API keys for OpenAI, Anthropic, or even custom fine-tuned models hosted on AWS SageMaker.

Why BYOM? (Bring Your Own Model)

• Data Privacy: Maintain strict Zero Data Retention policies directly with your LLM provider.
• Rate Limits: Use your own tier quotas rather than sharing Evnao"s global rate limits.
• Fine-tuning: Plug in highly specialized models trained specifically on your company's tone of voice and internal jargon.

Configuration JSON

Update your workspace configuration to point Evnao"s routing engine to your custom endpoint:

{"provider":"anthropic","model":"claude-3-opus-20240229","api_key":"sk-ant-api03-xxxxxxxxxx","system_prompt_override":"You are a senior support engineer for Acme Corp...","temperature": 0.2
}