Configure LLM (Large Language Model) access
mainThe project provides a unified AI model access experience supporting official APIs, OpenAI-compatible platforms, and local models. It is powered by LiteLLM.
Users can choose from three configuration priority levels depending on their needs:
- Simple Model Configuration: For beginners who want the quickest setup.
- Channel (Channels) Mode Configuration: For advanced users managing multiple API keys, fallback models, or custom Base URLs.
- YAML Advanced Configuration: For power users requiring complex load balancing, request routing, or multi-platform high availability.
Important Compatibility Notes:
- Dependency Boundary: The system uses
litellm>=1.80.10,!=1.82.7,!=1.82.8,<2.0.0. - Rollback Path: If a configuration fails, use your
.envbackup or thePOST /api/v1/system/config/importendpoint to restore settings. You can manually refill keys likeLITELLM_MODEL,LLM_*,AGENT_LITELLM_MODEL,VISION_MODEL,LLM_TEMPERATURE, orLLM_USAGE_HMAC_*before restarting.