Robin supports multiple LLM providers. You can configure them in two ways:
1. Environment Variables or .env file
Set your API keys in a .env file or as environment variables in your PATH.
Special Configuration for Ollama:
- If running via Docker: Set
OLLAMA_BASE_URL=http://host.docker.internal:11434 - If running via Python: Set
OLLAMA_BASE_URL=http://127.0.0.1:11434 - You may need to serve Ollama on
0.0.0.0 by running: OLLAMA_HOST=0.0.0.0 ollama serve &
2. Custom API Providers (UI-based)
For OpenAI-compatible providers (e.g., LM Studio, llama.cpp, Groq), use the 🔌 Custom API Provider expander in the Streamlit sidebar. You can enter:
- Base URL
- Optional API key
- Optional model name (if the provider doesn't support
/v1/models auto-discovery)