Overview of Local Model Providers
mainKilo Code allows you to run language models locally on your machine, providing privacy, offline access, and cost savings.
Supported providers include:
- Ollama: Open-source tool supporting a wide range of models.
- LM Studio: Desktop application that provides a local server emulating the OpenAI API.
- Atomic Chat: Open-source local AI with TurboQuant-optimized inference and an OpenAI-compatible API on port
1337. Kilo Code can automatically discover models if you use theprovider.atomic-chatsetting,atomicChat.autoDetect, or a model name prefixed withatomic-chat/....