Overview of SimpleMem Architecture Components
mainSimpleMem is composed of four functional layers:
- API Layer (OpenRouter): Acts as a unified gateway for all LLM and embedding calls, providing multi-provider access and cost tracking.
- Storage Layer (LanceDB): A vector database that stores dialogue entries and their semantic embeddings.
- Retrieval Layer (Hybrid Retriever): Combines semantic (vector) search and keyword (BM25) search. The number of retrieved entries is controlled via a configurable
top-kparameter. - Generation Layer (Answer Generator): Uses retrieved context to generate natural language answers. It supports an optional Reflection Mode for multi-step reasoning on complex queries.