Overview of Vectorize RAG pipeline features
Vectorize provides tools to automate the construction and maintenance of Retrieval-Augmented Generation (RAG) pipelines. Key capabilities include:
- RAG Pipeline Builder: A user interface to populate vector search indexes from documents, SaaS platforms, and knowledge bases with automatic synchronization to prevent stale data.
- Advanced Retrieval Endpoint: A built-in endpoint that handles query vectorization, k-ANN search, LLM-based query rewriting based on conversation history, result re-ranking, and providing relevancy scores, cosine similarity, and metadata.
- Real-Time Updates: Configuration options to immediately update vector search indexes when changes occur in unstructured data sources.
- Vector Database Integrations: Support for storing embedding vectors in existing databases (e.g., Pinecone, Couchbase) using models from providers like OpenAI and Voyage AI.
- Management API (Beta): Programmatic control over connectors, API platforms, vector databases, and pipelines for integration into AI applications or CI/CD workflows.