Understand the model-catalog JSON descriptor format
mainThe model-catalog uses standardized JSON descriptors to describe Large Language Model (LLM) models. Each model is represented by a <model_name>.json file located in the models/ directory.
These descriptors capture metadata including:
- Model size: (e.g.,
7B,13B,30B) - Model architecture: (e.g.,
Llama,MPT,Pythia) - Model file format: (e.g.,
ggml) - Quantization format: (e.g.,
q4_0,q4_K_M) - Authors and resources: Links to academic papers or other metadata.
- Files and providers: Information about available model files and their respective providers.