Primus by Transformer Lab

website·Indexed 33 days ago

https://lab.cloud/

An autonomous AI research scientist designed for machine learning, mathematics, physics, and theoretical quantum mechanics. Developed by Transformer Lab, Primus provides specialized domains for scientific research, integrated with features for pre-training, finetuning, RLHF, preference optimization, and comprehensive model evaluations.

Tokens
35.9K
Snippets
25
Records
263
Agent score
69%

What's inside Primus

  1. Overview of Primus for Math capabilities

    Primus for Math is an autonomous AI research scientist designed for mathematics and engineering. It automates the research workflow by reading existing literature, deriving precise models and equations from high-level problems, running computations, and logging its reasoning process (including failed paths) for user verification.
  2. Overview of the Primus research workflow

    Primus acts as an automated machine learning researcher. It takes a natural language prompt (even a single sentence) and executes a full research cycle: scoping the question, reviewing existing literature, designing and running experiments on GPUs, evaluating results, and authoring a final research paper. Users can monitor progress in a live workspace and provide steering notes (e.g., "focus on the smaller model first") to guide the AI's direction.
  3. Overview of Primus AI Researcher

    Primus is an autonomous AI researcher developed by Transformer Lab. It automates the full research loop: hypothesizing, reading literature, coding, running experiments on real compute, iterating, drawing conclusions, and writing final papers. It is designed to handle tasks typically assigned to a team of expert ML researchers across domains such as LLMs, seismology, physics, crystallography, and biology.
  4. Overview of RAG (Retrieval Augmented Generation) feature

    The RAG (Retrieval Augmented Generation) feature provides a drag-and-drop file user interface for document ingestion and is compatible with multiple backend engines, including Apple MLX and Hugging Face (HF) Transformers.
  5. Overview of Transformer Lab and Primus

    Transformer Lab focuses on Recursive Self-Improvement (RSI) to automate the act of scientific discovery. Their goal is to replace the manual human effort of hypothesis generation, architecture design, experimental coding, and optimization with an "AI Scientist" system. This approach aims to remove the "biological speed limit" of research—such as the time required for human schooling, reading, and manual experimentation—allowing for research cycles to happen in months rather than years.
  6. Overview of Primus autonomous ML research scientist

    Primus is an autonomous ML research scientist designed to accelerate the research loop (hypothesizing, literature review, coding, experimenting, and paper writing). It is capable of running this loop significantly faster than human researchers, autonomously producing complete research papers across diverse fields such as LLMs, seismology, physics, crystallography, and biology.
  7. Overview of Advanced Training & Multimodal Workflows

    The Advanced Training & Multimodal Workflows environment provides a unified platform for pre-training, fine-tuning, and evaluating Large Language Models (LLMs), Diffusion models, and Audio models. It supports production-ready preference optimization techniques including Direct Preference Optimization (DPO), Odds Ratio Preference Optimization (ORPO), Simple Preference Optimization (SIMPO), and Group Relative Policy Optimization (GRPO). Additionally, it enables complex multimodal workflows such as implementing ControlNets, image inpainting, and fine-tuning Text-to-Speech (TTS) models using custom datasets.
  8. Overview of Primus for Machine Learning

    Primus is an autonomous AI research agent for machine learning. It allows users to start a research project with a single-sentence prompt. The system handles the end-to-end research pipeline: scoping the research question, conducting literature reviews, designing and running experiments on provisioned GPUs, and writing the final paper (including methods, results, and citations). It is designed to be usable by both ML engineers and non-experts.
  9. Overview of Primus Society

    Primus Society is a virtual community of 10,000 autonomous AI researchers designed to tackle frontier problems in machine learning, quantum mechanics, and mathematics. Unlike single-agent systems, it uses a population-based approach where agents are organized into labs, governed by a central institute, and compete for compute resources. The system mimics human scientific institutions—using grants, peer review, and conferences—to ensure diversity of thought and coordinated progress.
  10. Understand the impact of parseable-answering rate on RL training

    The 'parseable-answering rate' is the frequency with which a model writes its final answer in the requested format (e.g., a number wrapped in a box). This rate acts as a 'gate' for reinforcement learning (RL). If the answering rate is near zero, the model is not producing readable answers for a grader to evaluate, rendering any reward signal—including perfect answer keys or random rewards—ineffective. Training cannot improve accuracy until the model consistently produces a parseable format.
  11. Use Experiment Tracking to manage research workflows

    Experiment Tracking allows you to automatically record hyperparameters, code versions, metrics, and logs for every run. This creates a consistent history within a single workspace where jobs are launched and monitored, enabling you to revisit, compare, and resume experiments without manual searching.
  12. Prohibited system interference and reverse engineering on Primus

    Activities that compromise the integrity or security of Primus are forbidden, including:

    • Reverse Engineering: Decompiling, disassembling, or attempting to derive source code, architecture, algorithms, or model weights.
    • Prompt Hacking: Using prompt injection, 'jailbreaking', or any method to bypass safety guardrails and content filters.
    • Exfiltration: Scraping or stealing proprietary system prompts, tool configurations, internal APIs, skills, or training datasets.