Overview of the Collect Trace workflow
mainThe collect-trace component automates the creation of training data by following these steps:
- Load RLVR items: Reads questions and verifiable answers from a dataset.
- Run Agent: Executes the agent in an evaluation pipeline (including tool use/browsing).
- Verify: Uses an LLM-as-a-Judge to compare the model's answer against the RLVR reference.
- Harvest: For correct items only, collects the full multi-turn trace and converts it into SFT/DPO-ready samples.