Overview of the MCP Testing Framework levels
mainThe sunpeak testing framework provides five levels of automated testing to replicate host environments (like ChatGPT and Claude) without requiring host accounts or API credits:
- Unit tests: Component and hook logic using Vitest and
happy-dom. - E2E tests: Playwright specs against replicated ChatGPT and Claude runtimes via the
inspector. - Visual regression tests: Playwright specs comparing screenshots against saved baselines.
- Live tests: Playwright specs against real ChatGPT (requires API keys/costs money).
- Evals: Multi-model tool calling reliability tests (requires API keys/costs money).
Command Reference:
| Command | What it tests | Runtime |
|---|---|---|
sunpeak test | Unit + e2e tests | Vitest + Playwright |
sunpeak test --unit | Unit tests only | Vitest + happy-dom |
sunpeak test --e2e | E2E tests only | Playwright + inspector |
sunpeak test --visual | E2E with visual regression | Playwright + inspector |
sunpeak test --visual --update | Update visual baselines | Playwright + inspector |
sunpeak test --live | Live tests against real ChatGPT | Playwright + real host |
sunpeak test --eval | Evals against multiple models | Vitest + Vercel AI SDK |