> ## Documentation Index
> Fetch the complete documentation index at: https://ezvals.com/llms.txt
> Use this file to discover all available pages before exploring further.

# EZVals

> The evals framework your coding agent wants

<img className="block dark:hidden" src="https://mintcdn.com/solo-ac8cca18/nR2ODCFcXAvbJ2Ht/assets/hero-light.svg?fit=max&auto=format&n=nR2ODCFcXAvbJ2Ht&q=85&s=22bfc917b4e23d99a570436dcd4037fd" alt="EZVals" width="800" height="300" data-path="assets/hero-light.svg" />

<img className="hidden dark:block" src="https://mintcdn.com/solo-ac8cca18/nR2ODCFcXAvbJ2Ht/assets/hero-dark.svg?fit=max&auto=format&n=nR2ODCFcXAvbJ2Ht&q=85&s=da3ce3b597bf8d93ded0e7698352a1f5" alt="EZVals" width="800" height="300" data-path="assets/hero-dark.svg" />

EZVals is an evaluation framework for testing LLMs and Agents

What makes EZVals special is that its built to be used by your coding agent. Your agent writes evals, runs them, analyzes results, and iterates while you monitor the situation from the Dashboard.

<CardGroup cols={2}>
  <Card title="Agent-First" icon="robot">
    Full CLI that mirrors every UI action. Built-in [skill](/guides/agent-skill) gives your agent eval-specific guidance.
  </Card>

  <Card title="Local Dashboard" icon="chart-mixed">
    [Compare runs](/guides/web-ui), annotate, and export from a local web UI.
  </Card>

  <Card title="Flexible" icon="sliders">
    Quick smoke tests or deep multi-model comparisons. [Pytest-style assertions](/core-concepts/scoring), clean code.
  </Card>

  <Card title="Local-Only" icon="laptop-code">
    Code, data, and results live in your repo. No external platforms or auth.
  </Card>
</CardGroup>

## Get Started

Install the EZVals skill for your coding agent:

```bash theme={null}
npx skills add camronh/evals-skill
```

Then prompt your agent:

<CodeGroup>
  ```text Compare theme={null}
  Compare Opus 4.6 vs GPT-5.3 on answer correctness. Show me the comparison.
  ```

  ```text Evaluate theme={null}
  Help me evaluate hallucinations in my RAG agent @agent.py
  ```

  ```text Error Analysis theme={null}
  Run error analysis on the last eval run @.ezvals/sessions/rag-tests/baseline_a1b2c3d4.json
  ```
</CodeGroup>

The agent writes the evals, runs them, and reports back with results. For the comparison example, that looks something like:

```markdown theme={null}
I ran both models against your 50-question correctness dataset.

| Model    | Correctness | Avg Latency |
|----------|-------------|-------------|
| Opus 4.6 | 94%         | 1.2s        |
| GPT-5.3  | 87%         | 0.8s        |

Opus scores 7% higher on correctness but is ~50% slower.

Full comparison: http://127.0.0.1:8000/?compare_run_id=a1b2...&compare_run_id=c3d4...
```

<img className="block dark:hidden" src="https://mintcdn.com/solo-ac8cca18/ArUfHP03PRTr-wOn/assets/comparison-light.png?fit=max&auto=format&n=ArUfHP03PRTr-wOn&q=85&s=f27292fa28d31bcedce0af85d6b6d037" alt="EZVals Comparison View" width="1280" height="800" data-path="assets/comparison-light.png" />

<img className="hidden dark:block" src="https://mintcdn.com/solo-ac8cca18/ArUfHP03PRTr-wOn/assets/comparison-dark.png?fit=max&auto=format&n=ArUfHP03PRTr-wOn&q=85&s=0ae4d3d0ccdc13886417d1a0ca411d9e" alt="EZVals Comparison View" width="1280" height="800" data-path="assets/comparison-dark.png" />

Results can be exported as JSON, CSV, Markdown, or PNG from the dashboard or CLI.

<Card title="Setup Details" icon="gear" href="/setup">
  Install the library directly, configure your project, and learn how EZVals works under the hood.
</Card>
