Skip to main content
EZVals EZVals is an evaluation framework for testing LLMs and Agents What makes EZVals special is that its built to be used by your coding agent. Your agent writes evals, runs them, analyzes results, and iterates while you monitor the situation from the Dashboard.

Agent-First

Full CLI that mirrors every UI action. Built-in skill gives your agent eval-specific guidance.

Local Dashboard

Compare runs, annotate, and export from a local web UI.

Flexible

Quick smoke tests or deep multi-model comparisons. Pytest-style assertions, clean code.

Local-Only

Code, data, and results live in your repo. No external platforms or auth.

Get Started

Install the EZVals skill for your coding agent:
Then prompt your agent:
The agent writes the evals, runs them, and reports back with results. For the comparison example, that looks something like:
EZVals Comparison View Results can be exported as JSON, CSV, Markdown, or PNG from the dashboard or CLI.

Setup Details

Install the library directly, configure your project, and learn how EZVals works under the hood.