Documentation

Two lines to start tracing.

Install the SDK, initialize with your API key, and evaluation data flows into the tools your team already uses.

Quickstart

import agy_eval
from openai import OpenAI

agy_eval.init(api_key="ev_abc123", project_id=5)
client = OpenAI()
# Your agent calls are traced automatically
  • 1. Create a projectOpen the dashboard and create your first evaluation workspace.
  • 2. Connect your stackLangChain, LangGraph, OpenAI, CrewAI, AutoGen, and more.
  • 3. Define gatesShip only when scores clear your regression thresholds.