# Judgment Labs Docs



> Judgment Labs builds tools for AI agent evaluation, tracing, monitoring, and improvement.

> Products: Judgeval SDK (Python + TypeScript), Judgment CLI, MCP Server, Agent Judges, Agent Behavior Monitoring.

## cli-reference

- [judgment agent-threads CLI Reference | Judgment Docs](/cli-reference/agent-threads): Command reference for `judgment agent-threads`, used to list and inspect agent thread conversations in Judgment CLI workflows.
- [judgment automations CLI Reference | Judgment Docs](/cli-reference/automations): Command reference for `judgment automations`, used to manage automations that act on metrics in Judgment CLI workflows.
- [judgment behaviors CLI Reference | Judgment Docs](/cli-reference/behaviors): Command reference for `judgment behaviors`, used to view and manage behavior labels in Judgment CLI workflows.
- [judgment completion CLI Reference | Judgment Docs](/cli-reference/completion): Command reference for `judgment completion`, used to print shell completion scripts in Judgment CLI workflows.
- [judgment configure CLI Reference | Judgment Docs](/cli-reference/configure): Command reference for `judgment configure`, used to update stored credentials in Judgment CLI workflows.
- [judgment context CLI Reference | Judgment Docs](/cli-reference/context): Command reference for `judgment context`, used to manage default organization and project context in Judgment CLI workflows.
- [judgment docs CLI Reference | Judgment Docs](/cli-reference/docs): Command reference for `judgment docs`, used to search and read Judgment documentation in Judgment CLI workflows.
- [Deprecated Judgment CLI Reference | Legacy Commands](/cli-reference): Legacy command reference for the deprecated Judgment CLI. The CLI is no longer under active development.
- [judgment judges CLI Reference | Judgment Docs](/cli-reference/judges): Command reference for `judgment judges`, used to view and manage judges and online evaluation settings in Judgment CLI workflows.
- [judgment login CLI Reference | Judgment Docs](/cli-reference/login): Command reference for `judgment login`, used to authenticate the Judgment CLI in Judgment CLI workflows.
- [judgment logout CLI Reference | Judgment Docs](/cli-reference/logout): Command reference for `judgment logout`, used to remove stored credentials in Judgment CLI workflows.
- [judgment organizations CLI Reference | Judgment Docs](/cli-reference/organizations): Command reference for `judgment organizations`, used to list and inspect organizations in Judgment CLI workflows.
- [judgment projects CLI Reference | Judgment Docs](/cli-reference/projects): Command reference for `judgment projects`, used to manage projects in Judgment CLI workflows.
- [judgment prompts CLI Reference | Judgment Docs](/cli-reference/prompts): Command reference for `judgment prompts`, used to fetch, commit, and tag versioned prompts in Judgment CLI workflows.
- [judgment sessions CLI Reference | Judgment Docs](/cli-reference/sessions): Command reference for `judgment sessions`, used to search and inspect agent sessions in Judgment CLI workflows.
- [judgment status CLI Reference | Judgment Docs](/cli-reference/status): Command reference for `judgment status`, used to show authentication and project status in Judgment CLI workflows.
- [judgment traces CLI Reference | Judgment Docs](/cli-reference/traces): Command reference for `judgment traces`, used to search, inspect, tag, and re-evaluate traces in Judgment CLI workflows.

## documentation

- [Coding Agent Setup Docs | Install Judgment in AI Coding Assistants](/documentation/agent-rules): Install Judgment in AI coding assistants so they can use traces, judges, and docs during agent debugging workflows.
- [Deprecated Judgment CLI | Legacy Documentation](/documentation/cli): The Judgment CLI is deprecated and no longer under active development. Legacy documentation remains available for existing users.
- [Judgment Labs Docs | Agent Evaluation, Tracing, MCP, SDK, and CLI](/documentation): Documentation for Judgment Labs: trace production AI agents, monitor behavior, build Agent Judges, run evaluations, and use the CLI, SDK, and MCP server.
- [Judgment Labs MCP Server Docs | Query Agent Traces](/documentation/mcp-server): Use the Judgment Labs MCP server to query traces, inspect behaviors, run judges, and debug production AI agents from MCP clients.
- [Agent Judges Docs | LLM-Based Evaluation with Natural Language Rubrics](/documentation/evaluation/agent-judges): Define Agent Judges with natural language rubrics to evaluate AI agent behavior. Create, version, and deploy LLM-as-a-judge scorers in Judgment.
- [Code Judges Docs | Evaluate Agent Behavior with Custom Scorers](/documentation/evaluation/custom-scorers): Use Code Judges to evaluate agent behavior with custom code, deterministic checks, and LLM-based scoring in Judgment.
- [Evaluation Datasets Docs | Build Datasets from Agent Traces](/documentation/evaluation/datasets): Create datasets in Judgment to group examples and traces for scalable agent evaluation and regression testing.
- [Agent Evaluation Judges Docs | Track AI Agent Regressions](/documentation/evaluation/introduction): Learn how Judgment judges evaluate production agent behavior and track regressions across traces, examples, and workflows.
- [Offline Testing Docs | Catch AI Agent Regressions Before Rollout](/documentation/evaluation/offline-testing): Use offline testing in Judgment to evaluate datasets before shipping model, prompt, tool, or workflow changes.
- [Judgment Integrations Docs | Trace AI Agents Across Frameworks and Providers](/documentation/integrations/introduction): Connect Judgment with agent frameworks, model providers, tracing providers, and application instrumentation for production AI monitoring.
- [Judgment Agent Docs | Investigate Traces, Judges, and Agent Behavior](/documentation/judgment-agent): Use Judgment Agent to investigate traces, sharpen judges, debug behaviors, and reason over production agent evals.
- [Agent Behavior Monitoring Docs | Monitor Production AI Agents](/documentation/performance/agent-behavior-monitoring): Monitor production AI agent behavior in Judgment and trigger checks for regressions, failure modes, and behavior changes.
- [Automations and Alerts Docs | Act on AI Agent Misbehavior](/documentation/performance/automations-and-alerts): Set up Judgment automations and alerts to notify teams or trigger actions when production agents misbehave.
- [Agent Behaviors Docs | Tag and Analyze Production Agent Traces](/documentation/performance/behaviors): Use behaviors in Judgment to tag traces, discover recurring failure patterns, and monitor production agent quality.
- [AI Agent Tracing Docs | Track Tool Calls, Spans, and Behavior](/documentation/performance/tracing): Trace AI agent executions in Judgment to capture tool calls, model calls, spans, and runtime behavior for monitoring and evaluation.
- [Claude Agent SDK Tracing with Judgment | Agent Framework Integration Docs](/documentation/integrations/agent-frameworks/claude-agent-sdk): Trace Claude Agent SDK agent executions with Judgment, including tool calls, handoffs, spans, and behavior for production agent monitoring.
- [Google ADK Tracing with Judgment | Agent Framework Integration Docs](/documentation/integrations/agent-frameworks/google-adk): Trace Google ADK agent executions with Judgment, including tool calls, handoffs, spans, and behavior for production agent monitoring.
- [LangGraph Tracing with Judgment | Agent Framework Integration Docs](/documentation/integrations/agent-frameworks/langgraph): Trace LangGraph agent executions with Judgment, including tool calls, handoffs, spans, and behavior for production agent monitoring.
- [LiveKit Tracing with Judgment | Agent Framework Integration Docs](/documentation/integrations/agent-frameworks/livekit): Trace LiveKit agent executions with Judgment, including tool calls, handoffs, spans, and behavior for production agent monitoring.
- [OpenAI Agents SDK Tracing with Judgment | Agent Framework Integration Docs](/documentation/integrations/agent-frameworks/openai-agents): Trace OpenAI Agents SDK agent executions with Judgment, including tool calls, handoffs, spans, and behavior for production agent monitoring.
- [OpenClaw Tracing with Judgment | Agent Framework Integration Docs](/documentation/integrations/agent-frameworks/openclaw): Trace OpenClaw agent executions with Judgment, including tool calls, handoffs, spans, and behavior for production agent monitoring.
- [Pipecat Tracing with Judgment | Agent Framework Integration Docs](/documentation/integrations/agent-frameworks/pipecat): Trace Pipecat agent executions with Judgment, including tool calls, handoffs, spans, and behavior for production agent monitoring.
- [Vercel AI SDK Tracing with Judgment | Agent Framework Integration Docs](/documentation/integrations/agent-frameworks/vercel-ai-sdk): Trace Vercel AI SDK agent executions with Judgment, including tool calls, handoffs, spans, and behavior for production agent monitoring.
- [Anthropic Integration with Judgment | Model Provider Docs](/documentation/integrations/model-providers/anthropic): Use Judgment with Anthropic to capture model calls, trace agent behavior, and evaluate production AI systems.
- [AWS Bedrock Integration with Judgment | Model Provider Docs](/documentation/integrations/model-providers/aws_bedrock): Use Judgment with AWS Bedrock to capture model calls, trace agent behavior, and evaluate production AI systems.
- [Google Integration with Judgment | Model Provider Docs](/documentation/integrations/model-providers/google): Use Judgment with Google to capture model calls, trace agent behavior, and evaluate production AI systems.
- [Groq Integration with Judgment | Model Provider Docs](/documentation/integrations/model-providers/groq): Use Judgment with Groq to capture model calls, trace agent behavior, and evaluate production AI systems.
- [HuggingFace Integration with Judgment | Model Provider Docs](/documentation/integrations/model-providers/huggingface): Use Judgment with HuggingFace to capture model calls, trace agent behavior, and evaluate production AI systems.
- [LiteLLM Integration with Judgment | Model Provider Docs](/documentation/integrations/model-providers/litellm): Use Judgment with LiteLLM to capture model calls, trace agent behavior, and evaluate production AI systems.
- [Ollama Integration with Judgment | Model Provider Docs](/documentation/integrations/model-providers/ollama): Use Judgment with Ollama to capture model calls, trace agent behavior, and evaluate production AI systems.
- [OpenAI Integration with Judgment | Model Provider Docs](/documentation/integrations/model-providers/openai): Use Judgment with OpenAI to capture model calls, trace agent behavior, and evaluate production AI systems.
- [OpenRouter Integration with Judgment | Model Provider Docs](/documentation/integrations/model-providers/openrouter): Use Judgment with OpenRouter to capture model calls, trace agent behavior, and evaluate production AI systems.
- [Together AI Integration with Judgment | Model Provider Docs](/documentation/integrations/model-providers/together_ai): Use Judgment with Together AI to capture model calls, trace agent behavior, and evaluate production AI systems.
- [Vertex AI Integration with Judgment | Model Provider Docs](/documentation/integrations/model-providers/vertexai): Use Judgment with Vertex AI to capture model calls, trace agent behavior, and evaluate production AI systems.
- [AIOHTTP Client Tracing with Judgment | Integration Docs](/documentation/integrations/other/aiohttp-client): Trace AIOHTTP Client spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [AIOHTTP Server Tracing with Judgment | Integration Docs](/documentation/integrations/other/aiohttp-server): Trace AIOHTTP Server spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [ASGI Tracing with Judgment | Integration Docs](/documentation/integrations/other/asgi): Trace ASGI spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [Asyncpg Tracing with Judgment | Integration Docs](/documentation/integrations/other/asyncpg): Trace Asyncpg spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [AWS Lambda Tracing with Judgment | Integration Docs](/documentation/integrations/other/aws-lambda): Trace AWS Lambda spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [Celery Tracing with Judgment | Integration Docs](/documentation/integrations/other/celery): Trace Celery spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [Django Tracing with Judgment | Integration Docs](/documentation/integrations/other/django): Trace Django spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [FastAPI Tracing with Judgment | Integration Docs](/documentation/integrations/other/fastapi): Trace FastAPI spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [Flask Tracing with Judgment | Integration Docs](/documentation/integrations/other/flask): Trace Flask spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [HTTPX Tracing with Judgment | Integration Docs](/documentation/integrations/other/httpx): Trace HTTPX spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [MySQL Tracing with Judgment | Integration Docs](/documentation/integrations/other/mysql): Trace MySQL spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [Psycopg Tracing with Judgment | Integration Docs](/documentation/integrations/other/psycopg): Trace Psycopg spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [PyMongo Tracing with Judgment | Integration Docs](/documentation/integrations/other/pymongo): Trace PyMongo spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [Redis Tracing with Judgment | Integration Docs](/documentation/integrations/other/redis): Trace Redis spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [Requests Tracing with Judgment | Integration Docs](/documentation/integrations/other/requests): Trace Requests spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [SQLAlchemy Tracing with Judgment | Integration Docs](/documentation/integrations/other/sqlalchemy): Trace SQLAlchemy spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [SQLite3 Tracing with Judgment | Integration Docs](/documentation/integrations/other/sqlite3): Trace SQLite3 spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [Starlette Tracing with Judgment | Integration Docs](/documentation/integrations/other/starlette): Trace Starlette spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [Temporal Tracing with Judgment | Integration Docs](/documentation/integrations/other/temporal): Trace Temporal spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [WSGI Tracing with Judgment | Integration Docs](/documentation/integrations/other/wsgi): Trace WSGI spans with Judgment to connect application behavior to production AI agent monitoring and evaluation.
- [Direct OTEL Trace Export to Judgment | Integration Docs](/documentation/integrations/tracing-providers/direct-otel): Export Direct OTEL traces to Judgment so teams can inspect agent behavior, run judges, and monitor production regressions.
- [Dual Export Trace Export to Judgment | Integration Docs](/documentation/integrations/tracing-providers/dual-export): Export Dual Export traces to Judgment so teams can inspect agent behavior, run judges, and monitor production regressions.
- [OpenInference Trace Export to Judgment | Integration Docs](/documentation/integrations/tracing-providers/openinference): Export OpenInference traces to Judgment so teams can inspect agent behavior, run judges, and monitor production regressions.
- [OpenLit Trace Export to Judgment | Integration Docs](/documentation/integrations/tracing-providers/openlit): Export OpenLit traces to Judgment so teams can inspect agent behavior, run judges, and monitor production regressions.
- [OpenLLMetry Trace Export to Judgment | Integration Docs](/documentation/integrations/tracing-providers/openllmetry): Export OpenLLMetry traces to Judgment so teams can inspect agent behavior, run judges, and monitor production regressions.

## sdk-reference

- [Judgeval SDK Reference | Python and TypeScript APIs for Judgment](/sdk-reference): Reference for the Judgeval SDK APIs used to send traces, run evaluations, manage datasets, and work with judges in Judgment.
- [Judge Python API Reference | Judgeval SDK Docs](/sdk-reference/python/judges): Python API reference for `Judge` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Judgeval Python API Reference | Judgeval SDK Docs](/sdk-reference/python/judgeval): Python API reference for `Judgeval` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [AgentJudgeFactory TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/agent-judge-factory): TypeScript API reference for `AgentJudgeFactory` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [AgentJudge TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/agent-judge): TypeScript API reference for `AgentJudge` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [AsyncEvaluateOptions TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/async-evaluate-options): TypeScript API reference for `AsyncEvaluateOptions` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [BaseResponse TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/base-response): TypeScript API reference for `BaseResponse` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [BinaryResponse TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/binary-response): TypeScript API reference for `BinaryResponse` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [CategoricalResponse TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/categorical-response): TypeScript API reference for `CategoricalResponse` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Citation TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/citation): TypeScript API reference for `Citation` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [DatasetFactory TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/dataset-factory): TypeScript API reference for `DatasetFactory` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [DatasetInfo TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/dataset-info): TypeScript API reference for `DatasetInfo` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [DatasetSchemaProperty TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/dataset-schema-property): TypeScript API reference for `DatasetSchemaProperty` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [DatasetSchema TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/dataset-schema): TypeScript API reference for `DatasetSchema` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Dataset TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/dataset): TypeScript API reference for `Dataset` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [EvaluationFactory TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/evaluation-factory): TypeScript API reference for `EvaluationFactory` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [EvaluationRunOptions TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/evaluation-run-options): TypeScript API reference for `EvaluationRunOptions` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Evaluation TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/evaluation): TypeScript API reference for `Evaluation` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [EvaluatorRunner TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/evaluator-runner): TypeScript API reference for `EvaluatorRunner` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Example TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/example): TypeScript API reference for `Example` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [ExperimentScorer TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/experiment-scorer): TypeScript API reference for `ExperimentScorer` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [HostedEvaluatorRunner TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/hosted-evaluator-runner): TypeScript API reference for `HostedEvaluatorRunner` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Judgeval TypeScript SDK Reference | APIs for Tracing and Evaluation](/sdk-reference/typescript): TypeScript API reference for the Judgeval SDK, used for tracing, datasets, evaluations, judges, and production agent monitoring.
- [JudgeVersionPin TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/judge-version-pin): TypeScript API reference for `JudgeVersionPin` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Judge TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/judge): TypeScript API reference for `Judge` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [JudgevalConfig TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/judgeval-config): TypeScript API reference for `JudgevalConfig` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Judgeval TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/judgeval): TypeScript API reference for `Judgeval` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [JudgmentBaggageSpanProcessor TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/judgment-baggage-span-processor): TypeScript API reference for `JudgmentBaggageSpanProcessor` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [JudgmentSpanExporter TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/judgment-span-exporter): TypeScript API reference for `JudgmentSpanExporter` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [JudgmentSpanProcessor TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/judgment-span-processor): TypeScript API reference for `JudgmentSpanProcessor` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [JudgmentTracerProvider TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/judgment-tracer-provider): TypeScript API reference for `JudgmentTracerProvider` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [LLMMetadata TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/llm-metadata): TypeScript API reference for `LLMMetadata` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [LocalEvaluatorRunner TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/local-evaluator-runner): TypeScript API reference for `LocalEvaluatorRunner` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [NoOpSpanExporter TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/no-op-span-exporter): TypeScript API reference for `NoOpSpanExporter` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [NoOpSpanProcessor TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/no-op-span-processor): TypeScript API reference for `NoOpSpanProcessor` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [NumericResponse TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/numeric-response): TypeScript API reference for `NumericResponse` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [ObserveOptions TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/observe-options): TypeScript API reference for `ObserveOptions` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [OfflineExampleResult TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/offline-example-result): TypeScript API reference for `OfflineExampleResult` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [OfflineJudgmentSpanProcessor TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/offline-judgment-span-processor): TypeScript API reference for `OfflineJudgmentSpanProcessor` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [OfflineRunOptions TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/offline-run-options): TypeScript API reference for `OfflineRunOptions` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [OfflineScorerData TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/offline-scorer-data): TypeScript API reference for `OfflineScorerData` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [OfflineTestResult TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/offline-test-result): TypeScript API reference for `OfflineTestResult` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [OfflineTestRunner TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/offline-test-runner): TypeScript API reference for `OfflineTestRunner` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [OfflineTestsFactory TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/offline-tests-factory): TypeScript API reference for `OfflineTestsFactory` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [OfflineTracerConfig TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/offline-tracer-config): TypeScript API reference for `OfflineTracerConfig` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [OfflineTracer TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/offline-tracer): TypeScript API reference for `OfflineTracer` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [ScoringResult TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/scoring-result): TypeScript API reference for `ScoringResult` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [TestConfig TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/test-config): TypeScript API reference for `TestConfig` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [TracerConfig TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/tracer-config): TypeScript API reference for `TracerConfig` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Tracer TypeScript API Reference | Judgeval SDK Docs](/sdk-reference/typescript/tracer): TypeScript API reference for `Tracer` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [AgentJudge Python API Reference | Judgeval SDK Docs](/sdk-reference/python/agent_judges/agent_judge): Python API reference for `AgentJudge` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [AgentJudgeFactory Python API Reference | Judgeval SDK Docs](/sdk-reference/python/agent_judges/agent_judge_factory): Python API reference for `AgentJudgeFactory` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Example Python API Reference | Judgeval SDK Docs](/sdk-reference/python/data/example): Python API reference for `Example` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [ScorerData Python API Reference | Judgeval SDK Docs](/sdk-reference/python/data/scorer_data): Python API reference for `ScorerData` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [ScoringResult Python API Reference | Judgeval SDK Docs](/sdk-reference/python/data/scoring_result): Python API reference for `ScoringResult` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Trace Python API Reference | Judgeval SDK Docs](/sdk-reference/python/data/trace): Python API reference for `Trace` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Evaluation Python API Reference | Judgeval SDK Docs](/sdk-reference/python/evaluation/evaluation): Python API reference for `Evaluation` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Evaluation Base Python API Reference | Judgeval SDK Docs](/sdk-reference/python/evaluation/evaluation_base): Python API reference for `Evaluation Base` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [EvaluationFactory Python API Reference | Judgeval SDK Docs](/sdk-reference/python/evaluation/evaluation_factory): Python API reference for `EvaluationFactory` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Hosted Evaluation Python API Reference | Judgeval SDK Docs](/sdk-reference/python/evaluation/hosted_evaluation): Python API reference for `Hosted Evaluation` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Local Evaluation Python API Reference | Judgeval SDK Docs](/sdk-reference/python/evaluation/local_evaluation): Python API reference for `Local Evaluation` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [ExampleCustomScorer Python API Reference | Judgeval SDK Docs](/sdk-reference/python/hosted/example_custom_scorer): Python API reference for `ExampleCustomScorer` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Trace Custom Scorer Python API Reference | Judgeval SDK Docs](/sdk-reference/python/hosted/trace_custom_scorer): Python API reference for `Trace Custom Scorer` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Claude Agent SDK Python API Reference | Judgeval SDK Docs](/sdk-reference/python/integrations/claude_agent_sdk): Python API reference for `Claude Agent SDK` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [LangGraph Python API Reference | Judgeval SDK Docs](/sdk-reference/python/integrations/langgraph): Python API reference for `LangGraph` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Openlit Python API Reference | Judgeval SDK Docs](/sdk-reference/python/integrations/openlit): Python API reference for `Openlit` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Offline Tests Factory Python API Reference | Judgeval SDK Docs](/sdk-reference/python/offline_tests/offline_tests_factory): Python API reference for `Offline Tests Factory` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Prompt Python API Reference | Judgeval SDK Docs](/sdk-reference/python/prompts/prompt): Python API reference for `Prompt` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [PromptFactory Python API Reference | Judgeval SDK Docs](/sdk-reference/python/prompts/prompt_factory): Python API reference for `PromptFactory` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [LinkedTraceSpans Python API Reference | Judgeval SDK Docs](/sdk-reference/python/trace/internal): Python API reference for `LinkedTraceSpans` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [OfflineTracer](/sdk-reference/python/trace/offline_tracer): Tracer for offline / experiment-style runs.
- [Propagation](/sdk-reference/python/trace/propagation)
- [Tracer](/sdk-reference/python/trace/tracer): Capture execution traces and LLM performance metrics for your application.
- [Dataset Python API Reference | Judgeval SDK Docs](/sdk-reference/python/datasets/dataset/Dataset): Python API reference for `Dataset` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [DatasetInfo Python API Reference | Judgeval SDK Docs](/sdk-reference/python/datasets/dataset/DatasetInfo): Python API reference for `DatasetInfo` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [DatasetVersion Python API Reference | Judgeval SDK Docs](/sdk-reference/python/datasets/dataset/DatasetVersion): Python API reference for `DatasetVersion` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Dataset Python API Reference | Judgeval SDK Docs](/sdk-reference/python/datasets/dataset): Python API reference for `Dataset` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [DatasetFactory Python API Reference | Judgeval SDK Docs](/sdk-reference/python/datasets/dataset_factory/DatasetFactory): Python API reference for `DatasetFactory` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [DatasetSchema Python API Reference | Judgeval SDK Docs](/sdk-reference/python/datasets/dataset_factory/DatasetSchema): Python API reference for `DatasetSchema` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [DatasetSchemaProperty Python API Reference | Judgeval SDK Docs](/sdk-reference/python/datasets/dataset_factory/DatasetSchemaProperty): Python API reference for `DatasetSchemaProperty` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Dataset Factory Python API Reference | Judgeval SDK Docs](/sdk-reference/python/datasets/dataset_factory): Python API reference for `Dataset Factory` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [BaseResponse Python API Reference | Judgeval SDK Docs](/sdk-reference/python/hosted/responses/BaseResponse): Python API reference for `BaseResponse` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [BinaryResponse Python API Reference | Judgeval SDK Docs](/sdk-reference/python/hosted/responses/BinaryResponse): Python API reference for `BinaryResponse` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [CategoricalResponse Python API Reference | Judgeval SDK Docs](/sdk-reference/python/hosted/responses/CategoricalResponse): Python API reference for `CategoricalResponse` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Category Python API Reference | Judgeval SDK Docs](/sdk-reference/python/hosted/responses/Category): Python API reference for `Category` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Citation Python API Reference | Judgeval SDK Docs](/sdk-reference/python/hosted/responses/Citation): Python API reference for `Citation` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [NumericResponse Python API Reference | Judgeval SDK Docs](/sdk-reference/python/hosted/responses/NumericResponse): Python API reference for `NumericResponse` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Responses Python API Reference | Judgeval SDK Docs](/sdk-reference/python/hosted/responses): Python API reference for `Responses` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [JudgeVersionPin Python API Reference | Judgeval SDK Docs](/sdk-reference/python/offline_tests/offline_test_runner/JudgeVersionPin): Python API reference for `JudgeVersionPin` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [OfflineTestRunner Python API Reference | Judgeval SDK Docs](/sdk-reference/python/offline_tests/offline_test_runner/OfflineTestRunner): Python API reference for `OfflineTestRunner` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Offline Test Runner Python API Reference | Judgeval SDK Docs](/sdk-reference/python/offline_tests/offline_test_runner): Python API reference for `Offline Test Runner` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [OfflineTestResult Python API Reference | Judgeval SDK Docs](/sdk-reference/python/offline_tests/types/OfflineTestResult): Python API reference for `OfflineTestResult` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [TestConfig Python API Reference | Judgeval SDK Docs](/sdk-reference/python/offline_tests/types/TestConfig): Python API reference for `TestConfig` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [Baggage Python API Reference | Judgeval SDK Docs](/sdk-reference/python/trace/baggage): Python API reference for `Baggage` in the Judgeval SDK, used with Judgment traces, evaluations, datasets, judges, or monitoring workflows.
- [JudgmentBaggagePropagator Python API Reference | Judgeval SDK Docs](/sdk-reference/python/trace/baggage/propagator): Python API reference for `J