specification: API Evangelist Vocabulary specificationVersion: '0.1' provider: Galileo providerId: galileo-ai created: '2026-05-25' modified: '2026-05-25' description: >- Vocabulary mapping of Galileo's operational and capability dimensions across the evaluation, observability, and guardrail surface of the platform. tags: - AI Evaluation - AI Observability - GenAI - Guardrails - Agentic AI - LLM domains: - name: Evaluation terms: - Evaluator - Metric - Luna Model - LLM-as-Judge - Score - Ground Truth - Custom Metric - Built-in Metric - name: Observability terms: - Trace - Span - LLM Span - Workflow Span - Retriever Span - Tool Span - Log Stream - Session - name: Experimentation terms: - Experiment - Runner - Dataset - Dataset Row - Prompt Template - Variant - name: Protect terms: - Guardrail - Policy - Rule - Block - Rewrite - Allow - name: Access Control terms: - User - Group - Group Role - API Key - Project - Workspace - name: Integrations terms: - OpenAI - LangChain - CrewAI - OpenAI Agents - OpenTelemetry - OpenInference - MCP - Anthropic verbs: - list - create - get - update - delete - search - query - download - evaluate - log - protect - annotate resources: - projects - datasets - dataset_content - experiments - traces - spans - log_streams - prompts - annotation_templates - annotation_ratings - groups - group_roles - integrations - api_keys - users maintainers: - FN: Kin Lane email: kin@apievangelist.com