Shows the logo of agenta

The Open-source LLMOps Platform

Build reliable LLM applications with prompt management, evaluation, and observability.

Agenta platform walkthrough
---

DocumentationWebsiteAgenta Cloud

---

MIT license. Doc PRs welcome Contributors PyPI - Downloads Last Commit

Try Agenta Live Demo

--- ## What is Agenta? Agenta is a platform for building production-grade LLM applications. It helps **engineering** and **product teams** create reliable LLM apps faster through integrated prompt management, evaluation, and observability. ## Core Features ### ๐Ÿงช Prompt Management & Prompt Engineering Collaborate with Subject Matter Experts (SMEs) on prompt engineering and make sure nothing breaks in production. - **Interactive LLM Playground**: Compare prompts side by side against your test cases - **Multi-Model Support**: Experiment with 50+ LLM models or [bring-your-own models](https://agenta.ai/docs/prompt-engineering/playground/custom-providers?utm_source=github&utm_medium=referral&utm_campaign=readme) - **Version Control**: Version prompts and configurations with branching and environments - **Complex Configurations**: Enable SMEs to collaborate on [complex configuration schemas](https://agenta.ai/docs/custom-workflows/overview?utm_source=github&utm_medium=referral&utm_campaign=readme) beyond simple prompts [Explore prompt management โ†’](https://agenta.ai/docs/prompt-engineering/concepts?utm_source=github&utm_medium=referral&utm_campaign=readme) ### ๐Ÿ“Š LLM Evaluation Evaluate your LLM applications systematically with both human and automated feedback. - **Flexible Testsets**: Create testcases from production data, playground experiments, or upload CSVs - **Pre-built and Custom Evaluators**: Use LLM-as-judge, one of our 20+ pre-built evaluators, or your custom evaluators - **UI and API Access**: Run evaluations via UI (for SMEs) or programmatically (for engineers) - **Human Feedback Integration**: Collect and incorporate expert annotations [Explore evaluation frameworks โ†’](https://agenta.ai/docs/evaluation/overview?utm_source=github&utm_medium=referral&utm_campaign=readme) ### ๐Ÿ“ก LLM Observability Get visibility into your LLM applications in production. - **Cost & Performance Tracking**: Monitor spending, latency, and usage patterns - **LLM Tracing**: Debug complex workflows with detailed traces - **Open Standards**: OpenTelemetry native tracing compatible with OpenLLMetry, and OpenInference - **Integrations**: Comes with pre-built integrations for most models and frameworks [Learn about observability โ†’](https://agenta.ai/docs/observability/overview?utm_source=github&utm_medium=referral&utm_campaign=readme) ## ๐Ÿ“ธ Screenshots Playground Prompt Management Evaluation Observability ## ๐Ÿš€ Getting Started ### Agenta Cloud (Recommended): The easiest way to get started is through Agenta Cloud. Free tier available with no credit card required.

Try Agenta Live Demo

### Self-hosting Agenta 1. Clone Agenta: ```bash git clone https://github.com/Agenta-AI/agenta && cd agenta ``` 2. Copy configuration: Before starting the services, create the environment file from the example: ```bash cp hosting/docker-compose/oss/env.oss.gh.example hosting/docker-compose/oss/.env.oss.gh ``` 3. Start Agenta services: ```bash docker compose -f hosting/docker-compose/oss/docker-compose.gh.yml --env-file hosting/docker-compose/oss/.env.oss.gh --profile with-web --profile with-traefik up -d ``` 4. Access Agenta at `http://localhost`. For deploying on a remote host, or using different ports refer to our [self-hosting](https://agenta.ai/docs/self-host/quick-start?utm_source=github&utm_medium=referral&utm_campaign=readme) and [remote deployment documentation](https://agenta.ai/docs/self-host/guides/deploy-remotely?utm_source=github&utm_medium=referral&utm_campaign=readme). ## ๐Ÿ’ฌ Community Find help, explore resources, or get involved: ### ๐Ÿงฐ Support - **๐Ÿ“š [Documentation](https://agenta.ai/docs/?utm_source=github&utm_medium=referral&utm_campaign=readme)** โ€“ Full guides and API reference - **๐Ÿ“‹ [Changelog](https://agenta.ai/docs/changelog?utm_source=github&utm_medium=referral&utm_campaign=readme)** โ€“ Track recent updates - **๐Ÿ’ฌ [Slack Community](https://join.slack.com/t/agenta-hq/shared_invite/zt-37pnbp5s6-mbBrPL863d_oLB61GSNFjw)** โ€“ Ask questions and get support ### ๐Ÿค Contribute We welcome contributions of all kinds, from filing issues and sharing ideas to improving the codebase. Check out our [CONTRIBUTING.md](CONTRIBUTING.md) and: - **๐Ÿ› [Report bugs](https://github.com/Agenta-AI/agenta/issues)** โ€“ Help us by reporting problems you encounter - **๐Ÿ’ก [Share ideas and feedback](https://github.com/Agenta-AI/agenta/discussions)** โ€“ Suggest features or vote on ideas - **๐Ÿ”ง [Contribute to the codebase](https://agenta.ai/docs/contributing/overview?utm_source=github&utm_medium=referral&utm_campaign=readme)** โ€“ Read the guide and open a pull request ## โญ Star Agenta **Consider giving us a star!** It helps us grow our community and gets Agenta in front of more developers.

Star us

## Contributors โœจ [![All Contributors](https://img.shields.io/badge/all_contributors-68-orange.svg?style=flat-square)](#contributors-) Thanks goes to these wonderful people ([emoji key](https://allcontributors.org/docs/en/emoji-key)):
Sameh Methnani
Sameh Methnani

๐Ÿ’ป ๐Ÿ“–
Suad Suljovic
Suad Suljovic

๐Ÿ’ป ๐ŸŽจ ๐Ÿง‘โ€๐Ÿซ ๐Ÿ‘€
burtenshaw
burtenshaw

๐Ÿ’ป
Abram
Abram

๐Ÿ’ป ๐Ÿ“–
Israel Abebe
Israel Abebe

๐Ÿ› ๐ŸŽจ ๐Ÿ’ป
Master X
Master X

๐Ÿ’ป
corinthian
corinthian

๐Ÿ’ป ๐ŸŽจ
Pavle Janjusevic
Pavle Janjusevic

๐Ÿš‡
Kaosi Ezealigo
Kaosi Ezealigo

๐Ÿ› ๐Ÿ’ป
Alberto Nunes
Alberto Nunes

๐Ÿ›
Maaz Bin Khawar
Maaz Bin Khawar

๐Ÿ’ป ๐Ÿ‘€ ๐Ÿง‘โ€๐Ÿซ
Nehemiah Onyekachukwu Emmanuel
Nehemiah Onyekachukwu Emmanuel

๐Ÿ’ป ๐Ÿ’ก ๐Ÿ“–
Philip Okiokio
Philip Okiokio

๐Ÿ“–
Abhinav Pandey
Abhinav Pandey

๐Ÿ’ป
Ramchandra Warang
Ramchandra Warang

๐Ÿ’ป ๐Ÿ›
Biswarghya Biswas
Biswarghya Biswas

๐Ÿ’ป
Uddeepta Raaj Kashyap
Uddeepta Raaj Kashyap

๐Ÿ’ป
Nayeem Abdullah
Nayeem Abdullah

๐Ÿ’ป
Kang Suhyun
Kang Suhyun

๐Ÿ’ป
Yoon
Yoon

๐Ÿ’ป
Kirthi Bagrecha Jain
Kirthi Bagrecha Jain

๐Ÿ’ป
Navdeep
Navdeep

๐Ÿ’ป
Rhythm Sharma
Rhythm Sharma

๐Ÿ’ป
Osinachi Chukwujama
Osinachi Chukwujama

๐Ÿ’ป
่Žซๅฐ”็ดข
่Žซๅฐ”็ดข

๐Ÿ“–
Agunbiade Adedeji
Agunbiade Adedeji

๐Ÿ’ป
Emmanuel Oloyede
Emmanuel Oloyede

๐Ÿ’ป ๐Ÿ“–
Dhaneshwarguiyan
Dhaneshwarguiyan

๐Ÿ’ป
Priyanshu Prajapati
Priyanshu Prajapati

๐Ÿ“–
Raviteja
Raviteja

๐Ÿ’ป
Arijit
Arijit

๐Ÿ’ป
Yachika9925
Yachika9925

๐Ÿ“–
Aldrin
Aldrin

โš ๏ธ
seungduk.kim.2304
seungduk.kim.2304

๐Ÿ’ป
Andrei Dragomir
Andrei Dragomir

๐Ÿ’ป
diego
diego

๐Ÿ’ป
brockWith
brockWith

๐Ÿ’ป
Dennis Zelada
Dennis Zelada

๐Ÿ’ป
Romain Brucker
Romain Brucker

๐Ÿ’ป
Heon Heo
Heon Heo

๐Ÿ’ป
Drew Reisner
Drew Reisner

๐Ÿ’ป
Ikko Eltociear Ashimine
Ikko Eltociear Ashimine

๐Ÿ“–
Vishal Vanpariya
Vishal Vanpariya

๐Ÿ’ป
Youcef Boumar
Youcef Boumar

๐Ÿ“–
LucasTrg
LucasTrg

๐Ÿ’ป ๐Ÿ›
Ashraf Chowdury
Ashraf Chowdury

๐Ÿ› ๐Ÿ’ป
jp-agenta
jp-agenta

๐Ÿ’ป ๐Ÿ›
Mr Unhappy
Mr Unhappy

๐Ÿ› ๐Ÿš‡
Moreno Bonaventura
Moreno Bonaventura

๐Ÿ›
Yoshiki Ozaki
Yoshiki Ozaki

๐Ÿ›
ahmed-agenta
ahmed-agenta

๐ŸŽจ
Vahant Sharma
Vahant Sharma

๐Ÿ“–
Muhammad Muzammil
Muhammad Muzammil

๐Ÿ’ป
Sirous Namjoo
Sirous Namjoo

๐Ÿ“– ๐Ÿ’ก
adityadewan22-hub
adityadewan22-hub

๐Ÿ’ป
lif
lif

๐Ÿ’ป
karim kohel
karim kohel

๐Ÿ’ก ๐Ÿ“–
Vishesh Paliwal
Vishesh Paliwal

๐Ÿ’ป
Eve
Eve

๐Ÿ’ป
Endoze
Endoze

๐Ÿš‡ ๐Ÿ“–
Ansh Kakkar
Ansh Kakkar

๐Ÿ›
Devarsh Prajapati
Devarsh Prajapati

๐Ÿ›
AxelRay
AxelRay

๐Ÿ“ฆ ๐Ÿ“–
Sanket Shakya
Sanket Shakya

๐Ÿ’ป ๐Ÿ“ฆ ๐Ÿ“–
unfitcoder101
unfitcoder101

๐Ÿ›
Shunmuka Valsa
Shunmuka Valsa

๐Ÿ’ป ๐Ÿ“ฆ
Hแป“ Trung Nam
Hแป“ Trung Nam

๐Ÿ’ป
Koushik-Salammagari
Koushik-Salammagari

๐Ÿ›
This project follows the [all-contributors](https://github.com/all-contributors/all-contributors) specification. Contributions of any kind are welcome! ## Disabling Anonymized Tracking By default, Agenta automatically reports anonymized basic usage statistics. This helps us understand how Agenta is used and track its overall usage and growth. This data does not include any sensitive information. To disable anonymized telemetry set `AGENTA_TELEMETRY_ENABLED` to `false` in your `.env` file.