# Agents Towards Production
### _The open-source playbook for turning AI agents into real-world products._
**Agents Towards Production is your go‑to resource for building production‑ready GenAI agents that scale from prototype to enterprise.** Tutorials cover stateful workflows, vector memory, real‑time web search APIs, Docker deployment, FastAPI endpoints, security guardrails, GPU scaling, browser automation, fine‑tuning, multi‑agent coordination, observability, evaluation, and UI development.
### ⭐ **If you find value in this project, PLEASE STAR IT to help others discover these tutorials!**
[](https://www.linkedin.com/in/nir-diamant-759323134/)
[](https://twitter.com/NirDiamantAI)
[](https://discord.gg/cA6Aa4uyDX)
[](https://github.com/sponsors/NirDiamant)
[](https://europe-west1-atp-views-tracker.cloudfunctions.net/working-analytics?notebook=main-readme--hiring-badge&click=top-badge-hiring&target=https%3A%2F%2Fdiamant-ai.com%2Fjobs&text=Hiring%20Badge)
---
## 📖 From the Same Author
**[RAG Made Simple](https://europe-west1-rag-techniques-views-tracker.cloudfunctions.net/rag-techniques-tracker?notebook=agents-towards-production--readme&click=book-buy-amazon-title&target=https%3A%2F%2Fwww.amazon.com%2Fdp%2FB0D76734SZ%3Ftag%3Ddiamantai-atp-20&text=RAG%20Made%20Simple)** — **#1 Best Seller on Amazon in Generative AI.**
22 RAG techniques with intuition, comparisons, and illustrations. **Free with Kindle Unlimited** or **$0.99** launch price (goes up soon).
### 👉 [**Get the book on Amazon**](https://europe-west1-rag-techniques-views-tracker.cloudfunctions.net/rag-techniques-tracker?notebook=agents-towards-production--readme&click=book-buy-amazon-cta&target=https%3A%2F%2Fwww.amazon.com%2Fdp%2FB0D76734SZ%3Ftag%3Ddiamantai-atp-20&text=Get%20the%20book%20on%20Amazon)
## 📫 Stay Updated!
🚀
Cutting-edge
Updates |
💡
Expert
Insights |
🎯
Top 0.1%Content |
[](https://diamantai.substack.com/?r=336pe4&utm_campaign=pub-share-checklist)
_Join over 50,000 AI enthusiasts getting unique cutting-edge insights and free tutorials!_
**_Plus, subscribers get exclusive early access and special 33% discounts to my book and upcoming courses!_**
[](https://diamantai.substack.com/?r=336pe4&utm_campaign=pub-share-checklist)
## 💬 Join Our Community
Stay connected with the latest in GenAI and agent development:
### r/EducationalAI
[](https://www.reddit.com/r/EducationalAI/)
_Join our growing community discussing cutting-edge AI research, agent development, and production insights!_
---
---
## ✨ Introduction
**Agents Towards Production** is your hands-on guide to every building block of a GenAI agent stack.
All knowledge is delivered through runnable tutorials covering orchestration, memory, observability, deployment, security, and more. Each tutorial lives in its own folder with ready-to-run notebooks or code files, so you can move from concept to working agent in minutes.
---
## 🏗️ AI Agent Architecture
*This diagram shows the flow of building a production-level agent. The tutorials in this repository cover each of these components step-by-step.*
---
## 📚 Tutorials
### 🔌 Tool Integration
| Tutorial |
Description |
View |
Secure Tool Calling (Arcade)  |
Enable agents to securely call external tools (Gmail, Slack, Notion) with OAuth2 authentication and human-in-the-loop safety controls. Learn production-ready tool integration with user isolation and approval workflows. |
|
### 📊 Data Processing
| Tutorial |
Description |
View |
| Web Data Collection for AI Agents (Bright Data) |
Build agents that collect and process web data at scale using enterprise-grade scraping infrastructure. Learn to integrate proxy networks, handle CAPTCHAs, and extract structured data from complex websites. |
|
| Real-Time Web Data Integration for Agents (Tavily) |
Enable agents to access, search, and extract real-time web data. Build workflows that combine live web information with private knowledge for research, monitoring, and up-to-date recommendations. |
|
### 🔍 RAG & Knowledge Management
| Tutorial |
Description |
View |
| Production-Ready RAG Agents with Contextual AI (Contextual AI) |
Build enterprise-grade RAG systems in 15 minutes using Contextual AI's managed platform. Learn document processing, intelligent indexing, agent deployment, and automated evaluation with LMUnit testing framework for financial document analysis. |
|
### 🧠 Memory
| Tutorial |
Description |
View |
| Agent Memory: Dual-Memory & Semantic Search (Redis) |
Implement dual-memory (short-term and long-term), semantic search, and persistent state for agents that remember user preferences and learn from conversations. |
|
| Self-Improving Memory with Mem0: Hybrid Vector & Graph Storage |
Build intelligent agents with self-improving memory that automatically extracts insights, resolves conflicts, and evolves with each interaction. Learn hybrid memory architecture combining vector search for semantic recall and graph databases for relationship mapping. |
|
| AI Memory with Cognee |
Build intelligent AI memory systems that learn from Python's creator and improve your development workflow. Transform scattered development data into unified knowledge graphs with contextual insights. |
|
### 🚀 Deployment
| Tutorial |
Description |
View |
| AWS Bedrock AgentCore: Managed Agent Deployment |
Deploy and manage AI agents on AWS Bedrock AgentCore Runtime. Learn to transform local agents into production-ready managed services with automatic infrastructure, request tracking, and standardized communication patterns. |
|
| Containerizing Agents with Docker |
Containerize agents for portability and scalability. Learn foundational patterns for running agents in containers across environments. |
|
| On-Prem LLM Deployment with Ollama |
Run and interact with large language models locally. Replace cloud APIs with on-prem models for privacy, cost control, and low-latency agent workflows. |
|
### 👥 Multi-agent Coordination
| Tutorial |
Description |
View |
| Multi-Agent Communication with A2A Protocol |
Simulate collaborative agent workflows and message exchange using open communication protocols for interoperability. |
|
### 🚀 GPU Deployment
| Tutorial |
Description |
View |
| Scalable GPU Deployment for AI Agents (Runpod) |
Deploy AI agents on scalable GPU infrastructure. Learn to set up cost-effective, high-performance environments for demanding agent workloads. |
|
### 🔒 Security
| Tutorial |
Description |
View |
| Comprehensive Agent Security (LlamaFirewall) |
Apply comprehensive input, output, and tool security guardrails for agents. Covers prompt injection, behavior alignment, and tool access control. |
|
| Hands-On Agent Security Evaluation (Apex) |
Hands-on prompt injection attacks, defenses, and automated security testing for AI agents. |
|
### 👥 Multi-agent Coordination
| Tutorial |
Description |
View |
| Multi-Agent Communication with A2A Protocol |
Simulate collaborative agent workflows and message exchange using open communication protocols for interoperability. |
|
### 🧩 Agent Frameworks
| Tutorial |
Description |
View |
| Tool & API Integration via Model Context Protocol (MCP) |
Integrate agents with external tools and APIs using a standardized protocol. Example: Seamless tool and API integration for advanced agent workflows. |
|
| Stateful Agent Workflows with LangGraph |
Design complex, stateful agent workflows using a directed graph architecture. Example: Multi-step text analysis pipeline with classification, entity extraction, and summarization. |
|
| Deploying Agents as APIs with FastAPI |
Create and deploy agents as performant APIs, supporting both synchronous and streaming endpoints. |
|
| Building AI Agents in Kotlin with Koog |
Build your first AI agent in Kotlin using JetBrains' Koog framework. Step-by-step from hello world to tool calling and structured output in under 30 minutes. |
|
### 🛠️ Model Customization
| Tutorial |
Description |
View |
| Fine-Tuning AI Agents for Domain Expertise & Efficiency |
Learn how to fine-tune language models for specialized agent behavior, domain expertise, and efficient, cost-effective responses. Covers data preparation, training, evaluation, and integration into agent workflows. |
|
### 🔍 Tracing & Debugging
| Tutorial |
Description |
View |
| Agent Tracing & Debugging with LangSmith |
Add comprehensive observability to AI systems. Capture detailed traces, decision points, and timing data to debug, monitor, and systematically improve agent performance. |
|
### 📊 Evaluation
| Tutorial |
Description |
View |
| Automated Agent Evaluation & Behavioral Analysis (IntellAgent) |
Automate agent evaluation with behavioral analysis, performance metrics, and actionable insights for improving agent quality. |
|
### 🖥️ UI & Frontend
| Tutorial |
Description |
View |
| Building a Chatbot UI with Streamlit |
Build a beginner-friendly chatbot web app with a chat interface, file upload, and session state for interactive agent demos. |
|
---
## 🚀 Getting Started
Transform your AI agent ideas into production-ready systems using our battle-tested patterns and implementations.
### 📖 Browse Online
Explore tutorials directly on GitHub to understand production-grade implementations, architectural decisions, and integration patterns. Each tutorial includes comprehensive documentation and code that you can study and adapt to your specific requirements without any local setup.
### 🛠️ Clone and Build
Download the repository to run tutorials locally, experiment with configurations, customize implementations, and integrate proven patterns directly into your agent development workflow.
#### Quick Setup
**1. Get the Code**
```bash
git clone https://github.com/NirDiamant/agents-towards-production.git
cd agents-towards-production
```
**2. Install Dependencies**
Navigate to your target tutorial and set up the environment:
```bash
# Example: Multi-tool agent orchestration
cd tutorials/agentic-applications-by-xpander.ai
pip install -r meeting-recorder-agent/requirements.txt
```
**3. Deploy and Test**
Launch tutorials through their preferred interface:
```bash
# Run interactive notebooks for experimentation
jupyter notebook tutorial.ipynb
# Execute production scripts for integration testing
python app.py
```
---
## 📚 Recommended reading
*This list contains Amazon affiliate links. As an Amazon Associate I earn from qualifying purchases. Every book below is one I've read and genuinely recommend to engineers working in this space. The companion book to this repo is featured separately at the top of this README.*
- [Build a Large Language Model (From Scratch)](https://europe-west1-atp-views-tracker.cloudfunctions.net/working-analytics?notebook=agents-towards-production--readme&click=amazon-product&target=https%3A%2F%2Fwww.amazon.com%2Fdp%2F1633437167%3Ftag%3Ddiamantai-atp-20&text=Build%20a%20Large%20Language%20Model%20%28From%20Scratch%29) by Sebastian Raschka. Build a GPT-style model end to end in PyTorch.
- [AI Engineering: Building Applications with Foundation Models](https://europe-west1-atp-views-tracker.cloudfunctions.net/working-analytics?notebook=agents-towards-production--readme&click=amazon-product&target=https%3A%2F%2Fwww.amazon.com%2Fdp%2F1098166302%3Ftag%3Ddiamantai-atp-20&text=AI%20Engineering%3A%20Building%20Applications%20with%20Foundation%20Models) by Chip Huyen. Canonical reference for productionizing foundation-model apps.
- [Hands-On Large Language Models](https://europe-west1-atp-views-tracker.cloudfunctions.net/working-analytics?notebook=agents-towards-production--readme&click=amazon-product&target=https%3A%2F%2Fwww.amazon.com%2Fdp%2F1098150961%3Ftag%3Ddiamantai-atp-20&text=Hands-On%20Large%20Language%20Models) by Jay Alammar and Maarten Grootendorst. Visual, practical LLM walkthroughs.
- [Natural Language Processing with Transformers](https://europe-west1-atp-views-tracker.cloudfunctions.net/working-analytics?notebook=agents-towards-production--readme&click=amazon-product&target=https%3A%2F%2Fwww.amazon.com%2Fdp%2F1098136799%3Ftag%3Ddiamantai-atp-20&text=Natural%20Language%20Processing%20with%20Transformers) by Lewis Tunstall, Leandro von Werra, and Thomas Wolf. From the Hugging Face team.
- [Designing Machine Learning Systems](https://europe-west1-atp-views-tracker.cloudfunctions.net/working-analytics?notebook=agents-towards-production--readme&click=amazon-product&target=https%3A%2F%2Fwww.amazon.com%2Fdp%2F1098107969%3Ftag%3Ddiamantai-atp-20&text=Designing%20Machine%20Learning%20Systems) by Chip Huyen. ML systems in production, still the standard reference.
## 🤝 Contributing
We welcome contributions of tools, infrastructure, and frameworks that support agent development. This includes monitoring, deployment platforms, security tools, databases, APIs, and other horizontal services that enable production agent systems.
Please see our [Contributing Guidelines](CONTRIBUTING.md) for more details.
---
## ⚠️ Disclaimer
**Educational use only.** Authors disclaim all responsibility for use, misuse, or consequences. We do not endorse, verify, or guarantee third-party companies, tools, or services referenced herein. Not liable for damages, losses, security breaches, or fraudulent activities by referenced parties.
**Your responsibility:** Conduct due diligence, verify legitimacy, test in isolation, ensure legal compliance. Security tools require ethical use with proper authorization.
By using this repository, you agree to this disclaimer.
---
## 📜 License
This project is licensed under a custom non-commercial license - see the [LICENSE](LICENSE) file for details.
---
### ⭐️ If you find this repository helpful, please consider giving it a star!
Keywords: AI Agents, Production Deployment, LLM, Orchestration, Multi-agent Systems, Memory Systems, Monitoring, Security, Observability, Agent Frameworks, Infrastructure, Serverless, Enterprise AI, Tool Integration
## 💼 Apply for open AI engineering jobs
**AI-first companies are hiring through the DiamantAI Collective.**
[](https://europe-west1-atp-views-tracker.cloudfunctions.net/working-analytics?notebook=main-readme--jobs-panel&click=jobs-panel-see-all-roles&target=https%3A%2F%2Fdiamant-ai.com%2Fjobs&text=See%20open%20jobs%20and%20apply)
---
