# Awesome Open Source AI Curated open-source artificial intelligence models, libraries, infrastructure, and developer tools. [![Awesome](https://awesome.re/badge.svg)](https://awesome.re) [![Follow @opensrc_ai on X](https://img.shields.io/badge/Follow-%40opensrc__ai-000000?logo=x&logoColor=white)](https://x.com/opensrc_ai)

svgdiagram.ai _{· Turn your notes into clean, editable SVG diagrams}

---

**[Contributing](#contributing)**

## Contents - [1. Core Frameworks & Libraries](#1-core-frameworks--libraries) - [2. Model Codebases & Model Families](#2-model-codebases--model-families) - [3. Inference Engines & Serving](#3-inference-engines--serving) - [4. Agentic AI & Multi-Agent Systems](#4-agentic-ai--multi-agent-systems) - [5. Retrieval-Augmented Generation (RAG) & Knowledge](#5-retrieval-augmented-generation-rag--knowledge) - [6. Generative Media Tools](#6-generative-media-tools) - [7. Training & Fine-tuning Ecosystem](#7-training--fine-tuning-ecosystem) - [8. MLOps / LLMOps & Production](#8-mlops--llmops--production) - [9. Evaluation, Benchmarks & Datasets](#9-evaluation-benchmarks--datasets) - [10. AI Safety, Alignment & Interpretability](#10-ai-safety-alignment--interpretability) - [11. Specialized Domains](#11-specialized-domains) - [12. User Interfaces & Self-hosted Platforms](#12-user-interfaces--self-hosted-platforms) - [13. Developer Tools & Integrations](#13-developer-tools--integrations) - [14. Resources & Learning](#14-resources--learning) --- ## About this list Awesome Open Source AI is a curated list of open-source projects for people building with AI. The goal is to help readers find useful models, libraries, tools, infrastructure, datasets, and learning resources without sorting through a directory dump. Projects do not need a minimum number of GitHub stars to be included. Stars can be useful context, but they are only one signal. A smaller project may belong here if it is useful, well-maintained, technically interesting, clearly documented, or important to a specific part of the AI ecosystem. Good entries should have a clear reason to exist. They should help people build, study, run, evaluate, or understand AI systems. --- ## 1. Core Frameworks & Libraries > Core libraries and frameworks used to build, train, and run AI and machine learning systems. #### Deep Learning Frameworks - [PyTorch](https://github.com/pytorch/pytorch) - Dynamic computation graphs, Pythonic API, dominant in research and production. The current standard for most frontier AI work. ![GitHub stars](https://img.shields.io/github/stars/pytorch/pytorch?style=social) - [TensorFlow](https://github.com/tensorflow/tensorflow) - End-to-end platform with excellent production deployment, TPU support, and large-scale serving tools. ![GitHub stars](https://img.shields.io/github/stars/tensorflow/tensorflow?style=social) - [JAX](https://github.com/jax-ml/jax) - High-performance numerical computing with composable transformations (JIT, vmap, grad). Rising favorite for research and scientific ML. ![GitHub stars](https://img.shields.io/github/stars/jax-ml/jax?style=social) - [Flax](https://github.com/google/flax) - Neural network library for JAX, designed for flexibility. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/google/flax?style=social) - [dm-haiku](https://github.com/google-deepmind/dm-haiku) - JAX-based neural network library from Google DeepMind. Elegant functional API with state management, widely used in DeepMind's research. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/google-deepmind/dm-haiku?style=social) - [Equinox](https://github.com/patrick-kidger/equinox) - Elegant easy-to-use neural networks and scientific computing in JAX. Callable PyTrees with filtered transformations, seamless interoperability with the JAX ecosystem. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/patrick-kidger/equinox?style=social) - [Diffrax](https://github.com/patrick-kidger/diffrax) - Numerical differential equation solvers in JAX. Autodifferentiable and GPU-capable ODE/SDE/CDE solvers for scientific machine learning and neural differential equations. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/patrick-kidger/diffrax?style=social) - [vit-pytorch](https://github.com/lucidrains/vit-pytorch) - Comprehensive Vision Transformer (ViT) implementations in PyTorch. Reference implementations of all major vision transformer variants including ViT, DeiT, Swin, and more. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/lucidrains/vit-pytorch?style=social) - [NumPyro](https://github.com/pyro-ppl/numpyro) - Probabilistic programming with NumPy powered by JAX for autograd and JIT compilation. Bayesian modeling and inference at scale. ![GitHub stars](https://img.shields.io/github/stars/pyro-ppl/numpyro?style=social) - [Keras](https://github.com/keras-team/keras) - High-level, beginner-friendly API that now runs on multiple backends (TensorFlow, JAX, PyTorch). Perfect for rapid experimentation. ![GitHub stars](https://img.shields.io/github/stars/keras-team/keras?style=social) - [tinygrad](https://github.com/tinygrad/tinygrad) - Minimalist deep learning framework with tiny code footprint. The "you like PyTorch? you like micrograd? you love tinygrad!" philosophy - simple yet powerful. ![GitHub stars](https://img.shields.io/github/stars/tinygrad/tinygrad?style=social) - [PaddlePaddle](https://github.com/PaddlePaddle/Paddle) - Industrial deep learning platform from Baidu serving 23+ million developers and 760,000+ companies. China's first independent R&D framework with advanced distributed training and deployment capabilities. ![GitHub stars](https://img.shields.io/github/stars/PaddlePaddle/Paddle?style=social) - [PyTorch Geometric](https://github.com/pyg-team/pytorch_geometric) - Library for deep learning on irregular input data such as graphs, point clouds, and manifolds. Part of the PyTorch ecosystem. ![GitHub stars](https://img.shields.io/github/stars/pyg-team/pytorch_geometric?style=social) - [timm (PyTorch Image Models)](https://github.com/huggingface/pytorch-image-models) - The largest collection of PyTorch image encoders and backbones. 900+ pretrained models including ResNet, EfficientNet, Vision Transformer, ConvNeXt, and more with training and inference scripts. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/huggingface/pytorch-image-models?style=social) - [Triton](https://github.com/triton-lang/triton) - Language and compiler for writing highly efficient custom deep-learning primitives. Powers kernel optimizations in PyTorch, JAX, and other frameworks. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/triton-lang/triton?style=social) - [GGML](https://github.com/ggml-org/ggml) - Tensor library for machine learning. The foundational C/C++ library powering llama.cpp and many on-device inference engines. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/ggml-org/ggml?style=social) - [MLX](https://github.com/ml-explore/mlx) - Array framework for machine learning on Apple silicon. Efficient unified memory design with NumPy-like API, automatic differentiation, and multi-device support. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/ml-explore/mlx?style=social) - [notorch](https://github.com/ariannamethod/notorch) - Neural network framework in pure C with reverse-mode automatic differentiation, model training, and GGUF inference, without a Python runtime. ![GitHub stars](https://img.shields.io/github/stars/ariannamethod/notorch?style=social) #### High-Performance Compute Libraries - [oneDNN](https://github.com/uxlfoundation/oneDNN) - oneAPI Deep Neural Network Library. Cross-platform performance library of basic building blocks for deep learning, optimized for Intel CPUs, GPUs, and Arm architectures. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/uxlfoundation/oneDNN?style=social) - [ONNX](https://github.com/onnx/onnx) - Open standard for machine learning interoperability. Open Neural Network Exchange provides an open ecosystem that empowers AI developers to choose the right tools as their project evolves. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/onnx/onnx?style=social) - [IREE](https://github.com/iree-org/iree) - Retargetable MLIR-based machine learning compiler and runtime toolkit. Lowers ML models to unified IR that scales from datacenter to mobile and edge deployments. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/iree-org/iree?style=social) - [Modular Platform](https://github.com/modular/modular) - Open-source AI compute and programming platform built around the MAX Engine and Mojo programming language. ![GitHub stars](https://img.shields.io/github/stars/modular/modular?style=social) #### Rust ML Frameworks - [Burn](https://github.com/tracel-ai/burn) - Next-generation deep learning framework in Rust. Backend-agnostic with CPU, GPU, WebAssembly support. ![GitHub stars](https://img.shields.io/github/stars/tracel-ai/burn?style=social) - [Candle (Hugging Face)](https://github.com/huggingface/candle) - Minimalist ML framework for Rust. PyTorch-like API with focus on performance and simplicity. ![GitHub stars](https://img.shields.io/github/stars/huggingface/candle?style=social) - [linfa](https://github.com/rust-ml/linfa) - Comprehensive Rust ML toolkit with classical algorithms. scikit-learn equivalent for Rust with clustering, regression, and preprocessing. ![GitHub stars](https://img.shields.io/github/stars/rust-ml/linfa?style=social) #### Julia ML Frameworks - [Flux.jl](https://github.com/FluxML/Flux.jl) - 100% pure-Julia ML stack with lightweight abstractions on top of native GPU and AD support. Elegant, hackable, and fully integrated with Julia's scientific computing ecosystem. ![GitHub stars](https://img.shields.io/github/stars/FluxML/Flux.jl?style=social) - [MLJ.jl](https://github.com/JuliaAI/MLJ.jl) - Comprehensive Julia machine learning framework providing a unified interface to 200+ models with meta-algorithms for selection, tuning, and evaluation. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/JuliaAI/MLJ.jl?style=social) - [ModelingToolkit.jl](https://github.com/SciML/ModelingToolkit.jl) - High-performance symbolic-numeric modeling framework for scientific machine learning. Automatically generates fast functions for model components like Jacobians and Hessians with automatic sparsification and parallelization. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/SciML/ModelingToolkit.jl?style=social) #### NLP & Transformers - [spaCy (Explosion AI)](https://github.com/explosion/spaCy) - Industrial-strength natural language processing with 75+ languages, transformer pipelines, and production-grade NER, parsing, and text classification. ![GitHub stars](https://img.shields.io/github/stars/explosion/spaCy?style=social) - [Transformers (Hugging Face)](https://github.com/huggingface/transformers) - The de facto standard library for pretrained NLP models. 1M+ models, 250,000+ downloads/day. BERT, GPT, Llama, Qwen, and hundreds more. ![GitHub stars](https://img.shields.io/github/stars/huggingface/transformers?style=social) - [sentence-transformers](https://github.com/UKPLab/sentence-transformers) - Classic library for sentence and image embeddings. ![GitHub stars](https://img.shields.io/github/stars/UKPLab/sentence-transformers?style=social) - [tokenizers (Hugging Face)](https://github.com/huggingface/tokenizers) - Fast state-of-the-art tokenizers for training and inference. ![GitHub stars](https://img.shields.io/github/stars/huggingface/tokenizers?style=social) - [fairseq2](https://github.com/facebookresearch/fairseq2) - FAIR Sequence Modeling Toolkit 2. Complete rewrite of fairseq with modern PyTorch APIs, native support for LLM training (70B+ models), vLLM integration, and first-party recipes for instruction finetuning and preference optimization. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/facebookresearch/fairseq2?style=social) - [LibreTranslate](https://github.com/LibreTranslate/LibreTranslate) - Self-hosted machine translation API powered by the Argos Translate engine. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/LibreTranslate/LibreTranslate?style=social) #### Data Processing & Manipulation - [Pandas](https://github.com/pandas-dev/pandas) - The gold standard for data analysis and manipulation in Python. ![GitHub stars](https://img.shields.io/github/stars/pandas-dev/pandas?style=social) - [Polars](https://github.com/pola-rs/polars) - Blazing-fast DataFrame library (Rust backend) - modern alternative to Pandas for large-scale workloads. ![GitHub stars](https://img.shields.io/github/stars/pola-rs/polars?style=social) - [cuDF](https://github.com/rapidsai/cudf) - GPU DataFrame library from RAPIDS. Accelerates Pandas workflows on NVIDIA GPUs with zero code changes using cuDF.pandas accelerator mode. ![GitHub stars](https://img.shields.io/github/stars/rapidsai/cudf?style=social) - [Dask](https://github.com/dask/dask) - Parallel computing for big data - scales Pandas/NumPy/scikit-learn to clusters. ![GitHub stars](https://img.shields.io/github/stars/dask/dask?style=social) - [DataFlow](https://github.com/OpenDCAI/DataFlow) - LLM-ready data preparation system for turning raw PDFs, conversations, code, databases, and other sources into SFT, QA, and RAG-ready datasets. ![GitHub stars](https://img.shields.io/github/stars/OpenDCAI/DataFlow?style=social) - [NumPy](https://github.com/numpy/numpy) - Fundamental array computing library that powers almost every AI stack. ![GitHub stars](https://img.shields.io/github/stars/numpy/numpy?style=social) - [SciPy](https://github.com/scipy/scipy) - Scientific computing algorithms (optimization, linear algebra, statistics, signal processing). ![GitHub stars](https://img.shields.io/github/stars/scipy/scipy?style=social) - [CuPy](https://github.com/cupy/cupy) - NumPy and SciPy-compatible array library for GPU-accelerated computing in Python. ![GitHub stars](https://img.shields.io/github/stars/cupy/cupy?style=social) - [NetworkX](https://github.com/networkx/networkx) - Creation, manipulation, and study of complex networks. The foundational graph analysis library for Python data science. ![GitHub stars](https://img.shields.io/github/stars/networkx/networkx?style=social) - [cuGraph](https://github.com/rapidsai/cugraph) - GPU graph analytics library with NetworkX-compatible API. 10-100x faster than CPU for large-scale graph algorithms. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/rapidsai/cugraph?style=social) - [Datashader](https://github.com/holoviz/datashader) - High-performance large data visualization. Renders billions of points interactively without aggregation artifacts. BSD-3-Clause licensed. ![GitHub stars](https://img.shields.io/github/stars/holoviz/datashader?style=social) - [Zarr](https://github.com/zarr-developers/zarr-python) - Chunked, compressed, N-dimensional array storage. Scalable tensor data format optimized for cloud and parallel computing. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/zarr-developers/zarr-python?style=social) - [NVIDIA DALI](https://github.com/NVIDIA/DALI) - GPU-accelerated data loading and augmentation library with highly optimized building blocks for deep learning applications. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/NVIDIA/DALI?style=social) - [Narwhals](https://github.com/narwhals-dev/narwhals) - Lightweight compatibility layer between DataFrame libraries. Write Polars-like code that works seamlessly across Pandas, Polars, cuDF, Modin, and more. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/narwhals-dev/narwhals?style=social) - [Ibis](https://github.com/ibis-project/ibis) - Portable Python dataframe library with 20+ backends. Write Pandas-like code that runs locally with DuckDB or scales to production databases (BigQuery, Snowflake, PostgreSQL) by changing one line. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/ibis-project/ibis?style=social) - [skrub](https://github.com/skrub-data/skrub) - Machine learning with dataframes for dirty categorical data. Preprocessing and feature engineering for heterogeneous data with seamless Pandas/Polars integration. BSD-3-Clause licensed. ![GitHub stars](https://img.shields.io/github/stars/skrub-data/skrub?style=social) - [Oxen](https://github.com/Oxen-AI/Oxen) - Lightning fast data version control for machine learning. Optimized for large datasets with efficient diffing, branching, and collaboration. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Oxen-AI/Oxen?style=social) - [Pandera](https://github.com/unionai-oss/pandera) - Statistical data testing and validation for dataframes. Pydantic-like API for Pandas, Polars, and other dataframe libraries with type hints and lazy validation. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/unionai-oss/pandera?style=social) - [Snorkel](https://github.com/snorkel-team/snorkel) - System for quickly generating training data with weak supervision. Programmatically label, build, and manage training data using labeling functions and probabilistic consensus models. Powers Snorkel Flow and used by Google, Apple, and Intel. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/snorkel-team/snorkel?style=social) - [DuckDB](https://github.com/duckdb/duckdb) - High-performance analytical in-process SQL database system. Fast, reliable, portable, and easy to use with rich SQL dialect support. Perfect for data processing and analytics workloads. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/duckdb/duckdb?style=social) - [FiftyOne](https://github.com/voxel51/fiftyone) - Visual AI development toolkit for visualizing, labeling, and evaluating visual datasets and models. Supercharges computer vision workflows with dataset exploration and model analysis. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/voxel51/fiftyone?style=social) - [Label Studio](https://github.com/HumanSignal/label-studio) - Multi-type data labeling and annotation tool with standardized output format. Configurable interface for images, text, audio, video, and time series with ML-assisted labeling. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/HumanSignal/label-studio?style=social) - [Delta Lake](https://github.com/delta-io/delta) - Open-source storage framework enabling Lakehouse architecture with ACID transactions, scalable metadata handling, and unified batch/streaming processing. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/delta-io/delta?style=social) - [Apache Iceberg](https://github.com/apache/iceberg) - High-performance open table format for huge analytic tables. Brings SQL table reliability to big data with time travel, hidden partitioning, and schema evolution. Works with Spark, Trino, Flink, Presto, Hive and Impala. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/apache/iceberg?style=social) - [Apache Hudi](https://github.com/apache/hudi) - Open data lakehouse platform for ingesting, indexing, storing, serving, transforming and managing data across cloud environments. Supports upserts, deletes and incremental processing on big data with built-in ingestion tools for Spark and Flink. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/apache/hudi?style=social) - [lakeFS](https://github.com/treeverse/lakeFS) - Data version control for your data lake that transforms object storage into Git-like repositories. Enables atomic, versioned data lake operations with branching, committing, and merging for data pipelines. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/treeverse/lakeFS?style=social) - [Apache Airflow](https://github.com/apache/airflow) - Platform to programmatically author, schedule, and monitor workflows. Industry-standard orchestration for data pipelines and ML workflows with 500+ integrations. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/apache/airflow?style=social) - [Apache Spark](https://github.com/apache/spark) - Unified analytics engine for large-scale data processing. In-memory cluster computing with high-level APIs in Python, Scala, Java, and R. Powers MLlib for distributed machine learning and Structured Streaming for real-time data. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/apache/spark?style=social) - [Apache Flink](https://github.com/apache/flink) - Stream processing framework with powerful batch and streaming capabilities. High-throughput, low-latency runtime with exactly-once processing guarantees. Ideal for real-time AI inference pipelines and event-driven ML applications. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/apache/flink?style=social) - [Apache Beam](https://github.com/apache/beam) - Unified programming model for batch and streaming data processing. Write pipelines once, run anywhere on Flink, Spark, or Google Cloud Dataflow. Portable, extensible, and enterprise-ready for AI data pipelines. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/apache/beam?style=social) - [Scrapy](https://github.com/scrapy/scrapy) - Fast, high-level web crawling and scraping framework for Python. Extract structured data from websites at scale with built-in support for handling common challenges like pagination, cookies, and concurrent requests. BSD-3-Clause licensed. ![GitHub stars](https://img.shields.io/github/stars/scrapy/scrapy?style=social) - [Temporal](https://github.com/temporalio/temporal) - Durable execution platform for reliable workflow orchestration. Build resilient data pipelines and ML workflows that survive failures and continue execution exactly where they left off. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/temporalio/temporal?style=social) - [Luigi](https://github.com/spotify/luigi) - Python module for building complex pipelines of batch jobs. Handles dependency resolution, workflow management, visualization, and Hadoop integration. Built at Spotify and battle-tested in production. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/spotify/luigi?style=social) - [Mage.ai](https://github.com/mage-ai/mage-ai) - Modern open-source data pipeline tool for integrating and transforming data. AI-native ETL/ELT platform with 100+ integrations, real-time monitoring, and collaborative features. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/mage-ai/mage-ai?style=social) - [Hamilton](https://github.com/apache/hamilton) - Declarative dataflow framework for building testable, modular, self-documenting data pipelines. Encode lineage and metadata directly in Python functions. Originally from Stitch Fix, now Apache incubating. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/apache/hamilton?style=social) - [D-Tale](https://github.com/man-group/dtale) - Visualizer for Pandas data structures with a Flask back-end and React front-end. Interactive data exploration with charting, filtering, and code export. LGPL-2.1 licensed. ![GitHub stars](https://img.shields.io/github/stars/man-group/dtale?style=social) - [TextAttack](https://github.com/QData/TextAttack) - Python framework for adversarial attacks, data augmentation, and model training in NLP. Augment datasets to increase model robustness and generate adversarial examples. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/QData/TextAttack?style=social) - [uv](https://github.com/astral-sh/uv) - An extremely fast Python package and project manager, written in Rust. 10-100x faster than pip with built-in virtual environment management, dependency resolution, and lockfiles. Essential for modern AI/ML development workflows. Apache 2.0 and MIT dual-licensed. ![GitHub stars](https://img.shields.io/github/stars/astral-sh/uv?style=social) - [Vector](https://github.com/vectordotdev/vector) - A high-performance observability data pipeline for collecting, transforming, and routing logs and metrics. Real-time data processing with 50+ sources and sinks including Kafka, S3, and Elasticsearch. Ideal for AI/ML log processing and data ingestion. MPL 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/vectordotdev/vector?style=social) #### Classical ML & Gradient Boosting - [scikit-learn](https://github.com/scikit-learn/scikit-learn) - Industry-standard library for traditional machine learning (classification, regression, clustering, pipelines). ![GitHub stars](https://img.shields.io/github/stars/scikit-learn/scikit-learn?style=social) - [XGBoost](https://github.com/dmlc/xgboost) - Scalable, high-performance gradient boosting library. Still dominates Kaggle and tabular competitions. ![GitHub stars](https://img.shields.io/github/stars/dmlc/xgboost?style=social) - [LightGBM](https://github.com/microsoft/LightGBM) - Microsoft's ultra-fast gradient boosting framework, optimized for speed and memory. ![GitHub stars](https://img.shields.io/github/stars/microsoft/LightGBM?style=social) - [CatBoost](https://github.com/catboost/catboost) - Gradient boosting that handles categorical features natively with great out-of-the-box performance. ![GitHub stars](https://img.shields.io/github/stars/catboost/catboost?style=social) - [sktime](https://github.com/sktime/sktime) - Unified framework for machine learning with time series. scikit-learn compatible API for forecasting, classification, clustering, and anomaly detection. ![GitHub stars](https://img.shields.io/github/stars/sktime/sktime?style=social) - [StatsForecast](https://github.com/Nixtla/statsforecast) - Lightning-fast statistical forecasting with ARIMA, ETS, CES, and Theta models. Optimized for high-performance time series workloads. ![GitHub stars](https://img.shields.io/github/stars/Nixtla/statsforecast?style=social) - [MLForecast](https://github.com/Nixtla/mlforecast) - Scalable machine learning for time series forecasting. Train any sklearn-compatible model on millions of time series with efficient feature engineering. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Nixtla/mlforecast?style=social) - [cuML](https://github.com/rapidsai/cuml) - GPU-accelerated machine learning algorithms with scikit-learn compatible API. 10-50x faster than CPU implementations for large datasets. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/rapidsai/cuml?style=social) - [SynapseML](https://github.com/microsoft/SynapseML) - Distributed machine learning on Apache Spark. Scalable, composable APIs for text analytics, vision, anomaly detection with seamless Python/Scala/R/.NET integration. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/microsoft/SynapseML?style=social) - [Darts](https://github.com/unit8co/darts) - User-friendly forecasting and anomaly detection for time series. Unifies classical statistical models (ARIMA, ETS) with modern neural networks (N-BEATS, TFT, DeepAR) in a single scikit-learn compatible API. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/unit8co/darts?style=social) - [PyTorch Forecasting](https://github.com/sktime/pytorch-forecasting) - Time series forecasting with PyTorch. Multiple neural architectures (N-BEATS, TFT, DeepAR) with in-built interpretation capabilities, built on PyTorch Lightning for distributed training. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/sktime/pytorch-forecasting?style=social) #### Data Engineering & Feature Stores - [DataHub](https://github.com/datahub-project/datahub) - The #1 open-source metadata platform for data and AI. Data discovery, governance, and observability with 80+ connectors, column-level lineage, and AI assistant integration. Originally built at LinkedIn. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/datahub-project/datahub?style=social) - [OpenMetadata](https://github.com/open-metadata/OpenMetadata) - Unified metadata platform for data discovery, observability, and governance. Column-level lineage, semantic search, and team collaboration with 70+ data service connectors. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/open-metadata/OpenMetadata?style=social) - [Amundsen](https://github.com/amundsen-io/amundsen) - Data discovery and metadata engine from Lyft. PageRank-style search for data resources with usage-based ranking. LF AI & Data Foundation project. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/amundsen-io/amundsen?style=social) #### Data Transformation & Analytics Engineering - [Apache Ossie](https://github.com/apache/ossie) - Vendor-neutral specification to standardize semantic models across analytics, BI, and AI agent platforms. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/apache/ossie?style=social) - [dbt-core](https://github.com/dbt-labs/dbt-core) - Transform data using software engineering best practices. The industry-standard framework for analytics engineering with 15M+ monthly downloads. Enables version control, testing, and documentation for SQL transformations. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/dbt-labs/dbt-core?style=social) - [SQLMesh](https://github.com/TobikoData/sqlmesh) - Scalable and efficient data transformation framework with dbt compatibility. Features automatic data lineage, time travel, and virtual data environments for testing. Optimized for large-scale data warehouses. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/TobikoData/sqlmesh?style=social) - [SLayer](https://github.com/MotleyAI/slayer) - Semantic layer for AI-powered data analytics. Allows AI agents to describe data models and query the data using an expressive format with measures, dimensions, and filters, without writing raw SQL. MCP, CLI, API, and Python clients. Embeddable as a Python library. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/MotleyAI/slayer?style=social) - [WrenAI](https://github.com/Canner/WrenAI) - Open-source Generative BI engine and context layer for AI agents to query databases and produce trusted SQL and dashboards. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Canner/WrenAI?style=social) #### Data Quality & Validation - [Deequ](https://github.com/awslabs/deequ) - Library built on top of Apache Spark for defining "unit tests for data". Measures data quality in large datasets with constraint verification, anomaly detection, and incremental validation. Used at Amazon for production data quality. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/awslabs/deequ?style=social) - [Great Expectations](https://github.com/great-expectations/great_expectations) - Always know what to expect from your data. Data validation, profiling, and documentation for data pipelines. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/great-expectations/great_expectations?style=social) - [ydata-profiling](https://github.com/ydataai/ydata-profiling) - One line of code for comprehensive data quality profiling and exploratory data analysis. Generates detailed reports for Pandas and Spark DataFrames including statistics, correlations, missing values, and data quality alerts. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/ydataai/ydata-profiling?style=social) - [Soda Core](https://github.com/sodadata/soda-core) - Data contracts engine for the modern data stack. Define data quality checks in YAML and automatically validate schema and data across your pipelines. Supports 20+ data sources including Snowflake, BigQuery, and PostgreSQL. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/sodadata/soda-core?style=social) - [TFX (TensorFlow Extended)](https://github.com/tensorflow/tfx) - End-to-end platform for deploying production ML pipelines. Data validation, transformation, model training, and serving with TensorFlow. Powers Google's production ML infrastructure. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/tensorflow/tfx?style=social) #### Data Labeling & Annotation - [OpenRefine](https://github.com/OpenRefine/OpenRefine) - Free, open-source power tool for working with messy data. Clean, transform, and extend data with web services. Formerly Google Refine. BSD-3-Clause licensed. ![GitHub stars](https://img.shields.io/github/stars/OpenRefine/OpenRefine?style=social) #### AutoML & Hyperparameter Optimization - [Optuna](https://github.com/optuna/optuna) - Modern, define-by-run hyperparameter optimization with pruning and visualizations. Extremely popular in 2026. ![GitHub stars](https://img.shields.io/github/stars/optuna/optuna?style=social) - [AutoGluon](https://github.com/autogluon/autogluon) - AWS AutoML toolkit for tabular, image, text, and multimodal data - state-of-the-art with almost zero code. ![GitHub stars](https://img.shields.io/github/stars/autogluon/autogluon?style=social) - [FLAML](https://github.com/microsoft/FLAML) - Microsoft's fast & lightweight AutoML focused on efficiency and low compute. ![GitHub stars](https://img.shields.io/github/stars/microsoft/FLAML?style=social) - [Katib (Kubeflow)](https://github.com/kubeflow/katib) - Kubernetes-native AutoML for hyperparameter tuning, early stopping, and neural architecture search. Framework-agnostic with support for TensorFlow, PyTorch, XGBoost, and custom training operators. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/kubeflow/katib?style=social) #### Interactive ML Apps & Notebooks - [Streamlit](https://github.com/streamlit/streamlit) - The fastest way to build and share data apps. Transform Python scripts into beautiful web applications with minimal code. Widely used for ML model demos, data visualization, and internal tools. ![GitHub stars](https://img.shields.io/github/stars/streamlit/streamlit?style=social) - [Gradio](https://github.com/gradio-app/gradio) - Build and share delightful machine learning apps, all in Python. The de facto standard for creating interactive ML demos with automatic UI generation from function signatures. Powers thousands of Hugging Face Spaces. ![GitHub stars](https://img.shields.io/github/stars/gradio-app/gradio?style=social) - [Marimo](https://github.com/marimo-team/marimo) - A reactive notebook for Python — run reproducible experiments, query with SQL, execute as a script, deploy as an app, and version with git. Stored as pure Python. All in a modern, AI-native editor. ![GitHub stars](https://img.shields.io/github/stars/marimo-team/marimo?style=social) #### Model Training & Optimization Utilities - [Hugging Face Accelerate](https://github.com/huggingface/accelerate) - Simple API to make training scripts run on any hardware (multi-GPU, TPU, mixed precision) with minimal code changes. ![GitHub stars](https://img.shields.io/github/stars/huggingface/accelerate?style=social) - [DeepSpeed](https://github.com/microsoft/DeepSpeed) - Microsoft's deep learning optimization library for extreme-scale training (ZeRO, offloading, MoE). ![GitHub stars](https://img.shields.io/github/stars/microsoft/DeepSpeed?style=social) - [FlashAttention](https://github.com/Dao-AILab/flash-attention) - Fast exact attention kernels that reduce memory usage and accelerate transformer training and inference. ![GitHub stars](https://img.shields.io/github/stars/Dao-AILab/flash-attention?style=social) - [xFormers](https://github.com/facebookresearch/xformers) - Optimized transformer building blocks and attention operators for PyTorch. ![GitHub stars](https://img.shields.io/github/stars/facebookresearch/xformers?style=social) - [PyTorch Lightning](https://github.com/Lightning-AI/lightning) - High-level wrapper for PyTorch that removes boilerplate and adds best practices. ![GitHub stars](https://img.shields.io/github/stars/Lightning-AI/lightning?style=social) - [fastai](https://github.com/fastai/fastai) - Deep learning library providing practitioners with high-level components for state-of-the-art results. Built on PyTorch with a focus on usability and transfer learning. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/fastai/fastai?style=social) - [PyTorch Ignite](https://github.com/pytorch/ignite) - High-level library for training and evaluating neural networks in PyTorch with an engine, events & handlers system for maximum flexibility. BSD-3-Clause licensed. ![GitHub stars](https://img.shields.io/github/stars/pytorch/ignite?style=social) - [ONNX Runtime](https://github.com/microsoft/onnxruntime) - High-performance inference and training for ONNX models across hardware. ![GitHub stars](https://img.shields.io/github/stars/microsoft/onnxruntime?style=social) - [einops](https://github.com/arogozhnikov/einops) - Flexible, powerful tensor operations for readable and reliable code. Supports PyTorch, JAX, TensorFlow, NumPy, MLX. ![GitHub stars](https://img.shields.io/github/stars/arogozhnikov/einops?style=social) - [safetensors](https://github.com/huggingface/safetensors) - Simple, safe way to store and distribute tensors. Fast, secure alternative to pickle for model serialization. ![GitHub stars](https://img.shields.io/github/stars/huggingface/safetensors?style=social) - [torchmetrics](https://github.com/Lightning-AI/torchmetrics) - Machine learning metrics for distributed, scalable PyTorch applications. 80+ metrics with built-in distributed synchronization. ![GitHub stars](https://img.shields.io/github/stars/Lightning-AI/torchmetrics?style=social) - [torchao](https://github.com/pytorch/ao) - PyTorch native quantization and sparsity for training and inference. Drop-in optimizations for production deployment. ![GitHub stars](https://img.shields.io/github/stars/pytorch/ao?style=social) - [SHAP](https://github.com/shap/shap) - Game theoretic approach to explain the output of any machine learning model. Industry standard for model interpretability. ![GitHub stars](https://img.shields.io/github/stars/shap/shap?style=social) - [skorch](https://github.com/skorch-dev/skorch) - scikit-learn compatible neural network library that wraps PyTorch. Seamlessly integrate PyTorch models with scikit-learn pipelines, grid search, and cross-validation. ![GitHub stars](https://img.shields.io/github/stars/skorch-dev/skorch?style=social) - [Composer](https://github.com/mosaicml/composer) - Supercharge your model training. MosaicML's PyTorch training library with built-in algorithms for efficient training (FSDP, gradient compression, progressive resizing) and seamless distributed training on large-scale clusters. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/mosaicml/composer?style=social) - [NVIDIA Apex](https://github.com/NVIDIA/apex) - PyTorch extension for mixed precision training and distributed training optimizations. Powers many production deep learning workloads with tools for automatic mixed precision (AMP), distributed data parallel, and fused optimizers. BSD-3-Clause licensed. ![GitHub stars](https://img.shields.io/github/stars/NVIDIA/apex?style=social) --- ## 2. Model Codebases & Model Families > Canonical model-family repositories with useful code, recipes, evaluation tools, or engineering context. This is not a complete model leaderboard; use Hugging Face and model hubs for up-to-date weight discovery. #### Language Model Families - [RWKV](https://github.com/BlinkDL/RWKV-LM) - Attention-free language model architecture with linear-time inference, training code, inference examples, and an active open-source ecosystem. ![GitHub stars](https://img.shields.io/github/stars/BlinkDL/RWKV-LM?style=social) - [MiniCPM](https://github.com/OpenBMB/MiniCPM) - Compact open model family with practical code, deployment notes, and active edge/on-device focus. ![GitHub stars](https://img.shields.io/github/stars/OpenBMB/MiniCPM?style=social) - [GPT-OSS](https://github.com/openai/gpt-oss) - OpenAI open-weight model repository with inference examples, recipes, and deployment guidance. ![GitHub stars](https://img.shields.io/github/stars/openai/gpt-oss?style=social) - [Mamba](https://github.com/state-spaces/mamba) - State Space Model implementation with pretrained checkpoints, architecture code, and research tooling for efficient long-sequence modeling. ![GitHub stars](https://img.shields.io/github/stars/state-spaces/mamba?style=social) - [GPT-NeoX](https://github.com/EleutherAI/gpt-neox) - Large-scale language model training codebase from EleutherAI with distributed training support and historical open-model importance. ![GitHub stars](https://img.shields.io/github/stars/EleutherAI/gpt-neox?style=social) - [GLM-5](https://github.com/zai-org/GLM-5) - Open-source mixture-of-experts language model family optimized for long-horizon planning, agentic tasks, and coding. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/zai-org/GLM-5?style=social) - [Bonsai Demo](https://github.com/PrismML-Eng/Bonsai-demo) - Local runtime and model package for the Bonsai ternary reasoning model family, with GGUF and MLX support for on-device text, vision, and tool-calling workloads. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/PrismML-Eng/Bonsai-demo?style=social) #### Multimodal & Vision-Language Codebases - [OpenCLIP](https://github.com/mlfoundations/open_clip) - Open implementation of CLIP with training code, pretrained models, and zero-shot evaluation tooling. ![GitHub stars](https://img.shields.io/github/stars/mlfoundations/open_clip?style=social) - [OmniParser](https://github.com/microsoft/OmniParser) - Vision-based GUI parsing model and tooling for computer-use agents. ![GitHub stars](https://img.shields.io/github/stars/microsoft/OmniParser?style=social) - [MiniCPM-V](https://github.com/OpenBMB/MiniCPM-V) - Compact vision-language model family with edge-focused deployment examples and strong OCR-oriented use cases. ![GitHub stars](https://img.shields.io/github/stars/OpenBMB/MiniCPM-V?style=social) - [Eagle](https://github.com/NVlabs/Eagle) - NVIDIA multimodal model codebase with open checkpoints and reusable research materials for vision-language and video-language tasks. ![GitHub stars](https://img.shields.io/github/stars/NVlabs/Eagle?style=social) - [NVIDIA Cosmos](https://github.com/NVIDIA/cosmos) - Open platform of world models, tokenizers, and post-training tools designed for physical AI, robotics, and autonomous systems. ![GitHub stars](https://img.shields.io/github/stars/NVIDIA/cosmos?style=social) #### Speech & Audio Model Codebases - [Whisper](https://github.com/openai/whisper) - Canonical open speech-to-text model codebase with widespread ecosystem support and many downstream implementations. ![GitHub stars](https://img.shields.io/github/stars/openai/whisper?style=social) - [FunASR](https://github.com/modelscope/FunASR) - Speech recognition toolkit with pretrained models, streaming support, diarization, VAD, and production-oriented examples. ![GitHub stars](https://img.shields.io/github/stars/modelscope/FunASR?style=social) - [NVIDIA NeMo](https://github.com/NVIDIA-NeMo/NeMo) - Scalable framework and model codebase for speech, language, and multimodal AI with recipes and deployment guidance. ![GitHub stars](https://img.shields.io/github/stars/NVIDIA-NeMo/NeMo?style=social) - [Sherpa-ONNX](https://github.com/k2-fsa/sherpa-onnx) - Complete speech toolkit with ASR, TTS, diarization, source separation, and VAD across embedded and edge environments via ONNX Runtime. ![GitHub stars](https://img.shields.io/github/stars/k2-fsa/sherpa-onnx?style=social) - [MOSS-TTS](https://github.com/OpenMOSS/MOSS-TTS) - Open speech and sound generation family focused on expressive, long-form text-to-speech with streaming and multi-speaker support. ![GitHub stars](https://img.shields.io/github/stars/OpenMOSS/MOSS-TTS?style=social) - [VoxCPM](https://github.com/OpenBMB/VoxCPM) - Open-sourced tokenizer-free multilingual speech synthesis model with high-quality TTS and style transfer workflows. ![GitHub stars](https://img.shields.io/github/stars/OpenBMB/VoxCPM?style=social) - [VibeVoice](https://github.com/microsoft/VibeVoice) - Open Frontier Voice AI toolkit spanning speech understanding, generation, and multilingual TTS workflows, with active research and deployment tooling. ![GitHub stars](https://img.shields.io/github/stars/microsoft/VibeVoice?style=social) - [SpeechBrain](https://github.com/speechbrain/speechbrain) - PyTorch speech toolkit with recipes for ASR, TTS, speaker recognition, and speech enhancement. ![GitHub stars](https://img.shields.io/github/stars/speechbrain/speechbrain?style=social) - [Pocket TTS](https://github.com/kyutai-labs/pocket-tts) - Lightweight text-to-speech engine optimized for CPU inference with low latency and streaming support. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/kyutai-labs/pocket-tts?style=social) - [transcribe.cpp](https://github.com/handy-computer/transcribe.cpp) - C/C++ speech-to-text inference library running 16+ model families on the ggml runtime with GPU acceleration. ![GitHub stars](https://img.shields.io/github/stars/handy-computer/transcribe.cpp?style=social) - [Moonshine](https://github.com/moonshine-ai/moonshine) - Open-source on-device voice AI toolkit for low-latency speech-to-text, intent recognition, and text-to-speech. ![GitHub stars](https://img.shields.io/github/stars/moonshine-ai/moonshine?style=social) --- ## 3. Inference Engines & Serving > Inference runtimes, serving systems, and optimization tools for running models locally or in production. #### Local / On-device Inference - [llama.cpp](https://github.com/ggml-org/llama.cpp) - Pure C/C++ inference engine with GGUF format support. The gold standard for CPU/GPU/Apple Silicon on-device running. Includes llama-server for OpenAI-compatible API. Now at 100K+ stars. ![GitHub stars](https://img.shields.io/github/stars/ggml-org/llama.cpp?style=social) - [Ollama](https://github.com/ollama/ollama) - Dead-simple local LLM runner with a one-line install, model registry, and OpenAI-compatible API. ![GitHub stars](https://img.shields.io/github/stars/ollama/ollama?style=social) - [Foundry Local](https://github.com/microsoft/Foundry-Local) - Open-source on-device AI platform covering discovery, model running, sandboxed execution, and evaluation of open models. ![GitHub stars](https://img.shields.io/github/stars/microsoft/Foundry-Local?style=social) - [Potato OS](https://github.com/slomin/potato-os) - Linux distribution for fully local AI inference on Raspberry Pi 5 and 4, optimized for running open models at the edge. ![GitHub stars](https://img.shields.io/github/stars/slomin/potato-os?style=social) - [MLC-LLM](https://github.com/mlc-ai/mlc-llm) - Deployment engine that compiles and runs LLMs across browsers, mobile devices, and local hardware. ![GitHub stars](https://img.shields.io/github/stars/mlc-ai/mlc-llm?style=social) - [WebLLM](https://github.com/mlc-ai/web-llm) - High-performance in-browser LLM inference engine. Runs models directly in the browser with WebGPU acceleration. ![GitHub stars](https://img.shields.io/github/stars/mlc-ai/web-llm?style=social) - [llama-cpp-python](https://github.com/abetlen/llama-cpp-python) - Official Python bindings for llama.cpp. ![GitHub stars](https://img.shields.io/github/stars/abetlen/llama-cpp-python?style=social) - [KoboldCpp](https://github.com/LostRuins/koboldcpp) - User-friendly llama.cpp fork focused on role-playing and creative writing. ![GitHub stars](https://img.shields.io/github/stars/LostRuins/koboldcpp?style=social) - [RamaLama](https://github.com/containers/ramalama) - Container-centric tool for simplifying local AI model serving. Automatically detects GPUs, pulls optimized container images, and runs models securely in rootless containers with enterprise-grade isolation. ![GitHub stars](https://img.shields.io/github/stars/containers/ramalama?style=social) - [LiteRT](https://github.com/google-ai-edge/LiteRT) - Google's production-ready on-device ML and GenAI deployment framework. Supports Android, iOS, Web, Desktop, and IoT targets with GPU/NPU acceleration via a unified edge-first runtime. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/google-ai-edge/LiteRT?style=social) - [LiteRT-LM](https://github.com/google-ai-edge/LiteRT-LM) - Production-ready runtime for deploying LLMs on edge devices with low-latency inference and optimized hardware paths for mobile and embedded platforms. ![GitHub stars](https://img.shields.io/github/stars/google-ai-edge/LiteRT-LM?style=social) - [exo](https://github.com/exo-explore/exo) - Run frontier AI locally by connecting all your devices into an AI cluster. Features automatic device discovery, RDMA over Thunderbolt for 99% latency reduction, topology-aware auto parallel, and tensor parallelism. Uses MLX backend for distributed inference across Apple Silicon devices. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/exo-explore/exo?style=social) - [ds4](https://github.com/antirez/ds4) - Native inference engine optimized for DeepSeek V4 and GLM models with Metal, CUDA, and ROCm support. ![GitHub stars](https://img.shields.io/github/stars/antirez/ds4?style=social) - [qwen3.8-flash-next-in-c](https://github.com/shyringo/qwen3.8-flash-next-in-c) - Native C implementation of Qwen3.8-Flash-Next for local CPU inference, with terminal chat, a resident OpenAI-compatible API, and reproducible benchmarks. ![GitHub stars](https://img.shields.io/github/stars/shyringo/qwen3.8-flash-next-in-c?style=social) - [omlx](https://github.com/jundot/omlx) - Apple-centric inference server for local-first AI workflows with model management, GPU orchestration, and OpenAI-compatible APIs for self-hosted deployment. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/jundot/omlx?style=social) - [llmfit](https://github.com/AlexsJones/llmfit) - Terminal tool and TUI that right-sizes LLM models to hardware specs and scores local compatibility across GPU, CPU, and RAM. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/AlexsJones/llmfit?style=social) - [Needle](https://github.com/cactus-compute/needle) - Compact 45M-parameter foundation model and 14MB inference engine for tool calling and structured extraction on tiny devices. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/cactus-compute/needle?style=social) - [Colibri](https://github.com/JustVugg/colibri) - Zero-dependency C inference engine that runs large Mixture-of-Experts models locally by streaming experts across disk, RAM, and VRAM. ![GitHub stars](https://img.shields.io/github/stars/JustVugg/colibri?style=social) - [Claude Code Local](https://github.com/nicedreamzapp/claude-code-local) - MLX-native server that speaks the Anthropic Messages API so the unmodified Claude Code CLI runs against local models on Apple Silicon, with parsing for local models' tool-call formats. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/nicedreamzapp/claude-code-local?style=social) - [nemotron-omni-mlx](https://github.com/nicedreamzapp/nemotron-omni-mlx) - Pure MLX runtime for the vision and audio towers of NVIDIA Nemotron 3 Nano Omni on Apple Silicon, tested for parity against NVIDIA's PyTorch reference. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/nicedreamzapp/nemotron-omni-mlx?style=social) - [Magnitude](https://github.com/magnitudedev/magnitude) - Hardware-aware local inference engine that profiles host hardware, recommends suitable open models, and tunes execution across Apple Silicon, NVIDIA, AMD, and CPU. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/magnitudedev/magnitude?style=social) - [llm-vram-calculator](https://github.com/159753a52/llm-vram-calculator) - Dependency-free TypeScript core that estimates inference memory (weights, KV cache, overhead) of any Hugging Face model from its config.json and safetensors metadata, covering MoE, MLA, sliding-window and linear-attention layers; runs in the browser at [modelvram.com](https://modelvram.com/llm-vram-calculator/). MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/159753a52/llm-vram-calculator?style=social) - [llmash](https://github.com/omgitsbase/llmash) - Ollama-compatible LLM server on a llama.cpp fork, tuned for speculative decoding on NVIDIA GPUs. Keeps Ollama's commands, API and model store, drafts with the model's own MTP head, and can uncensor a model with a control vector applied at load. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/omgitsbase/llmash?style=social) #### High-performance Serving & API Servers - [llm-d](https://github.com/llm-d/llm-d) - Kubernetes-native distributed LLM inference framework. Donated to CNCF by RedHat, Google, and IBM. Intelligent scheduling, KV-cache optimization, and state-of-the-art performance across accelerators. ![GitHub stars](https://img.shields.io/github/stars/llm-d/llm-d?style=social) - [LMDeploy](https://github.com/InternLM/lmdeploy) - Toolkit for compressing, deploying, and serving LLMs from OpenMMLab. 4-bit inference with 2.4x higher performance than FP16, distributed multi-model serving across machines. ![GitHub stars](https://img.shields.io/github/stars/InternLM/lmdeploy?style=social) - [vLLM](https://github.com/vllm-project/vllm) - State-of-the-art serving engine with PagedAttention and continuous batching. Currently the fastest production-grade LLM server. ![GitHub stars](https://img.shields.io/github/stars/vllm-project/vllm?style=social) - [TokenSpeed](https://github.com/lightseekorg/tokenspeed) - LLM inference engine for agentic workloads with a C++ scheduling control plane, Python execution plane, modular kernels, and KV-cache lifecycle management. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/lightseekorg/tokenspeed?style=social) - [vLLM-Omni](https://github.com/vllm-project/vllm-omni) - Multi-modal inference stack extending vLLM for image, audio, and video generation workloads with a unified serving interface. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/vllm-project/vllm-omni?style=social) - [LMCache](https://github.com/LMCache/LMCache) - Supercharge LLM inference with the fastest KV Cache layer. 3-10x delay savings and GPU cycle reduction for multi-round QA and RAG. Integrates seamlessly with vLLM for distributed, high-throughput deployments. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/LMCache/LMCache?style=social) - [vLLM Production Stack](https://github.com/vllm-project/production-stack) - Kubernetes-native production stack for vLLM inference. Automated deployment, autoscaling, and monitoring for enterprise-grade LLM serving. Built by the vLLM team for seamless integration. ![GitHub stars](https://img.shields.io/github/stars/vllm-project/production-stack?style=social) - [Open Model Engine (OME)](https://github.com/sgl-project/ome) - Kubernetes operator for LLM serving with GPU scheduling and model lifecycle management across vLLM, SGLang, and TensorRT-LLM. ![GitHub stars](https://img.shields.io/github/stars/sgl-project/ome?style=social) - [SGLang](https://github.com/sgl-project/sglang) - Next-gen serving framework with RadixAttention. Powers xAI's production workloads at 100K+ GPUs scale. ![GitHub stars](https://img.shields.io/github/stars/sgl-project/sglang?style=social) - [TensorRT-LLM](https://github.com/NVIDIA/TensorRT-LLM) - NVIDIA's official high-performance inference backend. ![GitHub stars](https://img.shields.io/github/stars/NVIDIA/TensorRT-LLM?style=social) - [Aphrodite Engine](https://github.com/aphrodite-engine/aphrodite-engine) - vLLM fork optimized for role-play and creative writing. Supports extensive quantization methods (AQLM, AWQ, GPTQ, GGUF, FP8) and modern samplers. Active development with multi-LoRA and speculative decoding support. ![GitHub stars](https://img.shields.io/github/stars/aphrodite-engine/aphrodite-engine?style=social) - [AIBrix](https://github.com/vllm-project/aibrix) - Cost-efficient and pluggable infrastructure components for GenAI inference. Kubernetes-native control plane for vLLM with distributed KV cache, heterogeneous GPU serving, and intelligent routing. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/vllm-project/aibrix?style=social) - [AISIX](https://github.com/api7/aisix) - Self-hosted Apache-2.0-licensed AI gateway written in Rust, with OpenAI-compatible endpoints, an Anthropic-compatible Messages endpoint, model routing, traffic policies, Prometheus metrics, and OTLP trace export. ![GitHub stars](https://img.shields.io/github/stars/api7/aisix?style=social) - [Triton Inference Server](https://github.com/triton-inference-server/server) - NVIDIA's production-grade open-source inference serving software. Supports multiple frameworks (TensorRT, PyTorch, ONNX) with optimized cloud and edge deployment. ![GitHub stars](https://img.shields.io/github/stars/triton-inference-server/server?style=social) - [mistral.rs](https://github.com/EricLBuehler/mistral.rs) - Fast, flexible Rust-native LLM inference engine built on Candle. Supports text, vision, audio, image generation, and embeddings with hardware-aware auto-tuning. ![GitHub stars](https://img.shields.io/github/stars/EricLBuehler/mistral.rs?style=social) - [KTransformers](https://github.com/kvcache-ai/ktransformers) - Flexible framework for heterogeneous CPU-GPU LLM inference and fine-tuning. Enables running large MoE models by offloading experts to CPU with BF16/FP8 precision support. ![GitHub stars](https://img.shields.io/github/stars/kvcache-ai/ktransformers?style=social) - [llamafile](https://github.com/mozilla-ai/llamafile) - Mozilla's single-file distributable LLM solution. Bundle model weights, inference engine, and runtime into one portable executable that runs on six OSes without installation. ![GitHub stars](https://img.shields.io/github/stars/mozilla-ai/llamafile?style=social) - [Xinference](https://github.com/xorbitsai/inference) - Unified, production-ready inference API for LLMs, speech, and multimodal models. Drop-in GPT replacement with single-line code changes. Supports thousands of models with auto-batching and distributed inference. ![GitHub stars](https://img.shields.io/github/stars/xorbitsai/inference?style=social) - [RTP-LLM (Alibaba)](https://github.com/alibaba/rtp-llm) - Alibaba's high-performance LLM inference acceleration engine. Powers production LLM services across Taobao, Tmall, and Alibaba's international AI platform. Supports PagedAttention, FlashAttention, FlashDecoding, INT8/INT4 quantization, and heterogeneous hardware (GPU/ARM CPU/Intel). Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/alibaba/rtp-llm?style=social) - [LitServe (Lightning AI)](https://github.com/Lightning-AI/LitServe) - Minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling. 2x faster than FastAPI with built-in batching, streaming, and multi-GPU autoscaling. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Lightning-AI/LitServe?style=social) - [LightLLM](https://github.com/ModelTC/LightLLM) - Pure Python-based LLM inference and serving framework with lightweight design, easy extensibility, and high-speed performance. Integrates optimizations from FasterTransformer, TGI, vLLM, and SGLang. ![GitHub stars](https://img.shields.io/github/stars/ModelTC/LightLLM?style=social) - [TabbyAPI](https://github.com/theroyallab/tabbyAPI) - FastAPI-based API server for ExLlamaV2/V3 backends. OpenAI-compatible API with support for model loading/unloading, embeddings, speculative decoding, multi-LoRA, and streaming. ![GitHub stars](https://img.shields.io/github/stars/theroyallab/tabbyAPI?style=social) - [GPUStack](https://github.com/gpustack/gpustack) - GPU cluster manager that orchestrates inference engines like vLLM and SGLang. Automated engine selection, parameter optimization, and distributed multi-GPU deployment for high-performance AI workloads. ![GitHub stars](https://img.shields.io/github/stars/gpustack/gpustack?style=social) - [OpenLLM (BentoML)](https://github.com/bentoml/OpenLLM) - Production-grade platform for running any open-source LLMs as OpenAI-compatible API endpoints. Supports 50+ models with built-in streaming, batching, and auto-acceleration. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/bentoml/OpenLLM?style=social) - [Higress (Alibaba)](https://github.com/alibaba/higress) - AI-native API gateway born from Alibaba's internal infrastructure with 2+ years of production validation. Provides unified LLM API and MCP (Model Context Protocol) management with enterprise-grade 99.99% availability. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/alibaba/higress?style=social) - [NVIDIA Dynamo](https://github.com/ai-dynamo/dynamo) - Datacenter-scale distributed inference serving framework from NVIDIA. Orchestration layer above vLLM/SGLang/TensorRT-LLM with disaggregated serving, KV-aware routing, and automatic scaling. Built in Rust with Python extensibility. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/ai-dynamo/dynamo?style=social) - [Microsoft BitNet](https://github.com/microsoft/BitNet) - Official inference framework for 1-bit LLMs (BitNet b1.58). Enables running large models on CPU with minimal memory footprint. Features custom kernels for ternary weight quantization and efficient matmul operations. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/microsoft/BitNet?style=social) - [FreeLLMAPI](https://github.com/tashfeenahmed/freellmapi) - OpenAI-compatible proxy gateway that stacks the free tiers of multiple LLM providers behind a single endpoint with automatic failover and rate tracking. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/tashfeenahmed/freellmapi?style=social) - [OmniRoute](https://github.com/diegosouzapw/OmniRoute) - Unified AI gateway and proxy supporting over 230 providers with token compression, automatic failover, and routing strategies. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/diegosouzapw/OmniRoute?style=social) - [Switchyard](https://github.com/NVIDIA-NeMo/Switchyard) - Rust proxy and library for routing, protocol translation, and operational metrics across LLM backends and coding agents. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/NVIDIA-NeMo/Switchyard?style=social) - [Bifrost](https://github.com/maximhq/bifrost) - LLM gateway with a unified OpenAI-compatible API across providers, routing, load balancing, fallbacks, guardrails, and observability. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/maximhq/bifrost?style=social) - [freelm](https://github.com/shihabshahrier/freelm) - Python and TypeScript client library, with an optional local OpenAI-compatible server, that pools the free tiers of Gemini, Groq, OpenRouter, Cloudflare Workers AI and other providers with key rotation and failover. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/shihabshahrier/freelm?style=social) - [fitcheck](https://github.com/SIDDARTHAREDDY8/fitcheck) - Zero-dependency Python CLI that plans LLM VRAM before you serve: real per-token KV-cache math, FITS/TIGHT/OOM verdicts, max safe context, and paste-ready vLLM/llama.cpp flags. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/SIDDARTHAREDDY8/fitcheck?style=social) - [Weave Router](https://github.com/weave-os/router) - Self-hostable drop-in proxy for the Anthropic Messages, OpenAI Chat Completions and Gemini APIs that picks a model for each request with an on-box embedder; supports BYOK and OTLP traces and works with Claude Code, Codex, opencode and pi. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/weave-os/router?style=social) - [Ollama Herd](https://github.com/geeks-accelerator/ollama-herd) - Self-hosted router that spreads LLM, embedding, image and speech-to-text requests across machines running Ollama or mlx_lm.server, choosing a node per request by memory fit, thermal state, queue depth and loaded models. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/geeks-accelerator/ollama-herd?style=social) #### Additional Inference Engines - [AirLLM](https://github.com/lyogavin/airllm) - Single-GPU 70B inference stack with strong memory/performance optimizations for local deployment on commodity hardware. ![GitHub stars](https://img.shields.io/github/stars/lyogavin/airllm?style=social) - [Mirage Persistent Kernel](https://github.com/mirage-project/mirage) - Compiler that fuses model execution into a single mega-kernel for tighter performance. ![GitHub stars](https://img.shields.io/github/stars/mirage-project/mirage?style=social) - [vLLM-Ascend](https://github.com/vllm-project/vllm-ascend) - Hardware plugin for running vLLM on Huawei Ascend accelerators. ![GitHub stars](https://img.shields.io/github/stars/vllm-project/vllm-ascend?style=social) - [CTranslate2](https://github.com/OpenNMT/CTranslate2) - Fast inference engine for Transformer models supporting OpenNMT and Hugging Face models. Optimized for CPU and GPU with batching, quantization (INT8/FP16), and dynamic memory management. Powers faster-whisper and other production deployments. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/OpenNMT/CTranslate2?style=social) - [llama-swap](https://github.com/mostlygeek/llama-swap) - Intelligent model swapping proxy for llama.cpp. Enables seamless hot-swapping between different GGUF models without restarting the server, with automatic model loading/unloading and OpenAI-compatible API. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/mostlygeek/llama-swap?style=social) - [optillm](https://github.com/algorithmicsuperintelligence/optillm) - Optimizing inference proxy for LLMs with load balancing, failover, and request routing across multiple providers and models. Improves reliability and performance for production deployments. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/algorithmicsuperintelligence/optillm?style=social) - [Fugusashi](https://github.com/eulogik/fugusashi) - Open-source intelligent model router with CMA-ES evolved routing weights, federated learning for privacy-preserving collaborative routing, and human-interpretable explanations for every decision. OpenAI-compatible API with web dashboard. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/eulogik/fugusashi?style=social) - [OpenRoutiQ](https://github.com/antat-ai/openroutiq) - Explainable, policy-controlled Python router for selecting models, providers, deployments, and reasoning levels, with optional outcome learning and an OpenAI-compatible proxy. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/antat-ai/openroutiq?style=social) - [mllm](https://github.com/UbiquitousLearning/mllm) - Fast and lightweight multimodal LLM inference engine for mobile and edge devices. Optimized for running vision-language models on resource-constrained hardware with efficient memory management. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/UbiquitousLearning/mllm?style=social) - [shimmy](https://github.com/Michael-A-Kuykendall/shimmy) - Python-free Rust inference server with OpenAI API compatibility. Supports GGUF and SafeTensors formats with hot model swap, auto-discovery, and single binary deployment for zero-dependency inference. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Michael-A-Kuykendall/shimmy?style=social) - [PowerInfer](https://github.com/SJTU-IPADS/PowerInfer) - High-speed LLM inference for local deployment on consumer GPUs. Achieves up to 11x speedup over llama.cpp on RTX 4090 by exploiting power-law neuron activation patterns. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/SJTU-IPADS/PowerInfer?style=social) - [distributed-llama](https://github.com/b4rtaz/distributed-llama) - Distributed LLM inference connecting home devices into a powerful cluster. More devices means faster inference via tensor parallelism over Ethernet. Supports Linux, macOS, Windows, ARM, and x86_64 AVX2 CPUs. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/b4rtaz/distributed-llama?style=social) - [ik_llama.cpp](https://github.com/ikawrakow/ik_llama.cpp) - High-performance llama.cpp fork with better CPU and hybrid GPU/CPU performance, SOTA quantization types, first-class Bitnet support, and improved DeepSeek performance via MLA, FlashMLA, and fused MoE operations. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/ikawrakow/ik_llama.cpp?style=social) - [xLLM](https://github.com/jd-opensource/xllm) - High-performance inference engine optimized for Chinese AI accelerators (Cambricon MLU, Hygon DCU, Huawei Ascend). Features service-engine decoupled architecture with elastic scheduling, PD disaggregation, and global KV cache management. Powers JD.com's core retail businesses. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/jd-opensource/xllm?style=social) - [Mooncake](https://github.com/kvcache-ai/Mooncake) - Production-grade serving platform for Kimi (Moonshot AI). Features distributed KV cache pool with intelligent offloading, prefill/decode disaggregation, and cross-instance KV reuse. Integrated with vLLM, SGLang, and TensorRT-LLM. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/kvcache-ai/Mooncake?style=social) - [gemma.cpp](https://github.com/google/gemma.cpp) - Lightweight, standalone C++ inference engine for Google's Gemma models. Optimized for on-device deployment with minimal dependencies and efficient memory usage. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/google/gemma.cpp?style=social) - [FlashInfer](https://github.com/flashinfer-ai/flashinfer) - Kernel library for LLM serving. High-performance CUDA kernels for attention, sampling, and matrix multiplication. Powers vLLM, SGLang, and other inference engines with optimized GPU kernels. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/flashinfer-ai/flashinfer?style=social) #### Inference Kernels & Runtime Primitives - [DeepEP](https://github.com/deepseek-ai/DeepEP) - Communication library for efficient expert-parallel training/inference pipelines, reducing MoE cross-device communication overhead. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/deepseek-ai/DeepEP?style=social) - [FlashKDA](https://github.com/MoonshotAI/FlashKDA) - High-performance CUTLASS-based Kimi Delta Attention CUDA kernels for linear attention mechanisms. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/MoonshotAI/FlashKDA?style=social) - [DeepGEMM](https://github.com/deepseek-ai/DeepGEMM) - Clean, high-performance FP8 GEMM kernels with fine-grained scaling for modern inference workloads. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/deepseek-ai/DeepGEMM?style=social) - [RAFT](https://github.com/rapidsai/raft) - CUDA-accelerated algorithms and ANN building blocks for high-performance similarity search, clustering, and matrix learning workloads. ![GitHub stars](https://img.shields.io/github/stars/rapidsai/raft?style=social) - [ThunderKittens](https://github.com/HazyResearch/ThunderKittens) - CUDA tile primitives and kernel templates for accelerating transformer attention blocks. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/HazyResearch/ThunderKittens?style=social) - [tt-metal](https://github.com/tenstorrent/tt-metal) - TT-Metalium + TT-NN operator stack for building and optimizing kernels on Tenstorrent AI accelerators. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/tenstorrent/tt-metal?style=social) - [mini-sglang](https://github.com/sgl-project/mini-sglang) - Compact implementation of SGLang designed to demystify modern LLM serving systems. Educational yet production-quality with RadixAttention, continuous batching, and speculative decoding. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/sgl-project/mini-sglang?style=social) #### Quantization, Distillation & Optimization - [bitsandbytes](https://github.com/bitsandbytes-foundation/bitsandbytes) - 8-bit and 4-bit optimizers + quantization. ![GitHub stars](https://img.shields.io/github/stars/bitsandbytes-foundation/bitsandbytes?style=social) - [Optimum](https://github.com/huggingface/optimum) - Hardware-specific acceleration and quantization. ![GitHub stars](https://img.shields.io/github/stars/huggingface/optimum?style=social) --- ## 4. Agentic AI & Multi-Agent Systems > Frameworks and platforms for building agent-based systems and multi-agent workflows. #### Single-Agent Frameworks - [AutoGPT](https://github.com/Significant-Gravitas/AutoGPT) - The original autonomous AI agent framework that sparked the agent revolution. Vision of accessible AI for everyone with modular agent architecture, benchmark testing, and forge-based agent building. 183k+ stars. ![GitHub stars](https://img.shields.io/github/stars/Significant-Gravitas/AutoGPT?style=social) - [LangGraph](https://github.com/langchain-ai/langgraph) - Stateful, controllable agent orchestration. ![GitHub stars](https://img.shields.io/github/stars/langchain-ai/langgraph?style=social) - [CrewAI](https://github.com/crewAIInc/crewAI) - Role-based agent framework. ![GitHub stars](https://img.shields.io/github/stars/crewAIInc/crewAI?style=social) - [AutoGen (AG2)](https://github.com/microsoft/autogen) - Flexible multi-agent conversation framework. ![GitHub stars](https://img.shields.io/github/stars/microsoft/autogen?style=social) - [DSPy](https://github.com/stanfordnlp/dspy) - Framework for programming language model pipelines with modules, optimizers, and evaluation loops. ![GitHub stars](https://img.shields.io/github/stars/stanfordnlp/dspy?style=social) - [Semantic Kernel](https://github.com/microsoft/semantic-kernel) - SDK for building and orchestrating AI agents and workflows across multiple programming languages. ![GitHub stars](https://img.shields.io/github/stars/microsoft/semantic-kernel?style=social) - [System One SDK](https://github.com/ziyu/system-one-sdk) - TypeScript API/SDK for AI agent decision workflows: typed choices, scores, and probabilities via one evaluate() call. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/ziyu/system-one-sdk?style=social) - [smolagents](https://github.com/huggingface/smolagents) - Lightweight agent framework centered on tool use and code-executing workflows. ![GitHub stars](https://img.shields.io/github/stars/huggingface/smolagents?style=social) - [LangChain](https://github.com/langchain-ai/langchain) - Foundational library for agents, chains, and memory. ![GitHub stars](https://img.shields.io/github/stars/langchain-ai/langchain?style=social) - [Neuron AI](https://github.com/neuron-core/neuron-ai) - PHP Agentic Framework for building production-ready AI driven applications. Connect components (LLMs, vector DBs, memory) to agents that can interact with your data. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/neuron-core/neuron-ai?style=social) - [II-Agent (Intelligent Internet)](https://github.com/Intelligent-Internet/ii-agent) - New open-source framework to build and deploy intelligent agents with support for Claude, Gemini, and OpenAI models. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Intelligent-Internet/ii-agent?style=social) - [Hermes Agent (NousResearch)](https://github.com/NousResearch/hermes-agent) - The agent that grows with you. Autonomous server-side agent with persistent memory that learns and improves over time. ![GitHub stars](https://img.shields.io/github/stars/NousResearch/hermes-agent?style=social) - [Strands Agents](https://github.com/strands-agents/sdk-python) - Model-driven approach to building AI agents in just a few lines of code. Multi-agent systems, autonomous agents, and streaming support with built-in MCP. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/strands-agents/sdk-python?style=social) - [Agno](https://github.com/agno-agi/agno) - Build, run, and manage agentic software at scale. High-performance framework for multi-agent systems with memory, knowledge, and tools. ![GitHub stars](https://img.shields.io/github/stars/agno-agi/agno?style=social) - [Upsonic](https://github.com/Upsonic/Upsonic) - Agent framework for fintech and banking with built-in MCP support, guardrails, and tool server architecture. ![GitHub stars](https://img.shields.io/github/stars/Upsonic/Upsonic?style=social) - [VoltAgent](https://github.com/VoltAgent/voltagent) - TypeScript-first AI agent engineering platform with memory, RAG, workflows, MCP integration, and voice support. ![GitHub stars](https://img.shields.io/github/stars/VoltAgent/voltagent?style=social) - [PocketFlow](https://github.com/The-Pocket/PocketFlow) - 100-line minimalist LLM framework for building agent workflows. Lightweight, extensible architecture for tool use and autonomous task execution. ![GitHub stars](https://img.shields.io/github/stars/The-Pocket/PocketFlow?style=social) - [Agent Development Kit (Google)](https://github.com/google/adk-python) - Code-first Python toolkit for building sophisticated AI agents with multi-agent orchestration, built-in evaluation, and flexible deployment. Model-agnostic with tight Google ecosystem integration. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/google/adk-python?style=social) - [PydanticAI](https://github.com/pydantic/pydantic-ai) - Type-safe AI agent framework from the creators of Pydantic. Model-agnostic with 20+ providers, built-in observability via Logfire, MCP/A2A protocol support, and YAML/JSON agent definitions. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/pydantic/pydantic-ai?style=social) - [Griptape](https://github.com/griptape-ai/griptape) - Modular Python framework for AI agents and workflows with chain-of-thought reasoning, tools, and memory. Enforces structures like sequential pipelines and DAG-based workflows for predictable AI systems. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/griptape-ai/griptape?style=social) - [Langroid](https://github.com/langroid/langroid) - Harness LLMs with multi-agent programming. Mature tool calling system based on Pydantic, supports hundreds of LLM providers including OpenAI and local servers. Built for robust agent behavior in real-world use cases. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/langroid/langroid?style=social) - [Octomind](https://github.com/Muvon/octomind) - Model-agnostic AI agent runtime written in Rust with specialist agents, MCP support, multiple provider integrations, and zero-config setup. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Muvon/octomind?style=social) - [Marvin](https://github.com/PrefectHQ/marvin) - Python framework for structured outputs and agentic AI workflows. Simplifies LLM interactions with type-safe interfaces, automatic schema generation, and built-in observability. From the creators of Prefect. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/PrefectHQ/marvin?style=social) - [Burr](https://github.com/apache/burr) - Apache incubating framework for building stateful AI applications (chatbots, agents, simulations). Monitor, trace, persist, and execute on your own infrastructure with built-in UI and pluggable memory. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/apache/burr?style=social) - [KaibanJS](https://github.com/kaiban-ai/KaibanJS) - JavaScript-native framework for building and managing multi-agent systems with a Kanban-inspired approach. Visual task board for AI agents with real-time collaboration features. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/kaiban-ai/KaibanJS?style=social) - [Jido](https://github.com/agentjido/jido) - Autonomous agent framework for Elixir. Built for distributed, autonomous behavior and dynamic workflows with actor-model concurrency. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/agentjido/jido?style=social) - [Flue](https://github.com/withastro/flue) - Programmable TypeScript harness and sandbox agent framework for building autonomous workflows and agents. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/withastro/flue?style=social) - [Agent-Native](https://github.com/BuilderIO/agent-native) - TypeScript-first framework for building agent-first applications featuring shared database state, real-time multiplayer editing, and action-driven tools. ISC licensed. ![GitHub stars](https://img.shields.io/github/stars/BuilderIO/agent-native?style=social) - [rlm](https://github.com/alexzhang13/rlm) - General plug-and-play inference library for Recursive Language Models (RLMs) that programmatically execute sub-LM calls inside isolated code sandboxes. ![GitHub stars](https://img.shields.io/github/stars/alexzhang13/rlm?style=social) - [Page Agent](https://github.com/alibaba/page-agent) - JavaScript-native, in-page GUI agent framework for controlling web interfaces with natural language without screenshots or external browser automation. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/alibaba/page-agent?style=social) - [Computer (Cloudflare)](https://github.com/cloudflare/computer) - Virtual filesystem inside a Durable Object providing sandboxed execution environments for AI agents. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/cloudflare/computer?style=social) - [Embabel](https://github.com/embabel/embabel-agent) - Agent framework for the JVM written in Kotlin with dynamic goal-oriented planning and Spring Boot integration. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/embabel/embabel-agent?style=social) - [Ouroboros](https://github.com/razzant/ouroboros) - Self-hosted general-purpose agent with durable identity and memory, specialist subagent coordination, and reviewed changes to its own implementation. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/razzant/ouroboros?style=social) - [OpenAmer](https://github.com/openamer/openamer) - Open-source Windows-native agent that runs its cognition in-process (five native tools: think, learn, remember, trigger, heartbeat) and operates the real desktop locally — filesystem, terminal, GUI and browser over the Chrome DevTools Protocol. A single 10-subsystem heartbeat replaces 84 cron entries, and an A2A mesh routes work peer-to-peer between instances. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/openamer/openamer?style=social) - [CUGA](https://github.com/cuga-project/cuga-agent) - IBM Research generalist agent harness built on LangGraph that runs tasks over APIs (OpenAPI, MCP, LangChain tools) and the web, with configurable policies and human-in-the-loop tool approval. ![GitHub stars](https://img.shields.io/github/stars/cuga-project/cuga-agent?style=social) #### Multi-Agent Orchestration - [ChatDev](https://github.com/OpenBMB/ChatDev) - Multi-agent software development framework where AI agents collaborate as programmers, designers, and testers to build software. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/OpenBMB/ChatDev?style=social) - [CAMEL](https://github.com/camel-ai/camel) - First and best multi-agent framework for building scalable agent systems. Apache 2.0 licensed with extensive tooling for agent communication and task automation. ![GitHub stars](https://img.shields.io/github/stars/camel-ai/camel?style=social) - [DeepAgents](https://github.com/langchain-ai/deepagents) - Batteries-included LangChain agent harness for building and running structured multi-agent workflows with reusable runtime patterns. ![GitHub stars](https://img.shields.io/github/stars/langchain-ai/deepagents?style=social) - [EvoFlux](https://github.com/evoelsewhere/evoflux) - Local-first desktop workspace for coordinating AI agent teams across conversations, files, terminal, browser, Git, memory, plugins, and verification. ![GitHub stars](https://img.shields.io/github/stars/evoelsewhere/evoflux?style=social) - [Swarms](https://github.com/kyegomez/swarms) - Bleeding-edge enterprise multi-agent orchestration. ![GitHub stars](https://img.shields.io/github/stars/kyegomez/swarms?style=social) - [Mastra](https://github.com/mastra-ai/mastra) - TypeScript-first agent framework with built-in RAG, workflows, tool integrations, observability and observational memory. ![GitHub stars](https://img.shields.io/github/stars/mastra-ai/mastra?style=social) - [Nika](https://github.com/supernovae-st/nika) - Workflow engine for AI where agent work is captured as reviewable .nika.yaml DAG files, statically checked before execution (schema, permits, cost floor) with tamper-evident traces after. Local-first (Ollama, llama.cpp, vLLM), MCP client and server. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/supernovae-st/nika?style=social) - [Deer-Flow (ByteDance)](https://github.com/bytedance/deer-flow) - Open-source long-horizon SuperAgent harness that researches, codes, and creates. Handles tasks from minutes to hours with sandboxes, memories, tools, skills, subagents, and message gateway. ![GitHub stars](https://img.shields.io/github/stars/bytedance/deer-flow?style=social) - [OpenAI Agents SDK](https://github.com/openai/openai-agents-python) - Production-ready lightweight framework for multi-agent workflows. The evolution of Swarm with enhanced orchestration capabilities and enterprise-grade features. ![GitHub stars](https://img.shields.io/github/stars/openai/openai-agents-python?style=social) - [Symphony](https://github.com/openai/symphony) - Turns project work into isolated, autonomous implementation runs. Monitors work boards, spawns agents to handle tasks, and provides proof of work including CI status, PR reviews, and walkthrough videos. Engineering preview for managing work instead of supervising coding agents. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/openai/symphony?style=social) - [Paperclip](https://github.com/paperclipai/paperclip) - AI agent company and orchestration framework with 55K+ stars. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/paperclipai/paperclip?style=social) - [AgentScope](https://github.com/agentscope-ai/agentscope) - Alibaba's production-ready multi-agent framework with 23K+ stars. Features built-in MCP and A2A support, message hub for flexible orchestration, and AgentScope Runtime for production deployment. ![GitHub stars](https://img.shields.io/github/stars/agentscope-ai/agentscope?style=social) - [Microsoft Agent Framework](https://github.com/microsoft/agent-framework) - Microsoft's official framework combining AutoGen's agent abstractions with Semantic Kernel's enterprise features. Supports Python and .NET with graph-based workflows. ![GitHub stars](https://img.shields.io/github/stars/microsoft/agent-framework?style=social) - [NarraNexus](https://github.com/NetMindAI-Open/NarraNexus) - A ready-to-run AI agent team workspace whose agents remember, collaborate, and use tools from day one. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/NetMindAI-Open/NarraNexus?style=social) - [Agency Swarm](https://github.com/VRSEN/agency-swarm) - Reliable multi-agent orchestration framework built on top of the OpenAI Assistants API with organizational structure modeling. ![GitHub stars](https://img.shields.io/github/stars/VRSEN/agency-swarm?style=social) - [elizaOS](https://github.com/elizaOS/eliza) - Autonomous multi-agent framework for building and deploying AI-powered applications. Features Discord/Telegram/Farcaster connectors, RAG support, and a modern web dashboard. ![GitHub stars](https://img.shields.io/github/stars/elizaOS/eliza?style=social) - [OpenAgents](https://github.com/openagents-org/openagents) - AI Agent Networks for Open Collaboration. Platform for building collaborative multi-agent systems with shared knowledge and distributed task execution. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/openagents-org/openagents?style=social) - [Hive (Aden)](https://github.com/aden-hive/hive) - Production-grade multi-agent orchestration framework with 10K+ stars. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/aden-hive/hive?style=social) - [Agent Squad (AWS Labs)](https://github.com/awslabs/agent-squad) - Flexible multi-agent orchestration framework with intelligent intent classification and context management. Supports Python and TypeScript with pre-built agents for Bedrock, Lex, and custom integrations. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/awslabs/agent-squad?style=social) - [DeepResearchAgent](https://github.com/SkyworkAI/DeepResearchAgent) - Hierarchical multi-agent system for deep research tasks with automated task decomposition and execution across complex domains. ![GitHub stars](https://img.shields.io/github/stars/SkyworkAI/DeepResearchAgent?style=social) - [Composio Agent Orchestrator](https://github.com/ComposioHQ/agent-orchestrator) - Agentic orchestrator for parallel coding agents. Plans tasks, spawns agents, and autonomously handles CI fixes, merge conflicts, and code reviews. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/ComposioHQ/agent-orchestrator?style=social) - [Open Multi-Agent](https://github.com/open-multi-agent/open-multi-agent) - MIT-licensed TypeScript-native orchestration framework that plans multi-agent task DAGs at runtime, with approval gates, tracing, evaluation, checkpoints, and resumable execution in your own environment. ![GitHub stars](https://img.shields.io/github/stars/open-multi-agent/open-multi-agent?style=social) - [BeeAI Framework (IBM)](https://github.com/i-am-bee/beeai-framework) - Production-ready multi-agent framework in Python and TypeScript. Features workflow orchestration, ACP/MCP protocol support, and deep watsonx integration. Part of Linux Foundation AI & Data program. ![GitHub stars](https://img.shields.io/github/stars/i-am-bee/beeai-framework?style=social) - [AI Town](https://github.com/a16z-infra/ai-town) - Deployable starter kit for building virtual towns where AI characters live, chat and socialize. Inspired by Stanford's Generative Agents research with persistent agent memory and social interactions. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/a16z-infra/ai-town?style=social) - [Conductor OSS](https://github.com/conductor-oss/conductor) - Event-driven agentic orchestration platform providing durable and resilient execution engine for applications and AI agents. Battle-tested at Netflix, Tesla, LinkedIn, and J.P. Morgan with 30K+ stars. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/conductor-oss/conductor?style=social) - [A2A Protocol](https://github.com/a2aproject/A2A) - Agent2Agent (A2A) open protocol enabling communication and interoperability between opaque agentic applications. Donated to Linux Foundation by Google with 50+ technology partners. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/a2aproject/A2A?style=social) - [777genius/agent-teams-ai](https://github.com/777genius/agent-teams-ai) - Open-source desktop app for coordinating autonomous coding-agent teams with inter-agent messaging, Kanban task management, and code review across Claude Code, Codex, OpenCode, Cursor, Grok, GitHub Copilot, Kiro, Z.AI, MiniMax, Kimi, and 75+ LLM providers. ![GitHub stars](https://img.shields.io/github/stars/777genius/agent-teams-ai?style=social) - [Panniantong/Agent-Reach](https://github.com/Panniantong/Agent-Reach) - Reusable search and web-ingestion layer for AI agents spanning Reddit, X/Twitter, YouTube, GitHub, Bilibili and more through one CLI. ![GitHub stars](https://img.shields.io/github/stars/Panniantong/Agent-Reach?style=social) - [xerrors/Yuxi](https://github.com/xerrors/Yuxi) - Self-hosted multi-tenant agent harness combining retrieval, knowledge graph grounding, and workflow orchestration for production teams. ![GitHub stars](https://img.shields.io/github/stars/xerrors/Yuxi?style=social) - [Sim Studio](https://github.com/simstudioai/sim) - Open-source AI workspace for building, deploying, and orchestrating AI agents. Visual canvas with 1000+ integrations, multi-framework support (Agno, OpenAI, LangChain, Google ADK), and self-hosted or cloud deployment. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/simstudioai/sim?style=social) - [2FastLabs Agent Squad](https://github.com/2FastLabs/agent-squad) - Flexible, lightweight open-source framework for orchestrating multiple AI agents to handle complex conversations with parallel execution capabilities. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/2FastLabs/agent-squad?style=social) - [SIA](https://github.com/hexo-ai/sia) - Self-improving framework that orchestrates meta, target, and feedback agents to autonomously optimize the performance of AI models and agents on benchmark tasks. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/hexo-ai/sia?style=social) - [Council of High Intelligence](https://github.com/0xNyk/council-of-high-intelligence) - Multi-agent deliberation framework that routes specialized personas across different LLM providers to debate topics and reach consensus. ![GitHub stars](https://img.shields.io/github/stars/0xNyk/council-of-high-intelligence?style=social) - [Gas Town](https://github.com/gastownhall/gastown) - Multi-agent workspace manager and orchestration system for Claude Code and other coding agents with persistent work tracking, mailboxes, and automated merge queues. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/gastownhall/gastown?style=social) - [Agentlas OS Agent Operation Environment (AOE)](https://github.com/agentlas-ai/Agentlas-OS) - Local-first, model-agnostic environment for building, borrowing, and orchestrating specialist agents and teams across supported LLM hosts, with owner-scoped packages and host-enforced permissions. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/agentlas-ai/Agentlas-OS?style=social) - [Open Deep Research](https://github.com/langchain-ai/open_deep_research) - Open-source deep research assistant that orchestrates language models and search tools to run multi-step web research and compile reports. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/langchain-ai/open_deep_research?style=social) - [Claudexor](https://github.com/razzant/claudexor) - Local-first control plane for routing coding work across Claude Code, Codex, Cursor, and OpenCode, with quota-aware rotation across multiple Claude/Codex subscription profiles, shared thread context, best-of-N runs, and cross-model review. ![GitHub stars](https://img.shields.io/github/stars/razzant/claudexor?style=social) - [MiroFish](https://github.com/666ghj/MiroFish) - Multi-agent swarm intelligence engine that constructs parallel digital environments with autonomous agents to simulate and predict real-world outcomes. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/666ghj/MiroFish?style=social) - [Maka](https://github.com/apache/maka) - Apache-incubating local-first AI-agent workspace with durable append-only agent execution history, licensed under Apache-2.0. ![GitHub stars](https://img.shields.io/github/stars/apache/maka?style=social) - [Ruflo](https://github.com/ruvnet/ruflo) - Multi-agent orchestration and meta-harness for coordinating agent swarms with shared memory, licensed under the MIT license. ![GitHub stars](https://img.shields.io/github/stars/ruvnet/ruflo?style=social) - [munder-difflin](https://github.com/chaitanyagiri/munder-difflin) - MIT-licensed desktop multi-agent workspace and harness for coordinating local coding agents across multiple LLM backends. ![GitHub stars](https://img.shields.io/github/stars/chaitanyagiri/munder-difflin?style=social) - [fractal](https://github.com/plasma-ai/fractal) - Hierarchical coding-agent orchestrator with recursive delegation, per-node Git worktrees, configurable limits, persistent SQLite state, and live terminal monitoring and steering. ![GitHub stars](https://img.shields.io/github/stars/plasma-ai/fractal?style=social) - [AX (Google)](https://github.com/google/ax) - Declarative, high-throughput agent orchestration runtime for sandboxed agent workloads at cluster scale. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/google/ax?style=social) - [Strands Agent Harness](https://github.com/strands-agents/harness-sdk) - Production SDK and harness runtime for building, monitoring, and controlling end-to-end AI agent lifecycles in Python and TypeScript. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/strands-agents/harness-sdk?style=social) - [StarNet](https://github.com/androoAGI/starnet) - Local-first desktop multi-agent harness with persistent workspaces, capability-scoped tools, agent memory, budgets, schedules, and live runtime visualization. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/androoAGI/starnet?style=social) - [OpenRig](https://github.com/mvschwarz/openrig) - Local multi-agent harness for defining persistent Claude Code and Codex teams, with YAML topologies, tmux sessions, durable state, and a shared terminal UI. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/mvschwarz/openrig?style=social) - [Raven](https://github.com/EverMind-AI/Raven) - Multi-agent harness whose host agent plans complex tasks as DAGs and delegates them to built-in research, coding, design, and on-call agents or to third-party agents over ACP, CLI, or OpenAI-compatible APIs, with cross-session memory and an experimental self-evolution loop that installs only verified changes. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/EverMind-AI/Raven?style=social) - [5dive](https://github.com/5dive-ai/5dive) - Self-hosted CLI that runs a team of AI agents on one Linux server, each its own Linux user running Claude Code, Codex or another official agent CLI as a systemd service, sharing an org chart and a backlog. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/5dive-ai/5dive?style=social) - [subagent-tuner](https://github.com/Kruhlikau/subagent-tuner) - Claude Code mod that sets the model and reasoning effort of each subagent by asking the user, by task-kind recommendation, or from a saved default. ![GitHub stars](https://img.shields.io/github/stars/Kruhlikau/subagent-tuner?style=social) - [apowerb](https://github.com/apowerb/apowerb) - Platform to build, run and govern multi-agent systems on ADK, with RAG, Text-to-SQL, MCP tools, token quotas and per-session audit. Apache 2.0 licensed, self-hosted with Docker Compose or Helm. ![GitHub stars](https://img.shields.io/github/stars/apowerb/apowerb?style=social) - [Frink](https://github.com/benord-labs/frink) - Desktop-first, open-source application for running parallel agents, and multi-step custom workflows triggered by schedules, webhooks or events from tools like Linear and Sentry, across your already-used providers. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/benord-labs/frink?style=social) #### Agent Protocols & Standards - [Agent Gateway](https://github.com/agentgateway/agentgateway) - Next-generation proxy and routing layer for AI agents and MCP servers, with Kubernetes-native transport, protocol interoperability, and service-mesh-style isolation for reliable agent infrastructure. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/agentgateway/agentgateway?style=social) - [Microsandbox](https://github.com/superradcompany/microsandbox) - Fast, local-first microVM runtime and library for isolated execution of AI agents and untrusted workloads. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/superradcompany/microsandbox?style=social) - [Agent Substrate](https://github.com/agent-substrate/substrate) - Kubernetes-native execution runtime for high-density, stateful AI-agent sandboxes with actor lifecycle management, suspend/resume, and workload routing. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/agent-substrate/substrate?style=social) - [DESIGN.md (Google)](https://github.com/google-labs-code/design.md) - A format specification for describing visual identity to coding agents, combining YAML tokens and markdown prose to give agents a structured understanding of design systems. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/google-labs-code/design.md?style=social) - [Agent Skills](https://github.com/agentskills/agentskills) - Standardized specification and document format for bundling and progressively loading AI agent capabilities, instructions, scripts, and resources. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/agentskills/agentskills?style=social) - [FastMCP](https://github.com/PrefectHQ/fastmcp) - A Python framework for building Model Context Protocol (MCP) servers and clients with automatic schema generation and validation. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/PrefectHQ/fastmcp?style=social) #### Agent Context, Memory & Knowledge - [OpenViking](https://github.com/volcengine/OpenViking) - Open-source context database for AI agents that unifies agent memory, knowledge RAG, and skills as a virtual filesystem. AGPL 3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/volcengine/OpenViking?style=social) - [LWC (Local Wiki CLI)](https://github.com/JanYork/llm-wiki-cli) - Local-first, source-grounded project memory for coding agents with bounded MCP retrieval, citations and provenance, atomic changesets, and optional document and code knowledge graphs. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/JanYork/llm-wiki-cli?style=social) - [Obsidian Agent Skills](https://github.com/kepano/obsidian-skills) - Agent skills and open-format tooling for Obsidian vaults, Markdown, Bases, and JSON Canvas compatible with Claude Code, Codex, and OpenCode. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/kepano/obsidian-skills?style=social) - [claude-obsidian](https://github.com/AgriciDaniel/claude-obsidian) - MIT-licensed Obsidian and Claude Code integration that organizes Markdown vaults with local indexing and links. ![GitHub stars](https://img.shields.io/github/stars/AgriciDaniel/claude-obsidian?style=social) - [Cangjie Skill](https://github.com/kangarooking/cangjie-skill) - Pipeline to distill books, videos, and podcasts into structured, executable agent skills using verification and testing workflows. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/kangarooking/cangjie-skill?style=social) - [Hexis](https://github.com/Bevel-Software/Hexis) - Git-backed platform for managing and sharing skills, tools, and context across AI agents through a remote MCP server. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Bevel-Software/Hexis?style=social) - [Codegraph](https://github.com/colbymchenry/codegraph) - Local pre-indexed code knowledge graph for coding agents to reduce token usage and redundant tool calls across Claude, Codex, and other agents. ![GitHub stars](https://img.shields.io/github/stars/colbymchenry/codegraph?style=social) - [Wenlan](https://github.com/7xuanlu/wenlan) - Local source-backed AI knowledge base and LLM wiki for coding agents, with Markdown pages, hybrid retrieval, knowledge graphs, CLI workflows, and MCP integrations. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/7xuanlu/wenlan?style=social) - [Gortex](https://github.com/zzet/gortex) - Local-first code knowledge graph and code intelligence engine built in Golang with multi-repository support and real-time graph actualisation. Built for AI coding agents aiming to expose only the needed information, reducing token usage by up to 50x. Works natively with Claude, Codex, Hermes, and other agents. ![GitHub stars](https://img.shields.io/github/stars/zzet/gortex?style=social) - [Graphify](https://github.com/safishamsi/graphify) - AI coding assistant skill that indexes codebases, databases, and documents into a queryable knowledge graph for coding agents. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/safishamsi/graphify?style=social) - [Workspai](https://github.com/chistiq/workspai) - Open-source workspace intelligence CLI that models polyglot workspaces, builds proof-backed knowledge graphs, runs health and release gates, and generates bounded context for AI coding agents. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/chistiq/workspai?style=social) - [Headroom](https://github.com/chopratejas/headroom) - Context compression proxy for tool outputs, logs, and RAG chunks, reducing token pressure while preserving intent for AI agents. ![GitHub stars](https://img.shields.io/github/stars/chopratejas/headroom?style=social) - [llmtrim](https://github.com/fkiene/llmtrim) - Self-hosted Rust proxy, MCP server, CLI, and library that compresses LLM prompts, tool outputs, and replies to cut token usage, quality-gated so it never raises your bill. MPL-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/fkiene/llmtrim?style=social) - [MailFathom](https://github.com/Krzysztof318/MailFathom) - Security-first, self-hosted email knowledge system that synchronizes IMAP mailboxes into user-owned PostgreSQL for lexical and semantic retrieval, cited answers, local-model operation, and MCP access. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Krzysztof318/MailFathom?style=social) - [MemPalace](https://github.com/MemPalace/mempalace) - High-performance, benchmarked AI memory system for persistent recall and retrieval in long-horizon autonomous workflows. ![GitHub stars](https://img.shields.io/github/stars/MemPalace/mempalace?style=social) - [Tree Ring Memory](https://github.com/TerminallyLazy/Tree-Ring-Memory) - Framework-agnostic, local-first memory lifecycle for AI agents with a Rust CLI, SQLite/FTS recall, redaction, forgetting, audit checks, consolidation, and agent-skill guidance. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/TerminallyLazy/Tree-Ring-Memory?style=social) - [deja](https://github.com/vshulcz/deja-vu) - Memory layer over the session transcripts coding agents already write to disk — Claude Code, Codex, Cursor, opencode, Zed and more — including sessions from before it was installed; local BM25 recall over them with no LLM or embeddings, MCP tools, and credentials redacted at index time. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/vshulcz/deja-vu?style=social) - [Claude Mem](https://github.com/thedotmack/claude-mem) - Persistent agent-memory system that captures session observations, summarizes them, and retrieves relevant context across coding-agent sessions. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/thedotmack/claude-mem?style=social) - [codebase-memory-mcp](https://github.com/DeusData/codebase-memory-mcp) - High-performance C-based codebase intelligence engine and MCP server that indexes repositories into local type-resolved knowledge graphs. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/DeusData/codebase-memory-mcp?style=social) - [book-to-skill](https://github.com/virgiliojr94/book-to-skill) - CLI tool that distills technical books, documents, and reference materials into structured, on-demand agent skills. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/virgiliojr94/book-to-skill?style=social) - [gknowledge](https://github.com/openapi/gknowledge) - Native GNOME desktop app (GTK 4, Libadwaita) implementing the Karpathy LLM Wiki pattern: ingests documents into an Obsidian-compatible Markdown wiki with source provenance, works offline or with Ollama and OpenAI-compatible endpoints, and exposes the wiki to coding agents through an MCP server. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/openapi/gknowledge?style=social) - [AI Memory](https://github.com/akitaonrails/ai-memory) - Rust-native long-term memory server and MCP client for agent coding CLIs, featuring Karpathy-style LLM wiki compilation, FTS5 recall, and cross-agent session handoffs. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/akitaonrails/ai-memory?style=social) - [Busabase](https://github.com/busabase/busabase) - Open-source database and workspace that gives AI agents structured data, durable knowledge, docs, skills, and apps through MCP, OpenAPI, CLI, and coding-agent skills; material writes can remain reviewable ChangeRequests before becoming canonical. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/busabase/busabase?style=social) - [ThreadShelf](https://github.com/ChrystianSchutz/ThreadShelf) - Local-first archive and semantic search for AI conversation histories across multiple providers, with local embeddings, LanceDB storage, complete thread retrieval, HTTP and CLI access, and a stdio MCP server. ![GitHub stars](https://img.shields.io/github/stars/ChrystianSchutz/ThreadShelf?style=social) - [drevon](https://github.com/csakash/drevon) - `npx drevon init` turns any directory into an AI workspace with one shared config, persistent cross-session memory, prompts and skills for Claude Code, Codex, Copilot, Cursor, Windsurf, Cline, Aider and Continue. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/csakash/drevon?style=social) - [cocoindex-code](https://github.com/cocoindex-io/cocoindex-code) - Embedded, AST-aware code search CLI and MCP server that chunks a repository with tree-sitter grammars, embeds it into a local SQLite index, and re-indexes only the files that changed, for coding agents. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/cocoindex-io/cocoindex-code?style=social) #### Autonomous Coding Agents - [BitFun](https://github.com/GCWing/BitFun) - Open-source coding agent with a Rust runtime, desktop and CLI interfaces, self-hosted remote access, and support for custom tools and skills. ![GitHub stars](https://img.shields.io/github/stars/GCWing/BitFun?style=social) - [Free Claude Code](https://github.com/Alishahryar1/free-claude-code) - Multi-provider proxy and launcher for Claude Code, Codex, and Pi with a local Admin UI to route coding agents to 31+ cloud and local LLM backends. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Alishahryar1/free-claude-code?style=social) - [Background Agents](https://github.com/ColeMurray/background-agents) - Open-source background coding agent system inspired by Ramp's Inspect, supporting file and environment snapshots, cron-based automation, and multi-provider models. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/ColeMurray/background-agents?style=social) - [OpenHands (ex-OpenDevin)](https://github.com/All-Hands-AI/OpenHands) - Full-featured open-source AI software engineer. ![GitHub stars](https://img.shields.io/github/stars/All-Hands-AI/OpenHands?style=social) - [HEXStrike AI](https://github.com/0x4m4/hexstrike-ai) - MCP-powered coding-focused cybersecurity agent framework for automated pentesting and bug-hunting workflows. ![GitHub stars](https://img.shields.io/github/stars/0x4m4/hexstrike-ai?style=social) - [Darkmoon](https://github.com/ASCIT31/Dark-Moon) - Open-source autonomous AI pentest platform and MCP host orchestrating 80+ offensive tools via per-tech offensive sub-agents, with Active Directory and Kubernetes support. GPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/ASCIT31/Dark-Moon?style=social) - [VulnClaw](https://github.com/Unclecheng-li/VulnClaw) - Autonomous penetration testing agent utilizing Model Context Protocol (MCP) toolchains, blackboard state space search, and structured reasoning. ![GitHub stars](https://img.shields.io/github/stars/Unclecheng-li/VulnClaw?style=social) - [Goose](https://github.com/aaif-goose/goose) - Extensible on-machine AI agent for development tasks. ![GitHub stars](https://img.shields.io/github/stars/aaif-goose/goose?style=social) - [OpenShell (NVIDIA)](https://github.com/NVIDIA/OpenShell) - Safe and private runtime for autonomous AI agents with policy-driven execution boundaries and CLI integration. ![GitHub stars](https://img.shields.io/github/stars/NVIDIA/OpenShell?style=social) - [OpenCode](https://github.com/anomalyco/opencode) - Terminal-native autonomous coding agent. ![GitHub stars](https://img.shields.io/github/stars/anomalyco/opencode?style=social) - [ECC](https://github.com/affaan-m/ECC) - Performance-oriented agent harness for coding agents with skills, memory, and security-aware orchestration across Claude Code, Codex, and more. ![GitHub stars](https://img.shields.io/github/stars/affaan-m/ECC?style=social) - [oh-my-pi](https://github.com/can1357/oh-my-pi) - Terminal coding agent with hash-anchored edits, subagents, LSP, browser integrations, and terminal-native workflows. ![GitHub stars](https://img.shields.io/github/stars/can1357/oh-my-pi?style=social) - [Pi (earendil-works)](https://github.com/earendil-works/pi) - Modular agent toolkit with terminal-first CLI, unified model/provider layer, and runtime integrations for coding workflows and TUI/web UIs. ![GitHub stars](https://img.shields.io/github/stars/earendil-works/pi?style=social) - [Aider](https://github.com/paul-gauthier/aider) - Command-line pair-programming agent. ![GitHub stars](https://img.shields.io/github/stars/paul-gauthier/aider?style=social) - [Pi (badlogic)](https://github.com/badlogic/pi-mono) - Terminal coding agent with hash-anchored edits, LSP integration, subagents, MCP support, and package ecosystem. ![GitHub stars](https://img.shields.io/github/stars/badlogic/pi-mono?style=social) - [Mistral-Vibe (Mistral)](https://github.com/mistralai/mistral-vibe) - Minimal CLI coding agent by Mistral. Lightweight, fast, and designed for local development workflows. ![GitHub stars](https://img.shields.io/github/stars/mistralai/mistral-vibe?style=social) - [Nanocoder (Nano-Collective)](https://github.com/Nano-Collective/nanocoder) - Beautiful local-first coding agent running in your terminal. Built for privacy and control with support for multiple AI providers via OpenRouter. ![GitHub stars](https://img.shields.io/github/stars/Nano-Collective/nanocoder?style=social) - [Gemini CLI (Google)](https://github.com/google-gemini/gemini-cli) - Open-source AI agent that brings Gemini's power directly into your terminal. Supports code generation, shell execution, and file editing with full Apache 2.0 licensing. ![GitHub stars](https://img.shields.io/github/stars/google-gemini/gemini-cli?style=social) - [Archon](https://github.com/coleam00/Archon) - Workflow engine for deterministic AI coding agents. Define development processes as YAML workflows (planning → implementation → validation → review → PR) with isolated Git worktrees for parallel execution. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/coleam00/Archon?style=social) - [mini-SWE-agent](https://github.com/SWE-agent/mini-swe-agent) - Lightweight coding agent for repository and issue-fixing workflows, designed for simple agentic software engineering experiments. ![GitHub stars](https://img.shields.io/github/stars/SWE-agent/mini-swe-agent?style=social) - [Kilo Code](https://github.com/Kilo-Org/kilocode) - Open-source agentic coding assistant with IDE workflows, tool use, and support for local or OpenAI-compatible models. ![GitHub stars](https://img.shields.io/github/stars/Kilo-Org/kilocode?style=social) - [Open SWE](https://github.com/langchain-ai/open-swe) - Asynchronous coding agent from the LangChain ecosystem for background software engineering tasks. ![GitHub stars](https://img.shields.io/github/stars/langchain-ai/open-swe?style=social) - [Letta Code](https://github.com/letta-ai/letta-code) - Memory-first coding harness designed for long-lived agents that learn from experience. Persistent agents with portable memory across models (Claude, GPT, Gemini, GLM, Kimi). CLI and desktop app for macOS, Windows, and Linux. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/letta-ai/letta-code?style=social) - [LoopTroop](https://github.com/looptroop-ai/LoopTroop) - Local-first AI coding workspace that orchestrates multi-model planning councils, git worktrees, and task loops. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/looptroop-ai/LoopTroop?style=social) - [gptme](https://github.com/gptme/gptme) - Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/gptme/gptme?style=social) - [Superpowers](https://github.com/obra/superpowers) - Composable skills framework and software development methodology for coding agents, structuring processes like planning, test-driven development, and code review. ![GitHub stars](https://img.shields.io/github/stars/obra/superpowers?style=social) - [Agent Skills](https://github.com/addyosmani/agent-skills) - Production-grade engineering skills and quality gates for AI coding agents, packaging developer workflows like spec refinement, planning, and testing. ![GitHub stars](https://img.shields.io/github/stars/addyosmani/agent-skills?style=social) - [Harness](https://github.com/revfactory/harness) - Team-architecture factory for C‍laude Code that designs domain-specific agent teams, defines specialized agents, and generates their skills. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/revfactory/harness?style=social) - [jcode](https://github.com/1jehuang/jcode) - Performance-oriented, memory-efficient coding agent harness built for multi-session workflows and infinite customizability. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/1jehuang/jcode?style=social) - [firstmate](https://github.com/kunchenguid/firstmate) - Agent distro for running a crew of autonomous coding agents in isolated Git worktrees across visible terminal session backends. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/kunchenguid/firstmate?style=social) - [DeepSeek-Reasonix](https://github.com/esengine/DeepSeek-Reasonix) - DeepSeek-native AI coding agent for the terminal, designed around prefix-cache stability. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/esengine/DeepSeek-Reasonix?style=social) - [gstack](https://github.com/garrytan/gstack) - Multi-specialist agent skills framework for Claude Code and coding agents that structures development workflows into planning, design, QA, and release phases. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/garrytan/gstack?style=social) - [taste-skill](https://github.com/Leonxlnx/taste-skill) - Anti-slop frontend design skills for coding agents that improve layout, typography, and design system alignment during generation. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Leonxlnx/taste-skill?style=social) - [Agents CLI (Google)](https://github.com/google/agents-cli) - CLI and skills that turn coding assistants into experts at creating, evaluating, and deploying AI agents on Google Cloud. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/google/agents-cli?style=social) - [Claude Code Skills & Plugins](https://github.com/alirezarezvani/claude-skills) - Modular instruction packages, custom commands, and utility scripts for Claude Code, Gemini CLI, Cursor, and other AI coding agents. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/alirezarezvani/claude-skills?style=social) - [AG Kit](https://github.com/vudovn/ag-kit) - Antigravity-first agent engineering kit featuring rules, skills, persistent memory, MCP guidance, and a native safety hook. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/vudovn/ag-kit?style=social) - [Prime Agent](https://github.com/PrimeIntellect-ai/prime-agent) - Self-improving recursive language model (RLM) agent for coding workflows and autonomous tasks. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/PrimeIntellect-ai/prime-agent?style=social) - [Agent Skills (Google)](https://github.com/google/skills) - Official collection of Agent Skills for Google Cloud and Google developer platforms, extending AI coding agents with product and technology workflows. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/google/skills?style=social) - [Agent Skills (Anthropic)](https://github.com/anthropics/skills) - Official collection of Agent Skills and reference implementations for Claude Code, Claude API, and AI agents. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/anthropics/skills?style=social) - [Superagent](https://github.com/pungme/superagent-desktop) - macOS desktop app giving Claude Code and Codex a real browser to drive, an iOS Simulator to install and screenshot apps in, and a phone companion app for remote monitoring. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/pungme/superagent-desktop?style=social) - [BrowserSkill (Tencent)](https://github.com/Tencent/BrowserSkill) - CLI and extension enabling AI coding agents to control authenticated browser sessions in background tabs without interrupting user workflows. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Tencent/BrowserSkill?style=social) - [Ordewell](https://github.com/ordewell/ordewell) - Terminal CLI and TUI that turns one goal into an ordered, editable plan of coding agent tasks, each carrying its own runner (Claude Code, Codex, OpenCode), model and mode, where a task counts as done only when its completion marker appears in that runner's output. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/ordewell/ordewell?style=social) - [Orbi](https://github.com/orbi-build/orbi) - Self-hosted runner that turns a labelled GitHub Issue into a pull request, has a separate model review the frozen diff before merge, and publishes the tagged GitHub Release. Works with any OpenAI-compatible model or a Codex subscription. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/orbi-build/orbi?style=social) - [Threadlines](https://github.com/Threadlines/threadlines) - Desktop app for Claude Code, Codex, OpenCode, Cursor and other coding agents that keeps a live browser, terminal, and source control beside each thread, and lets a second agent join a thread to answer questions or review changes. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Threadlines/threadlines?style=social) - [Mercury CLI](https://github.com/Whq02/MercuryCLI) - Runs AI coding agents in your terminal ([mercury-cli.ai](https://mercury-cli.ai), npm `mercury-tech-cli`), inside your own git repositories on macOS, Linux and Windows, with parallel sessions on one screen, cross-provider crewmates in isolated git worktrees with file leases across 22 provider families and local models (Ollama, LM Studio, vLLM, llama.cpp), hybrid BM25 and on-device BGE project memory, LSP refactors, 23-language AST rewrites, and a built-in DAP debugger. Open source, Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Whq02/MercuryCLI?style=social) #### Prompt Engineering & Structured Outputs - [Outlines](https://github.com/dottxt-ai/outlines) - Structured outputs for LLMs. Guarantees valid JSON, regex-compliant text, and Pydantic model outputs during generation. Trusted by NVIDIA, Cohere, Hugging Face, and vLLM. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/dottxt-ai/outlines?style=social) - [LangGPT](https://github.com/langgptai/LangGPT) - Pioneering framework for structured and meta-prompt design. Battle-tested by thousands of users worldwide with 10,000+ stars. The most popular prompt engineering paradigm for creating reusable, maintainable prompt templates. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/langgptai/LangGPT?style=social) - [Prompt Optimizer](https://github.com/linshenkx/prompt-optimizer) - AI prompt optimization tool with multi-round iterative improvements, dual-mode optimization for system and user prompts, and multi-model support. Available as web app, desktop app, Chrome extension, and Docker deployment. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/linshenkx/prompt-optimizer?style=social) - [Guidance](https://github.com/guidance-ai/guidance) - Efficient programming paradigm for steering language models. Control output structure with loops, conditionals, and regex constraints inline. Reduces latency and cost vs conventional prompting. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/guidance-ai/guidance?style=social) - [XGrammar](https://github.com/mlc-ai/xgrammar) - Fast, flexible and portable structured generation engine. Default backend for vLLM, SGLang, TensorRT-LLM, and MLC-LLM with flexible grammar support and zero-overhead mask generation. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/mlc-ai/xgrammar?style=social) - [AdalFlow](https://github.com/SylphAI-Inc/AdalFlow) - Library to build and auto-optimize LLM applications with LLM-AutoDiff for fine-tuning-free optimization. End-to-end workflow optimization with tracing and human-in-the-loop capabilities. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/SylphAI-Inc/AdalFlow?style=social) - [guidelint](https://github.com/SIDDARTHAREDDY8/guidelint) - Zero-dependency Python CLI that lints structured-output configs for vLLM, llama.cpp, and Ollama against 23 version-aware rules, catching silently-ignored fields before production. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/SIDDARTHAREDDY8/guidelint?style=social) #### Domain-Specific Agents - [Composio](https://github.com/ComposioHQ/composio) - Tool integration layer for AI agents with 1000+ toolkits, authentication management, and sandboxed workbench. Powers tool use across major frameworks. ![GitHub stars](https://img.shields.io/github/stars/ComposioHQ/composio?style=social) - [Langflow](https://github.com/langflow-ai/langflow) - Visual low-code platform for agentic workflows. ![GitHub stars](https://img.shields.io/github/stars/langflow-ai/langflow?style=social) - [Dify](https://github.com/langgenius/dify) - Production-ready agentic workflow platform. ![GitHub stars](https://img.shields.io/github/stars/langgenius/dify?style=social) - [OWL (camel-ai/owl)](https://github.com/camel-ai/owl) - Advanced multi-agent collaboration system. ![GitHub stars](https://img.shields.io/github/stars/camel-ai/owl?style=social) - [gpt-researcher](https://github.com/assafelovic/gpt-researcher) - Autonomous agent that conducts deep online research on any topic. Generates comprehensive reports with citations by orchestrating web searches, content scraping, and synthesis. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/assafelovic/gpt-researcher?style=social) - [last30days-skill](https://github.com/mvanhorn/last30days-skill) - AI agent that researches and synthesizes topic trends from Reddit, X, YouTube, Hacker News, and prediction markets. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/mvanhorn/last30days-skill?style=social) - [Jev Social](https://github.com/socai-io/jev-social) - Local social-media research agent that uses TypeSafe Jev to select bounded socai CLI browser operations for Instagram, TikTok, and LinkedIn, streams captured evidence, and generates cited reports. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/socai-io/jev-social?style=social) - [pm-skills](https://github.com/phuryn/pm-skills) - Marketplace of product management plugin skills and workflows for Claude Code, Codex, and Claude Cowork. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/phuryn/pm-skills?style=social) - [claude-code-best-practice](https://github.com/shanraisshan/claude-code-best-practice) - Custom subagents, skills, environment configurations, and best practices for the Claude Code developer agent. ![GitHub stars](https://img.shields.io/github/stars/shanraisshan/claude-code-best-practice?style=social) - [PPT Master](https://github.com/hugohe3/ppt-master) - AI-driven multi-role agent skill for converting documents into editable PowerPoint presentations via SVG and DrawingML workflows. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/hugohe3/ppt-master?style=social) - [PraisonAI](https://github.com/MervinPraison/PraisonAI) - 24/7 AI employee team for automating complex challenges. Low-code multi-agent framework with handoffs, guardrails, memory, RAG, and 100+ LLM providers. ![GitHub stars](https://img.shields.io/github/stars/MervinPraison/PraisonAI?style=social) - [Agent-S (Simular AI)](https://github.com/simular-ai/Agent-S) - Open agentic framework that uses computers like a human. SOTA on OSWorld benchmark (72.6%) for GUI automation and computer control. ![GitHub stars](https://img.shields.io/github/stars/simular-ai/Agent-S?style=social) - [MobileAgent (Alibaba/X-PLUG)](https://github.com/X-PLUG/MobileAgent) - Powerful GUI agent family for autonomous mobile device control. Multimodal agent framework designed to operate smartphone apps through visual UI perception and reasoning. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/X-PLUG/MobileAgent?style=social) - [UI-TARS Desktop (ByteDance)](https://github.com/bytedance/UI-TARS-desktop) - Open-source multimodal AI agent stack with native GUI agent capabilities. Desktop application bringing GUI agent and vision power to your computer, browser, and terminal. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/bytedance/UI-TARS-desktop?style=social) - [Browser Use](https://github.com/browser-use/browser-use) - Makes websites accessible for AI agents. Enables autonomous web automation, data extraction, and task completion with natural language instructions. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/browser-use/browser-use?style=social) - [Jet Browser](https://github.com/masakaai/jet-browser) - Self-hosted WPE WebKit runtime that gives AI agents isolated Docker browser sessions, native input, screenshots, and an ordered JSONL control interface. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/masakaai/jet-browser?style=social) - [Steel Browser](https://github.com/steel-dev/steel-browser) - Open-source browser API for AI agents and apps. Batteries-included browser sandbox for web automation without infrastructure worries. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/steel-dev/steel-browser?style=social) - [Cua](https://github.com/trycua/cua) - Open-source sandboxes, SDKs, and benchmarks for computer-use agents to control desktop environments. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/trycua/cua?style=social) - [Webwright](https://github.com/microsoft/Webwright) - A terminal-style web agent framework that enables coding models to run as browser agents by writing and executing Playwright scripts. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/microsoft/Webwright?style=social) - [invisible_playwright_mcp](https://github.com/feder-cr/invisible_playwright_mcp) - Self-hosted browser agent that drives a patched Firefox with real pointer and keyboard input, usable as a local MCP server from Claude Code, Codex, Cursor or Gemini CLI, or from its own web UI. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/feder-cr/invisible_playwright_mcp?style=social) - [TradingAgents](https://github.com/TauricResearch/TradingAgents) - Multi-agent framework for financial trading. Simulates professional trading firm operations with 6+ specialized agent roles, backtesting, risk management, and portfolio optimization. Built with LangGraph, supports multiple LLM providers. ![GitHub stars](https://img.shields.io/github/stars/TauricResearch/TradingAgents?style=social) - [Parlant](https://github.com/emcie-co/parlant) - Conversational control layer for customer-facing AI agents. Enterprise-grade context engineering framework optimized for consistent, compliant, and on-brand B2C and sensitive B2B interactions. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/emcie-co/parlant?style=social) - [n8n](https://github.com/n8n-io/n8n) - Self-hostable workflow automation platform with AI agent nodes, tool integrations, and production automation workflows. ![GitHub stars](https://img.shields.io/github/stars/n8n-io/n8n?style=social) - [Activepieces](https://github.com/activepieces/activepieces) - Open-source automation platform with AI agents, MCP integrations, and self-hosted workflow orchestration. ![GitHub stars](https://img.shields.io/github/stars/activepieces/activepieces?style=social) - [Julep](https://github.com/julep-ai/julep) - Stateful agent workflow platform with memory, tools, branching, and long-running task execution. ![GitHub stars](https://img.shields.io/github/stars/julep-ai/julep?style=social) - [uAgents (Fetch.ai)](https://github.com/fetchai/uAgents) - Fast and lightweight framework for creating decentralized agents with ease. Agents automatically join the network by registering on the Almanac smart contract. Supports agent-to-agent communication out of the box. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/fetchai/uAgents?style=social) - [Tracecat](https://github.com/TracecatHQ/tracecat) - Self-hostable security automation platform for building agentic workflows across alerts, cases, and operations. ![GitHub stars](https://img.shields.io/github/stars/TracecatHQ/tracecat?style=social) - [PentAGI](https://github.com/vxcontrol/pentagi) - Fully autonomous AI agent system for conducting ethical hacking and complex penetration testing tasks. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/vxcontrol/pentagi?style=social) - [ToolJet](https://github.com/ToolJet/ToolJet) - Self-hostable internal app builder with AI app and agent workflows for operations teams. ![GitHub stars](https://img.shields.io/github/stars/ToolJet/ToolJet?style=social) - [The Agency](https://github.com/msitarzewski/agency-agents) - Extensive library of specialized developer and workflow agent personas with installer support for Claude Code, Cursor, Codex, and other coding assistants. ![GitHub stars](https://img.shields.io/github/stars/msitarzewski/agency-agents?style=social) - [CubeSandbox (Tencent Cloud)](https://github.com/TencentCloud/CubeSandbox) - High-performance, secure agent sandbox built on RustVMM and KVM, compatible with the E2B SDK. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/TencentCloud/CubeSandbox?style=social) - [DeepTutor](https://github.com/HKUDS/DeepTutor) - Multi-agent system for lifelong personalized tutoring with interactive and adaptive learning workflows. ![GitHub stars](https://img.shields.io/github/stars/HKUDS/DeepTutor?style=social) - [Corsair](https://github.com/corsairdev/corsair) - Domain-specific AI agent framework for building and running specialized agents. ![GitHub stars](https://img.shields.io/github/stars/corsairdev/corsair?style=social) - [DeskcommCRM](https://github.com/melgarafael/DeskcommCRM) - Self-hosted sales CRM that uses autonomous AI agents, WhatsApp integration, tenant RAG, and MCP tooling for chat-based sales workflows. ![GitHub stars](https://img.shields.io/github/stars/melgarafael/DeskcommCRM?style=social) - [OpenResearch](https://github.com/alphaXiv/OpenResearch) - Local-first workspace and harness for turning coding agents into autonomous research agents for literature review, hypothesis generation, and experiments. ![GitHub stars](https://img.shields.io/github/stars/alphaXiv/OpenResearch?style=social) - [call4me](https://github.com/skeptrunedev/call4me) - Voice agent and remote MCP server that places phone calls to businesses for a coding agent user, navigating phone menus and returning the transcript and outcome. ![GitHub stars](https://img.shields.io/github/stars/skeptrunedev/call4me?style=social) - [AdsTurbo Creative MCP](https://github.com/AdsTurbo/adsturbo-creative-mcp) - Local stdio MCP server and CLI that turns a product page or reference ad into structured video ad briefs, hook variants, UGC scripts and storyboards, with no API key and no network calls. ![GitHub stars](https://img.shields.io/github/stars/AdsTurbo/adsturbo-creative-mcp?style=social) - [Unsora MCP](https://github.com/Shipped-Studio/unsora/tree/main/apps/mcp) - Remote MCP server that lets agents generate images, video, voiceovers and music, cut long videos into short clips, and schedule or publish posts to connected social accounts, with interactive MCP Apps previews. The Express API, Next.js app and Trigger.dev workers it calls live in the same AGPL-3.0 repo. ![GitHub stars](https://img.shields.io/github/stars/Shipped-Studio/unsora?style=social) - [AI Agent by TerraLab](https://github.com/TerraLabAI/QGIS_AI-Agent) - QGIS plugin where an AI agent finds open data, runs the analysis and builds the map from a plain-language task, with undo for every change. GPL-2.0 licensed; it calls a hosted service with a free tier. ![GitHub stars](https://img.shields.io/github/stars/TerraLabAI/QGIS_AI-Agent?style=social) #### Agent Memory & State - [Letta (ex-MemGPT)](https://github.com/letta-ai/letta) - Platform for building stateful agents with advanced memory that learn and self-improve over time. ![GitHub stars](https://img.shields.io/github/stars/letta-ai/letta?style=social) - [Mem0](https://github.com/mem0ai/mem0) - Universal memory layer for AI agents. Persistent, multi-session memory across models and environments. ![GitHub stars](https://img.shields.io/github/stars/mem0ai/mem0?style=social) - [Caura](https://github.com/caura-ai/caura) - Open-source memory infrastructure for AI agents, providing persistent memory and context management for building stateful, long-running agents. ![GitHub stars](https://img.shields.io/github/stars/caura-ai/caura?style=social) - [Rohitg (agentmemory)](https://github.com/rohitg00/agentmemory) - Open-source memory service for agents with benchmarked retrieval, structured entities, and API/SDK support for persistent personalized memory in tooling workflows. ![GitHub stars](https://img.shields.io/github/stars/rohitg00/agentmemory?style=social) - [Forgetful](https://github.com/ScottRBK/forgetful) - MCP server for persistent AI agent memory with atomic notes, semantic linking, and SQLite or PostgreSQL storage. ![GitHub stars](https://img.shields.io/github/stars/ScottRBK/forgetful?style=social) - [Hindsight](https://github.com/vectorize-io/hindsight) - State-of-the-art long-term memory for AI agents by Vectorize. Fully self-hosted, MIT-licensed, with integrations for LangChain, CrewAI, LlamaIndex, Vercel AI SDK, and more. ![GitHub stars](https://img.shields.io/github/stars/vectorize-io/hindsight?style=social) - [Supermemory](https://github.com/supermemoryai/supermemory) - Memory API and app for AI agents that provides fast, scalable, context-aware storage and retrieval across projects. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/supermemoryai/supermemory?style=social) - [TencentDB Agent Memory](https://github.com/TencentCloud/TencentDB-Agent-Memory) - Fully local long-term memory layer for AI agents with a four-tier progressive pipeline and zero external dependencies. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/TencentCloud/TencentDB-Agent-Memory?style=social) - [Cognee](https://github.com/topoteretes/cognee) - AI memory platform for agents that builds a self-hosted knowledge graph for persistent, long-term memory across sessions. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/topoteretes/cognee?style=social) - [LoopX](https://github.com/huangruiteng/loopx) - Lightweight state kernel and local control plane for long-running AI agent loops with goal tracking, auto-wake, and verifiable handoffs. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/huangruiteng/loopx?style=social) - [Unlimited Context](https://github.com/AetherAI3/Unlimited-Context-LLM) - Local-first context and memory engine that keeps a billion-token encoded pool on disk and pages relevant slices into a small resident window for Ollama and other local LLMs. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/AetherAI3/Unlimited-Context-LLM?style=social) - [MemTether](https://github.com/MemTether/MemTether) - Cross-client AI memory hub where agents share one physical SQLite database via file-level pointers. Zero cloud, bi-temporal governance with supersession chains, hash-chain audit, and MCP. Apache-2.0. ![GitHub stars](https://img.shields.io/github/stars/MemTether/MemTether?style=social) - [inspeximus](https://github.com/DanceNitra/inspeximus) - Memory layer that retires a corrected fact by key and can undo the correction later from the key alone. Zero-dependency core with an MCP server. ![GitHub stars](https://img.shields.io/github/stars/DanceNitra/inspeximus?style=social) - [Mnemoverse](https://github.com/mnemoverse/mcp-memory-server) - MIT-licensed MCP server for agent memory, backed by a hosted engine that re-ranks recall from reported outcomes rather than similarity alone, with one key or OAuth across Claude Code, Cursor, VS Code, and ChatGPT. ![GitHub stars](https://img.shields.io/github/stars/mnemoverse/mcp-memory-server?style=social) - [Statewave](https://github.com/smaramwbc/statewave) - Open-source memory runtime for AI agents that compiles reproducible, provenance-tagged context bundles instead of relying on query-time retrieval, self-hosted on Postgres and pgvector with Python and TypeScript SDKs. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/smaramwbc/statewave?style=social) - [Vestige](https://github.com/samvallad33/vestige) - Causal proof engine and operating system for AI agents built on Strata, an append-only signed log, with no vectors and no RAG, where every answer carries its proof as a memory id, an edge path or a receipt and a failure is traced back to the commit that caused it. AGPL 3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/samvallad33/vestige?style=social) --- - [Xenon](https://github.com/xianyu-sheng/Xenon) - Verifiable terminal coding agent combining an append-only evidence hash chain, a single deterministic verification gate, and a manual-verification checklist for what it could not check (multi-provider, MCP-ready, MIT). ![GitHub stars](https://img.shields.io/github/stars/xianyu-sheng/Xenon?style=social) ## 5. Retrieval-Augmented Generation (RAG) & Knowledge > Retrieval systems, vector databases, embedding models, and related tooling for RAG pipelines. #### Vector Databases & Search Engines - [Chroma](https://github.com/chroma-core/chroma) - Most popular open-source embedding database. ![GitHub stars](https://img.shields.io/github/stars/chroma-core/chroma?style=social) - [Qdrant](https://github.com/qdrant/qdrant) - High-performance vector search engine in Rust. ![GitHub stars](https://img.shields.io/github/stars/qdrant/qdrant?style=social) - [Weaviate](https://github.com/weaviate/weaviate) - GraphQL-native vector search engine. ![GitHub stars](https://img.shields.io/github/stars/weaviate/weaviate?style=social) - [Milvus](https://github.com/milvus-io/milvus) - Scalable cloud-native vector database. ![GitHub stars](https://img.shields.io/github/stars/milvus-io/milvus?style=social) - [NornicDB](https://github.com/orneryd/NornicDB) - Low-latency graph and vector hybrid retrieval database in Go with Neo4j and Qdrant-compatible drivers. ![GitHub stars](https://img.shields.io/github/stars/orneryd/NornicDB?style=social) - [Faiss](https://github.com/facebookresearch/faiss) - Similarity search and clustering library for dense vectors with CPU and GPU implementations. ![GitHub stars](https://img.shields.io/github/stars/facebookresearch/faiss?style=social) - [LanceDB](https://github.com/lancedb/lancedb) - Serverless vector DB optimized for multimodal data. ![GitHub stars](https://img.shields.io/github/stars/lancedb/lancedb?style=social) - [Vespa](https://github.com/vespa-engine/vespa) - AI + Data platform with hybrid search (vector + keyword) and real-time indexing at scale. Battle-tested serving billions of queries daily. ![GitHub stars](https://img.shields.io/github/stars/vespa-engine/vespa?style=social) - [pgvector](https://github.com/pgvector/pgvector) - PostgreSQL extension for vector similarity search. ![GitHub stars](https://img.shields.io/github/stars/pgvector/pgvector?style=social) - [pgvectorscale](https://github.com/timescale/pgvectorscale) - PostgreSQL extension for scalable vector search with DiskANN algorithm. Complements pgvector with significantly faster search and higher recall at large scale. PostgreSQL licensed. ![GitHub stars](https://img.shields.io/github/stars/timescale/pgvectorscale?style=social) - [VectorChord](https://github.com/tensorchord/VectorChord) - Scalable, fast, and disk-friendly vector search in Postgres. Successor to pgvecto.rs with production-grade performance and efficient storage. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/tensorchord/VectorChord?style=social) - [Quickwit](https://github.com/quickwit-oss/quickwit) - Cloud-native search engine for observability. Open-source alternative to Datadog, Elasticsearch, Loki, and Tempo with native vector search support. ![GitHub stars](https://img.shields.io/github/stars/quickwit-oss/quickwit?style=social) - [Tantivy](https://github.com/quickwit-oss/tantivy) - Full-text search engine library inspired by Apache Lucene and written in Rust. Powers Quickwit and other production search systems. ![GitHub stars](https://img.shields.io/github/stars/quickwit-oss/tantivy?style=social) - [Manticore Search](https://github.com/manticoresoftware/manticoresearch) - Easy to use open source fast database for search. Good alternative to Elasticsearch with SQL-like interface and vector search capabilities. ![GitHub stars](https://img.shields.io/github/stars/manticoresoftware/manticoresearch?style=social) - [OpenSearch](https://github.com/opensearch-project/OpenSearch) - Open-source distributed and RESTful search and analytics suite with native vector search. Enterprise-grade fork of Elasticsearch with k-NN plugin for semantic search at scale. ![GitHub stars](https://img.shields.io/github/stars/opensearch-project/OpenSearch?style=social) - [Marqo](https://github.com/marqo-ai/marqo) - Multimodal vector search for text, image, and structured data. End-to-end indexing and search with built-in embedding models. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/marqo-ai/marqo?style=social) - [Vald](https://github.com/vdaas/vald) - Highly scalable distributed vector search engine. Cloud-native architecture with automatic indexing, horizontal scaling, and multiple ANN algorithm support. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/vdaas/vald?style=social) - [hnswlib](https://github.com/nmslib/hnswlib) - Header-only C++ library for fast approximate nearest neighbors with Python bindings. Supports CRUD operations and concurrent read/write - unique among ANN libraries. Powers many production vector databases. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/nmslib/hnswlib?style=social) - [turbovec](https://github.com/RyanCodrai/turbovec) - Rust-native high-performance vector index with Python bindings optimized for fast ANN search and SIMD acceleration on modern CPUs. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/RyanCodrai/turbovec?style=social) - [sqlite-vec](https://github.com/asg017/sqlite-vec) - A vector search SQLite extension that runs anywhere. Extremely small, "fast enough" vector search written in pure C with no dependencies. Perfect for embedded and edge deployments. MIT/Apache-2.0 dual licensed. ![GitHub stars](https://img.shields.io/github/stars/asg017/sqlite-vec?style=social) - [zvec](https://github.com/alibaba/zvec) - Lightweight, lightning-fast, in-process vector database from Alibaba. Built on Proxima (Alibaba's battle-tested vector search engine) for production-grade, low-latency similarity search. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/alibaba/zvec?style=social) - [Meilisearch](https://github.com/meilisearch/meilisearch) - Lightning-fast search engine API with AI-powered hybrid search. Features typo-tolerant full-text search combined with HNSW-based vector search for semantic retrieval. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/meilisearch/meilisearch?style=social) - [Typesense](https://github.com/typesense/typesense) - Open source alternative to Algolia + Pinecone. Fast, typo-tolerant, in-memory fuzzy search engine with native vector search capabilities. GPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/typesense/typesense?style=social) - [Elasticsearch](https://github.com/elastic/elasticsearch) - Distributed search and analytics engine with native k-NN vector search, hybrid search, and dense vector indexing. Industry-standard for full-text search now with powerful semantic search capabilities. AGPL-3.0/Elastic-2.0 dual licensed. ![GitHub stars](https://img.shields.io/github/stars/elastic/elasticsearch?style=social) - [Apache Solr](https://github.com/apache/solr) - Mature Lucene-based search platform with dense vector search, filtering, faceting, and hybrid retrieval patterns for production search-heavy RAG systems. ![GitHub stars](https://img.shields.io/github/stars/apache/solr?style=social) - [RediSearch](https://github.com/RediSearch/RediSearch) - Full-text, secondary indexing, and vector similarity search for Redis deployments. Useful when retrieval needs low-latency Redis-native search. ![GitHub stars](https://img.shields.io/github/stars/RediSearch/RediSearch?style=social) - [ParadeDB](https://github.com/paradedb/paradedb) - Postgres-native search and analytics engine for full-text, faceted, and hybrid retrieval without moving data out of PostgreSQL. ![GitHub stars](https://img.shields.io/github/stars/paradedb/paradedb?style=social) - [Orama](https://github.com/oramasearch/orama) - Lightweight search engine with full-text, vector, and hybrid search for browser, server, and edge applications. ![GitHub stars](https://img.shields.io/github/stars/oramasearch/orama?style=social) - [HelixDB](https://github.com/HelixDB/helix-db) - Graph-vector database for retrieval systems that need relationship traversal alongside semantic search. ![GitHub stars](https://img.shields.io/github/stars/HelixDB/helix-db?style=social) - [USearch](https://github.com/unum-cloud/usearch) - Fast single-file similarity search & clustering engine for vectors. Smaller and faster than FAISS with 20+ language bindings (C++, Python, JavaScript, Rust, Java, Go, etc.) and support for custom metrics. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/unum-cloud/usearch?style=social) - [Deep Lake](https://github.com/activeloopai/deeplake) - AI Data Runtime for Agents with serverless PostgreSQL and multimodal datalake. Store and search vectors, images, text, videos, and more with LangChain/LlamaIndex integrations. Used by Intel, Bayer, Yale, and Oxford. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/activeloopai/deeplake?style=social) - [DiskANN (Microsoft)](https://github.com/microsoft/DiskANN) - Graph-structured indices for scalable, fast, fresh and filtered approximate nearest neighbor search. Handles billion-vector datasets on a single node with SSD-based indexing. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/microsoft/DiskANN?style=social) - [SPTAG (Microsoft)](https://github.com/microsoft/SPTAG) - Distributed approximate nearest neighbor search library with high-quality vector index build and online serving toolkits. Powers Bing's vector search at trillion-vector scale. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/microsoft/SPTAG?style=social) - [nanoflann](https://github.com/jlblancoc/nanoflann) - C++11 header-only library for fast nearest neighbor search with KD-trees. Zero dependencies, single-file integration, and 2-3x faster than FLANN with modern C++. BSD licensed. ![GitHub stars](https://img.shields.io/github/stars/jlblancoc/nanoflann?style=social) - [Vearch](https://github.com/vearch/vearch) - Cloud-native distributed vector database for AI-native applications. Efficient similarity search of embedding vectors with horizontal scaling and real-time indexing. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/vearch/vearch?style=social) - [JVector (DataStax)](https://github.com/datastax/jvector) - The most advanced embedded vector search engine for Java. DiskANN-based algorithm for billion-scale vector search with efficient memory mapping. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/datastax/jvector?style=social) - [VectorDBBench (Zilliz)](https://github.com/zilliztech/VectorDBBench) - Industry-standard benchmark suite for vector databases. Test and compare performance of Milvus, Zilliz Cloud, and other vector DBs with your own datasets. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/zilliztech/VectorDBBench?style=social) #### Embedding Models - [BGE (FlagEmbedding)](https://github.com/FlagOpen/FlagEmbedding) - BAAI's best-in-class embedding family. ![GitHub stars](https://img.shields.io/github/stars/FlagOpen/FlagEmbedding?style=social) - [FastEmbed (Qdrant)](https://github.com/qdrant/fastembed) - Lightweight, fast Python library for embedding generation with ONNX Runtime. Supports text, sparse (SPLADE), and late-interaction (ColBERT) embeddings without GPU dependencies. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/qdrant/fastembed?style=social) - [EmbedAnything](https://github.com/StarlightSearch/EmbedAnything) - Minimalist, highly performant multimodal embedding pipeline built in Rust. Memory-safe, modular, and production-ready for text, image, and audio embeddings with seamless vector DB integration. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/StarlightSearch/EmbedAnything?style=social) - [Text Embeddings Inference (Hugging Face)](https://github.com/huggingface/text-embeddings-inference) - Blazing fast inference solution for text embedding models. High-performance extraction with token-based dynamic batching, Flash Attention, and support for FlagEmbedding, E5, GTE, and more. OpenAI-compatible API with Docker deployment. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/huggingface/text-embeddings-inference?style=social) #### Embedding Benchmarks - [MTEB](https://github.com/embeddings-benchmark/mteb) - Massive Text Embedding Benchmark covering 1000+ languages and diverse tasks. The industry standard for evaluating and comparing embedding models. ![GitHub stars](https://img.shields.io/github/stars/embeddings-benchmark/mteb?style=social) #### RAG Frameworks & Advanced Retrieval Tools - [EmbedChain](https://github.com/embedchain/embedchain) - Universal memory layer for AI agents. Simple API to create RAG applications over any dataset with support for multiple vector stores, embedding models, and LLM providers. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/embedchain/embedchain?style=social) - [LlamaIndex](https://github.com/run-llama/llama_index) - Full-featured RAG pipeline with advanced indexing. ![GitHub stars](https://img.shields.io/github/stars/run-llama/llama_index?style=social) - [Haystack](https://github.com/deepset-ai/haystack) - End-to-end NLP and RAG framework. ![GitHub stars](https://img.shields.io/github/stars/deepset-ai/haystack?style=social) - [RAGFlow](https://github.com/infiniflow/ragflow) - Deep-document-understanding RAG engine. ![GitHub stars](https://img.shields.io/github/stars/infiniflow/ragflow?style=social) - [GraphRAG (Microsoft)](https://github.com/microsoft/graphrag) - Knowledge-graph-based RAG. ![GitHub stars](https://img.shields.io/github/stars/microsoft/graphrag?style=social) - [Docling](https://github.com/docling-project/docling) - Document processing toolkit for turning PDFs and other files into structured data for GenAI workflows. ![GitHub stars](https://img.shields.io/github/stars/docling-project/docling?style=social) - [Unstructured](https://github.com/Unstructured-IO/unstructured) - Best-in-class document preprocessing. ![GitHub stars](https://img.shields.io/github/stars/Unstructured-IO/unstructured?style=social) - [MinerU](https://github.com/opendatalab/MinerU) - High-accuracy document parsing for LLM and RAG workflows. Converts PDFs, Word, PPTs, and images into structured Markdown/JSON with VLM+OCR dual engine. ![GitHub stars](https://img.shields.io/github/stars/opendatalab/MinerU?style=social) - [Marker](https://github.com/datalab-to/marker) - Fast, accurate PDF-to-markdown converter with table extraction, equation handling, and optional LLM enhancement for RAG pipelines. ![GitHub stars](https://img.shields.io/github/stars/datalab-to/marker?style=social) - [ColPali / ColQwen](https://github.com/illuin-tech/colpali) - Vision-language models for document retrieval. ![GitHub stars](https://img.shields.io/github/stars/illuin-tech/colpali?style=social) - [LightRAG](https://github.com/HKUDS/LightRAG) - Graph-based RAG with dual-level retrieval system. Simple and fast with comprehensive knowledge discovery (EMNLP 2025). ![GitHub stars](https://img.shields.io/github/stars/HKUDS/LightRAG?style=social) - [RAG-Anything](https://github.com/HKUDS/RAG-Anything) - All-in-One Multimodal RAG system for seamless processing of text, images, tables, and equations. Built on LightRAG. ![GitHub stars](https://img.shields.io/github/stars/HKUDS/RAG-Anything?style=social) - [RAGLite (Superlinear)](https://github.com/superlinear-ai/raglite) - Python toolkit for RAG with DuckDB or PostgreSQL. Lightweight, efficient retrieval-augmented generation without heavy dependencies. MPL 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/superlinear-ai/raglite?style=social) - [GPT-RAG (Azure)](https://github.com/Azure/GPT-RAG) - Enterprise RAG pattern for Azure OpenAI at scale. Secure, production-ready architecture using Azure Cognitive Search and Azure OpenAI LLMs for ChatGPT-style Q&A experiences. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Azure/GPT-RAG?style=social) - [LangChain4j](https://github.com/langchain4j/langchain4j) - Java library for integrating LLMs into Java applications. Implements RAG, tool calling (including MCP support), and agents with seamless integration into enterprise Java frameworks like Spring Boot. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/langchain4j/langchain4j?style=social) - [Kernel Memory (Microsoft)](https://github.com/microsoft/kernel-memory) - Memory solution for users, teams, and applications. RAG pipelines with document ingestion, vector indexing, and natural language querying with citations. Supports multiple LLM providers and vector stores. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/microsoft/kernel-memory?style=social) - [txtai](https://github.com/neuml/txtai) - All-in-one AI framework for semantic search, LLM orchestration and language model workflows. Embeddings database with customizable pipelines. ![GitHub stars](https://img.shields.io/github/stars/neuml/txtai?style=social) - [FlashRAG](https://github.com/RUC-NLPIR/FlashRAG) - Efficient toolkit for RAG research with 40+ retrieval and reranking models, 20+ benchmark datasets, and optimized evaluation pipelines (WWW 2025 Resource). MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/RUC-NLPIR/FlashRAG?style=social) - [DocsGPT](https://github.com/arc53/DocsGPT) - Private AI platform for building intelligent agents and assistants with enterprise search. Features Agent Builder, deep research tools, multi-format document analysis, and multi-model support. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/arc53/DocsGPT?style=social) - [llmware](https://github.com/llmware-ai/llmware) - Unified framework for building enterprise RAG pipelines with small, specialized models. Optimized for AI PC and local deployment with 300+ models in catalog. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/llmware-ai/llmware?style=social) - [AutoFlow](https://github.com/pingcap/autoflow) - Graph RAG-based conversational knowledge base tool built on TiDB Vector and LlamaIndex. Features Perplexity-style search with built-in website crawler. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/pingcap/autoflow?style=social) - [Chonkie](https://github.com/chonkie-inc/chonkie) - Lightweight document chunking library for fast, efficient RAG pipelines. Memory-safe with multiple chunking strategies (semantic, token, recursive) and direct vector DB integration. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/chonkie-inc/chonkie?style=social) - [PageIndex (VectifyAI)](https://github.com/VectifyAI/PageIndex) - Vectorless, reasoning-based RAG framework using document index structure. Achieves high accuracy without vector databases through intelligent context engineering and reasoning-based retrieval. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/VectifyAI/PageIndex?style=social) - [Kotaemon (Cinnamon)](https://github.com/Cinnamon/kotaemon) - Open-source RAG-based tool for chatting with your documents. Hybrid RAG pipeline with full-text and vector retriever, re-ranking, and multi-modal capabilities. Clean Gradio-based UI with support for local and API-based LLMs. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Cinnamon/kotaemon?style=social) - [Reader (Jina AI)](https://github.com/jina-ai/reader) - Convert any URL to LLM-friendly input with a simple prefix (r.jina.ai). Free service that extracts article content, removes clutter, and returns clean Markdown for RAG and agentic workflows. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/jina-ai/reader?style=social) - [UltraRAG (OpenBMB)](https://github.com/OpenBMB/UltraRAG) - First lightweight RAG framework based on Model Context Protocol (MCP) architecture. Low-code RAG pipeline builder with comprehensive evaluation system and DeepResearch capabilities. From Tsinghua THUNLP, NEUIR, OpenBMB, and AI9stars. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/OpenBMB/UltraRAG?style=social) - [Semantic Router](https://github.com/aurelio-labs/semantic-router) - Superfast AI decision-making layer for LLMs and agents. Uses semantic vector space to route requests using semantic meaning rather than waiting for slow LLM generations. Cuts routing time from seconds to milliseconds. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/aurelio-labs/semantic-router?style=social) - [Pathway](https://github.com/pathwaycom/pathway) - Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG. Features 350+ connectors with always-in-sync data from SharePoint, Google Drive, S3, Kafka, PostgreSQL and more. BSL 1.1 license (becomes Apache 2.0 after 4 years). ![GitHub stars](https://img.shields.io/github/stars/pathwaycom/pathway?style=social) - [Infinity (AI Database)](https://github.com/infiniflow/infinity) - AI-native database built for LLM applications with incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text. Powers RAGFlow's document engine. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/infiniflow/infinity?style=social) - [PrivateGPT](https://github.com/zylon-ai/private-gpt) - Private document Q&A project for local and offline RAG workflows where data stays inside the user's environment. ![GitHub stars](https://img.shields.io/github/stars/zylon-ai/private-gpt?style=social) - [FastGPT](https://github.com/labring/FastGPT) - Knowledge-base platform with RAG retrieval, document processing, visual AI workflows, and self-hosted deployment options. ![GitHub stars](https://img.shields.io/github/stars/labring/FastGPT?style=social) - [MaxKB](https://github.com/1Panel-dev/MaxKB) - Self-hostable knowledge-base and agent platform for document ingestion, RAG pipelines, and enterprise assistant workflows. ![GitHub stars](https://img.shields.io/github/stars/1Panel-dev/MaxKB?style=social) - [DB-GPT](https://github.com/eosphoros-ai/DB-GPT) - Self-hosted AI data assistant for private knowledge, database-aware conversations, and data-heavy RAG workflows. ![GitHub stars](https://img.shields.io/github/stars/eosphoros-ai/DB-GPT?style=social) - [WeKnora](https://github.com/Tencent/WeKnora) - Enterprise knowledge platform that combines RAG retrieval, autonomous reasoning agents, wiki generation, and multi-source document ingestion. ![GitHub stars](https://img.shields.io/github/stars/Tencent/WeKnora?style=social) - [localGPT](https://github.com/PromtEngineer/localGPT) - Local document-chat project for private, on-device Q&A over files without sending data to external APIs. ![GitHub stars](https://img.shields.io/github/stars/PromtEngineer/localGPT?style=social) - [SurfSense](https://github.com/MODSetter/SurfSense) - Privacy-focused NotebookLM-style workspace for teams to search, organize, and query knowledge with self-hosted RAG. ![GitHub stars](https://img.shields.io/github/stars/MODSetter/SurfSense?style=social) - [PieKBS](https://github.com/pieteams/piekbs) - Local-first knowledge search engine for agents with FTS5 full-text search and graph-based document expansion via citation/support/wiki links. Pure Go, no embedding required. ![GitHub stars](https://img.shields.io/github/stars/pieteams/piekbs?style=social) - [XERJ](https://github.com/xerj-org/xerj) - Local AI search and agent-memory server that autoindexes code, documents, logs, and PDFs, then exposes full-text, vector, hybrid search, and MCP tools through an Elasticsearch-compatible API. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/xerj-org/xerj?style=social) - [Morphik](https://github.com/morphik-org/morphik-core) - Open-source multimodal RAG framework for building AI apps over private knowledge. Handles text, images, and documents with built-in embedding generation and vector search. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/morphik-org/morphik-core?style=social) - [Beever Atlas](https://github.com/Beever-AI/beever-atlas) - Open-source LLM knowledge base combining Neo4j knowledge graph with Weaviate vector DB for graph-based RAG. Native MCP server, team chat ingestion (Slack, Discord, Teams, Telegram), and BYO LLM via LiteLLM. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Beever-AI/beever-atlas?style=social) - [VidXP](https://github.com/grayhatdevelopers/vidxp) - Local-first multimodal video indexing and semantic search toolkit with transcript extraction, embeddings, scene-aware search. Can be used as a CLI, API and MCP. ![GitHub stars](https://img.shields.io/github/stars/grayhatdevelopers/vidxp?style=social) - [CocoIndex](https://github.com/cocoindex-io/cocoindex) - Incremental data transformation engine for AI pipelines with built-in chunking, embedding, and source connectors that recomputes only the inputs that changed. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/cocoindex-io/cocoindex?style=social) #### Knowledge Graphs for RAG - [Graphiti](https://github.com/getzep/graphiti) - Build real-time temporal knowledge graphs for AI agents. Tracks how facts change over time with provenance to source data. Supports prescribed and learned ontology for evolving real-world data. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/getzep/graphiti?style=social) - [Semantica](https://github.com/semantica-agi/semantica) - Graph-native infrastructure for context management, bi-temporal knowledge graphs, GraphRAG document chunking, and explainable AI reasoning. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/semantica-agi/semantica?style=social) - [Code-Graph-RAG](https://github.com/vitali87/code-graph-rag) - Multi-language codebase RAG framework using Tree-sitter and Memgraph knowledge graphs to query, edit, and optimize codebases with AI. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/vitali87/code-graph-rag?style=social) #### Web Data Ingestion - [Crawl4AI](https://github.com/unclecode/crawl4ai) - LLM-friendly web crawler that turns websites into clean Markdown for RAG and agentic workflows. ![GitHub stars](https://img.shields.io/github/stars/unclecode/crawl4ai?style=social) - [Scrapling](https://github.com/D4Vinci/Scrapling) - Adaptive web scraping and crawling framework for robust structured extraction from pages to large-scale pipelines. ![GitHub stars](https://img.shields.io/github/stars/D4Vinci/Scrapling?style=social) - [Lightpanda](https://github.com/lightpanda-io/browser) - Machine-first headless browser in Zig; rendering-free and ultra-lightweight for AI agent browsing. ![GitHub stars](https://img.shields.io/github/stars/lightpanda-io/browser?style=social) - [Paperless-AI](https://github.com/clusterzx/paperless-ai) - Automated document analyzer for Paperless-ngx with RAG-powered semantic search across your document archive. ![GitHub stars](https://img.shields.io/github/stars/clusterzx/paperless-ai?style=social) - [Firecrawl](https://github.com/firecrawl/firecrawl) - Web Data API for AI - search, scrape, and interact with the web at scale. Clean markdown/JSON output with proxy rotation and JS-blocking handled automatically. ![GitHub stars](https://img.shields.io/github/stars/firecrawl/firecrawl?style=social) - [wigolo](https://github.com/KnockOutEZ/wigolo) - Local-first web intelligence and Model Context Protocol (MCP) server for web search, crawling, and structured data extraction. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/KnockOutEZ/wigolo?style=social) - [Zoom Search](https://github.com/goofrey/zoom-search) - MCP search and evidence tool for AI agents with query rewriting, source zoom-in, sourced answers, and runtime metrics. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/goofrey/zoom-search?style=social) - [invisible-playwright](https://github.com/feder-cr/invisible_playwright) - Playwright wrapper for a stealth-patched Firefox 150 binary. Drop-in Browser object for AI agents that need to ingest web data from sites with anti-bot guardrails (reCAPTCHA, FingerprintPro, Cloudflare). Spoofing happens in C++ source, not via JS overrides. MIT (wrapper) + MPL-2.0 (patches). ![GitHub stars](https://img.shields.io/github/stars/feder-cr/invisible_playwright?style=social) #### Document Conversion & Preprocessing - [pdf-inspector](https://github.com/firecrawl/pdf-inspector) - Fast Rust library for PDF classification and text extraction that detects scanned vs text-based documents to route RAG pipelines without OCR. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/firecrawl/pdf-inspector?style=social) - [OpenDataLoader PDF](https://github.com/opendataloader-project/opendataloader-pdf) - Accessibility-aware PDF parser and conversion pipeline for AI-ready markdown and structured data workflows. ![GitHub stars](https://img.shields.io/github/stars/opendataloader-project/opendataloader-pdf?style=social) - [MarkItDown (Microsoft)](https://github.com/microsoft/markitdown) - Python tool for converting files and office documents to Markdown. Supports PDF, PowerPoint, Word, Excel, images, audio, HTML, and more with OCR and transcription capabilities. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/microsoft/markitdown?style=social) - [LiteParse](https://github.com/run-llama/liteparse) - Lightweight document parsing toolkit for AI and RAG pipelines with PDF/OCR extraction and clean preprocessing defaults. ![GitHub stars](https://img.shields.io/github/stars/run-llama/liteparse?style=social) - [PaddleOCR](https://github.com/PaddlePaddle/PaddleOCR) - Large-scale OCR suite with detection, recognition, and layout analysis, used widely for document digitization and downstream RAG pipelines. ![GitHub stars](https://img.shields.io/github/stars/PaddlePaddle/PaddleOCR?style=social) - [DocETL (UC Berkeley)](https://github.com/ucbepic/docetl) - Agentic LLM-powered data processing and ETL system for complex document processing. Query rewriting and evaluation for unstructured data analysis with 80% higher accuracy than baselines. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/ucbepic/docetl?style=social) - [kordoc](https://github.com/chrisryugj/kordoc) - TypeScript library, CLI, and MCP server that converts Korean documents (HWP 3.x/5.x, HWPX, HWPML) as well as PDF, DOCX, XLSX, PPTX, and images to Markdown and structured data. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/chrisryugj/kordoc?style=social) #### LLM Application Frameworks - [aisuite](https://github.com/andrewyng/aisuite) - Simple, unified interface to multiple Generative AI providers. Use OpenAI, Anthropic, Google, and 10+ other providers with a standardized API similar to OpenAI's. Switch between models or providers with a single line of code. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/andrewyng/aisuite?style=social) - [Spring AI](https://github.com/spring-projects/spring-ai) - Application framework for AI engineering in the Spring ecosystem. Unified API for LLMs, vector stores, and embedding models with seamless integration into Spring Boot applications. Supports RAG, tool calling, and structured outputs. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/spring-projects/spring-ai?style=social) - [Rig](https://github.com/0xPlaygrounds/rig) - Rust library for building scalable, modular LLM-powered applications. Type-safe agent framework with unified LLM interface, built-in vector store integrations, and ergonomic abstractions for production AI systems. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/0xPlaygrounds/rig?style=social) - [Ax](https://github.com/ax-llm/ax) - TypeScript framework for building reliable AI applications. "Official" DSPy-inspired framework for TypeScript with type-safe LLM interactions, chain-of-thought reasoning, and structured output validation. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/ax-llm/ax?style=social) - [Genkit](https://github.com/genkit-ai/genkit) - Open-source framework for building full-stack AI-powered applications in JavaScript, Go, and Python. Built and used in production by Google's Firebase. Unified interface for integrating AI models from multiple providers with built-in RAG, tool calling, structured outputs, and developer tools. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/genkit-ai/genkit?style=social) - [ContextGem](https://github.com/shcherbak-ai/contextgem) - Effortless LLM extraction framework for documents. Powerful abstractions for building extraction workflows with automated dynamic prompts, data modeling, validation, and precise reference mapping. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/shcherbak-ai/contextgem?style=social) - [Eino](https://github.com/cloudwego/eino) - The ultimate LLM/AI application development framework in Go. Drawing from LangChain and Google ADK, designed to follow Go conventions with composable components for chains, agents, and workflows. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/cloudwego/eino?style=social) - [ruby_llm](https://github.com/crmne/ruby_llm) - One beautiful Ruby API for OpenAI, Anthropic, Gemini, Bedrock, Azure, OpenRouter, DeepSeek, Ollama, and 15+ providers. Agents, Chat, Vision, Audio, PDF, Images, Embeddings, Tools, Streaming and Rails integration. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/crmne/ruby_llm?style=social) - [LangChain.rb](https://github.com/patterns-ai-core/langchainrb) - Build LLM-powered applications in Ruby. Idiomatic Ruby library for building AI applications with support for multiple LLM providers, vector stores, and RAG pipelines. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/patterns-ai-core/langchainrb?style=social) --- ## 6. Generative Media Tools > Open-source models and applications for image, video, audio, and 3D generation and editing. #### Image Generation & Editing - [ComfyUI](https://github.com/Comfy-Org/ComfyUI) - Node-based visual workflow editor for Stable Diffusion, FLUX, etc. ![GitHub stars](https://img.shields.io/github/stars/Comfy-Org/ComfyUI?style=social) - [Stable Diffusion WebUI Forge - Neo](https://github.com/Haoming02/sd-webui-forge-classic) - Actively maintained Forge-based Stable Diffusion web UI with the familiar extension-driven workflow. ![GitHub stars](https://img.shields.io/github/stars/Haoming02/sd-webui-forge-classic?style=social) - [Diffusers](https://github.com/huggingface/diffusers) - PyTorch library for diffusion pipelines spanning image, video, and audio generation. ![GitHub stars](https://img.shields.io/github/stars/huggingface/diffusers?style=social) - [InvokeAI](https://github.com/invoke-ai/InvokeAI) - Full-featured creative studio. ![GitHub stars](https://img.shields.io/github/stars/invoke-ai/InvokeAI?style=social) - [SD.Next](https://github.com/vladmandic/sdnext) - All-in-one WebUI for AI generative image and video creation with multi-platform support, SDNQ quantization, and balanced CPU/GPU memory offload. ![GitHub stars](https://img.shields.io/github/stars/vladmandic/sdnext?style=social) - [stable-diffusion.cpp](https://github.com/leejet/stable-diffusion.cpp) - Production-ready C++ inference runtime for SD, Flux, and related diffusion models, optimized for CPU and GPU deployment. ![GitHub stars](https://img.shields.io/github/stars/leejet/stable-diffusion.cpp?style=social) - [ArtCraft](https://github.com/storytold/artcraft) - Interactive AI image and video creation studio that combines 2D/3D scene composition, controlled generation, image editing, and model-provider choice. Dual MIT/Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/storytold/artcraft?style=social) - [Upscayl](https://github.com/upscayl/upscayl) - Free and open-source AI image upscaler for Linux, macOS, and Windows. Uses Real-ESRGAN and Vulkan architecture to enhance images by reconstructing high-resolution details. Cross-platform desktop app with batch processing. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/upscayl/upscayl?style=social) - [upres-cli](https://github.com/auroracapital/upres-cli) - Open-source (MIT) CLI and MCP server for [UpRes](https://upres.ai), an image and video upscaler with 14 public model aliases (faces, text, print, art, motion) and 8K output. ![GitHub stars](https://img.shields.io/github/stars/auroracapital/upres-cli?style=social) - [Krita AI Diffusion](https://github.com/Acly/krita-ai-diffusion) - Streamlined AI image generation plugin for Krita. Inpaint and outpaint with optional text prompt, no tweaking required. Integrates ComfyUI backend for professional digital painting workflows. GPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Acly/krita-ai-diffusion?style=social) - [ImageLoom](https://github.com/elapen/imageloom) - Local AI image studio for macOS (Windows build experimental) built on stable-diffusion.cpp, with a chat-style UI for generating, editing (instruction or brush mask), upscaling and exporting images, plus a CLI and agent skills. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/elapen/imageloom?style=social) - [OpenPixels](https://gitlab.com/openpixelsapp/OpenPixels) - Browser-based photo upscaler and restorer: Real-ESRGAN upscaling up to 8x, GFPGAN face restoration, DDColor colorization and U2-Netp background removal run on-device through onnxruntime-web with a Rust/WebAssembly core, so photos are never uploaded. Works offline as a PWA and also ships as a browser extension and Mac/Windows/Android apps. MIT or Apache-2.0 licensed. #### Face Swap & Deepfake - [Deep-Live-Cam](https://github.com/hacksider/Deep-Live-Cam) - Real-time face swap and one-click video deepfake with only a single image. High-quality face swapping for live video streaming and content creation. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/hacksider/Deep-Live-Cam?style=social) - [Faceswap](https://github.com/deepfakes/faceswap) - Open-source deep learning software for recognizing and swapping faces in pictures and videos. GPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/deepfakes/faceswap?style=social) #### Portrait Animation #### Video Generation - [Hyperframes (HeyGen)](https://github.com/heygen-com/hyperframes) - Open-source long video generation platform for cinematic and social video creation with timeline control, diffusion-based motion modules, and multimodal conditioning. ![GitHub stars](https://img.shields.io/github/stars/heygen-com/hyperframes?style=social) - [LTX-2 (Lightricks)](https://github.com/Lightricks/LTX-2) - Official Python inference and LoRA trainer package for the LTX-2 audio–video generative model. ![GitHub stars](https://img.shields.io/github/stars/Lightricks/LTX-2?style=social) - [Helios (PKU-YuanGroup)](https://github.com/PKU-YuanGroup/Helios) - Efficient long-video generation framework with 24GB VRAM support for up to 10,000 frames (5+ minutes) and 1280×768 resolution. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/PKU-YuanGroup/Helios?style=social) - [Pixelle-Video (AIDC-AI)](https://github.com/AIDC-AI/Pixelle-Video) - Text-to-video foundation model optimized for long coherent scenes and controllable generation workflows. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/AIDC-AI/Pixelle-Video?style=social) - [MoneyPrinterTurbo](https://github.com/harry0703/MoneyPrinterTurbo) - An end-to-end short-video generation pipeline that automates scripts, footage collection, voiceover, and subtitle synthesis. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/harry0703/MoneyPrinterTurbo?style=social) - [OpenMontage](https://github.com/calesthio/OpenMontage) - Agentic video production platform that orchestrates scriptwriting, asset generation, voice synthesis, editing, and rendering. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/calesthio/OpenMontage?style=social) - [ViMax](https://github.com/HKUDS/ViMax) - Multi-agent video generation framework that orchestrates scriptwriting, storyboarding, character design, and temporal visual consistency for end-to-end video synthesis. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/HKUDS/ViMax?style=social) - [WhisperLive](https://github.com/collabora/WhisperLive) - Nearly-live implementation of OpenAI's Whisper for real-time speech-to-text transcription. Supports faster-whisper, tensorrt, and openvino backends with WebSocket streaming. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/collabora/WhisperLive?style=social) - [OpenShorts](https://github.com/mutonby/openshorts) - Self-hosted app that turns long videos into vertical short clips using faster-whisper transcription, LLM clip selection, face-tracking 9:16 reframing, and animated captions. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/mutonby/openshorts?style=social) #### Audio / Music / Voice Generation - [ACE-Step 1.5](https://github.com/ace-step/ACE-Step-1.5) - Local-first music generation model with broad hardware support across Mac, AMD, Intel, and CUDA devices. ![GitHub stars](https://img.shields.io/github/stars/ace-step/ACE-Step-1.5?style=social) - [Magenta RealTime 2](https://github.com/magenta/magenta-realtime) - Open-weights live music model for streaming generation and real-time interaction. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/magenta/magenta-realtime?style=social) - [YuE](https://github.com/multimodal-art-projection/YuE) - Full-song music generation foundation model with symbolic melody-and-chord planning, acoustic synthesis, zero-shot covers, and song editing. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/multimodal-art-projection/YuE?style=social) - [Stable Audio Tools](https://github.com/Stability-AI/stable-audio-tools) - Stability AI's open-source audio and music generative models. Latent diffusion model for generating audio conditioned on metadata and timing, providing faster inference times and creative control for sound effects and music production. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Stability-AI/stable-audio-tools?style=social) - [GPT-SoVITS](https://github.com/RVC-Boss/GPT-SoVITS) - Few-shot voice cloning with just 1 minute of voice data. Combines GPT and SoVITS architectures for high-quality TTS with cross-lingual support and emotional expression. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/RVC-Boss/GPT-SoVITS?style=social) - [Supertonic](https://github.com/supertone-inc/supertonic) - Lightning-fast, on-device, multilingual text-to-speech system running natively via ONNX. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/supertone-inc/supertonic?style=social) - [Voicebox](https://github.com/jamiepine/voicebox) - Local-first AI voice studio to clone voices, generate speech in multiple languages, and dictate text locally. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/jamiepine/voicebox?style=social) - [Voice-Pro](https://github.com/abus-aikorea/voice-pro) - Multilingual AI speech recognition, text-to-speech, and zero-shot voice cloning WebUI. GPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/abus-aikorea/voice-pro?style=social) - [VoiceStudio](https://github.com/debpalash/VoiceStudio) - Local-first voice platform for multi-engine text-to-speech, voice cloning and design, video dubbing, and dictation. ![GitHub stars](https://img.shields.io/github/stars/debpalash/VoiceStudio?style=social) #### 3D & Creative Tools - [Modly](https://github.com/lightningpixel/modly) - Desktop application for image-to-3D mesh generation using local GPU-accelerated AI models. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/lightningpixel/modly?style=social) - [gsplat (3D Gaussian Splatting tools)](https://github.com/nerfstudio-project/gsplat) - High-performance 3D Gaussian Splatting library. ![GitHub stars](https://img.shields.io/github/stars/nerfstudio-project/gsplat?style=social) - [LichtFeld-Studio](https://github.com/MrNeRF/LichtFeld-Studio) - Native application for training, editing, and exporting 3D Gaussian Splatting scenes with MCMC optimization and timelapse generation. GPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/MrNeRF/LichtFeld-Studio?style=social) - [OpenSplat](https://github.com/pierotofy/OpenSplat) - Production-grade, portable implementation of 3D Gaussian Splatting with CPU/GPU support for Windows, Mac, and Linux. Creates 3D scenes from camera poses and sparse points. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/pierotofy/OpenSplat?style=social) - [TRELLIS.2](https://github.com/microsoft/TRELLIS.2) - 3D generative model for high-fidelity image-to-3D generation utilizing compact structured latents. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/microsoft/TRELLIS.2?style=social) - [MCP for Blender](https://github.com/ahujasid/mcp-for-blender) - Blender add-on and MCP server that let LLM agents create and manipulate 3D scenes through structured tools. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/ahujasid/mcp-for-blender?style=social) --- ## 7. Training & Fine-tuning Ecosystem > Tools for model training, fine-tuning, synthetic data generation, and distributed training. #### Full Training Frameworks - [Oumi](https://github.com/oumi-ai/oumi) - Fully open-source platform for the complete foundation model lifecycle - from data preparation and training to evaluation and deployment. Supports 100+ models with 200+ recipes for fine-tuning gpt-oss, Qwen3, DeepSeek-R1, and more. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/oumi-ai/oumi?style=social) - [Marin](https://github.com/marin-community/marin) - Open-source framework for foundation-model development with composable data, training, and evaluation pipelines for modern LLM research. ![GitHub stars](https://img.shields.io/github/stars/marin-community/marin?style=social) - [LLaMA-Factory](https://github.com/hiyouga/LLaMA-Factory) - One-stop unified framework for SFT, DPO, ORPO, KTO with web UI. ![GitHub stars](https://img.shields.io/github/stars/hiyouga/LLaMA-Factory?style=social) - [Axolotl](https://github.com/axolotl-ai-cloud/axolotl) - YAML-driven full pipeline for SFT, DPO, GRPO. ![GitHub stars](https://img.shields.io/github/stars/axolotl-ai-cloud/axolotl?style=social) - [ms-swift](https://github.com/modelscope/ms-swift) - Unified training framework for 600+ LLMs and 300+ MLLMs with CPT/SFT/DPO/GRPO (AAAI 2025). ![GitHub stars](https://img.shields.io/github/stars/modelscope/ms-swift?style=social) - [Unsloth](https://github.com/unslothai/unsloth) - 2× faster, 70% less memory fine-tuning. ![GitHub stars](https://img.shields.io/github/stars/unslothai/unsloth?style=social) - [LitGPT](https://github.com/Lightning-AI/litgpt) - Clean from-scratch implementations of 20+ LLMs. ![GitHub stars](https://img.shields.io/github/stars/Lightning-AI/litgpt?style=social) - [torchtune](https://github.com/pytorch/torchtune) - PyTorch-native library for post-training, fine-tuning, and experimentation with LLMs. ![GitHub stars](https://img.shields.io/github/stars/pytorch/torchtune?style=social) - [kohya_ss](https://github.com/bmaltais/kohya_ss) - Gradio-based GUI and CLI for training Stable Diffusion models (LoRA, Dreambooth, fine-tuning, SDXL). Provides accessible interface to Kohya's powerful training scripts. ![GitHub stars](https://img.shields.io/github/stars/bmaltais/kohya_ss?style=social) - [TRL (Transformers Reinforcement Learning)](https://github.com/huggingface/trl) - Official library for RLHF, SFT, DPO, ORPO. ![GitHub stars](https://img.shields.io/github/stars/huggingface/trl?style=social) - [verl](https://github.com/volcengine/verl) - Volcano Engine Reinforcement Learning for LLMs with PPO, GRPO, REINFORCE++, DAPO (EuroSys 2025). ![GitHub stars](https://img.shields.io/github/stars/volcengine/verl?style=social) - [NeMo-RL](https://github.com/NVIDIA-NeMo/RL) - Scalable toolkit for efficient model reinforcement with DTensor and Megatron backends. ![GitHub stars](https://img.shields.io/github/stars/NVIDIA-NeMo/RL?style=social) - [OpenRLHF](https://github.com/OpenRLHF/OpenRLHF) - Easy-to-use, scalable RLHF framework based on Ray. Supports PPO, GRPO, REINFORCE++, DAPO with vLLM integration and async training. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/OpenRLHF/OpenRLHF?style=social) - [LMFlow](https://github.com/OptimalScale/LMFlow) - Extensible toolkit for finetuning and inference of large foundation models. Features RAFT alignment algorithm and comprehensive model support. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/OptimalScale/LMFlow?style=social) - [XTuner](https://github.com/InternLM/xtuner) - A next-generation training engine built for ultra-large MoE models with efficient QLoRA and full-parameter fine-tuning. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/InternLM/xtuner?style=social) - [Ludwig](https://github.com/ludwig-ai/ludwig) - Low-code framework for building custom LLMs and deep neural networks. Declarative YAML configuration for training state-of-the-art models with PEFT/LoRA, 4-bit quantization, distributed training via Hugging Face Accelerate, and native Kubernetes support. Linux Foundation AI project. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/ludwig-ai/ludwig?style=social) - [TorchTitan (PyTorch)](https://github.com/pytorch/torchtitan) - PyTorch native platform for training generative AI models at scale. Showcases 4D parallelism (FSDP, tensor, pipeline, context) for LLM pretraining with 65%+ speedups over optimized baselines. BSD-3-Clause licensed. ![GitHub stars](https://img.shields.io/github/stars/pytorch/torchtitan?style=social) - [VeOmni (ByteDance)](https://github.com/ByteDance-Seed/VeOmni) - Versatile framework for both single- and multi-modal pre-training and post-training. Model-centric distributed recipe zoo supporting text, vision, audio, and video models with unified training interface. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/ByteDance-Seed/VeOmni?style=social) - [H2O LLM Studio](https://github.com/h2oai/h2o-llmstudio) - No-code GUI framework for fine-tuning LLMs. Streamlined interface for SFT, reward modeling, and model deployment. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/h2oai/h2o-llmstudio?style=social) - [PRIME-RL](https://github.com/PrimeIntellect-ai/prime-rl) - Agentic RL Training at Scale from Prime Intellect. Framework for large-scale reinforcement learning capable of scaling to 1000+ GPUs with fully asynchronous RL, FSDP2 training, and vLLM inference. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/PrimeIntellect-ai/prime-rl?style=social) - [slime](https://github.com/THUDM/slime) - LLM post-training framework for RL Scaling from THUDM. Supports SFT and RL training with multi-turn compilation feedback, powering projects like TritonForge for automated GPU kernel generation. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/THUDM/slime?style=social) - [rLLM](https://github.com/rllm-org/rllm) - Democratizing Reinforcement Learning for LLMs. Framework for training AI agents with RL featuring near-zero code changes, CLI-first workflow, and 50+ built-in benchmarks. Supports GRPO, REINFORCE, RLOO with verl and tinker backends. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/rllm-org/rllm?style=social) - [EasyR1](https://github.com/hiyouga/EasyR1) - Efficient, scalable, multi-modality RL training framework based on veRL. Extends veRL to support vision-language models with GRPO algorithm for efficient RL training. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/hiyouga/EasyR1?style=social) - [LeRobot](https://github.com/huggingface/lerobot) - Making AI for robotics more accessible with end-to-end learning. State-of-the-art approaches for imitation learning and reinforcement learning with pretrained models, datasets, and simulated environments. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/huggingface/lerobot?style=social) - [AI-Toolkit](https://github.com/ostris/ai-toolkit) - Ultimate training toolkit for finetuning diffusion models. Easy-to-use all-in-one training suite supporting FLUX.1, FLUX.2, Stable Diffusion, and video models with both GUI and CLI interfaces. Consumer-grade hardware friendly with comprehensive LoRA and full fine-tuning support. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/ostris/ai-toolkit?style=social) - [OneTrainer](https://github.com/Nerogar/OneTrainer) - One-stop solution for all your Diffusion training needs. Supports FLUX, Stable Diffusion 1.5/2.x/3.x/SDXL, Würstchen, PixArt, Hunyuan Video and more. Features full fine-tuning, LoRA, embeddings, masked training, automatic backups, and TensorBoard integration. GPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Nerogar/OneTrainer?style=social) - [FluxGym](https://github.com/cocktailpeanut/fluxgym) - Dead simple FLUX LoRA training UI with LOW VRAM support (12GB/16GB/20GB). WebUI forked from AI-Toolkit with backend powered by Kohya Scripts. Combines simplicity of Gradio interface with flexibility of Kohya's powerful training scripts. GPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/cocktailpeanut/fluxgym?style=social) - [MiniMind](https://github.com/jingyaogong/minimind) - Train a 64M-parameter LLM from scratch in just 2 hours for $3. Complete from-scratch implementation covering MoE, data cleaning, pretraining, SFT, LoRA, RLHF (DPO/PPO/GRPO), tool use, and model distillation. All core algorithms implemented in pure PyTorch without high-level abstractions. Educational framework for understanding LLM internals. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/jingyaogong/minimind?style=social) - [FastChat](https://github.com/lm-sys/FastChat) - Open platform for training, serving, and evaluating large language model chatbots. Powers Chatbot Arena (lmarena.ai) serving 10M+ requests for 70+ LLMs. Includes training code for Vicuna, MT-Bench evaluation, and distributed multi-model serving with OpenAI-compatible APIs. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/lm-sys/FastChat?style=social) - [PaddleNLP](https://github.com/PaddlePaddle/PaddleNLP) - Easy-to-use and powerful LLM library built on Baidu's PaddlePaddle framework. Supports 100+ models with efficient training, compression, and high-performance inference on diverse hardware. Features RsLoRA+ algorithm, DeepSeek V3/R1 support with FP8/INT8 quantization, and unified checkpointing. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/PaddlePaddle/PaddleNLP?style=social) - [Soup](https://github.com/MakazhanAlpamys/Soup) - One-config CLI for LLM post-training: SFT, DPO, GRPO, KTO, ORPO, plus eval gating and export. Layer streaming trains an 8B model on a 4 GB laptop GPU by streaming the frozen base from host RAM one decoder layer at a time. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/MakazhanAlpamys/Soup?style=social) #### LoRA / PEFT Tools - [PEFT (Parameter-Efficient Fine-Tuning)](https://github.com/huggingface/peft) - Official library with LoRA, QLoRA, DoRA, etc. ![GitHub stars](https://img.shields.io/github/stars/huggingface/peft?style=social) - [Liger Kernel](https://github.com/linkedin/Liger-Kernel) - Ultra-fast custom kernels for training speedup. ![GitHub stars](https://img.shields.io/github/stars/linkedin/Liger-Kernel?style=social) - [MergeKit](https://github.com/arcee-ai/mergekit) - Advanced model merging tools. ![GitHub stars](https://img.shields.io/github/stars/arcee-ai/mergekit?style=social) #### Synthetic Data Generation - [distilabel](https://github.com/argilla-io/distilabel) - End-to-end pipeline for synthetic instruction data. ![GitHub stars](https://img.shields.io/github/stars/argilla-io/distilabel?style=social) - [Data-Juicer](https://github.com/alibaba/data-juicer) - High-performance data processing for LLM training. ![GitHub stars](https://img.shields.io/github/stars/alibaba/data-juicer?style=social) - [Argilla](https://github.com/argilla-io/argilla) - Open-source data labeling + synthetic data platform. ![GitHub stars](https://img.shields.io/github/stars/argilla-io/argilla?style=social) - [SDV (Synthetic Data Vault)](https://github.com/sdv-dev/SDV) - High-fidelity tabular and relational synthetic data. ![GitHub stars](https://img.shields.io/github/stars/sdv-dev/SDV?style=social) - [DataTrove (Hugging Face)](https://github.com/huggingface/datatrove) - Platform-agnostic data processing pipelines for LLM training at scale. Handles filtering, deduplication, and tokenization on local machines or SLURM clusters. ![GitHub stars](https://img.shields.io/github/stars/huggingface/datatrove?style=social) - [Bespoke Curator](https://github.com/bespokelabsai/curator) - Synthetic data curation for post-training and structured data extraction. Makes it easy to build pipelines around LLMs with batching and progress tracking. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/bespokelabsai/curator?style=social) - [SDG (Harbin Institute)](https://github.com/hitsz-ids/synthetic-data-generator) - Specialized framework for generating high-quality structured tabular synthetic data with CTGAN models supporting billion-level data processing. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/hitsz-ids/synthetic-data-generator?style=social) #### Distributed Training - [DeepSpeed](https://github.com/deepspeedai/DeepSpeed) - Extreme-scale training optimizations. ![GitHub stars](https://img.shields.io/github/stars/deepspeedai/DeepSpeed?style=social) - [Colossal-AI](https://github.com/hpcaitech/ColossalAI) - Unified system for 100B+ models. ![GitHub stars](https://img.shields.io/github/stars/hpcaitech/ColossalAI?style=social) - [Megatron-LM](https://github.com/NVIDIA/Megatron-LM) - Distributed training framework and reference codebase for large transformer models at scale. ![GitHub stars](https://img.shields.io/github/stars/NVIDIA/Megatron-LM?style=social) - [Ray Train](https://github.com/ray-project/ray) - Scalable distributed training. ![GitHub stars](https://img.shields.io/github/stars/ray-project/ray?style=social) - [Nanotron (Hugging Face)](https://github.com/huggingface/nanotron) - Minimalistic 3D-parallelism LLM pretraining with tensor, pipeline, and data parallelism. Designed for simplicity and speed. ![GitHub stars](https://img.shields.io/github/stars/huggingface/nanotron?style=social) - [RLinf](https://github.com/RLinf/RLinf) - Scalable open-source RL infrastructure for post-training foundation models via reinforcement learning. Features M2Flow paradigm for embodied AI and agentic workflows with real-world robotics integrations. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/RLinf/RLinf?style=social) - [dstack](https://github.com/dstackai/dstack) - Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal. MPL-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/dstackai/dstack?style=social) - [Streaming (MosaicML)](https://github.com/mosaicml/streaming) - High-performance data streaming library for efficient neural network training. Streams training data from cloud storage (S3, GCS, Azure) with local caching and deterministic shuffling. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/mosaicml/streaming?style=social) - [Higgsfield](https://github.com/higgsfield-ai/higgsfield) - Fault-tolerant GPU orchestration and distributed ML framework for training models at billion- to trillion-parameter scale. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/higgsfield-ai/higgsfield?style=social) #### Model Quantization & Optimization - [LLM Compressor (vLLM)](https://github.com/vllm-project/llm-compressor) - Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM. Supports GPTQ, AWQ, SmoothQuant, AutoRound, and FP8/INT8 quantization with seamless Hugging Face integration. ![GitHub stars](https://img.shields.io/github/stars/vllm-project/llm-compressor?style=social) - [NVIDIA Model Optimizer](https://github.com/NVIDIA/Model-Optimizer) - Unified library of SOTA model optimization techniques including quantization, pruning, distillation, and speculative decoding. Compresses deep learning models for deployment with TensorRT-LLM, TensorRT, and vLLM to optimize inference speed across NVIDIA hardware. ![GitHub stars](https://img.shields.io/github/stars/NVIDIA/Model-Optimizer?style=social) --- ## 8. MLOps / LLMOps & Production > Tooling for tracking, deploying, monitoring, and operating AI systems in production. #### Experiment Tracking & Versioning - [MLflow](https://github.com/mlflow/mlflow) - End-to-end open platform for the ML/LLM lifecycle. ![GitHub stars](https://img.shields.io/github/stars/mlflow/mlflow?style=social) - [DVC (Data Version Control)](https://github.com/iterative/dvc) - Git-like versioning for data and models. ![GitHub stars](https://img.shields.io/github/stars/iterative/dvc?style=social) - [ClearML](https://github.com/clearml/clearml) - Open-source platform for experiment tracking, orchestration, data management, and model serving. ![GitHub stars](https://img.shields.io/github/stars/clearml/clearml?style=social) - [Weights & Biases Weave](https://github.com/wandb/weave) - Open-source tracing and experiment tracking. ![GitHub stars](https://img.shields.io/github/stars/wandb/weave?style=social) - [Aim](https://github.com/aimhubio/aim) - Self-hosted ML experiment tracker designed to handle 10,000s of training runs with performant UI and SDK for programmatic access. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/aimhubio/aim?style=social) - [Feast](https://github.com/feast-dev/feast) - Open source feature store for ML. Manages offline/online feature storage with point-in-time correctness to prevent data leakage. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/feast-dev/feast?style=social) - [OpenLineage](https://github.com/OpenLineage/OpenLineage) - Open standard for lineage metadata collection designed to instrument jobs as they run. Defines a generic model of run, job, and dataset entities for consistent data lineage tracking. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/OpenLineage/OpenLineage?style=social) - [Marquez](https://github.com/MarquezProject/marquez) - LF AI & Data Foundation Graduated project for metadata collection, aggregation, and visualization. Maintains provenance of how datasets are consumed and produced with global visibility into job runtime and dataset lifecycle management. Integrates with OpenLineage. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/MarquezProject/marquez?style=social) #### Model Hubs & Registries - [Civitai](https://github.com/civitai/civitai) - Open-source AI model hub and community platform for sharing and discovering generative AI models, with focus on image generation models. Features model versioning, reviews, and integrated inference. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/civitai/civitai?style=social) - [Hugging Face Hub](https://github.com/huggingface/huggingface_hub) - Official Python client for the Hugging Face Hub. Download, upload, and manage 1M+ open-source ML models and datasets programmatically. The de facto standard for model sharing and distribution. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/huggingface/huggingface_hub?style=social) - [ModelScope](https://github.com/modelscope/modelscope) - Model-as-a-Service platform bringing together 700+ state-of-the-art ML models from the AI community. Covers NLP, CV, Audio, Multi-modality, and AI for Science with streamlined model inference, fine-tuning and evaluation. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/modelscope/modelscope?style=social) - [OpenVINO Open Model Zoo](https://github.com/openvinotoolkit/open_model_zoo) - Pre-trained deep learning models and demos optimized for Intel hardware. 200+ public pre-trained models for vision, speech, and NLP with benchmarking tools and accuracy metrics. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/openvinotoolkit/open_model_zoo?style=social) - [ONNX Model Zoo](https://github.com/onnx/models) - Collection of pre-trained, state-of-the-art models in the ONNX format. 80+ models spanning vision, NLP, and audio with validation data and reference implementations. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/onnx/models?style=social) - [Transformers.js](https://github.com/huggingface/transformers.js) - State-of-the-art Machine Learning for the web. Run Hugging Face Transformers directly in your browser with no server needed. Supports 1000+ models including BERT, GPT-2, T5, and more via ONNX Runtime Web. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/huggingface/transformers.js?style=social) - [DJL (Deep Java Library)](https://github.com/deepjavalibrary/djl) - Engine-agnostic deep learning framework for Java with built-in model zoo. Load and run PyTorch, TensorFlow, MXNet, and ONNX models with a unified API. Includes 80+ pre-trained models for CV and NLP. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/deepjavalibrary/djl?style=social) - [TorchVision Models](https://github.com/pytorch/vision) - PyTorch's official computer vision library with 50+ pre-trained model architectures including ResNet, EfficientNet, Vision Transformers (ViT), ConvNeXt, and more. The de facto standard model zoo for PyTorch computer vision. BSD-3-Clause licensed. ![GitHub stars](https://img.shields.io/github/stars/pytorch/vision?style=social) - [TensorFlow Model Garden](https://github.com/tensorflow/models) - Official TensorFlow repository of state-of-the-art (SOTA) models and modeling solutions. Contains reference implementations for BERT, ResNet, Transformer, and many more with pre-trained weights and training scripts. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/tensorflow/models?style=social) - [PINTO Model Zoo](https://github.com/PINTO0309/PINTO_model_zoo) - Repository for storing models inter-converted between various frameworks. Supports TensorFlow, PyTorch, ONNX, OpenVINO, TFJS, TFTRT, TensorFlowLite (Float32/16/INT8), EdgeTPU, and CoreML. 4,100+ stars with extensive model conversion tools for edge deployment. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/PINTO0309/PINTO_model_zoo?style=social) - [Cerebras Model Zoo](https://github.com/Cerebras/modelzoo) - Collection of deep learning models and utilities optimized for Cerebras hardware. Includes reference implementations for Llama, Mixtral, DINOv2, and Llava with configuration files, data preprocessing tools, and checkpoint converters. 1,150+ stars. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Cerebras/modelzoo?style=social) - [PaddleClas](https://github.com/PaddlePaddle/PaddleClas) - Comprehensive image recognition and classification toolkit with rich model zoo. 5,800+ stars featuring 24 series of classification networks, 122 pretrained models, and end-to-end image recognition systems including PP-ShiTuV2. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/PaddlePaddle/PaddleClas?style=social) #### Model Packaging & Deployment - [Cog (Replicate)](https://github.com/replicate/cog) - Containerize and deploy ML models with production-grade inference servers. Packages models into standardized containers with automatic API generation, GPU support, and one-command deployment. Powers thousands of production AI models on Replicate. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/replicate/cog?style=social) #### Deployment & Orchestration - [BentoML](https://github.com/bentoml/BentoML) - Unified framework to build, ship, and scale AI apps. ![GitHub stars](https://img.shields.io/github/stars/bentoml/BentoML?style=social) - [ZenML](https://github.com/zenml-io/zenml) - Pipeline and orchestration framework for taking ML and LLM systems from development to production. ![GitHub stars](https://img.shields.io/github/stars/zenml-io/zenml?style=social) - [Kubeflow](https://github.com/kubeflow/kubeflow) - Kubernetes-native ML/LLM platform. ![GitHub stars](https://img.shields.io/github/stars/kubeflow/kubeflow?style=social) - [KServe](https://github.com/kserve/kserve) - Kubernetes-based model serving. ![GitHub stars](https://img.shields.io/github/stars/kserve/kserve?style=social) - [Metaflow](https://github.com/Netflix/metaflow) - Netflix's ML platform for building and managing real-world AI systems. Powers thousands of projects at Netflix, Amazon, and DoorDash. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Netflix/metaflow?style=social) - [Flyte](https://github.com/flyteorg/flyte) - Kubernetes-native workflow orchestration platform for AI/ML pipelines. Dynamic, resilient orchestration with strong type safety and reproducibility. Used by Lyft, Spotify, and Gojek. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/flyteorg/flyte?style=social) - [Prefect](https://github.com/prefecthq/prefect) - Workflow orchestration framework for building resilient data and ML pipelines. Python-native with modern observability and 200+ integrations. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/prefecthq/prefect?style=social) - [Dagster](https://github.com/dagster-io/dagster) - Cloud-native orchestration platform for developing and maintaining data assets including ML models. Declarative programming model with integrated lineage and observability. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/dagster-io/dagster?style=social) - [Kubeflow Pipelines](https://github.com/kubeflow/pipelines) - Machine Learning Pipelines for Kubeflow. Platform for building and deploying portable, scalable ML workflows using Kubernetes and Argo. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/kubeflow/pipelines?style=social) - [Argo Workflows](https://github.com/argoproj/argo-workflows) - CNCF graduated container-native workflow engine for orchestrating parallel jobs on Kubernetes. Powers Kubeflow Pipelines and widely used for ML/data processing at scale. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/argoproj/argo-workflows?style=social) - [MLRun](https://github.com/mlrun/mlrun) - Open-source AI orchestration platform for quickly building and managing continuous ML and generative AI applications across their lifecycle. Automates data preparation, model tuning, and deployment. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/mlrun/mlrun?style=social) - [Kestra](https://github.com/kestra-io/kestra) - Event-driven orchestration and scheduling platform for mission-critical workflows. Infrastructure-as-Code approach with declarative YAML, Git version control integration, and hundreds of plugins for data pipelines and ML workflows. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/kestra-io/kestra?style=social) - [KitOps](https://github.com/jozu-ai/kitops) - CNCF open source DevOps tool for packaging, versioning, and securely sharing AI/ML models, datasets, code, and configuration. Packages everything into OCI artifacts stored in existing container registries. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/jozu-ai/kitops?style=social) - [Polyaxon](https://github.com/polyaxon/polyaxon) - MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle. Reproducible and scalable machine learning workflows on Kubernetes with experiment tracking, model management, and pipeline orchestration. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/polyaxon/polyaxon?style=social) - [Netflix Maestro](https://github.com/Netflix/maestro) - Netflix's next-generation workflow orchestrator for data and ML pipelines at massive scale. Highly scalable and flexible scheduler designed to handle millions of workflows across thousands of nodes. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Netflix/maestro?style=social) - [HAMi](https://github.com/Project-HAMi/HAMi) - Heterogeneous GPU Sharing on Kubernetes. CNCF sandbox project providing GPU virtualization, slicing, and scheduling for efficient AI workload management across heterogeneous accelerators (GPUs, NPUs, MLUs). Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Project-HAMi/HAMi?style=social) - [NVIDIA KAI Scheduler](https://github.com/NVIDIA/KAI-Scheduler) - Kubernetes-native GPU scheduler for AI workloads at large scale. Originally developed by Run:ai, now open-sourced by NVIDIA. Optimizes GPU resource allocation with dynamic allocation and efficient queue management. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/NVIDIA/KAI-Scheduler?style=social) - [NVIDIA DeepOps](https://github.com/NVIDIA/deepops) - Infrastructure automation tools for building GPU clusters with Kubernetes and Slurm. Deploys multi-node GPU clusters with monitoring, logging, and storage for AI/HPC workloads. BSD-3-Clause licensed. ![GitHub stars](https://img.shields.io/github/stars/NVIDIA/deepops?style=social) - [SkyPilot](https://github.com/skypilot-org/skypilot) - Run, manage, and scale AI workloads on any AI infrastructure. Unified interface to access and manage compute across Kubernetes, Slurm, and 20+ cloud providers. Used by Shopify and research institutions for training and inference. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/skypilot-org/skypilot?style=social) - [Volcano](https://github.com/volcano-sh/volcano) - Cloud-native batch scheduling system for compute-intensive workloads. CNCF incubating project with gang scheduling, job dependency management, and topology-aware scheduling for AI/ML and deep learning. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/volcano-sh/volcano?style=social) - [Apache YuniKorn](https://github.com/apache/yunikorn-core) - Kubernetes resource scheduler for batch, data, and ML workloads. Provides hierarchical resource queues, multi-tenancy fairness, and gang scheduling for big data and machine learning applications. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/apache/yunikorn-core?style=social) - [Kueue](https://github.com/kubernetes-sigs/kueue) - Kubernetes-native job queueing system for batch, HPC, AI/ML, and similar applications. Cloud-native job queueing with resource flavor fungibility, fair sharing, cohorts, and preemption policies. Integrates with Kubeflow, Ray, and JobSet. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/kubernetes-sigs/kueue?style=social) #### Feature Engineering & Data Preparation - [Featuretools](https://github.com/alteryx/featuretools) - Open-source Python library for automated feature engineering. Transforms transactional and relational datasets into feature matrices for machine learning using Deep Feature Synthesis with reusable primitives. BSD-3-Clause licensed. ![GitHub stars](https://img.shields.io/github/stars/alteryx/featuretools?style=social) - [Kedro](https://github.com/kedro-org/kedro) - Toolbox for production-ready data science. Uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/kedro-org/kedro?style=social) - [Feature-engine](https://github.com/feature-engine/feature_engine) - Python library with multiple transformers to engineer and select features for machine learning models. scikit-learn compatible with fit() and transform() methods for encoding, imputation, variable transformation, and feature selection. BSD-3-Clause licensed. ![GitHub stars](https://img.shields.io/github/stars/feature-engine/feature_engine?style=social) - [NVTabular](https://github.com/NVIDIA-Merlin/NVTabular) - GPU-accelerated feature engineering and preprocessing library for tabular data. Manipulates terabyte-scale datasets to train deep learning recommender systems. Component of NVIDIA Merlin framework. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/NVIDIA-Merlin/NVTabular?style=social) - [OpenMLDB](https://github.com/4paradigm/OpenMLDB) - Open-source machine learning database providing a feature platform for consistent features between training and inference. Real-time relational data feature computation system for online ML applications. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/4paradigm/OpenMLDB?style=social) #### Monitoring, Evaluation & Observability - [Langfuse](https://github.com/langfuse/langfuse) - #1 open-source LLM observability platform. ![GitHub stars](https://img.shields.io/github/stars/langfuse/langfuse?style=social) - [Phoenix (Arize)](https://github.com/Arize-ai/phoenix) - AI observability & evaluation platform. ![GitHub stars](https://img.shields.io/github/stars/Arize-ai/phoenix?style=social) - [Evidently](https://github.com/evidentlyai/evidently) - ML & LLM monitoring framework. ![GitHub stars](https://img.shields.io/github/stars/evidentlyai/evidently?style=social) - [Opik (Comet)](https://github.com/comet-ml/opik) - Production-ready LLM evaluation platform. ![GitHub stars](https://img.shields.io/github/stars/comet-ml/opik?style=social) - [LiteLLM](https://github.com/BerriAI/litellm) - AI Gateway to call 100+ LLM APIs in OpenAI format with unified cost tracking, guardrails, load balancing, and logging. ![GitHub stars](https://img.shields.io/github/stars/BerriAI/litellm?style=social) - [OpenLIT](https://github.com/openlit/openlit) - OpenTelemetry-native LLM observability platform with GPU monitoring, evaluations, prompt management, and guardrails. ![GitHub stars](https://img.shields.io/github/stars/openlit/openlit?style=social) - [flameox](https://github.com/morluto/flameox) - Runtime-evidence toolkit for agents that coordinates PyTorch Profiler and Nsight Systems captures, preserves native traces, and compares GPU-kernel and inference runs. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/morluto/flameox?style=social) - [OpenLLMetry (Traceloop)](https://github.com/traceloop/openllmetry) - Open-source observability for GenAI/LLM applications based on OpenTelemetry with 25+ integration backends. ![GitHub stars](https://img.shields.io/github/stars/traceloop/openllmetry?style=social) - [Agenta](https://github.com/Agenta-AI/agenta) - Open-source LLMOps platform combining prompt playground, prompt management, LLM evaluation, and observability. ![GitHub stars](https://img.shields.io/github/stars/Agenta-AI/agenta?style=social) - [Latitude](https://github.com/latitude-dev/latitude-llm) - Open-source agent engineering platform with prompt management, evaluations, and optimization. Features prompt playground, LLM-as-judge evals, and GEPA prompt optimizer for production LLM features. LGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/latitude-dev/latitude-llm?style=social) - [Helicone](https://github.com/helicone/helicone) - Open-source LLM observability platform with request logging, caching, prompt management, rate limiting, and cost analytics. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/helicone/helicone?style=social) - [Giskard](https://github.com/Giskard-AI/giskard-oss) - Open-source evaluation and testing library for LLM agents. Red teaming, vulnerability scanning, RAG evaluation, and safety testing with modular architecture. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Giskard-AI/giskard-oss?style=social) - [Awesome Agentic Engineering](https://github.com/lindixu6-hash/awesome-agentic-engineering) - Zero-dependency AI agent production-readiness toolkit with GitHub Actions score and risk-profile gates, prompt-injection fixtures, machine-readable results, and reproducible LangGraph traces. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/lindixu6-hash/awesome-agentic-engineering?style=social) - [Portkey Gateway](https://github.com/Portkey-AI/gateway) - Blazing fast AI Gateway to route 200+ LLMs with unified API. Integrated guardrails, load balancing, fallbacks, and cost tracking. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Portkey-AI/gateway?style=social) - [Envoy AI Gateway](https://github.com/envoyproxy/ai-gateway) - Manages unified access to generative AI services built on Envoy Gateway. Kubernetes-native AI gateway for routing, load balancing, and managing LLM traffic with enterprise-grade reliability. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/envoyproxy/ai-gateway?style=social) - [Unified AI System](https://github.com/happy520ai/unified-ai-system) - Self-hosted Apache-2.0 AI gateway and MCP server: per-key virtual tokens with token budgets, exact and lexical-approximate response caching (semantic-grade matching requires an attached embedding endpoint), an append-only audit chain, deterministic local prompt enhancement that makes no provider call, and reverse MCP governance that exposes upstream MCP servers and OpenAPI 3 operations as allow-listed tools. ![GitHub stars](https://img.shields.io/github/stars/happy520ai/unified-ai-system?style=social) - [Pezzo](https://github.com/pezzolabs/pezzo) - Cloud-native LLMOps platform with prompt management, versioning, and observability. Features collaborative prompt editing, A/B testing, and cost analytics. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/pezzolabs/pezzo?style=social) - [Microsoft PromptFlow](https://github.com/microsoft/promptflow) - Comprehensive suite for LLM-based AI app development from prototyping to production. Includes prompt engineering, evaluation, and deployment tools with VS Code integration. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/microsoft/promptflow?style=social) - [ChainForge](https://github.com/ianarawjo/ChainForge) - Visual programming environment for battle-testing prompts and evaluating LLM outputs. Features node-based prompt chains, multi-model comparison, and hypothesis testing. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/ianarawjo/ChainForge?style=social) - [Future AGI](https://github.com/future-agi/future-agi) - Open-source self-hostable end-to-end agent engineering and optimization platform that unifies tracing, evals, simulations, datasets, gateway, and guardrails. Built for shipping self-improving AI agents with one feedback loop from prototype to production. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/future-agi/future-agi?style=social) - [KubeStellar Console](https://github.com/kubestellar/console) - AI-powered multi-cluster Kubernetes dashboard with GPU workload monitoring, AI pipeline observability, and CNCF ecosystem integrations. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/kubestellar/console?style=social) - [OrcaReplay](https://github.com/Continuum-AI-Corp/OrcaReplay) - Records a coding-agent run below the harness and replays it offline with the network off, or forks it from a checkpoint onto another model. ![GitHub stars](https://img.shields.io/github/stars/Continuum-AI-Corp/OrcaReplay?style=social) - [tokenwatt-check](https://github.com/tokenwatt/tokenwatt-check) - CLI that health-checks NVIDIA GPU nodes against reference values for the same model (power limit, sustained clocks, BF16 TFLOPS, memory bandwidth, throttle reasons, PCIe, ECC), with a per-minute watch mode for rentals. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/tokenwatt/tokenwatt-check?style=social) #### Guardrails & Safety Tools - [PurpleLlama (Meta)](https://github.com/meta-llama/PurpleLlama) - Comprehensive set of tools to assess and improve LLM security. Includes Llama Guard safety classifiers, CyberSec Eval benchmarks, and Prompt Guard for prompt injection detection. BSD-3-Clause licensed. ![GitHub stars](https://img.shields.io/github/stars/meta-llama/PurpleLlama?style=social) - [Garak (NVIDIA)](https://github.com/NVIDIA/garak) - The LLM vulnerability scanner. Probes models for hallucinations, data leakage, prompt injection, misinformation, toxicity, and jailbreaks. Extensive plugin-based architecture with 100+ vulnerability probes. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/NVIDIA/garak?style=social) - [Promptfoo](https://github.com/promptfoo/promptfoo) - Open-source LLM evaluation and red teaming framework. Test prompts, agents, and RAGs with automated security vulnerability scanning, side-by-side model comparison, and CI/CD integration. Now part of OpenAI. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/promptfoo/promptfoo?style=social) - [DeepTeam (Confident AI)](https://github.com/confident-ai/deepteam) - Red teaming framework for LLM systems with 50+ vulnerabilities, 20+ adversarial attacks, and production-ready guardrails. Includes OWASP, NIST, and MITRE ATLAS framework mappings. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/confident-ai/deepteam?style=social) - [SkillSpector (NVIDIA)](https://github.com/NVIDIA/SkillSpector) - Security scanner for AI agent skills that detects vulnerabilities, malicious patterns, and security risks. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/NVIDIA/SkillSpector?style=social) - [ADR (Uber)](https://github.com/uber/ADR) - Enterprise security system for AI agents providing telemetry collection, benchmark evaluations, and threat detection. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/uber/ADR?style=social) - [SafetyCard](https://github.com/safetycard/safetycard) - Safety-check MCP servers and AI agents against the OWASP agentic Top 10, and get the safest setup to run them. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/safetycard/safetycard?style=social) - [solvi](https://github.com/solvi-ai/solvi) - Python runtime where a model proposes typed decisions and hard checks, rules and calibrated thresholds decide, with escalation to a person, a tool-call guard for agents and replayable hash-chained traces. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/solvi-ai/solvi?style=social) --- ## 9. Evaluation, Benchmarks & Datasets > Benchmarks, evaluation frameworks, datasets, and supporting tools for model assessment. #### Benchmark Suites - [LiveBench](https://github.com/LiveBench/LiveBench) - Contamination-free LLM benchmark with objective ground-truth scoring. ICLR 2025 spotlight paper featuring frequently-updated questions from recent sources. Tests math, coding, reasoning, language, instruction following, and data analysis. ![GitHub stars](https://img.shields.io/github/stars/LiveBench/LiveBench?style=social) - [lm-evaluation-harness (EleutherAI)](https://github.com/EleutherAI/lm-evaluation-harness) - De-facto standard for generative model evaluation. ![GitHub stars](https://img.shields.io/github/stars/EleutherAI/lm-evaluation-harness?style=social) - [HELM (Stanford)](https://github.com/stanford-crfm/helm) - Holistic Evaluation of Language Models. ![GitHub stars](https://img.shields.io/github/stars/stanford-crfm/helm?style=social) - [SWE-bench](https://github.com/SWE-bench/SWE-bench) - Evaluates LLMs on real-world GitHub issues from 15+ Python repositories. ![GitHub stars](https://img.shields.io/github/stars/SWE-bench/SWE-bench?style=social) - [GAIA](https://huggingface.co/datasets/gaia-benchmark/GAIA) - Real-world multi-step agentic benchmark. - [OpenCompass](https://github.com/open-compass/opencompass) - Evaluation platform for benchmarking language and multimodal models across large benchmark suites. ![GitHub stars](https://img.shields.io/github/stars/open-compass/opencompass?style=social) - [MLPerf Inference](https://github.com/mlcommons/inference) - Industry-standard ML inference benchmarks with reference implementations for AI accelerators. ![GitHub stars](https://img.shields.io/github/stars/mlcommons/inference?style=social) - [MLPerf Training](https://github.com/mlcommons/training) - Industry-standard ML training benchmarks from MLCommons. Reference implementations for training AI models at scale across image classification, object detection, NLP, and recommendation tasks. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/mlcommons/training?style=social) - [VLMEvalKit](https://github.com/open-compass/VLMEvalKit) - Open-source evaluation toolkit for large multi-modality models (LMMs). Supports 220+ LMMs and 80+ benchmarks including MMMU, MathVista, and ChartQA. Powers the OpenVLM Leaderboard. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/open-compass/VLMEvalKit?style=social) - [Vectara Hallucination Leaderboard](https://github.com/vectara/hallucination-leaderboard) - Leaderboard comparing LLM performance at producing hallucinations when summarizing short documents. Systematic evaluation of factual consistency across major models. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/vectara/hallucination-leaderboard?style=social) - [SWE-rebench (Nebius)](https://huggingface.co/datasets/nebius/SWE-rebench) - Continuously updated benchmark with 21,000+ real-world SWE tasks for evaluating agentic LLMs. Decontaminated, mined from GitHub. - [PinchBench](https://github.com/pinchbench/skill) - Benchmarking system for evaluating LLM models as OpenClaw coding agents. Built with Rust by the kilo.ai team. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/pinchbench/skill?style=social) - [ImageBench V1](https://imagebench.ai/imagebench-v1) - Prompt-adherence leaderboard for text-to-image models. Same prompts run across 60+ frontier models (Flux 2 Max, Nano Banana Pro, Seedream V4, Reve 2.1, Imagen 4 Ultra, Qwen Image 2.0 Pro) and judged by a VLM panel. [Public methodology](https://imagebench.ai/imagebench-v1/methodology), [head-to-head compare pages](https://imagebench.ai/imagebench-v1/compare), and the full [prompt+judgment dataset on Hugging Face](https://huggingface.co/datasets/dh7/imagebench) (CC0). #### Evaluation Frameworks - [DeepEval](https://github.com/confident-ai/deepeval) - The "Pytest for LLMs". ![GitHub stars](https://img.shields.io/github/stars/confident-ai/deepeval?style=social) - [iFixAi](https://github.com/ifixai-ai/iFixAi) - Agent-auditing framework that runs adversarial and operational inspections against AI agents, producing scored JSON and Markdown reports for CLI, CI, and agent-plugin workflows. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/ifixai-ai/iFixAi?style=social) - [Inspect AI](https://github.com/UKGovernmentBEIS/inspect_ai) - Framework for large language model evaluations from the UK AI Security Institute. ![GitHub stars](https://img.shields.io/github/stars/UKGovernmentBEIS/inspect_ai?style=social) - [Lighteval](https://github.com/huggingface/lighteval) - Evaluation toolkit for LLMs across multiple backends with reusable tasks, metrics, and result tracking. ![GitHub stars](https://img.shields.io/github/stars/huggingface/lighteval?style=social) - [Hugging Face Evaluate](https://github.com/huggingface/evaluate) - Standardized evaluation metrics. ![GitHub stars](https://img.shields.io/github/stars/huggingface/evaluate?style=social) - [LMMs-Eval](https://github.com/EvolvingLMMs-Lab/lmms-eval) - Unified multimodal evaluation toolkit for text, image, video, and audio tasks with 100+ supported benchmarks. ![GitHub stars](https://img.shields.io/github/stars/EvolvingLMMs-Lab/lmms-eval?style=social) - [BrowserGym](https://github.com/ServiceNow/BrowserGym) - Gym environment for web task automation and agent evaluation. Includes MiniWoB, WebArena, WorkArena, and more. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/ServiceNow/BrowserGym?style=social) - [TruLens](https://github.com/truera/trulens) - Evaluation and tracking for LLM experiments and AI agents. Provides feedback functions for measuring quality, relevance, and groundedness with LangChain and LlamaIndex integrations. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/truera/trulens?style=social) - [OpenEvals](https://github.com/langchain-ai/openevals) - Open-source evaluation library for LLM and agent applications. Built by LangChain with pre-built evaluators for common use cases including RAG, agents, and structured output validation. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/langchain-ai/openevals?style=social) - [AutoRAG](https://github.com/Marker-Inc-Korea/AutoRAG) - RAG AutoML tool for automatically finding optimal RAG pipelines. Evaluates and optimizes retrieval-augmented generation with AutoML-style automation for your own data and use-case. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Marker-Inc-Korea/AutoRAG?style=social) - [E2B Code Interpreter](https://github.com/e2b-dev/code-interpreter) - Python & JS/TS SDK for running AI-generated code in secure isolated sandboxes. Essential infrastructure for evaluating code-generating LLMs with safe execution environments. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/e2b-dev/code-interpreter?style=social) - [EvalScope (ModelScope)](https://github.com/modelscope/evalscope) - Streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking. One-stop evaluation solution with 80+ benchmarks. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/modelscope/evalscope?style=social) - [Harbor](https://github.com/harbor-framework/harbor) - Framework for running agent evaluations and creating/using RL environments. Evaluate arbitrary agents like Claude Code, OpenHands, and Codex CLI. Build and share benchmarks and environments. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/harbor-framework/harbor?style=social) - [YYLO Benchmark](https://github.com/yylo-dev/yylo-benchmark) - Longitudinal evaluation for agent runs: executes task prompts in private fresh-repository attempt workspaces and retains attempt evidence, evaluator provenance, and reports for later re-evaluation. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/yylo-dev/yylo-benchmark?style=social) - [JevOss](https://github.com/mertkayacs/jevoss) - Test suite for decision-model servers that implement the Jev API, reporting accuracy and probability calibration and probing prompt injection, option-order sensitivity, irrelevant padding and repeated-call consistency. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/mertkayacs/jevoss?style=social) - [Solo R Benchmark Harness](https://github.com/O-word/solo-r-benchmark-harness) - Harness that runs the SoloRoleplayer app headless against a local model server and scores roleplay replies for personality lock, head-hopping, repetition and hard-rule adherence. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/O-word/solo-r-benchmark-harness?style=social) - [lane_lint](https://github.com/O-word/lane-lint) - Dependency-free checker that flags head-hopping (writing the other character's words, actions or feelings) in roleplay text. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/O-word/lane-lint?style=social) #### High-quality Open Datasets & Data Tools - [Hugging Face Datasets](https://github.com/huggingface/datasets) - Largest open repository of datasets. ![GitHub stars](https://img.shields.io/github/stars/huggingface/datasets?style=social) - [OrcaPromptVault](https://github.com/Continuum-AI-Corp/OrcaPromptVault) - Open corpus of the instructions and tool schemas shipping AI agents are actually sent: 119 artifacts from 43 products, 44 of them recorded off the wire with the command that reproduces each, every file marked captured or reported. AGPL-3.0. ![GitHub stars](https://img.shields.io/github/stars/Continuum-AI-Corp/OrcaPromptVault?style=social) - [FineWeb / FineWeb-2 (Hugging Face)](https://huggingface.co/datasets/HuggingFaceFW/fineweb) - Curated 15T+ token web dataset for pre-training. - [OSWorld](https://github.com/xlang-ai/OSWorld) - Multimodal agent benchmark dataset. ![GitHub stars](https://img.shields.io/github/stars/xlang-ai/OSWorld?style=social) - [The Deploy Log](https://github.com/dotcomjack/the-deploy-log) - Open dataset of AI products, models and APIs that shipped and are available now, each dated and linked to the publisher's own page, in CSV and JSON under CC BY 4.0 with no login, refreshed daily from [deployedbyai.com/log](https://deployedbyai.com/log/). ![GitHub stars](https://img.shields.io/github/stars/dotcomjack/the-deploy-log?style=social) --- ## 10. AI Safety, Alignment & Interpretability > Tools for alignment, interpretability, safety evaluation, and adversarial testing. #### Safety Evaluation Frameworks - [AgentOps](https://github.com/AgentOps-AI/agentops) - Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and evaluation. Integrates with CrewAI, Agno, OpenAI Agents SDK, LangChain, Autogen, AG2, and CamelAI. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/AgentOps-AI/agentops?style=social) - [Bloom](https://github.com/safety-research/bloom) - Open-source agentic framework for automated behavioral evaluations of frontier AI models. Generates targeted evaluation suites to probe LLMs for specific behaviors (sycophancy, self-preservation, political bias, etc.) with quantitative elicitation rates. From Anthropic's safety research team. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/safety-research/bloom?style=social) - [AgentShield Benchmark](https://github.com/doronp/agentshield-benchmark) - Apache-2.0 corpus of 537 test cases and a TypeScript runner for benchmarking AI agent guardrail products, maintained by a vendor whose own product it scores. ![GitHub stars](https://img.shields.io/github/stars/doronp/agentshield-benchmark?style=social) #### Alignment & RLHF Tools - [Alignment Handbook](https://github.com/huggingface/alignment-handbook) - Complete recipes for full-stack alignment. ![GitHub stars](https://img.shields.io/github/stars/huggingface/alignment-handbook?style=social) #### Interpretability & Explainability - [interpret (Microsoft)](https://github.com/interpretml/interpret) - Fit interpretable models and explain blackbox machine learning with state-of-the-art explainability techniques including Explainable Boosting Machines and SHAP-based explanations. ![GitHub stars](https://img.shields.io/github/stars/interpretml/interpret?style=social) - [TransformerLens](https://github.com/TransformerLensOrg/TransformerLens) - Gold-standard for mechanistic interpretability. ![GitHub stars](https://img.shields.io/github/stars/TransformerLensOrg/TransformerLens?style=social) - [SAELens](https://github.com/jbloomAus/SAELens) - Sparse autoencoders for interpretable features. ![GitHub stars](https://img.shields.io/github/stars/jbloomAus/SAELens?style=social) - [nnsight](https://github.com/ndif-team/nnsight) - Library for inspecting, tracing, and intervening on neural network internals at scale. ![GitHub stars](https://img.shields.io/github/stars/ndif-team/nnsight?style=social) - [Captum](https://github.com/pytorch/captum) - PyTorch's official interpretability library. ![GitHub stars](https://img.shields.io/github/stars/pytorch/captum?style=social) - [EasyEdit](https://github.com/zjunlp/EasyEdit) - Easy-to-use knowledge editing framework for LLMs. Enables precise modification of model knowledge and behavior to correct hallucinations or outdated information. ACL 2024. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/zjunlp/EasyEdit?style=social) - [AIX360](https://github.com/Trusted-AI/AIX360) - Comprehensive AI explainability toolkit with interpretability algorithms for data and machine learning models. Includes TED, BRCG, and ProtoNN methods for diverse explanation needs. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Trusted-AI/AIX360?style=social) - [Shapash](https://github.com/MAIF/shapash) - User-friendly explainability library for transparent ML models. Beautiful visualizations with explicit labels that everyone can understand. Generates web reports and integrates with SHAP/LIME. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/MAIF/shapash?style=social) #### Fairness & Bias Mitigation - [AI Fairness 360](https://github.com/Trusted-AI/AIF360) - Comprehensive toolkit for detecting, understanding, and mitigating unwanted algorithmic bias in datasets and ML models. ![GitHub stars](https://img.shields.io/github/stars/Trusted-AI/AIF360?style=social) - [Fairlearn](https://github.com/fairlearn/fairlearn) - Python package to assess and improve fairness of machine learning models. Provides metrics for disparity assessment and algorithms for unfairness mitigation with scikit-learn integration. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/fairlearn/fairlearn?style=social) #### Adversarial & Red-teaming Tools - [PyRIT (Microsoft)](https://github.com/microsoft/PyRIT) - Python Risk Identification Tool for generative AI. Microsoft's open-source framework for automated red teaming with multi-modal attack support, crescendo strategies, and 100+ operations experience. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/microsoft/PyRIT?style=social) - [Heretic](https://github.com/p-e-w/heretic) - Open-source system for automatic censorship and robustness suppression removal in language-model outputs. ![GitHub stars](https://img.shields.io/github/stars/p-e-w/heretic?style=social) - [Agentic Security](https://github.com/msoedov/agentic_security) - Agentic LLM vulnerability scanner and AI red teaming kit with multi-step attack simulation and automated security probing. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/msoedov/agentic_security?style=social) - [NeMo Guardrails (NVIDIA)](https://github.com/NVIDIA-NeMo/Guardrails) - Programmable guardrails toolkit for LLM-based conversational systems. Uses Colang DSL to define safety rules, dialog flows, and content boundaries. Integrates with LangChain, LangGraph, and LlamaIndex for production deployments. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/NVIDIA-NeMo/Guardrails?style=social) - [Guardrails AI](https://github.com/guardrails-ai/guardrails) - Input/output validation framework for building reliable AI applications. Detects and mitigates risks through composable validators for PII, toxicity, prompt injection, and structured output validation. Features Guardrails Hub with 50+ pre-built validators. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/guardrails-ai/guardrails?style=social) - [Detoxify](https://github.com/unitaryai/detoxify) - Trained models and code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using PyTorch Lightning and Transformers for toxicity, severe toxicity, obscene, threat, insult, identity attack, and sexual explicit content detection. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/unitaryai/detoxify?style=social) - [RedAmon](https://github.com/samugit83/redamon) - AI-powered agentic red team framework that automates offensive security operations from reconnaissance to exploitation to post-exploitation with zero human intervention. Integrates multiple security tools for comprehensive penetration testing. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/samugit83/redamon?style=social) - [CAI](https://github.com/aliasrobotics/cai) - Cybersecurity AI framework for semi- and fully-automating offensive and defensive security tasks. Purpose-built for cybersecurity use cases with agent-based architecture for vulnerability assessment and security operations. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/aliasrobotics/cai?style=social) - [AI-Infra-Guard (Tencent)](https://github.com/Tencent/AI-Infra-Guard) - Full-stack AI Red Teaming platform securing AI ecosystems via OpenClaw Security Scan, Agent Scan, Skills Scan, MCP scan, AI Infra scan and LLM jailbreak evaluation. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Tencent/AI-Infra-Guard?style=social) - [PentestAgent (GH05TCREW)](https://github.com/GH05TCREW/pentestagent) - AI agent framework for black-box security testing, supporting bug bounty, red-team, and penetration testing workflows. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/GH05TCREW/pentestagent?style=social) - [Superagent](https://github.com/superagent-ai/superagent) - Protects AI applications against prompt injections, data leaks, and harmful outputs. Embed safety directly into your app and prove compliance to your customers. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/superagent-ai/superagent?style=social) - [Anthropic Sandbox Runtime](https://github.com/anthropic-experimental/sandbox-runtime) - Portable sandbox execution environment for AI agents with constrained filesystem and network boundaries, designed to reduce blast radius in tool-use and LLM autonomy tests. ![GitHub stars](https://img.shields.io/github/stars/anthropic-experimental/sandbox-runtime?style=social) - [SchemaBrain](https://github.com/Arun-kc/schemabrain) - An open-source schema intelligence and safety layer (like Cloudflare) between AI agents and databases. Exposes a read-only Model Context Protocol (MCP) interface with PII masking, structured query recovery, and tamper-evident SHA-256 audit logs. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Arun-kc/schemabrain?style=social) - [Anthropic Cybersecurity Skills](https://github.com/mukul975/Anthropic-Cybersecurity-Skills) - Structured library of 754 cybersecurity skills mapped to five frameworks including MITRE ATT&CK and NIST CSF 2.0, compatible with Claude Code, Cursor, and agentskills.io. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/mukul975/Anthropic-Cybersecurity-Skills?style=social) - [Strix](https://github.com/usestrix/strix) - Autonomous AI-powered penetration testing agent that identifies vulnerabilities and validates them with proof-of-concept exploits. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/usestrix/strix?style=social) #### Responsible AI Development - [Responsible AI Toolbox](https://github.com/microsoft/responsible-ai-toolbox) - Suite of tools providing model and data exploration, assessment interfaces and libraries for understanding AI systems. Enables developers to develop and monitor AI more responsibly with better data-driven actions. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/microsoft/responsible-ai-toolbox?style=social) - [Agent Governance Toolkit](https://github.com/microsoft/agent-governance-toolkit) - Security and compliance toolkit for autonomous agents with policy enforcement, zero-trust identity, and sandboxed execution to reduce operational risk. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/microsoft/agent-governance-toolkit?style=social) - [Orca AI Incident Archive](https://github.com/Continuum-AI-Corp/Orca-AI-Incident-Archive) - Open database of real-world AI agent security incidents, with each sourced record flagged for confirmed harm, AI involvement and kind, plus JSON/CSV exports. CC BY 4.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Continuum-AI-Corp/Orca-AI-Incident-Archive?style=social) #### Privacy-Preserving AI - [Presidio (Microsoft)](https://github.com/microsoft/presidio) - SDK for detecting, redacting, masking, and anonymizing sensitive personally identifiable information (PII) across text and images. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/microsoft/presidio?style=social) - [PrivAiTe](https://github.com/crp4222/PrivAiTe) - Self-hosted OpenAI-compatible proxy that swaps detected PII for reversible placeholders before requests reach an LLM provider, tool-call arguments included, and restores the real values in the response. BSD-3-Clause licensed. ![GitHub stars](https://img.shields.io/github/stars/crp4222/PrivAiTe?style=social) --- ## 11. Specialized Domains #### Weather & Climate AI - [WeatherNext](https://github.com/google-deepmind/weathernext) - Global weather and tropical cyclone forecasting framework from Google DeepMind, including WeatherNext 2, GraphCast, and GenCast models. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/google-deepmind/weathernext?style=social) #### Scientific AI & Physics ML - [NVIDIA Modulus](https://github.com/NVIDIA/modulus) - Open-source deep learning framework for physics-informed machine learning (Physics-ML). Build, train, and fine-tune models for AI4science and engineering applications using state-of-the-art SciML methods. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/NVIDIA/modulus?style=social) - [TorchGeo](https://github.com/microsoft/torchgeo) - PyTorch domain library for geospatial data. Datasets, samplers, transforms, and pre-trained models for multispectral satellite imagery and remote sensing. First library with pre-trained models for Sentinel-2 bands. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/microsoft/torchgeo?style=social) - [Astropy](https://github.com/astropy/astropy) - Core library for astronomy and astrophysics in Python. Comprehensive tools for celestial coordinates, FITS I/O, cosmological calculations, and data analysis for professional astronomy. BSD-3-Clause licensed. ![GitHub stars](https://img.shields.io/github/stars/astropy/astropy?style=social) #### Scientific AI & Drug Discovery - [Boltz](https://github.com/jwohlwend/boltz) - Open-source biomolecular interaction prediction models. Boltz-1 was the first fully open source model to approach AlphaFold3 accuracy; Boltz-2 adds binding affinity prediction for drug discovery. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/jwohlwend/boltz?style=social) - [Protenix](https://github.com/bytedance/Protenix) - High-accuracy open-source biomolecular structure prediction model from ByteDance. First fully open-source model to outperform AlphaFold3 across diverse benchmarks with Apache 2.0 licensing for both academic and commercial use. ![GitHub stars](https://img.shields.io/github/stars/bytedance/Protenix?style=social) - [DeepChem](https://github.com/deepchem/deepchem) - Democratizing deep learning for drug discovery, quantum chemistry, materials science, and biology. High-quality open-source toolchain with 50+ models and extensive tutorials. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/deepchem/deepchem?style=social) #### Probabilistic Programming & Bayesian ML - [PyMC](https://github.com/pymc-devs/pymc) - Modern, comprehensive probabilistic programming framework in Python. Bayesian modeling with advanced MCMC sampling, variational inference, and seamless integration with ArviZ for visualization. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/pymc-devs/pymc?style=social) - [ArviZ](https://github.com/arviz-devs/arviz) - Exploratory analysis of Bayesian models with Python. Comprehensive visualization and diagnostics for probabilistic models, supporting PyMC, Pyro, Stan, and other PPLs. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/arviz-devs/arviz?style=social) - [Stanza](https://github.com/stanfordnlp/stanza) - Stanford NLP Python library for 100+ human languages. State-of-the-art neural pipelines for tokenization, NER, parsing, and sentiment analysis with pre-trained models. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/stanfordnlp/stanza?style=social) #### Medical Imaging & Healthcare AI - [MONAI](https://github.com/Project-MONAI/MONAI) - Medical Open Network for AI. End-to-end framework for healthcare imaging with state-of-the-art, production-ready training workflows. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Project-MONAI/MONAI?style=social) - [nnU-Net](https://github.com/MIC-DKFZ/nnUNet) - Self-configuring deep learning method for medical image segmentation. Automatically adapts to any dataset without manual parameter tuning. Widely adopted as the standard baseline for biomedical segmentation challenges. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/MIC-DKFZ/nnUNet?style=social) - [OpenMed](https://github.com/maziyarpanahi/openmed) - Local-first healthcare AI framework and application for clinical text de-identification, entity extraction, and on-device specialized model serving. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/maziyarpanahi/openmed?style=social) #### Creative Writing & Narrative AI - [Alex](https://github.com/Alex663028/Alex-Novel-Platform) - Open-source desktop novel-writing engine and AI story scaffold with Tauri, FastAPI, SQLite, and plot-generation workflows. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Alex663028/Alex-Novel-Platform?style=social) - [AI Novel Writer](https://github.com/EthanYoQ/AI-Novel-Writer) - Local-first desktop workbench for long-form fiction that organizes story premises, characters, worldbuilding, chapter blueprints, drafting, review, and revision, with Ollama support and Windows/macOS releases. GPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/EthanYoQ/AI-Novel-Writer?style=social) - [Ozan](https://github.com/arbazsiddiqui/Ozan) - Reproducible training recipe and open weights for a Mistral-Nemo-12B creative-writing fine-tune built with QLoRA and anti-slop DPO, with GGUF quants and the lowest slop score among the same-size 12B models tested on EQ-Bench Creative Writing v3. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/arbazsiddiqui/Ozan?style=social) #### HR & Recruiting AI - [Aural](https://github.com/1146345502/aural-oss) - Self-hostable AI interview platform for voice, chat, and video interviews with adaptive follow-ups, automated scoring, and detailed feedback reports. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/1146345502/aural-oss?style=social) #### Game AI & Simulations - [Unity ML-Agents](https://github.com/Unity-Technologies/ml-agents) - Toolkit for training intelligent agents in games and simulations using deep reinforcement learning. Enables NPC behavior control, automated testing, and game design evaluation. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Unity-Technologies/ml-agents?style=social) - [RL Baselines3 Zoo](https://github.com/DLR-RM/rl-baselines3-zoo) - A training framework for Stable Baselines3 reinforcement learning agents with hyperparameter optimization, pre-trained agents, and extensive benchmark environments. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/DLR-RM/rl-baselines3-zoo?style=social) - [skrl](https://github.com/Toni-SM/skrl) - Modular reinforcement learning library implemented in PyTorch, JAX, and NVIDIA Warp with support for Gymnasium, NVIDIA Isaac Lab, MuJoCo Playground, and other environments. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Toni-SM/skrl?style=social) - [Finetrainers](https://github.com/huggingface/finetrainers) - Scalable and memory-optimized training of diffusion models from Hugging Face. Supports LoRA and full fine-tuning for video and image generation models. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/huggingface/finetrainers?style=social) - [OpenSpiel](https://github.com/google-deepmind/open_spiel) - Collection of environments and algorithms for research in general reinforcement learning and search/planning in games from Google DeepMind. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/google-deepmind/open_spiel?style=social) #### Finance & Quantitative AI - [OpenBB](https://github.com/OpenBB-finance/OpenBB) - Financial data platform for analysts, quants and AI agents. Open-source investment research infrastructure with extensive data integrations. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/OpenBB-finance/OpenBB?style=social) - [FinGPT](https://github.com/AI4Finance-Foundation/FinGPT) - Open-source financial large language models. Democratizing financial AI with data-centric training pipeline and multiple model releases for trading, analysis, and robo-advising. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/AI4Finance-Foundation/FinGPT?style=social) - [FinRL](https://github.com/AI4Finance-Foundation/FinRL) - Financial reinforcement learning framework for quantitative trading. Deep RL library for stock trading, portfolio allocation, and market execution with pre-built environments and benchmarks. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/AI4Finance-Foundation/FinRL?style=social) - [Qlib](https://github.com/microsoft/qlib) - AI-oriented quantitative investment platform from Microsoft. Supports diverse ML modeling paradigms including supervised learning, market dynamics modeling, and RL. Now equipped with RD-Agent for automated R&D process. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/microsoft/qlib?style=social) - [FinRobot](https://github.com/AI4Finance-Foundation/FinRobot) - Open-source AI agent platform for financial analysis using LLMs. Multi-agent system with specialized agents for trading, analysis, and research. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/AI4Finance-Foundation/FinRobot?style=social) - [Daily Stock Analysis](https://github.com/ZhuLinsen/daily_stock_analysis) - LLM-powered multi-market stock analysis system providing automated decision dashboard reports and real-time market insights. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/ZhuLinsen/daily_stock_analysis?style=social) - [stock-analysis](https://github.com/AdvancingTitans/stock-analysis) - Evidence-first market research CLI and Agent Skill for A-share, Hong Kong, and US stocks, funds, and portfolios, with auditable JSON Evidence Packs and explicit data-quality gaps. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/AdvancingTitans/stock-analysis?style=social) - [Vibe-Trading](https://github.com/HKUDS/Vibe-Trading) - Open-source personal trading agent and research autopilot platform featuring multi-agent swarms, quantitative backtesting, and broker connectors. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/HKUDS/Vibe-Trading?style=social) - [AI Hedge Fund](https://github.com/virattt/ai-hedge-fund) - Multi-agent system simulating an AI-powered hedge fund that utilizes specialized investor agent personalities to make trading decisions. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/virattt/ai-hedge-fund?style=social) - [etf-pattern-match-pybind11](https://github.com/redamancy231-create/etf-pattern-match-pybind11) - High-performance ETF pattern matching with C++20/pybind11 acceleration achieving 43x DTW and 58x pattern-matching speedups over pure Python. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/redamancy231-create/etf-pattern-match-pybind11?style=social) #### Computer Vision - [OpenCV](https://github.com/opencv/opencv) - World's most widely used computer vision library. ![GitHub stars](https://img.shields.io/github/stars/opencv/opencv?style=social) - [Ultralytics YOLO](https://github.com/ultralytics/ultralytics) - State-of-the-art real-time object detection. ![GitHub stars](https://img.shields.io/github/stars/ultralytics/ultralytics?style=social) - [Detectron2](https://github.com/facebookresearch/detectron2) - High-performance object detection library. ![GitHub stars](https://img.shields.io/github/stars/facebookresearch/detectron2?style=social) - [CVAT](https://github.com/cvat-ai/cvat) - Industry-leading data annotation platform for computer vision. Interactive video and image annotation tool used by tens of thousands of teams for machine learning at any scale. ![GitHub stars](https://img.shields.io/github/stars/cvat-ai/cvat?style=social) - [SAM 2](https://github.com/facebookresearch/sam2) - Promptable image and video segmentation model with released checkpoints and training code. ![GitHub stars](https://img.shields.io/github/stars/facebookresearch/sam2?style=social) - [AI Segmentation by TerraLab](https://github.com/TerraLabAI/QGIS_AI-Segmentation) - QGIS plugin for point-and-click SAM segmentation of buildings, trees and any object in satellite and drone imagery, with a free CPU-only local mode. ![GitHub stars](https://img.shields.io/github/stars/TerraLabAI/QGIS_AI-Segmentation?style=social) - [Kornia](https://github.com/kornia/kornia) - Differentiable computer vision library. ![GitHub stars](https://img.shields.io/github/stars/kornia/kornia?style=social) - [Roboflow Supervision](https://github.com/roboflow/supervision) - Reusable computer-vision utilities for detection, tracking, and segmentation pipelines in Python. ![GitHub stars](https://img.shields.io/github/stars/roboflow/supervision?style=social) - [torchaudio](https://github.com/pytorch/audio) - PyTorch audio processing library. Comprehensive toolkit for audio I/O, transformations, and deep learning with support for speech recognition, TTS, and audio classification. BSD-2-Clause licensed. ![GitHub stars](https://img.shields.io/github/stars/pytorch/audio?style=social) - [MediaPipe](https://github.com/google-ai-edge/mediapipe) - Cross-platform multimodal pipelines. ![GitHub stars](https://img.shields.io/github/stars/google-ai-edge/mediapipe?style=social) - [xdfdet](https://github.com/mertkayacs/xdfdet) - Deepfake video detection with eight EfficientNet-B4 models trained on FaceForensics++, with Grad-CAM heatmaps and attention measured across eight facial regions. Code MIT licensed, model weights CC BY-NC 4.0. ![GitHub stars](https://img.shields.io/github/stars/mertkayacs/xdfdet?style=social) #### 3D Vision & Point Cloud Processing - [Open3D](https://github.com/isl-org/Open3D) - Modern library for 3D data processing with Python and C++ APIs. Core features include 3D data structures, processing algorithms, scene reconstruction, surface alignment, 3D visualization, and GPU acceleration. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/isl-org/Open3D?style=social) - [Point Cloud Library (PCL)](https://github.com/PointCloudLibrary/pcl) - Standalone, large-scale open project for 2D/3D image and point cloud processing. Comprehensive algorithms for filtering, feature estimation, surface reconstruction, registration, model fitting, and segmentation. BSD licensed. ![GitHub stars](https://img.shields.io/github/stars/PointCloudLibrary/pcl?style=social) - [PyTorch3D](https://github.com/facebookresearch/pytorch3d) - FAIR's library of reusable components for deep learning with 3D data. Provides efficient 3D operators, differentiable rendering, and mesh processing tools integrated with PyTorch. BSD licensed. ![GitHub stars](https://img.shields.io/github/stars/facebookresearch/pytorch3d?style=social) - [RTAB-Map](https://github.com/introlab/rtabmap) - Real-Time Appearance-Based Mapping library for RGB-D, Stereo and LiDAR SLAM. Graph-based SLAM approach with incremental appearance-based loop closure detection for large-scale and long-term operation. BSD licensed. ![GitHub stars](https://img.shields.io/github/stars/introlab/rtabmap?style=social) - [MoveIt 2](https://github.com/ros-planning/moveit2) - Open source robotics manipulation framework for ROS 2. Motion planning, manipulation, 3D perception, kinematics, control, and navigation for robotic arms. BSD-3-Clause licensed. ![GitHub stars](https://img.shields.io/github/stars/ros-planning/moveit2?style=social) - [LingBot-Map](https://github.com/Robbyant/lingbot-map) - Feed-forward 3D foundation model for transforming and reconstructing streaming 3D scenes. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Robbyant/lingbot-map?style=social) #### Reinforcement Learning & Robotics - [Stable-Baselines3](https://github.com/DLR-RM/stable-baselines3) - Production-ready RL algorithms. ![GitHub stars](https://img.shields.io/github/stars/DLR-RM/stable-baselines3?style=social) - [Isaac Lab](https://github.com/isaac-sim/IsaacLab) - GPU-accelerated robot learning framework. ![GitHub stars](https://img.shields.io/github/stars/isaac-sim/IsaacLab?style=social) - [MuJoCo](https://github.com/google-deepmind/mujoco) - General-purpose physics simulator for robotics, biomechanics, and ML research. High-fidelity contact dynamics with native Python and C++ bindings. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/google-deepmind/mujoco?style=social) - [Gymnasium (ex-OpenAI Gym)](https://github.com/Farama-Foundation/Gymnasium) - Standard RL environment API. ![GitHub stars](https://img.shields.io/github/stars/Farama-Foundation/Gymnasium?style=social) - [OpenEnv](https://github.com/huggingface/OpenEnv) - End-to-end sandbox execution environment framework for agentic reinforcement learning training built on Gymnasium-compatible APIs. ![GitHub stars](https://img.shields.io/github/stars/huggingface/OpenEnv?style=social) - [JaxMARL](https://github.com/FLAIROx/JaxMARL) - Multi-agent reinforcement learning library with JAX-accelerated environments and baselines. ![GitHub stars](https://img.shields.io/github/stars/FLAIROx/JaxMARL?style=social) - [MicroDuck RL](https://github.com/pollen-robotics/microduck_rl) - Reinforcement learning environments and training tools for the MicroDuck robotics platform. ![GitHub stars](https://img.shields.io/github/stars/pollen-robotics/microduck_rl?style=social) #### Time Series & Scientific AI - [Chronos (Amazon)](https://github.com/amazon-science/chronos-forecasting) - Pretrained foundation models for time-series forecasting. ![GitHub stars](https://img.shields.io/github/stars/amazon-science/chronos-forecasting?style=social) - [GluonTS (AWS Labs)](https://github.com/awslabs/gluonts) - Probabilistic time series modeling with deep learning. Powers Amazon SageMaker forecasting with PyTorch and MXNet backends. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/awslabs/gluonts?style=social) - [AutoTS](https://github.com/winedarksea/AutoTS) - Automated time series forecasting with broad model selection, ensembling, anomaly detection, and holiday effects. Designed for production deployment with minimal setup. ![GitHub stars](https://img.shields.io/github/stars/winedarksea/AutoTS?style=social) - [TimesFM (Google Research)](https://github.com/google-research/timesfm) - Pretrained decoder-only foundation model developed by Google Research for time-series forecasting, supporting up to 16k context length, covariate support, and Flax / PyTorch backends. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/google-research/timesfm?style=social) #### Edge / On-device AI - [ExecuTorch](https://github.com/pytorch/executorch) - PyTorch runtime and toolchain for deploying AI models on mobile, embedded, and edge devices. ![GitHub stars](https://img.shields.io/github/stars/pytorch/executorch?style=social) - [OpenVINO](https://github.com/openvinotoolkit/openvino) - Intel's toolkit for edge deployment. ![GitHub stars](https://img.shields.io/github/stars/openvinotoolkit/openvino?style=social) - [Apache TVM](https://github.com/apache/tvm) - Open Machine Learning Compiler Framework. Universal deployment to bring models into minimum deployable modules that can be embedded and run everywhere from datacenter to edge devices. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/apache/tvm?style=social) - [NCNN](https://github.com/Tencent/ncnn) - High-performance neural network inference framework optimized for mobile platforms. No third-party dependencies, cross-platform, and runs faster than all known open-source frameworks on mobile CPU. Powers Tencent apps including QQ, WeChat, and Pitu. BSD-3-Clause licensed. ![GitHub stars](https://img.shields.io/github/stars/Tencent/ncnn?style=social) - [MNN](https://github.com/alibaba/MNN) - Blazing-fast, lightweight inference engine battle-tested by Alibaba. Supports inference and training with industry-leading on-device performance. Powers high-performance LLMs and Edge AI with MNN-LLM runtime. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/alibaba/MNN?style=social) - [RuView](https://github.com/ruvnet/RuView) - Real-time spatial intelligence, vital sign monitoring, and human pose estimation using commodity WiFi signals and neural networks. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/ruvnet/RuView?style=social) #### Legal AI & Contract Analysis - [OpenContracts](https://github.com/Open-Source-Legal/OpenContracts) - Self-hosted document annotation platform for legal AI. Semantic search, contract analysis, version control, and MCP integration for building legal knowledge bases. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Open-Source-Legal/OpenContracts?style=social) - [Harvey LAB](https://github.com/harveyai/harvey-labs) - Benchmark dataset and execution harness for evaluating AI agents on complex legal work across 24+ practice areas. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/harveyai/harvey-labs?style=social) - [Korean Law MCP](https://github.com/chrisryugj/korean-law-mcp) - MCP server and CLI for Korea's official legal database (Ministry of Government Legislation Open API) covering statutes, precedents, administrative rules, local ordinances, and treaties, with existence and content checks for legal citations in LLM output. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/chrisryugj/korean-law-mcp?style=social) #### Autonomous Driving & Robotics Simulators - [CARLA](https://github.com/carla-simulator/carla) - Open-source simulator for autonomous driving research. High-fidelity simulation of urban environments with realistic physics, sensors, and traffic scenarios. Widely used for training and validating self-driving algorithms. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/carla-simulator/carla?style=social) - [Webots](https://github.com/cyberbotics/webots) - Open-source multi-platform robot simulator providing a complete development environment for modeling, programming, and simulating robots, vehicles, and mechanical systems. Used in education, research, and industry. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/cyberbotics/webots?style=social) - [Habitat-Sim](https://github.com/facebookresearch/habitat-sim) - High-performance physics-enabled 3D simulator for embodied AI research. Supports 3D scans of indoor/outdoor spaces, CAD models, and configurable sensors. Powers Meta's embodied AI research. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/facebookresearch/habitat-sim?style=social) - [Genesis World](https://github.com/Genesis-Embodied-AI/genesis-world) - General-purpose simulation platform for embodied AI and robotics research with flexible scenes, sensors, and agent workflows. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Genesis-Embodied-AI/genesis-world?style=social) - [OpenPilot](https://github.com/commaai/openpilot) - Operating system for robotics. Currently upgrades driver assistance systems on 300+ supported cars. End-to-end autonomous driving stack with open-source hardware and software. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/commaai/openpilot?style=social) - [Autoware](https://github.com/autowarefoundation/autoware) - World's leading open-source software project for autonomous driving. Complete stack from localization and object detection to route planning and control. Used by 50+ companies globally. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/autowarefoundation/autoware?style=social) --- ## 12. User Interfaces & Self-hosted Platforms #### Local AI Chat UIs & Personal Assistants - [OpenClaw](https://github.com/openclaw/openclaw) - Local-first personal AI assistant with multi-channel integrations and full agentic task execution. ![GitHub stars](https://img.shields.io/github/stars/openclaw/openclaw?style=social) - [AstrBot](https://github.com/AstrBotDevs/AstrBot) - Multi-channel personal AI agent assistant and integration framework for messaging platforms, LLMs, and plugins. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/AstrBotDevs/AstrBot?style=social) - [Open WebUI](https://github.com/open-webui/open-webui) - Most popular self-hosted ChatGPT-style interface. ![GitHub stars](https://img.shields.io/github/stars/open-webui/open-webui?style=social) - [text-generation-webui](https://github.com/oobabooga/text-generation-webui) - Web UI for running local LLMs with multiple backends, extensions, and model formats. ![GitHub stars](https://img.shields.io/github/stars/oobabooga/text-generation-webui?style=social) - [LibreChat](https://github.com/danny-avila/LibreChat) - Feature-packed multi-LLM interface. ![GitHub stars](https://img.shields.io/github/stars/danny-avila/LibreChat?style=social) - [HuggingChat (self-hosted)](https://github.com/huggingface/chat-ui) - Official open-source codebase for HuggingChat. ![GitHub stars](https://img.shields.io/github/stars/huggingface/chat-ui?style=social) - [Khoj](https://github.com/khoj-ai/khoj) - Self-hostable personal AI assistant for search, chat, automation, and workflows over local and web data. ![GitHub stars](https://img.shields.io/github/stars/khoj-ai/khoj?style=social) - [Newelle](https://github.com/qwersyk/Newelle) - GNOME/Linux desktop virtual assistant with integrated file editor, global hotkeys, and profile manager. ![GitHub stars](https://img.shields.io/github/stars/qwersyk/Newelle?style=social) - [NextChat](https://github.com/ChatGPTNextWeb/NextChat) - Light and fast AI assistant supporting Web, iOS, macOS, Android, Linux, and Windows. One-click deploy with multi-model support. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/ChatGPTNextWeb/NextChat?style=social) - [big-AGI](https://github.com/enricoros/big-AGI) - AI suite for power users with multi-model "Beam" chats, AI personas, voice, text-to-image, code execution, and PDF import. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/enricoros/big-AGI?style=social) - [Morphic](https://github.com/miurla/morphic) - AI-powered search engine with a generative UI. Supports multiple AI providers (OpenAI, Anthropic, Google, Ollama) and search providers (Tavily, SearXNG, Brave). Features smart search modes, widgets, and image/video search. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/miurla/morphic?style=social) - [Leon](https://github.com/leon-ai/leon) - Your open-source personal assistant. Built around tools, context, memory, and agentic execution. Self-hosted, privacy-focused, and extensible. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/leon-ai/leon?style=social) - [Willow](https://github.com/HeyWillow/willow) - Open source, local, and self-hosted Amazon Echo/Google Home competitive voice assistant alternative with hardware support. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/HeyWillow/willow?style=social) - [CoPaw](https://github.com/agentscope-ai/CoPaw) - Your Personal AI Assistant; easy to install, deploy on your own machine or on the cloud; supports multiple chat apps with easily extensible capabilities. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/agentscope-ai/CoPaw?style=social) - [Smart2Brain](https://github.com/your-papa/obsidian-Smart2Brain) - Privacy-focused Obsidian plugin for AI-powered second brain functionality. Chat with your notes using local or remote LLMs including Ollama and OpenAI. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/your-papa/obsidian-Smart2Brain?style=social) - [Casibase](https://github.com/casibase/casibase) - Open-source enterprise-level AI knowledge base and agent management platform. Supports multiple LLM providers, RAG, and team collaboration. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/casibase/casibase?style=social) - [BionicGPT](https://github.com/bionic-gpt/bionic-gpt) - On-prem ChatGPT replacement for teams with assistants, RAG, access controls, auditing, and enterprise deployment features. ![GitHub stars](https://img.shields.io/github/stars/bionic-gpt/bionic-gpt?style=social) - [OpenHuman](https://github.com/tinyhumansai/openhuman) - A local-first personal assistant and memory harness with Obsidian integration, model routing, and automatic integration sync. GPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/tinyhumansai/openhuman?style=social) - [Open-LLM-VTuber](https://github.com/Open-LLM-VTuber/Open-LLM-VTuber) - Talk to any LLM with hands-free voice interaction, voice interruption, and Live2D talking face running locally across platforms. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Open-LLM-VTuber/Open-LLM-VTuber?style=social) - [AIRI](https://github.com/moeru-ai/airi) - Self-hosted cyber companion and VTuber platform with Live2D character rendering, real-time voice chat, and game integration capabilities. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/moeru-ai/airi?style=social) - [Next AI Draw.io](https://github.com/DayuanJiang/next-ai-draw-io) - Next.js web application that integrates AI capabilities with draw.io diagrams to create and edit diagrams through natural language. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/DayuanJiang/next-ai-draw-io?style=social) - [lucinate](https://github.com/lucinate-ai/lucinate) - Terminal-native AI chat client supporting OpenClaw, Hermes, Ollama, and any OpenAI-compatible backend — with routines, multi-agent switching, and local agent skills, all in the TUI. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/lucinate-ai/lucinate?style=social) - [nanobot](https://github.com/HKUDS/nanobot) - Lightweight personal AI agent with a built-in WebUI, model routing, MCP, and multi-channel chat integrations. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/HKUDS/nanobot?style=social) - [LifeOS](https://github.com/danielmiessler/LifeOS) - General-purpose personal AI harness and assistant framework with persistent memory, custom skills, and goal tracking. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/danielmiessler/LifeOS?style=social) - [ThoughtDAG](https://github.com/chenxiachan/thoughtdag) - Local-first visual LLM workspace where graph edges determine the context sent to the model, with branching, merging, document extraction, and Ollama or OpenAI-compatible endpoint support. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/chenxiachan/thoughtdag?style=social) - [Thursday](https://github.com/cgoinglove/thursday) - Voice assistant started with `npx thursday-agent` that runs on the user's computer: an OpenAI GPT-Live call stays in conversation while background bots on OpenAI, Anthropic, Google or xAI models work with a shell, a browser, Agent Skills and MCP servers, and calls, memory and files stay in `~/.thursday`. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/cgoinglove/thursday?style=social) - [Arelis](https://github.com/sAnct1x/Arelis) - Windows desktop research assistant that runs a local model through Ollama, searches the web, drives its own browser, and asks for approval before writing files or sending messages. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/sAnct1x/Arelis?style=social) #### Full Self-hosted AI Platforms - [AnythingLLM](https://github.com/Mintplex-Labs/anything-llm) - All-in-one RAG + agents platform. ![GitHub stars](https://img.shields.io/github/stars/Mintplex-Labs/anything-llm?style=social) - [Flowise](https://github.com/FlowiseAI/Flowise) - Drag-and-drop LLM app builder. ![GitHub stars](https://img.shields.io/github/stars/FlowiseAI/Flowise?style=social) - [LocalAI](https://github.com/mudler/LocalAI) - Open-source AI engine running LLMs, vision, voice, image, and video models on any hardware. Self-hosted OpenAI-compatible API. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/mudler/LocalAI?style=social) - [Onyx](https://github.com/onyx-dot-app/onyx) - Full-featured AI platform with Chat, RAG, Agents, and Actions. 40+ document connectors and every LLM support. MIT licensed (Community Edition). ![GitHub stars](https://img.shields.io/github/stars/onyx-dot-app/onyx?style=social) - [biniou](https://github.com/Woolverine94/biniou) - Self-hosted webUI for 30+ generative AI models. Generate multimedia content with AI on your own computer, even without dedicated GPU (8GB RAM minimum). Works offline once deployed. GPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Woolverine94/biniou?style=social) - [Plane](https://github.com/makeplane/plane) - Open-source Jira, Linear, Monday, and ClickUp alternative. AI-powered project management platform with intelligent task triage, sprint planning, and automated workflows. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/makeplane/plane?style=social) - [Buzz](https://github.com/block/buzz) - Self-hostable workspace and Nostr relay implementation where human team members and AI agents collaborate in shared channels, canvases, and workflows. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/block/buzz?style=social) - [Cloudflare OS](https://github.com/cloudflare/cloudflare-os) - Open-source agent workspace for building and running AI-created apps, documents, and agents in sandboxed Cloudflare Workers with capability-based integrations and reviewable actions. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/cloudflare/cloudflare-os?style=social) - [Macro](https://github.com/macro-inc/macro) - Unified team workspace combining email, messaging, documents, tasks, CRM, and AI agents with shared memory. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/macro-inc/macro?style=social) - [ODS](https://github.com/Osmantic/ODS) - Apache-2.0-licensed self-hosted local AI stack for inference, chat, voice, agents, workflows, and RAG. ![GitHub stars](https://img.shields.io/github/stars/Osmantic/ODS?style=social) - [Self-Hosted AI Stack](https://github.com/hwdsl2/self-hosted-ai-stack) - MIT-licensed Docker Compose stack for private AI with Ollama, a LiteLLM gateway, chat/RAG, voice, and MCP tooling. ![GitHub stars](https://img.shields.io/github/stars/hwdsl2/self-hosted-ai-stack?style=social) - [Octop (Tencent Cloud)](https://github.com/TencentCloud/Octop) - Self-hosted multi-user, multi-agent AI assistant platform featuring long-term memory, MCP tool integration, and sandboxed execution. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/TencentCloud/Octop?style=social) - [ENZO](https://github.com/theguysudo/ENZO) - Self-hosted AI workspace combining agents, skills, and tools (Gmail, Calendar, file conversion) that runs entirely on your own provider API keys, sealed in the browser so the server stores none of them. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/theguysudo/ENZO?style=social) - [OpenBot](https://github.com/regnull/openbot) - Self-hosted platform for running a team of persistent AI bots that use tools and MCP servers, keep long-term memory, hand work to each other in shared threads, and can pause to ask a human for approval. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/regnull/openbot?style=social) - [Tale](https://github.com/tale-project/tale) - MIT-licensed project workspace coordinating people and AI agents through shared tasks, manager delegation, persistent sandboxes, and human review of delivered work. ![GitHub stars](https://img.shields.io/github/stars/tale-project/tale?style=social) - [Bunkhouse](https://github.com/braedonsaunders/bunkhouse) - Self-hosted platform for running AI employees for small businesses, each with its own mailbox, job description, governed procedures, memory, and place on an org chart, with observable desktop, browser, and terminal sessions. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/braedonsaunders/bunkhouse?style=social) #### Desktop & Mobile AI Apps - [InvoiceFlowAI](https://github.com/EthanYoQ/Invoice-Downloader) - Open-source Windows/macOS desktop app that collects emailed PDF/OFD/XML invoices, uses OCR with human review, and exports Excel summaries; optional model providers support extraction. ![GitHub stars](https://img.shields.io/github/stars/EthanYoQ/Invoice-Downloader?style=social) - [AI Language Partner](https://github.com/duct-tape2/ai-language-partner) - Local-first Expo and FastAPI Japanese practice app for Korean speakers that uses Whisper-compatible STT, local TTS, and embedding-based dialogue matching without a runtime LLM. ![GitHub stars](https://img.shields.io/github/stars/duct-tape2/ai-language-partner?style=social) - [Jan](https://github.com/janhq/jan) - Local-first AI app framework. ![GitHub stars](https://img.shields.io/github/stars/janhq/jan?style=social) - [Cherry Studio](https://github.com/CherryHQ/cherry-studio) - AI productivity studio with smart chat, autonomous agents, and 300+ assistants. Unified access to frontier LLMs. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/CherryHQ/cherry-studio?style=social) - [DeepChat](https://github.com/ThinkInAIXYZ/deepchat) - A smart assistant that connects powerful AI to your personal world. Built-in MCP and ACP support, multiple search engines, privacy-focused with local data storage. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/ThinkInAIXYZ/deepchat?style=social) - [SillyTavern](https://github.com/SillyTavern/SillyTavern) - Highly customizable role-playing frontend. ![GitHub stars](https://img.shields.io/github/stars/SillyTavern/SillyTavern?style=social) - [ChatALL](https://github.com/ai-shifu/ChatALL) - Concurrently chat with multiple AI bots to discover the best answers. Desktop app for comparing ChatGPT, Claude, Gemini, and 20+ LLMs side-by-side. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/ai-shifu/ChatALL?style=social) - [Panelize](https://github.com/Manho/Panelize) - Chrome and Edge extension that sends one prompt to ChatGPT, Claude, Gemini, DeepSeek and other chatbots and shows their official web apps side by side, using existing logins instead of API keys. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Manho/Panelize?style=social) - [aiFetchly](https://github.com/robertzengcn/aiFetchly) - Open-source desktop AI agent for business automation: lead generation, knowledge library RAG, outreach, and scheduled workflows on Windows, macOS, and Linux. ![GitHub stars](https://img.shields.io/github/stars/robertzengcn/aiFetchly?style=social) - [Chatbox](https://github.com/chatboxai/chatbox) - Powerful desktop AI client for ChatGPT, Claude, and other LLMs. Cross-platform with modern UI. GPLv3 licensed (Community Edition). ![GitHub stars](https://img.shields.io/github/stars/chatboxai/chatbox?style=social) - [Maid](https://github.com/Mobile-Artificial-Intelligence/maid) - Free and open-source Android app for interfacing with llama.cpp models locally and remote APIs (Anthropic, DeepSeek, Mistral, Ollama, OpenAI). MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Mobile-Artificial-Intelligence/maid?style=social) - [Jev for WhatsApp](https://github.com/jev-chat/jev-chat-jarvis) - Android reply copilot for WhatsApp that reads the chat on screen, judges intent and risk with your OpenRouter key, drafts two replies, and fills the one you pick. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/jev-chat/jev-chat-jarvis?style=social) - [Dive](https://github.com/OpenAgentPlatform/Dive) - Open-source MCP Host Desktop Application with dual Tauri/Electron architecture. Seamlessly integrates with any LLMs supporting function calling. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/OpenAgentPlatform/Dive?style=social) - [PocketPal AI](https://github.com/a-ghorbani/pocketpal-ai) - Open-source app that brings small language models directly to your phone. Run AI 100% privately on iOS and Android with no cloud required. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/a-ghorbani/pocketpal-ai?style=social) - [Scowld](https://github.com/apoorvdarshan/scowld) - Native iOS AI voice companion with an animated VRM character, voice and text chat, local conversation history, optional camera context, and BYOK AI, speech-to-text, and text-to-speech providers. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/apoorvdarshan/scowld?style=social) - [Hermes Desktop](https://github.com/fathah/hermes-desktop) - Desktop companion application for installing, configuring, and chatting with Hermes Agent. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/fathah/hermes-desktop?style=social) - [DSH Studio](https://github.com/Moresyl/dsh-studio) - Cross-platform desktop application for installing, running, health-checking, and supervising DeepSeek Harness locally. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Moresyl/dsh-studio?style=social) - [Craft Agents](https://github.com/craft-ai-agents/craft-agents-oss) - Open-source desktop and web interface for agentic workflows, featuring built-in MCP support, customizable API connections, and session sharing. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/craft-ai-agents/craft-agents-oss?style=social) - [Meetily](https://github.com/Zackriya-Solutions/meetily) - Privacy-first local AI meeting assistant for real-time transcription and summary generation. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Zackriya-Solutions/meetily?style=social) - [oats](https://github.com/ariso-ai/oats) - Open-source local-first macOS meeting-notes app with live transcription, speaker labels, AI summaries, and optional fully offline on-device mode. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/ariso-ai/oats?style=social) - [OpenSuperWhisper](https://github.com/Starmel/OpenSuperWhisper) - macOS dictation application providing real-time audio transcription and drag-and-drop file transcription using Whisper and Parakeet models. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Starmel/OpenSuperWhisper?style=social) - [akou](https://github.com/GeiserX/akou) - macOS desktop app that records calls, transcribes them on-device with speaker labels, and lets Claude Code, Codex, or any MCP client follow and question a call while it runs. GPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/GeiserX/akou?style=social) - [T3 Code](https://github.com/pingdotgg/t3code) - Minimal web GUI and desktop app for interacting with coding agents like Codex, Claude Code, Cursor, and OpenCode. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/pingdotgg/t3code?style=social) - [OpenWork](https://github.com/different-ai/openwork) - Open-source desktop app for sharing AI workflows, skills, and MCP capabilities across agents. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/different-ai/openwork?style=social) - [ego lite](https://github.com/citrolabs/ego-lite) - Desktop browser designed for running web automation tasks and AI agents in parallel within isolated workspaces. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/citrolabs/ego-lite?style=social) - [Off Grid AI Desktop](https://github.com/off-grid-ai/OGAD) - Local-first macOS AI app that runs LLM chat, image generation, voice transcription, and personal memory/RAG fully on-device via llama.cpp - nothing leaves the machine. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/off-grid-ai/OGAD?style=social) - [Clips Kitty](https://github.com/ColinGPT9/clips-studio) - Local-first Windows desktop app that turns long videos and livestreams into vertical clips, using faster-whisper for word-level captions and a local LLM through Ollama to pick highlights. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/ColinGPT9/clips-studio?style=social) - [Voz](https://github.com/quietbin/voz-mac) - macOS dictation app that types transcribed speech at the cursor in any application, with whisper.cpp and the Whisper model bundled so it runs offline with no setup. Also records meetings on-device and generates summaries through a bundled llama.cpp. GPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/quietbin/voz-mac?style=social) - [Codex-X](https://github.com/yynxxxxx/Codex-X) - Cross-platform desktop management application for OpenAI Codex Desktop and CLI with provider switching, local failover routing, session history management, MCP configuration, and token usage analytics. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/yynxxxxx/Codex-X?style=social) - [PersonalJarvis](https://github.com/PersonalJarvis/PersonalJarvis) - Desktop voice and chat assistant for Windows, macOS, and Linux with a custom wake phrase, local speech-to-text, and a workspace that runs CLI coding agents side by side in terminal panes, working with any single model provider key or local models via Ollama. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/PersonalJarvis/PersonalJarvis?style=social) - [Plainsay](https://github.com/conrader/plainsay) - MIT-licensed native macOS menu-bar dictation app whose free Local mode runs Whisper (WhisperKit) or NVIDIA Parakeet (FluidAudio) on device and pastes the text where you dictated it, with optional hosted Polishing and paid cloud transcription. ![GitHub stars](https://img.shields.io/github/stars/conrader/plainsay?style=social) #### Agent & Voice Infrastructure - [Speech to Speech](https://github.com/huggingface/speech-to-speech) - Low-latency, fully modular voice-agent pipeline integrating voice activity detection, speech-to-text, LLMs, and text-to-speech via an OpenAI Realtime-compatible WebSocket API. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/huggingface/speech-to-speech?style=social) - [LiveKit Agents](https://github.com/livekit/agents) - Framework for building realtime voice AI agents with WebRTC transport, STT-LLM-TTS pipelines, and production-grade orchestration. Used by Salesforce Agentforce and Tesla. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/livekit/agents?style=social) - [Pipecat](https://github.com/pipecat-ai/pipecat) - Open-source framework for voice and multimodal conversational AI. Build real-time voice agents with support for speech-to-text, LLMs, text-to-speech, and live video. BSD-2-Clause licensed. ![GitHub stars](https://img.shields.io/github/stars/pipecat-ai/pipecat?style=social) - [Agent Chat UI](https://github.com/langchain-ai/agent-chat-ui) - Web app for interacting with any LangGraph agent (Python & TypeScript) via a chat interface. Stream messages, handle interruptions, and view agent state. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/langchain-ai/agent-chat-ui?style=social) --- ## 13. Developer Tools & Integrations #### AI-Native IDEs & Development Environments - [Claude Pet](https://github.com/nikhilagrima/claude-pet) - Desktop companion for Claude Code that reacts to hook events with animated emotions and sounds, maintains a local SQLite graph memory per project injected as a compact recap at session start, promotes repeated patterns into SKILL.md files, and monitors GitHub repository activity. macOS/Windows/Linux, 100% local. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/nikhilagrima/claude-pet?style=social) - [Ralph](https://github.com/frankbria/ralph-claude-code) - Autonomous AI development loop for Claude Code with intelligent exit detection. Automates iterative coding workflows with self-monitoring capabilities. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/frankbria/ralph-claude-code?style=social) - [Nimbalyst](https://github.com/nimbalyst/nimbalyst) - Desktop app for running multiple Codex and Claude Code AI sessions in parallel Git worktrees. Test, compare approaches and manage AI-assisted development workflows in one unified interface. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/nimbalyst/nimbalyst?style=social) - [Yardlet](https://github.com/zzunkie/yardlet) - Local-first terminal workbench that runs existing Codex, Claude Code, or custom agent CLIs through a deterministic task queue, routing layer, evaluator, and handoff records. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/zzunkie/yardlet?style=social) - [Nezha](https://github.com/hanshuaikang/nezha) - Code editor for the AI agents era. Run multiple Claude Code and Codex agents across projects on your machine with an intuitive interface. GPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/hanshuaikang/nezha?style=social) - [Aider Desk](https://github.com/hotovo/aider-desk) - Platform for AI-powered software engineers. Desktop application that enhances the aider terminal experience with a modern UI. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/hotovo/aider-desk?style=social) - [Zed](https://github.com/zed-industries/zed) - High-performance, multiplayer code editor with built-in AI features. From the creators of Atom and Tree-sitter. Native AI agentic editing with support for any LLM provider. GPL licensed. ![GitHub stars](https://img.shields.io/github/stars/zed-industries/zed?style=social) - [Code Server](https://github.com/coder/code-server) - Run VS Code on any machine anywhere and access it in the browser. Self-hosted cloud IDE with full extension support. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/coder/code-server?style=social) - [Gitpod](https://github.com/gitpod-io/gitpod) - Cloud development environment platform with automated prebuilds, ephemeral workspaces, and support for any IDE. Self-hostable with open-source core. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/gitpod-io/gitpod?style=social) - [Onlook](https://github.com/onlook-dev/onlook) - Open-source AI-first design and React editing environment for visually building and modifying frontend applications. ![GitHub stars](https://img.shields.io/github/stars/onlook-dev/onlook?style=social) - [Daytona](https://github.com/daytonaio/daytona) - Secure elastic infrastructure for running AI-generated code. Self-hosted alternative to GitHub Codespaces with support for multiple IDEs, prebuilds, and any cloud provider. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/daytonaio/daytona?style=social) - [AI Workdeck](https://github.com/zeweihan/aiworkdeck) - Open-source AI-native IDE workspace for legal and document-heavy workflows — "VS Code for lawyers." Self-hosted with MCP agent orchestration, OCR, due-diligence risk flagging, evidence-chain management, WPS WebOffice integration, smart clipboard. Supports air-gapped deployment with Ollama + local storage. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/zeweihan/aiworkdeck?style=social) - [Orca](https://github.com/stablyai/orca) - An agentic development environment (ADE) for running and orchestrating coding agents in parallel Git worktrees on desktop and mobile. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/stablyai/orca?style=social) - [Terax](https://github.com/crynta/terax-ai) - Lightweight terminal-first AI-native dev workspace (ADE) featuring multi-tab terminals, a code editor with AI edit diffs, source control, and agentic workflows. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/crynta/terax-ai?style=social) - [Pi Web](https://github.com/agegr/pi-web) - Web UI and local workspace for the pi coding agent with session browsing, file previews, and model configuration. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/agegr/pi-web?style=social) - [Garcon](https://github.com/cfal/garcon) - Browser and mobile workspace for running and steering parallel Claude Code, Codex, Cursor Agent, OpenCode, Amp, Droid, and Pi sessions, with integrated terminal, file editing, diff review, Git/PR workflows, mobile approvals, scheduling, and cross-agent transfers. GPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/cfal/garcon?style=social) - [screenshot-to-code](https://github.com/abi/screenshot-to-code) - MIT-licensed tool that turns screenshots, mockups, and Figma designs into frontend code. ![GitHub stars](https://img.shields.io/github/stars/abi/screenshot-to-code?style=social) - [Atlas](https://github.com/pacifio/atlas) - Local-first agentic development environment and source-control system that connects Git commits with agent sessions, tool calls, reasoning traces, and shared memory. ![GitHub stars](https://img.shields.io/github/stars/pacifio/atlas?style=social) - [Volt](https://github.com/LeulAria/VOLT) - AI code editor built on VS Code (Code - OSS) that runs Claude Code, Codex, OpenCode and Kimi over ACP, with hunk-level keep/undo of agent edits and a Git checkpoint every turn. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/LeulAria/VOLT?style=social) #### AI Coding Assistants (open-source) - [Continue](https://github.com/continuedev/continue) - Open-source AI coding autopilot for VS Code & JetBrains. ![GitHub stars](https://img.shields.io/github/stars/continuedev/continue?style=social) - [Tabby](https://github.com/TabbyML/tabby) - Self-hosted AI coding assistant. ![GitHub stars](https://img.shields.io/github/stars/TabbyML/tabby?style=social) - [Cline](https://github.com/cline/cline) - Open-source IDE coding agent that can edit files, run commands, and use tools with user approval. ![GitHub stars](https://img.shields.io/github/stars/cline/cline?style=social) - [Open Interpreter](https://github.com/OpenInterpreter/open-interpreter) - Lets LLMs run code locally. ![GitHub stars](https://img.shields.io/github/stars/OpenInterpreter/open-interpreter?style=social) - [Aider](https://github.com/Aider-AI/aider) - Terminal-based AI pair programmer. Edit code in your local editor and aider implements the changes. Supports multiple LLMs, voice coding, and automatic Git commits. Top scores on SWE Bench. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Aider-AI/aider?style=social) - [Kimi Code CLI](https://github.com/MoonshotAI/kimi-code) - AI coding agent that runs in your terminal to edit code, execute shell commands, and manage Model Context Protocol (MCP) servers and skills. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/MoonshotAI/kimi-code?style=social) - [Qwen Code](https://github.com/QwenLM/qwen-code) - Open-source AI agent for the terminal, optimized for Qwen series models. Multi-protocol provider support including OpenAI, Anthropic, Gemini, Alibaba Cloud, OpenRouter. Features agentic workflow with Skills and SubAgents. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/QwenLM/qwen-code?style=social) - [Forge](https://github.com/NorviaLabs/forge) - Open-source terminal AI coding agent (Rust TUI) that unifies agent, code editor, and shell in one keyboard-driven workspace with durable SQLite session journals, MCP support, and approval-aware command execution. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/NorviaLabs/forge?style=social) - [DeepCode](https://github.com/HKUDS/DeepCode) - Transforms research papers and natural language into production-ready code. AI-powered research-to-code automation tool. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/HKUDS/DeepCode?style=social) - [OpenSpec](https://github.com/Fission-AI/OpenSpec) - Spec-driven development (SDD) framework and CLI tool for AI coding assistants, providing structured workflows for proposing, implementing, and archiving code changes. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Fission-AI/OpenSpec?style=social) - [Spec Kit](https://github.com/github/spec-kit) - Toolkit and CLI for Spec-Driven Development that integrates with AI coding agents to generate structured code implementations from executable specifications. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/github/spec-kit?style=social) - [SpecJudge](https://github.com/JoaquinRuiz/SpecJudge) - CLI that reads a project's specification files and recommends which LLM fits the work, using a local judge model via Ollama and citing the spec fragment behind each demand level. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/JoaquinRuiz/SpecJudge?style=social) - [Open Code Review](https://github.com/alibaba/open-code-review) - AI-powered code review CLI tool combining deterministic analysis pipelines with LLM agents for precise, line-level feedback. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/alibaba/open-code-review?style=social) - [CodeOtter](https://github.com/dharmeshgurnani/CodeOtter) - Self-hosted AI pull request reviewer for GitHub, Forgejo and Gitea that scores PRs, enforces merge gates as status checks and posts inline fixes, using local GGUF models via llama.cpp or a hosted model API. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/dharmeshgurnani/CodeOtter?style=social) #### Notebooks & Interactive Computing - [Open Notebook](https://github.com/lfnovo/open-notebook) - Open-source implementation of Notebook LM with multi-modal content support (PDFs, videos, audio, web pages). Features multi-speaker podcast generation, 18+ AI provider integrations, and full-text + vector search. Self-hosted with complete data sovereignty. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/lfnovo/open-notebook?style=social) - [Deta Surf](https://github.com/deta/surf) - Personal AI notebook for organizing files and webpages with AI-generated notes. Local-first data storage, open data formats, and open model choice including local models. Cross-platform desktop app for research and thinking workflows. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/deta/surf?style=social) - [FilePilot AI](https://github.com/cuiheng511/filepilot-ai) - Local-first file intelligence app, CLI, and MCP server for searching, summarizing, tagging, deduplicating, and safely organizing local files for AI agent workflows. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/cuiheng511/filepilot-ai?style=social) - [Quarto](https://github.com/quarto-dev/quarto-cli) - Open-source scientific and technical publishing system built on Pandoc. Create dynamic content with Python, R, Julia, and Observable. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/quarto-dev/quarto-cli?style=social) - [Drawdata](https://github.com/koaning/drawdata) - Draw datasets from within Python notebooks. Interactive data visualization tool for creating and editing datasets directly in Jupyter environments. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/koaning/drawdata?style=social) - [Deepnote](https://github.com/deepnote/deepnote) - Drop-in replacement for Jupyter with AI-first design, sleek UI, and native data integrations. Use Python, R, and SQL locally, then scale to Deepnote cloud for collaboration and deployable data apps. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/deepnote/deepnote?style=social) - [Zasper](https://github.com/zasper-io/zasper) - High-performance IDE for Jupyter Notebooks built with Go. Up to 5x less CPU and 40x less RAM than JupyterLab. Implements Jupyter's wire protocol with massive concurrency support. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/zasper-io/zasper?style=social) #### IDE Plugins & Extensions - [Sem](https://github.com/Ataraxy-Labs/sem) - Local structural code search, caller navigation, impact analysis, and entity-level diffs exposed to coding agents through a CLI and MCP server. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Ataraxy-Labs/sem?style=social) - [Weave](https://github.com/Ataraxy-Labs/weave) - Syntax-aware merge tool for overlapping coding-agent changes, with branch previews and Git merge-driver integration. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Ataraxy-Labs/weave?style=social) - [Parallel Search MCP](https://github.com/parallel-web/search-mcp) - MIT-licensed client packages and a setup skill that connect coding agents to Parallel's hosted web search and page fetching service without a Parallel account or API key. ![GitHub stars](https://img.shields.io/github/stars/parallel-web/search-mcp?style=social) - [Serply Agent Skills](https://github.com/serply-inc/skills) - MIT-licensed agent skill and Claude Code / Codex plugins that connect coding agents to the Serply API and hosted MCP server for Google web, News, Scholar, Maps and Jobs search, Bing, Amazon, Reddit and URL scraping; requires a Serply API key. ![GitHub stars](https://img.shields.io/github/stars/serply-inc/skills?style=social) - [Archify](https://github.com/tt-a1i/archify) - Diagram-generation agent skill for Claude Code, Codex, and OpenCode that converts natural language into interactive system, workflow, sequence, data flow, and lifecycle diagrams. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/tt-a1i/archify?style=social) - [Graphify](https://github.com/Graphify-Labs/graphify) - AI coding assistant skill that maps a codebase and resource directory into an interactive knowledge graph for local query and navigation. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Graphify-Labs/graphify?style=social) - [llama.vim](https://github.com/ggml-org/llama.vim) - Local LLM-powered code completion plugin for Vim/Neovim using llama.cpp. Fast, privacy-first, no API key needed. ![GitHub stars](https://img.shields.io/github/stars/ggml-org/llama.vim?style=social) - [CodeCompanion.nvim](https://github.com/olimorris/codecompanion.nvim) - AI-powered coding assistant for Neovim. Inline code generation, chat, actions, and tool use with support for multiple LLM providers. ![GitHub stars](https://img.shields.io/github/stars/olimorris/codecompanion.nvim?style=social) - [ProxyAI](https://github.com/carlrobertoh/ProxyAI) - Leading open-source AI copilot for JetBrains IDEs. Connect to any model in any environment with auto-apply, image chat, file references, web search, and customizable personas. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/carlrobertoh/ProxyAI?style=social) - [avante.nvim](https://github.com/yetone/avante.nvim) - Neovim plugin that brings Cursor-like AI IDE features to Vim. Edit code with natural language, generate code from context, and chat with AI about your codebase. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/yetone/avante.nvim?style=social) - [Serena](https://github.com/oraios/serena) - Powerful MCP toolkit for coding agents providing semantic retrieval and editing capabilities. Integrates language servers for IDE-level code understanding. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/oraios/serena?style=social) - [Jupyter AI](https://github.com/jupyterlab/jupyter-ai) - Chat and code generation inside notebooks. ![GitHub stars](https://img.shields.io/github/stars/jupyterlab/jupyter-ai?style=social) - [Minuet AI](https://github.com/milanglacier/minuet-ai.nvim) - Neovim plugin offering code completion as-you-type from popular LLMs including OpenAI, Gemini, Claude, Ollama, Llama.cpp, Codestral, and more. GPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/milanglacier/minuet-ai.nvim?style=social) - [Peekaboo](https://github.com/steipete/Peekaboo) - macOS CLI & MCP server enabling AI agents to capture screenshots and automate UI interactions. Visual question answering through local or remote AI models. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/steipete/Peekaboo?style=social) - [Skills](https://github.com/mattpocock/skills) - A collection of custom productivity and engineering skills for Claude Code and other AI coding agents. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/mattpocock/skills?style=social) - [planning-with-files](https://github.com/OthmanAdi/planning-with-files) - Persistent file-based planning skill for AI coding agents to survive context loss and restarts with a deterministic completion gate. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/OthmanAdi/planning-with-files?style=social) - [Understand Anything](https://github.com/Egonex-AI/Understand-Anything) - Turns subdirectories, codebases, or knowledge bases into an interactive, AI-navigable knowledge graph and dashboard. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Egonex-AI/Understand-Anything?style=social) - [Knowledge Work Plugins (Anthropic)](https://github.com/anthropics/knowledge-work-plugins) - Collection of role-specific plugins and sub-agents for Claude Cowork and Claude Code. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/anthropics/knowledge-work-plugins?style=social) - [Cursor Plugins](https://github.com/cursor/plugins) - Official Cursor plugins for developer tools, workflows, and SaaS integrations. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/cursor/plugins?style=social) - [Claude Plugins Marketplace](https://github.com/anthropics/claude-plugins-official) - Official, Anthropic-managed directory of high-quality plugins for Claude Code. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/anthropics/claude-plugins-official?style=social) - [Agent Toolkit for AWS](https://github.com/aws/agent-toolkit-for-aws) - Official AWS-supported MCP servers, skills, and plugins to help AI coding agents build, deploy, and manage applications on AWS. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/aws/agent-toolkit-for-aws?style=social) - [Caveman](https://github.com/JuliusBrussee/caveman) - Skill and setup script for Claude Code, Codex, Gemini, Cursor, and other coding agents that reduces token output by instructing agents to communicate in concise, caveman-style prose. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/JuliusBrussee/caveman?style=social) - [Chrome DevTools MCP](https://github.com/ChromeDevTools/chrome-devtools-mcp) - Official Model Context Protocol (MCP) server from Google that enables coding agents to control and inspect a live Chrome browser for automation, debugging, and web performance analysis. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/ChromeDevTools/chrome-devtools-mcp?style=social) - [Codex Plugin for Claude Code](https://github.com/openai/codex-plugin-cc) - Official integration plugin for Claude Code that enables developers to run Codex code reviews, delegate tasks, and manage background coding jobs. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/openai/codex-plugin-cc?style=social) - [Compound Engineering](https://github.com/EveryInc/compound-engineering-plugin) - Official AI engineering plugin for Claude Code, Codex, Cursor, and other coding agents that implements iterative brainstorm, plan, work, review, and compound workflows. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/EveryInc/compound-engineering-plugin?style=social) - [Unity MCP](https://github.com/CoplayDev/unity-mcp) - Model Context Protocol (MCP) server bridging AI assistants with the Unity Editor to automate asset, scene, and script workflows. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/CoplayDev/unity-mcp?style=social) - [.NET Agent Skills](https://github.com/dotnet/skills) - Curated set of skills, custom agents, and plugins to assist AI coding agents with .NET and C# development. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/dotnet/skills?style=social) - [Claude Video](https://github.com/bradautomates/claude-video) - A skill and plugin that enables AI coding assistants to view, transcribe, and analyze video content. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/bradautomates/claude-video?style=social) - [Stitch Design Skills](https://github.com/google-labs-code/stitch-skills) - A library of agent skills and plugins designed to work with the Stitch MCP server, following the Agent Skills open standard. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/google-labs-code/stitch-skills?style=social) - [Impeccable](https://github.com/pbakaus/impeccable) - Design guidance skill, CLI tool, and detector rules to improve user interface design generated by AI coding agents. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/pbakaus/impeccable?style=social) - [Hallmark](https://github.com/Nutlope/hallmark) - Anti-AI-slop design skill and ruleset for Claude Code, Cursor, and Codex to prevent generic, AI-generated layouts. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Nutlope/hallmark?style=social) - [Code Review Graph](https://github.com/tirth8205/code-review-graph) - Local-first code intelligence graph that builds a persistent map of a codebase to provide token-optimized context for AI coding tools. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/tirth8205/code-review-graph?style=social) - [CAD Skills](https://github.com/earthtojake/text-to-cad) - A library of modular agent skills for generating, inspecting, slicing, and exporting CAD and robot-description geometry (STEP, STL, URDF, SDF). MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/earthtojake/text-to-cad?style=social) - [ADHD](https://github.com/UditAkhourii/adhd) - Tree-of-thought divergent reasoning skill for AI agents that spawns parallel cognitive frames to prune traps and score surviving paths. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/UditAkhourii/adhd?style=social) - [MCP Lens](https://github.com/labmimors/dsh-mcp-lens) - DeepSeek Harness plugin that exposes configured remote MCP tools through a search interface and an explicit server/tool call interface with exact input schemas. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/labmimors/dsh-mcp-lens?style=social) - [jev-use](https://github.com/shitianfang/jev-use) - Claude Code, Codex and pi plugin that routes agent-loop steps needing no text output to a typed judgment model, returning anything it should not decide to the LLM. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/shitianfang/jev-use?style=social) - [Cockney](https://github.com/Kadajett/cockney) - Skill, Claude Code plugin and install script for omp, Claude Code and Codex that makes coding agents reply tersely in a Cockney voice and make the smallest correct change, with plain-English warnings for risky actions. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Kadajett/cockney?style=social) #### UI Components & Chat Libraries - [Assistant UI](https://github.com/assistant-ui/assistant-ui) - React/TypeScript library for building production-grade AI chat interfaces. Drop-in components for streaming messages, tool calls, and multi-modal inputs. ![GitHub stars](https://img.shields.io/github/stars/assistant-ui/assistant-ui?style=social) - [Deep Chat](https://github.com/OvidijusParsiunas/deep-chat) - Fully customizable AI chatbot component for your website. Supports OpenAI, direct API services, and custom endpoints. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/OvidijusParsiunas/deep-chat?style=social) - [Markstream](https://github.com/Simon-He95/markstream-vue) - Multi-framework streaming Markdown renderer for AI chat interfaces, with incomplete Markdown handling, Mermaid, KaTeX, Shiki/Monaco code blocks, SSR, and packages for Vue, React, Svelte, and Angular. ![GitHub stars](https://img.shields.io/github/stars/Simon-He95/markstream-vue?style=social) - [CopilotKit](https://github.com/CopilotKit/CopilotKit) - Best-in-class SDK for building full-stack agentic applications, Generative UI, and chat applications. Creators of the AG-UI Protocol adopted by Google, LangChain, AWS, and Microsoft. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/CopilotKit/CopilotKit?style=social) - [json-render](https://github.com/vercel-labs/json-render) - Generative UI framework for rendering dynamic, type-safe interfaces from structured JSON streamed by LLMs and agents. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/vercel-labs/json-render?style=social) #### CLI Tools & API Clients - [Ruler](https://github.com/intellectronica/ruler) - Central AI agent rule registry. Manages and distributes rules for AI coding agents across projects. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/intellectronica/ruler?style=social) - [PR-Agent (Qodo)](https://github.com/qodo-ai/pr-agent) - AI-powered code review agent for GitHub, GitLab, Bitbucket, and Azure DevOps. Automated PR analysis, improvement suggestions, and multi-platform deployment via CLI, GitHub Actions, or webhooks. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/qodo-ai/pr-agent?style=social) - [LLM (Simon Willison)](https://github.com/simonw/llm) - CLI tool and Python library for interacting with dozens of LLMs via remote APIs or locally. Extensible plugin ecosystem, SQLite logging. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/simonw/llm?style=social) - [aicommits](https://github.com/Nutlope/aicommits) - CLI that writes your Git commit messages for you with AI. Never write a commit message again. Supports multiple providers including OpenAI, Groq, xAI, Ollama, and LM Studio. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Nutlope/aicommits?style=social) - [Codex CLI](https://github.com/openai/codex) - OpenAI's lightweight coding agent that runs in your terminal. Code generation, file editing, and command execution with approval. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/openai/codex?style=social) - [VibePod](https://github.com/VibePod/vibepod-cli) - Unified CLI for running Claude Code, Codex, OpenCode, and other coding agents in isolated Docker or Podman containers, with local HTTP traffic and token metrics plus a side-by-side comparison dashboard. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/VibePod/vibepod-cli?style=social) - [Repomix](https://github.com/yamadashy/repomix) - Powerful tool that packs your entire repository into a single AI-friendly file. Perfect for feeding codebases to LLMs with smart filtering and token counting. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/yamadashy/repomix?style=social) - [DevProjex](https://github.com/Avazbek22/DevProjex) - Open-source GUI, TUI, CLI, and read-only MCP app for selecting project files, previewing, redacting secrets, and packing token-counted context with Git scopes and syntax-aware compression. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Avazbek22/DevProjex?style=social) - [GitIngest](https://github.com/cyclotruc/gitingest) - Replace 'hub' with 'ingest' in any GitHub URL to get a prompt-friendly extract of a codebase. Optimized for Python ecosystem and data science workflows. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/cyclotruc/gitingest?style=social) - [GitDiagram](https://github.com/ahmedkhaleel2004/gitdiagram) - Converts any GitHub repository into an interactive system architecture diagram using LLMs, with clickable source links and Mermaid export. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/ahmedkhaleel2004/gitdiagram?style=social) - [Instructor](https://github.com/jxnl/instructor) - Python library for extracting structured, validated data from LLMs using Pydantic models. Handles validation, retries, and error handling with 15+ provider support. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/jxnl/instructor?style=social) - [Mirascope](https://github.com/Mirascope/mirascope) - Python toolkit for building LLM applications with automatic versioning, tracing, and cost tracking. The "LLM Anti-Framework" for developers who want control. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Mirascope/mirascope?style=social) - [Context7](https://github.com/upstash/context7) - Up-to-date code documentation for LLMs and AI code editors. Fetches latest docs and code examples directly into LLM context via MCP. Eliminates hallucinated APIs. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/upstash/context7?style=social) - [Claude Squad](https://github.com/smtg-ai/claude-squad) - Manage multiple AI terminal agents like Claude Code, Codex, OpenCode, and Amp. Terminal multiplexer for AI coding agents with session management and parallel execution. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/smtg-ai/claude-squad?style=social) - [YYLO](https://github.com/yylo-dev/yylo) - Command-line orchestrator that runs AI coding agents (Claude Code, Codex, Gemini CLI) in parallel across isolated git worktrees, tracked on a Kanban board with typed merge and release flows. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/yylo-dev/yylo?style=social) - [Herdr](https://github.com/ogulcancelik/herdr) - Terminal agent multiplexer and workspace manager with mouse-native split-panes and automatic agent state detection. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/ogulcancelik/herdr?style=social) - [TUIOS](https://github.com/Gaurav-Gosain/tuios) - Terminal window manager and multiplexer for coding agents, with cross-machine persistent sessions, agent-state reporting, a shared inbox, harness integrations, and MCP control. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Gaurav-Gosain/tuios?style=social) - [agent-manager](https://github.com/YoanWai/agent-manager) - Terminal UI that runs coding-agent CLIs such as Claude Code, Codex, OpenCode, and Gemini CLI side by side, each in its own persistent tmux session, with live status, optional per-session Git worktrees, and a diff review that sends line comments back to the agent. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/YoanWai/agent-manager?style=social) - [agenttrace](https://github.com/luoyuctl/agenttrace) - Local-first TUI for observing AI coding agent sessions across Claude Code, Codex CLI, Gemini CLI, Aider, Cursor exports, OpenCode, and more. ![GitHub stars](https://img.shields.io/github/stars/luoyuctl/agenttrace?style=social) - [agentsview](https://github.com/kenn-io/agentsview) - Local-first session intelligence and cost analytics dashboard for AI coding agents, supporting Claude Code, Codex, and other tools. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/kenn-io/agentsview?style=social) - [Uni-CLI](https://github.com/olo-dot-io/Uni-CLI) - Self-repairing CLI catalog that exposes web, desktop, Electron, and bridge tools as deterministic commands for AI agents. ![GitHub stars](https://img.shields.io/github/stars/olo-dot-io/Uni-CLI?style=social) - [OpenChamber Mobile Bridge](https://github.com/Zaradacht/opencode-openchamber-mobile-bridge) - OpenCode/OpenChamber helper for exposing devcontainer-based coding sessions to private Tailscale mobile access through a host bridge. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/Zaradacht/opencode-openchamber-mobile-bridge?style=social) - [DesktopCommander MCP](https://github.com/wonderwhy-er/DesktopCommanderMCP) - MCP server for Claude providing terminal control, file system search, and diff file editing capabilities. Enables autonomous code editing through Model Context Protocol. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/wonderwhy-er/DesktopCommanderMCP?style=social) - [Mobile MCP](https://github.com/mobile-next/mobile-mcp) - MCP server that lets AI agents automate and inspect iOS and Android simulators, emulators, and real devices through accessibility trees, screenshots, and structured device tools. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/mobile-next/mobile-mcp?style=social) - [REA](https://github.com/morluto/rea) - MCP server and CLI that lets AI agents inspect binaries, applications, websites, and runtime behavior with evidence-backed reverse-engineering results. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/morluto/rea?style=social) - [Claude Code Action](https://github.com/anthropics/claude-code-action) - GitHub Action for running Claude Code in PR and issue workflows with approval-aware automation and coding assistance. ![GitHub stars](https://img.shields.io/github/stars/anthropics/claude-code-action?style=social) - [OfficeCLI](https://github.com/iOfficeAI/OfficeCLI) - Office suite purpose-built for AI agents to read, edit, and automate Word, Excel, and PowerPoint files without external Office installations. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/iOfficeAI/OfficeCLI?style=social) - [CLI-Anything](https://github.com/HKUDS/CLI-Anything) - Framework for converting software applications into agent-native command-line interfaces for AI coding agents. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/HKUDS/CLI-Anything?style=social) - [MulmoTerminal](https://github.com/receptron/mulmoterminal) - Browser grid of live Claude Code and Codex sessions started with one `npx` command. Each cell is a real PTY with a colour-coded status, tmux-backed persistence, and a git worktree per cell. For Claude Code, needs-you is shown separately from done, read from the CLI's own hooks. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/receptron/mulmoterminal?style=social) - [Worktrunk](https://github.com/max-sixty/worktrunk) - CLI for Git worktree management and workflow automation designed for parallel AI coding-agent workflows. ![GitHub stars](https://img.shields.io/github/stars/max-sixty/worktrunk?style=social) - [bestax-mcp](https://github.com/allxsmith/bestax/tree/main/bestax-mcp) - Offline MCP server and Agent Skills that give coding agents the props, examples and CSS variables of Bestax, a React component library for Bulma v1. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/allxsmith/bestax?style=social) - [KyttoMCP](https://github.com/heyitsjakub/KyttoMCP) - Desktop app for macOS (Swift) and Windows (.NET) that shows every MCP server across Claude Desktop, Claude Code, Cursor, VS Code and Codex in one matrix, runs health checks and a tool-description safety scan, and backs up configs before writing. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/heyitsjakub/KyttoMCP?style=social) - [Archcore](https://github.com/archcore-ai/archcore) - Git-native context engineering and spec-driven development for AI coding agents. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/archcore-ai/archcore?style=social) - [Caprock](https://github.com/dspv/caprock) - Desktop app and local dashboard for Claude Code, Codex and OpenCode sessions: agents in tabs and split panes, token cost per repository at API list prices, plan-limit windows, loop alerts and searchable history. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/dspv/caprock?style=social) - [LynxPrompt](https://github.com/GeiserX/LynxPrompt) - Self-hosted web app and `lynxp` CLI that turn one set of AI coding rules into the rule files of 30 tools, among them AGENTS.md, CLAUDE.md and Cursor rules, with blueprints a team can share. AGPL-3.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/GeiserX/LynxPrompt?style=social) - [gateway-price-check](https://github.com/happy520ai/gateway-price-check) - Zero-dependency CLI that sends one unauthenticated `GET /v1/models` to any OpenAI-compatible endpoint and classifies price disclosure into five verdicts, keeping "publishes no prices" separate from "could not be read"; includes a daily CI archive of the raw readings. ![GitHub stars](https://img.shields.io/github/stars/happy520ai/gateway-price-check?style=social) - [agent-chain-doctor](https://github.com/elfovo/agent-chain-doctor) - Zero-dependency shell script that runs 30 read-only checks on cron, launchd and systemd state and logs to find why scheduled AI-agent chains stop silently, with a missed-run alarm; ships an MCP server and a SKILL.md. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/elfovo/agent-chain-doctor?style=social) - [Claude Account Switcher](https://github.com/SnlperStripes/claude-account-switcher) - Windows tray app that switches the Claude desktop app between accounts, carries Claude Code sessions and projects across accounts, and shows live 5-hour and weekly usage of each; a macOS build exists but is not yet tested on a real Mac. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/SnlperStripes/claude-account-switcher?style=social) #### SDKs & API Development Tools - [Vercel AI SDK](https://github.com/vercel/ai) - Provider-agnostic TypeScript toolkit for building AI-powered applications and agents. Unified API for OpenAI, Anthropic, Google, and 20+ providers with first-class streaming, tool-calling, and structured output support. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/vercel/ai?style=social) - [GitHub Copilot SDK](https://github.com/github/copilot-sdk) - Multi-platform SDK for integrating GitHub Copilot Agent into apps and services. Production-tested agent runtime with planning, tool invocation, and context management. Build Copilot-style agents without writing your own orchestration. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/github/copilot-sdk?style=social) - [IBM MCP Context Forge](https://github.com/IBM/mcp-context-forge) - Gateway and registry for MCP/A2A/REST APIs with unified discovery, routing, and guardrails for production agent integrations. ![GitHub stars](https://img.shields.io/github/stars/IBM/mcp-context-forge?style=social) - [Fern](https://github.com/fern-api/fern) - Open-source SDK generator for REST APIs. Generate type-safe API clients in TypeScript, Python, Go, Java, and more from OpenAPI specs. Powers SDKs for companies like OpenAI, Anthropic, and Cloudflare. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/fern-api/fern?style=social) - [Cortex](https://github.com/cortex-docs/cortex) - Generates typed SDKs, API documentation, and MCP servers from OpenAPI, AsyncAPI, GraphQL, Protocol Buffer, OpenRPC, and Markdown sources. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/cortex-docs/cortex?style=social) - [Spectrum](https://github.com/photon-hq/spectrum-ts) - TypeScript framework that runs an agent over iMessage, WhatsApp Business, Telegram, Slack, and the terminal through one message loop, with hosted Spectrum Cloud or a local iMessage database. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/photon-hq/spectrum-ts?style=social) #### Testing & Debugging Tools - [no-mistakes](https://github.com/kunchenguid/no-mistakes) - A local Git proxy and validation pipeline that runs AI-driven checks and applies fixes in a temporary worktree before forwarding pushes and opening clean PRs. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/kunchenguid/no-mistakes?style=social) - [oai-smoke](https://github.com/airouter-dev/openai-compatible-api-smoke-test) - MIT-licensed, standard-library-only Go CLI that validates `/models` and opt-in `/chat/completions` behavior for OpenAI-compatible APIs and emits bounded diagnostics without credentials or response bodies. ![GitHub stars](https://img.shields.io/github/stars/airouter-dev/openai-compatible-api-smoke-test?style=social) - [e2e](https://github.com/tester-army/e2e) - Agent-native web and mobile end-to-end testing framework that executes natural-language goals and records verified actions for replay without further model calls. Apache-2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/tester-army/e2e?style=social) - [tokenwatt-verify](https://github.com/tokenwatt/tokenwatt-verify) - CLI that checks whether an LLM API endpoint serves the model it claims by comparing graded answers, input-token counts, refusals and latency against a reference endpoint, with a monitor mode for intermittent swaps. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/tokenwatt/tokenwatt-verify?style=social) #### Prompt Engineering & Management - [GEPA](https://github.com/gepa-ai/gepa) - Reflective prompt evolution optimizer using natural language reflection and Pareto frontier learning. Outperforms reinforcement learning for prompt optimization. Integrated with DSPY and MLflow. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/gepa-ai/gepa?style=social) - [Entroly](https://github.com/juyterman1000/entroly) - Local-first MCP server for explicit-budget context selection, content-addressed exact recovery, and auditable Context Receipts. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/juyterman1000/entroly?style=social) - [Vibe-Coding Prompt Template](https://github.com/KhazP/vibe-coding-prompt-template) - Staged prompt workflow and CLI that turns a product idea into a PRD, technical design, and `AGENTS.md` instruction files for AI coding agents. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/KhazP/vibe-coding-prompt-template?style=social) - [Webcmd](https://github.com/agentrhq/webcmd) - Self-learning browser infrastructure for AI agents that compiles a site's navigation into deterministic per-site CLI commands (Apache-2.0, TypeScript). ![GitHub stars](https://img.shields.io/github/stars/agentrhq/webcmd?style=social) --- ## 14. Resources & Learning #### Papers with Open Implementations - [Papers with Code](https://paperswithcode.com) - Definitive database linking papers to open code and datasets. - [Hugging Face Papers](https://huggingface.co/papers) - Daily-updated feed of the latest arXiv papers with open weights. - [Open LLM Leaderboard (Hugging Face)](https://huggingface.co/spaces/open-llm-leaderboard) - Real-time ranking of open models. #### Communities, Forums & Newsletters - [Hugging Face Discussions](https://discuss.huggingface.co) - Largest open AI forum. #### Educational Resources & Courses - [AI Engineering from Scratch (rohitg00)](https://github.com/rohitg00/ai-engineering-from-scratch) - Comprehensive curriculum covering machine learning, deep learning, NLP, computer vision, and agents by implementing them from scratch. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/rohitg00/ai-engineering-from-scratch?style=social) - [AMD Strix Halo Local LLM Guide](https://github.com/hogeheer499-commits/strix-halo-guide) - Reproducible Ubuntu, Ollama, llama.cpp, Vulkan/RADV, and ROCm setup and benchmark evidence for Ryzen AI MAX+ 395 local-AI systems. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/hogeheer499-commits/strix-halo-guide?style=social) - [AI Agents in Depth](https://github.com/bojieli/ai-agent-book) - Open-source textbook and code repository covering AI agent design principles, architectures, and engineering practice. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/bojieli/ai-agent-book?style=social) - [Claude How To](https://github.com/luongnv89/claude-howto) - Comprehensive learning path and template guide for Claude Code, covering setup, hooks, custom skills, and MCP server integrations. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/luongnv89/claude-howto?style=social) - [Maths, CS & AI Compendium](https://github.com/HenryNdubuaku/maths-cs-ai-compendium) - An open, unconventional textbook covering mathematics, computer science, and artificial intelligence from the ground up. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/HenryNdubuaku/maths-cs-ai-compendium?style=social) - [r/LocalLLaMA](https://www.reddit.com/r/LocalLLaMA) - Go-to subreddit for local/open-source LLM topics. #### Courses & Interactive Playgrounds - [Hugging Face Course](https://huggingface.co/learn) - Free hands-on courses using only open models. - [ML For Beginners (Microsoft)](https://github.com/microsoft/ML-For-Beginners) - 12-week, 26-lesson, 52-quiz classic machine learning course for beginners. Comprehensive curriculum covering regression, classification, clustering, and NLP with practical projects. ![GitHub stars](https://img.shields.io/github/stars/microsoft/ML-For-Beginners?style=social) - [AI For Beginners (Microsoft)](https://github.com/microsoft/AI-For-Beginners) - 12-week, 24-lesson curriculum on Artificial Intelligence. Covers symbolic AI, neural networks, computer vision, NLP, and reinforcement learning with hands-on labs. ![GitHub stars](https://img.shields.io/github/stars/microsoft/AI-For-Beginners?style=social) - [Generative AI for Beginners (Microsoft)](https://github.com/microsoft/generative-ai-for-beginners) - 21 lessons covering generative AI fundamentals, prompt engineering, RAG applications, fine-tuning, and LLM app deployment with practical exercises. ![GitHub stars](https://img.shields.io/github/stars/microsoft/generative-ai-for-beginners?style=social) - [LangChain Academy](https://academy.langchain.com) - Free courses on agents and RAG. - [Data Science for Beginners (Microsoft)](https://github.com/microsoft/Data-Science-For-Beginners) - 10-week, 20-lesson curriculum on data science fundamentals. Covers data preparation, visualization, modeling, and deployment with practical projects. ![GitHub stars](https://img.shields.io/github/stars/microsoft/Data-Science-For-Beginners?style=social) - [The Incredible PyTorch](https://github.com/ritchieng/the-incredible-pytorch) - Curated list of PyTorch tutorials, papers, projects, and communities for deep learning researchers. ![GitHub stars](https://img.shields.io/github/stars/ritchieng/the-incredible-pytorch?style=social) - [Deep RL Class (Hugging Face)](https://github.com/huggingface/deep-rl-class) - Free deep reinforcement learning course with hands-on exercises and trained agent publishing to the Hugging Face Hub. ![GitHub stars](https://img.shields.io/github/stars/huggingface/deep-rl-class?style=social) - [NLP Course (Yandex Data School)](https://github.com/yandexdataschool/nlp_course) - YSDA course in Natural Language Processing with 2025 materials covering text classification, language models, transformers, and modern NLP techniques. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/yandexdataschool/nlp_course?style=social) - [Large Language Model Notebooks Course](https://github.com/peremartra/Large-Language-Model-Notebooks-Course) - Practical hands-on course about Large Language Models and their applications. Covers Chatbots, Code Generation, OpenAI API, Hugging Face, Vector databases, LangChain, Fine Tuning, PEFT, LoRA, QLoRA. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/peremartra/Large-Language-Model-Notebooks-Course?style=social) - [Transformers Tutorials (Niels Rogge)](https://github.com/NielsRogge/Transformers-Tutorials) - Comprehensive tutorials and demos using the Hugging Face Transformers library for NLP, vision, and multimodal tasks. ![GitHub stars](https://img.shields.io/github/stars/NielsRogge/Transformers-Tutorials?style=social) - [AI Engineering Hub](https://github.com/patchy631/ai-engineering-hub) - 93+ production-ready projects with in-depth tutorials on LLMs, RAG, and real-world AI agent applications. Comprehensive resources for all skill levels from beginner to advanced. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/patchy631/ai-engineering-hub?style=social) - [Complete Agentic AI Engineering Course](https://github.com/ed-donner/agents) - 6-week comprehensive course on Agentic AI covering autonomous agents, multi-agent systems, and practical agent development. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/ed-donner/agents?style=social) - [OpenMAIC](https://github.com/THU-MAIC/OpenMAIC) - MIT-licensed multi-agent platform for interactive learning and course generation. ![GitHub stars](https://img.shields.io/github/stars/THU-MAIC/OpenMAIC?style=social) #### Starter Projects & Examples - [Awesome LLM Apps](https://github.com/Shubhamsaboo/awesome-llm-apps) - A collection of run-ready artificial intelligence templates and agent customizer scripts, featuring over 100 retrieval-augmented generation (RAG) and intelligent agent blueprints. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/Shubhamsaboo/awesome-llm-apps?style=social) - [Claude Cookbooks](https://github.com/anthropics/claude-cookbooks) - Official collection of recipes and notebooks demonstrating tool use, prompt caching, structured outputs, and agentic workflows with Claude. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/anthropics/claude-cookbooks?style=social) - [Hugging Face Transformers Notebooks](https://github.com/huggingface/notebooks) - Run Transformers, Datasets, and more in Colab. ![GitHub stars](https://img.shields.io/github/stars/huggingface/notebooks?style=social) - [TensorFlow Tutorials](https://github.com/tensorflow/docs) - Official guides for beginners to advanced users. ![GitHub stars](https://img.shields.io/github/stars/tensorflow/docs?style=social) - [AI Engineer Portfolio Projects](https://github.com/landedjobs/ai-engineer-portfolio-projects) - 85 buildable AI engineering project briefs grouped by theme (RAG, agents, evals, fine-tuning, multimodal), each with difficulty, skills shown, and reference resources. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/landedjobs/ai-engineer-portfolio-projects?style=social) #### Curated Resource Lists - [Awesome Machine Learning](https://github.com/josephmisiti/awesome-machine-learning) - The definitive curated list of machine learning frameworks, libraries and software organized by language. Covers Python, C++, Java, JavaScript, and more with comprehensive coverage of the ML ecosystem. CC0-1.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/josephmisiti/awesome-machine-learning?style=social) - [Awesome Artificial Intelligence](https://github.com/owainlewis/awesome-artificial-intelligence) - Curated list of artificial intelligence courses, books, video lectures, and papers for developers and researchers. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/owainlewis/awesome-artificial-intelligence?style=social) - [Awesome DESIGN.md](https://github.com/VoltAgent/awesome-design-md) - Curated collection of DESIGN.md files representing popular design systems to guide AI coding agents in consistent UI generation. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/VoltAgent/awesome-design-md?style=social) - [Awesome Claude Skills](https://github.com/ComposioHQ/awesome-claude-skills) - Curated list of Claude Skills, plugins, resources, and custom commands to extend terminal and API workflows. Apache 2.0 licensed. ![GitHub stars](https://img.shields.io/github/stars/ComposioHQ/awesome-claude-skills?style=social) - [Best of Open-Source AI](https://github.com/archestack/best-of-ai) - Ranked list of open-source AI apps, agents, model servers and infrastructure tools, each scored from public GitHub data with written strengths and weaknesses and refreshed twice a day. MIT licensed. ![GitHub stars](https://img.shields.io/github/stars/archestack/best-of-ai?style=social) - [Awesome AI Agents](https://github.com/ianwieds/awesome-ai-agents) - Curated list of AI agent frameworks, coding agents, browser agents, tools, platforms and research. ![GitHub stars](https://img.shields.io/github/stars/ianwieds/awesome-ai-agents?style=social) --- ## Contributing Contributions are welcome. Please read [CONTRIBUTING.md](CONTRIBUTING.md) for guidelines. - Only OSI-approved licenses - No minimum GitHub star requirement - Useful, relevant, well-documented projects with a clear reason to exist - Maintained current list, not a historical archive