Frameworks

Frameworks for building agents, RAG systems and LLM applications. 581 listed, most popular first.

  • open-webui — User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
  • langchain — The agent engineering platform.
  • awesome-llm-apps — 100+ AI Agents, Agent Skills and RAG Apps - Free and Open Source.
  • graphify — Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Curs…
  • ragflow — RAGFlow is a leading open-source Retrieval-Augmented Generation (RAG) engine that fuses cutting-edge RAG with Agent capabilities to create…
  • PaddleOCR — Turn any PDF or image document into structured data for your AI. A powerful, lightweight OCR toolkit that bridges the gap between images/PD…
  • crawl4ai — Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cl…
  • hello-agents — 📚 《从零开始构建智能体》——从零开始的智能体原理与实践教程
  • Prompt-Engineering-Guide — 🐙 Guides, papers, lessons, notebooks and resources for prompt engineering, context engineering, RAG, and AI Agents.
  • headroom — Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for J…
  • anything-llm — Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience
  • mem0 — The Memory Layer for AI Agents - Drop-in memory infrastructure for AI agents and apps. Context that persists. Built for production.
  • autogen — A programming framework for agentic AI
  • llm-app — Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint…
  • llama_index — LlamaIndex is the document processing platform for AI
  • ai-agent-book — 《深入理解 AI Agent：设计原理与工程实践》（李博杰 著）开源主仓库：全书正文、编译版 PDF 与按章配套代码
  • JeecgBoot — 【低代码v2.0，一句话即可生成整个系统】企业级AI低代码平台，一键生成前后端代码甚至整个系统。 AI Skills 一句话画流程、设计表单、生成报表、大屏。内置 AI应用平台涵盖：AI聊天、知识库、流程编排、MCP插件等，兼容主流大模型。引领AI低代码「Skills 生成 →…
  • milvus — Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search
  • langgraph — Build resilient agents.
  • BettaFish — 微舆：人人可用的多Agent舆情分析助手，打破信息茧房，还原舆情原貌，预测未来走向，辅助决策！从0实现，不依赖任何框架。
  • DeepTutor — DeepTutor: Lifelong Personalized Tutoring. https://deeptutor.info/.
  • LightRAG — [EMNLP2025] LightRAG: Simple and Fast Retrieval-Augmented Generation
  • quivr — Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products with c…
  • Langchain-Chatchat — Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-C…
  • PageIndex — 📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG
  • ai-engineering-hub — In-depth tutorials on LLMs, RAGs and real-world AI agent applications.
  • khoj — Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Tu…
  • Vane — Vane is an AI-powered answering engine.
  • graphrag — A modular graph-based Retrieval-Augmented Generation (RAG) system
  • DeepSeek-Reasonix — A reliable coding agent for complex software engineering tasks.
  • happy-llm — 📚 从零开始构建大模型
  • onyx — Open Source AI Platform - AI Chat with advanced features that works with every LLM
  • WeKnora — Open-source LLM knowledge platform: turn raw documents into a queryable RAG, an autonomous reasoning agent, and a self-maintaining Wiki.
  • Scrapegraph-ai — Python scraper based on AI
  • graphiti — Build Real-Time Knowledge Graphs for AI Agents
  • FastGPT — FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processin…
  • sim — Sim is the collaborative workspace to build, deploy, and monitor AI agents and workflows. Used by 100,000+ builders.
  • RAG_Techniques — This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. Each technique has a detailed noteb…
  • opendataloader-pdf — PDF Parser for AI-ready data. Automate PDF accessibility. Open-source.
  • haystack — Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and age…
  • 12-factor-agents — What are the principles we can use to build LLM-powered software that is actually good enough to put in the hands of production customers?
  • kotaemon — An open-source RAG-based tool for chatting with your documents.
  • promptfoo — Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Deep…
  • GenAI_Agents — 50+ tutorials and implementations for Generative AI Agent techniques, from basic conversational bots to complex multi-agent systems.
  • CV — ✅（已完结）超级全面的 深度学习 笔记【土堆 Pytorch】【李沐 动手学深度学习】【吴恩达 深度学习】【大飞 大模型Agent】
  • coze-studio — An AI agent development platform with all-in-one visual tools, simplifying agent creation, debugging, and deployment like never before. Coz…
  • agents-towards-production — End-to-end, code-first tutorials for building production-grade GenAI agents. From prototype to enterprise deployment.
  • ai-guide — 程序员鱼皮的 AI 资源大全 + Vibe Coding 零基础教程，分享 OpenClaw 保姆级教程、大模型玩法（DeepSeek / GPT / Gemini / Claude / GLM）、最新 AI 资讯、Prompt 提示词大全、AI 知识百科（Agent Skil…
  • pydantic-ai — How Python does AI. Agents, realtime voice, image generation, embeddings. Every model, every interface, typed end to end.
  • DB-GPT — open-source agentic AI data assistant for the next generation of AI + Data products.
  • eliza — Open source agentic operating system
  • DocsGPT — Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model sup…
  • openfang — Open-source Agent Operating System
  • LangBot — Production-grade platform for building agentic IM bots - 生产级多平台智能机器人开发平台/ Agent、知识库编排、插件系统 / Bots for Discord / Slack / LINE / Telegram / W…
  • WrenAI — GenBI (Generative BI) for AI agents, an open-source, governed text-to-SQL through an open context layer that turns natural-language questio…
  • turbovec — A vector index built on TurboQuant, written in Rust with Python bindings
  • Memori — Memori is agent-native memory infrastructure. A LLM-agnostic layer that turns agent execution and conversation into structured, persistent…
  • memvid — Memory layer for AI Agents. Replace complex RAG pipelines with a serverless, single-file memory layer. Give your agents instant retrieval a…
  • SurfSense — Air gapped, privacy focused open source NotebookLM alternative. Join our Discord: https://discord.gg/ejRNvftDp9
  • easy-dataset — A powerful tool for creating datasets for LLM fine-tuning 、RAG and Eval
  • llm-universe — 本项目是一个面向小白开发者的大模型应用开发教程，在线阅读地址：https://datawhalechina.github.io/llm-universe/
  • agent-framework — A framework for building, orchestrating and deploying AI agents and multi-agent workflows with support for Python and .NET.
  • EverOS — One portable memory layer for every AI agent: local-first, Markdown-native, user-owned, and self-evolving across apps, tools, and workflows.
  • LEANN — [MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, acc…
  • txtai — 💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows
  • note-gen — Capture first. Organize later. A local-first Markdown app that turns scattered records into clear notes with AI.
  • garden-skills — ConardLi's open-source Skills collection, featuring web design, knowledge retrieval, image generation, and more.
  • PocketFlow-Tutorial-Codebase-Knowledge — Pocket Flow: Codebase to Tutorial
  • claude-context — Code search MCP for Claude Code. Make entire codebase the context for any coding agent.
  • bisheng — BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI w…
  • MemOS — Self-evolving memory OS for LLM & AI Agents: ultra-persistent memory, hybrid-retrieval, and cross-task skill reuse, with 35.24% token savin…
  • all-in-rag — 🔍大模型应用开发实战一：RAG 技术全栈指南，在线阅读地址：https://datawhalechina.github.io/all-in-rag/
  • cocoindex — Incremental engine for long horizon agents 🌟 Star if you like it!
  • PocketFlow — Pocket Flow: 100-line LLM framework. Let Agents build Agents!
  • voltagent — AI Agent Engineering Platform built on an Open Source TypeScript AI Agent Framework
  • aichat — All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq,…
  • omnigent — Omnigent is an open-source AI agent framework and meta-harness: orchestrate Claude Code, Codex, Cursor, Pi, and custom agents — swap harnes…
  • AgentGuide — https://adongwanai.github.io/AgentGuide | AI Agent开发指南 | LangGraph实战 | 高级RAG | 转行大模型 | 大模型面试 | 算法工程师 | 面试题库 | 强化学习｜数据合成
  • PixelRAG — https://arxiv.org/abs/2606.28344. The end of web parsing. The beginning of scalable pixel-native search. link: https://pixelrag.ai/
  • xberg — Polyglot document intelligence with a Rust core: extract text, metadata, images, tables, and structured data from 106 formats across 140 fi…
  • paper-qa — High accuracy RAG for answering questions from scientific documents with citations
  • deeplake — Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and trainin…
  • evolver — The GEP-powered self-evolving engine for AI agents. Auditable evolution with Genes, Capsules, and Events. | evomap.ai
  • awesome-LLM-resources — 🧑‍🚀 全世界最好的LLM资料总结（多模态生成、Agent、辅助编程、AI审稿、数据处理、模型训练、模型推理、o1 模型、MCP、小语言模型、视觉语言模型） | Summary of the world's best LLM resources.
  • harness-sdk — Build an agent harness and control it end-to-end. Open-source SDK for production AI agents in Python & TypeScript - any model, any cloud.
  • MiroThinker — MiroThinker is a deep research agent optimized for complex research and prediction tasks. Our latest models, MiroThinker-1.7, achieves 74.0…
  • deep-searcher — Open Source Deep Research Alternative to Reason and Search on Private Data. Written in Python.
  • utopia — World's first open-source enterprise world model.
  • R2R — SoTA production-ready AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.
  • LLMForEverybody — 每个人都能看懂的大模型知识分享，LLMs春/秋招大模型面试前必看，让你和面试官侃侃而谈
  • Yuxi — 可私有部署的多租户知识智能体平台：统一 RAG、知识图谱、多智能体、MCP/Skills、沙盒与权限管理。Yuxi = Cloud Agents + Knowledge RAG, Self-hosted knowledge agent platform for RAG, kno…
  • vespa — The AI search platform
  • open-multi-agent — Self-hosted TypeScript agent runtime with durable approvals and verifiable run records. Own it, approve it, audit it.
  • ODS — ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server.
  • trafilatura — Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
  • SQLBot — 🔥 基于大模型和 RAG 的智能问数系统，对话式数据分析神器。Text-to-SQL Generation via LLMs using RAG.
  • postgresml — Postgres with GPUs for ML/AI apps.
  • rags — Build ChatGPT over your data, all with natural language
  • intentkit — IntentKit is an open-source, self-hosted cloud agent cluster that manages a collaborative team of AI agents for you.
  • genkit — Open-source framework for building agentic apps in JavaScript, Go, Dart, and Python, built and used in production by Google

Privacy · Terms · llms.txt