Decision guide
Best tool for how you actually work
Pick the constraint that matters most. Each section lists matching tools computed live from the verified specs.
64 Privacy and self-hosting Open-source tools you can run on your own infrastructure, so code and traces never leave your network.
Coding agent
- Aider — AI pair programming in your terminal, git-native.
- Cline — Autonomous coding agent inside VS Code, with approval gates.
- Continue — Open-source AI code assistant for VS Code and JetBrains.
- Floci — A free, open-source local AWS emulator for dev, testing, and CI.
- Goose — Block's open-source local AI agent.
- Hermes Agent — The self-improving AI agent built by Nous Research.
- Kilo Code — Open-source coding agent consolidating Cline and Roo.
- Open Interpreter — Let an LLM run code on your machine.
- OpenCode — A model-agnostic, local-first coding agent TUI.
- OpenCode Autolearn — Self-improvement engine for OpenCode agents.
- OpenHands — Open-source autonomous software engineer (formerly OpenDevin).
- Pi — A minimal, extensible terminal coding-agent harness.
- Roo Code — A community fork of Cline with extra modes.
- Tabby — Self-hosted AI coding assistant for teams.
Agent framework
- Agno — A high-performance multi-agent framework and runtime (formerly Phidata).
- AutoGen — Microsoft's framework for multi-agent conversations.
- AWS Strands Agents — AWS's model-driven, open-source agent SDK.
- CrewAI — Role-playing multi-agent crews.
- DSPy — Declarative, programmable prompt programming from Stanford.
- Google Agent Development Kit — Google's code-first toolkit for production agents.
- Haystack (deepset) — Production-grade RAG and agent pipelines from deepset.
- LangChain — The broad framework for LLM applications and agents.
- LangGraph — Graph-based agent orchestration from LangChain.
- Letta — Stateful agents with long-term memory (formerly MemGPT).
- LlamaIndex — The data framework for LLM applications.
- Mastra — The TypeScript-first agent framework.
- OpenAI Agents SDK — OpenAI's lightweight agents SDK (Swarm successor).
- PocketFlow — A 100-line minimalist LLM framework, agentic-coding friendly.
- Pydantic AI — Type-safe agent framework from the Pydantic team.
- Semantic Kernel — Microsoft's SDK for enterprise AI orchestration.
- Smolagents — Hugging Face's minimalist code-writing agents.
- Vercel AI SDK — The TypeScript toolkit for building AI apps and agents.
Observability
- Arize Phoenix — Open-source LLM tracing and eval.
- Comet Opik — Open-source eval and tracing from Comet.
- Helicone — Proxy-based LLM observability with instant cost tracking.
- Laminar — Open-source observability and eval for AI agents.
- Langfuse — The most-used open-source LLM observability tool.
- Lunary — Open-source LLM observability and prompt management.
- SigNoz — Open-source OpenTelemetry observability.
Evaluation
- DeepEval (Confident AI) — Open-source unit tests for LLMs.
- Latitude — Open-source prompt management and eval.
- promptfoo — Test and red-team LLM apps, prompts, and agents.
Instrumentation
- OpenLLMetry — OpenTelemetry instrumentation for LLMs.
Guardrails
- Guardrails AI — Validation and guardrails library for LLM applications.
- LLM Guard — Open-source security toolkit for sanitizing LLM inputs and outputs.
- NeMo Guardrails — NVIDIA's open-source toolkit for LLM guardrails.
Code intelligence
- Claude Context (Zilliz) — Semantic code-search MCP over your entire codebase.
- codebase-memory-mcp — Code-intelligence MCP server that indexes codebases into a knowledge graph.
- CodeGraph — Pre-indexed, local code knowledge graph for agents.
- Repomix — Pack a whole repository into one token-optimized file for AI context.
- Serena — LSP-based semantic code tools for agents, as an MCP toolkit.
Inference engine
- llama.cpp — C/C++ inference for GGUF models on any hardware.
- LMDeploy — Efficient inference and serving for open models.
- Ollama — Run large language models locally with one command.
- SGLang — Fast serving and structured generation engine.
- Text Generation Inference — Hugging Face's production LLM server.
- vLLM — High-throughput self-hosted LLM serving engine.
Agent memory
LLM gateway
Multiplexer
34 Bring your own key Provider-agnostic tools that work with any model, including local ones, so you are never locked to one vendor.
Coding agent
- Aider — AI pair programming in your terminal, git-native.
- Cline — Autonomous coding agent inside VS Code, with approval gates.
- Continue — Open-source AI code assistant for VS Code and JetBrains.
- Goose — Block's open-source local AI agent.
- Hermes Agent — The self-improving AI agent built by Nous Research.
- Kilo Code — Open-source coding agent consolidating Cline and Roo.
- Open Interpreter — Let an LLM run code on your machine.
- OpenCode — A model-agnostic, local-first coding agent TUI.
- OpenHands — Open-source autonomous software engineer (formerly OpenDevin).
- Pi — A minimal, extensible terminal coding-agent harness.
- Roo Code — A community fork of Cline with extra modes.
- Tabby — Self-hosted AI coding assistant for teams.
- Void — An open-source Cursor alternative.
- Zed (AI) — The high-performance editor with built-in AI.
Agent framework
- Agno — A high-performance multi-agent framework and runtime (formerly Phidata).
- AutoGen — Microsoft's framework for multi-agent conversations.
- AWS Strands Agents — AWS's model-driven, open-source agent SDK.
- Cloudflare Agents SDK — Stateful agents on Cloudflare Workers.
- CrewAI — Role-playing multi-agent crews.
- DSPy — Declarative, programmable prompt programming from Stanford.
- Google Agent Development Kit — Google's code-first toolkit for production agents.
- Haystack (deepset) — Production-grade RAG and agent pipelines from deepset.
- LangChain — The broad framework for LLM applications and agents.
- LangGraph — Graph-based agent orchestration from LangChain.
- Letta — Stateful agents with long-term memory (formerly MemGPT).
- LlamaIndex — The data framework for LLM applications.
- Mastra — The TypeScript-first agent framework.
- PocketFlow — A 100-line minimalist LLM framework, agentic-coding friendly.
- Pydantic AI — Type-safe agent framework from the Pydantic team.
- Semantic Kernel — Microsoft's SDK for enterprise AI orchestration.
- Smolagents — Hugging Face's minimalist code-writing agents.
- Vercel AI SDK — The TypeScript toolkit for building AI apps and agents.
Inference engine
53 Free and open source Fully free, community-maintained tools. You pay only for the model tokens you choose to use.
Coding agent
- Aider — AI pair programming in your terminal, git-native.
- Cline — Autonomous coding agent inside VS Code, with approval gates.
- Continue — Open-source AI code assistant for VS Code and JetBrains.
- Floci — A free, open-source local AWS emulator for dev, testing, and CI.
- Goose — Block's open-source local AI agent.
- Hermes Agent — The self-improving AI agent built by Nous Research.
- Kilo Code — Open-source coding agent consolidating Cline and Roo.
- Open Interpreter — Let an LLM run code on your machine.
- OpenCode — A model-agnostic, local-first coding agent TUI.
- OpenCode Autolearn — Self-improvement engine for OpenCode agents.
- OpenHands — Open-source autonomous software engineer (formerly OpenDevin).
- Pi — A minimal, extensible terminal coding-agent harness.
- Roo Code — A community fork of Cline with extra modes.
- Tabby — Self-hosted AI coding assistant for teams.
- Void — An open-source Cursor alternative.
Agent framework
- Agno — A high-performance multi-agent framework and runtime (formerly Phidata).
- AutoGen — Microsoft's framework for multi-agent conversations.
- AWS Strands Agents — AWS's model-driven, open-source agent SDK.
- DSPy — Declarative, programmable prompt programming from Stanford.
- Google Agent Development Kit — Google's code-first toolkit for production agents.
- Haystack (deepset) — Production-grade RAG and agent pipelines from deepset.
- LangChain — The broad framework for LLM applications and agents.
- LangGraph — Graph-based agent orchestration from LangChain.
- LlamaIndex — The data framework for LLM applications.
- Mastra — The TypeScript-first agent framework.
- OpenAI Agents SDK — OpenAI's lightweight agents SDK (Swarm successor).
- PocketFlow — A 100-line minimalist LLM framework, agentic-coding friendly.
- Pydantic AI — Type-safe agent framework from the Pydantic team.
- Semantic Kernel — Microsoft's SDK for enterprise AI orchestration.
- Smolagents — Hugging Face's minimalist code-writing agents.
- Vercel AI SDK — The TypeScript toolkit for building AI apps and agents.
Observability
- Arize Phoenix — Open-source LLM tracing and eval.
Evaluation
- DeepEval (Confident AI) — Open-source unit tests for LLMs.
- promptfoo — Test and red-team LLM apps, prompts, and agents.
Instrumentation
- OpenLLMetry — OpenTelemetry instrumentation for LLMs.
Guardrails
- Guardrails AI — Validation and guardrails library for LLM applications.
- LLM Guard — Open-source security toolkit for sanitizing LLM inputs and outputs.
- NeMo Guardrails — NVIDIA's open-source toolkit for LLM guardrails.
Code intelligence
- Claude Context (Zilliz) — Semantic code-search MCP over your entire codebase.
- codebase-memory-mcp — Code-intelligence MCP server that indexes codebases into a knowledge graph.
- CodeGraph — Pre-indexed, local code knowledge graph for agents.
- Repomix — Pack a whole repository into one token-optimized file for AI context.
- Serena — LSP-based semantic code tools for agents, as an MCP toolkit.
Inference engine
- llama.cpp — C/C++ inference for GGUF models on any hardware.
- LMDeploy — Efficient inference and serving for open models.
- Ollama — Run large language models locally with one command.
- SGLang — Fast serving and structured generation engine.
- Text Generation Inference — Hugging Face's production LLM server.
- vLLM — High-throughput self-hosted LLM serving engine.
LLM gateway
Multiplexer
44 MCP-first Tools with first-class Model Context Protocol support, ready to connect to the growing MCP ecosystem.
Coding agent
- Aider — AI pair programming in your terminal, git-native.
- Augment Code — A context engine for large enterprise codebases.
- Claude Code — Anthropic's agentic CLI coding assistant.
- Cline — Autonomous coding agent inside VS Code, with approval gates.
- Continue — Open-source AI code assistant for VS Code and JetBrains.
- Cursor — The AI-first code editor built on VS Code.
- Gemini CLI — Google's open-source terminal agent for Gemini.
- GitHub Copilot — GitHub's AI pair programmer across editor and CLI.
- Goose — Block's open-source local AI agent.
- Hermes Agent — The self-improving AI agent built by Nous Research.
- Kilo Code — Open-source coding agent consolidating Cline and Roo.
- OpenAI Codex — OpenAI's open-source agentic coding CLI.
- OpenCode — A model-agnostic, local-first coding agent TUI.
- OpenHands — Open-source autonomous software engineer (formerly OpenDevin).
- Pi — A minimal, extensible terminal coding-agent harness.
- Roo Code — A community fork of Cline with extra modes.
- Void — An open-source Cursor alternative.
- Windsurf — Codeium's AI-native IDE (Cascade agent).
- Zed (AI) — The high-performance editor with built-in AI.
Agent framework
- Agno — A high-performance multi-agent framework and runtime (formerly Phidata).
- AutoGen — Microsoft's framework for multi-agent conversations.
- AWS Strands Agents — AWS's model-driven, open-source agent SDK.
- Cloudflare Agents SDK — Stateful agents on Cloudflare Workers.
- CrewAI — Role-playing multi-agent crews.
- Google Agent Development Kit — Google's code-first toolkit for production agents.
- Haystack (deepset) — Production-grade RAG and agent pipelines from deepset.
- LangChain — The broad framework for LLM applications and agents.
- LangGraph — Graph-based agent orchestration from LangChain.
- Letta — Stateful agents with long-term memory (formerly MemGPT).
- LlamaIndex — The data framework for LLM applications.
- Mastra — The TypeScript-first agent framework.
- OpenAI Agents SDK — OpenAI's lightweight agents SDK (Swarm successor).
- Pydantic AI — Type-safe agent framework from the Pydantic team.
- Semantic Kernel — Microsoft's SDK for enterprise AI orchestration.
- Smolagents — Hugging Face's minimalist code-writing agents.
- Vercel AI SDK — The TypeScript toolkit for building AI apps and agents.
Code intelligence
- Claude Context (Zilliz) — Semantic code-search MCP over your entire codebase.
- codebase-memory-mcp — Code-intelligence MCP server that indexes codebases into a knowledge graph.
- CodeGraph — Pre-indexed, local code knowledge graph for agents.
- Greptile — Hosted codebase intelligence for AI code review and Q&A.
- Repomix — Pack a whole repository into one token-optimized file for AI context.
- Serena — LSP-based semantic code tools for agents, as an MCP toolkit.
- Sourcegraph — Enterprise code intelligence, search, and agent context.
LLM gateway
- Executor — One MCP gateway to connect any agent to every tool.
37 Hosted and managed Tools you sign up for, not infrastructure you run. No servers, no setup, just an API key or a login.
Coding agent
- Augment Code — A context engine for large enterprise codebases.
- Claude Code — Anthropic's agentic CLI coding assistant.
- Cursor — The AI-first code editor built on VS Code.
- Devin — Cognition's autonomous software engineer.
- Gemini CLI — Google's open-source terminal agent for Gemini.
- GitHub Copilot — GitHub's AI pair programmer across editor and CLI.
- OpenAI Codex — OpenAI's open-source agentic coding CLI.
- Replit Agent — Build and ship apps conversationally on Replit.
- Void — An open-source Cursor alternative.
- Windsurf — Codeium's AI-native IDE (Cascade agent).
- Zed (AI) — The high-performance editor with built-in AI.
Agent framework
- Cloudflare Agents SDK — Stateful agents on Cloudflare Workers.
Observability
- AgentOps — Observability built specifically for AI agents.
- Fiddler — AI observability and governance for enterprise.
- LangSmith — LangChain's observability and eval platform.
- Pydantic Logfire — Observability from the Pydantic team.
- Weights and Biases Weave — LLM tracing and eval inside W&B.
Evaluation
- Braintrust — Evals and prompt playground for serious teams.
- Galileo — Guardrails and evaluation for production LLMs.
- Maxim AI — Evaluation and simulation for AI agents.
- Patronus AI — Automated evaluation and guardrails for LLMs.
Code intelligence
- Greptile — Hosted codebase intelligence for AI code review and Q&A.
- Sourcegraph — Enterprise code intelligence, search, and agent context.
LLM provider
- Anthropic — The Claude model API.
- Cerebras Inference — Wafer-scale inference for very high throughput.
- Cohere — Enterprise LLMs, embeddings, and rerankers.
- DeepInfra — Low-cost hosted inference for open models.
- Fireworks AI — Fast hosted open-model inference.
- Google AI Studio — The Gemini API with a generous free tier.
- Groq — Ultra-low-latency inference on custom LPU silicon.
- Mistral AI — Provider of the Mistral and Codestral models.
- Novita AI — Affordable hosted LLM and image APIs.
- OpenAI — The GPT and Codex model API.
- OpenRouter — One API routing to hundreds of models across providers.
- Replicate — Run and host thousands of open models via API.
- Together AI — Hosted open-model inference and fine-tuning.
- Z.ai — Provider of the GLM family of models.