Platform engineer
Running infrastructure and agents in production. Your stack is about building, watching, and hardening agents. 48 tools.
The shape of a stack that fits this role. Open one for the full diagram, the tools that fill it, and a worked example.
See what my agents do
Full stack & case study →I want to watch what my AI agents actually do once they're running.
flowchart LR
app(("Your agent app"))
instrument["Instrumentation"]
observe["Observability"]
app -->|records each step with| instrument
instrument -->|sends traces to| observe Test and score my agents
Full stack & case study →I want to test how well my AI behaves before I ship it.
flowchart LR
app(("Your agent"))
eval["Evaluation"]
app -->|is tested by| eval Build my own agent
Full stack & case study →I want to put an AI agent into my app.
flowchart LR
app(("Your application"))
framework["Agent framework"]
model["The model"]
observe["See what it does"]
app -->|calls| framework
framework -->|sends prompts to| model
framework -->|emits traces to| observe Agno
A high-performance multi-agent framework and runtime (formerly Phidata).
AutoGen
Microsoft's framework for multi-agent conversations.
AWS Strands Agents
AWS's model-driven, open-source agent SDK.
Cloudflare Agents SDK
Stateful agents on Cloudflare Workers.
CrewAI
Role-playing multi-agent crews.
DSPy
Declarative, programmable prompt programming from Stanford.
Google Agent Development Kit
Google's code-first toolkit for production agents.
Haystack (deepset)
Production-grade RAG and agent pipelines from deepset.
LangChain
The broad framework for LLM applications and agents.
LangGraph
Graph-based agent orchestration from LangChain.
Letta
Stateful agents with long-term memory (formerly MemGPT).
LlamaIndex
The data framework for LLM applications.
Mastra
The TypeScript-first agent framework.
OpenAI Agents SDK
OpenAI's lightweight agents SDK (Swarm successor).
PocketFlow
A 100-line minimalist LLM framework, agentic-coding friendly.
Pydantic AI
Type-safe agent framework from the Pydantic team.
Semantic Kernel
Microsoft's SDK for enterprise AI orchestration.
Smolagents
Hugging Face's minimalist code-writing agents.
Vercel AI SDK
The TypeScript toolkit for building AI apps and agents.
AgentOps
Observability built specifically for AI agents.
Arize Phoenix
Open-source LLM tracing and eval.
Comet Opik
Open-source eval and tracing from Comet.
Fiddler
AI observability and governance for enterprise.
Helicone
Proxy-based LLM observability with instant cost tracking.
Laminar
Open-source observability and eval for AI agents.
Langfuse
The most-used open-source LLM observability tool.
LangSmith
LangChain's observability and eval platform.
Lunary
Open-source LLM observability and prompt management.
Pydantic Logfire
Observability from the Pydantic team.
SigNoz
Open-source OpenTelemetry observability.
Weights and Biases Weave
LLM tracing and eval inside W&B.
Braintrust
Evals and prompt playground for serious teams.
DeepEval (Confident AI)
Open-source unit tests for LLMs.
Galileo
Guardrails and evaluation for production LLMs.
Latitude
Open-source prompt management and eval.
Maxim AI
Evaluation and simulation for AI agents.
Patronus AI
Automated evaluation and guardrails for LLMs.
promptfoo
Test and red-team LLM apps, prompts, and agents.
Guardrails AI
Validation and guardrails library for LLM applications.
LLM Guard
Open-source security toolkit for sanitizing LLM inputs and outputs.
NeMo Guardrails
NVIDIA's open-source toolkit for LLM guardrails.
Executor
One MCP gateway to connect any agent to every tool.
LiteLLM
Open-source LLM gateway with cost tracking, routing, and fallbacks.
Portkey
AI gateway with caching, fallbacks, and observability.