The Index
Every entry verified live, scored against the public rubric, and timestamped. Sorted by overall score, never by stars.
31 of 46 entries
Test harness for prompts, agents, and RAG pipelines: declarative test cases, assertions, matrix comparisons, and red-team scanning, runnable…
The most adopted graph-based agent orchestration framework: workflows as explicit state machines with checkpointing, human-in-the-loop…
An agent framework built on type validation: structured outputs, dependency injection, and tool schemas checked the way Pydantic checks…
Anthropic's first-party public skill collection: the de facto reference for SKILL.md structure, frontmatter conventions, and…
A pytest-style LLM evaluation framework: metric classes for correctness, hallucination, RAG quality, and agent task completion, written as…
Open-source LLM engineering platform: tracing, evals, prompt management, and metrics for agent systems. The observability layer most stacks…
Browser automation as agent tools, built on Playwright's accessibility tree rather than screenshots: structured, deterministic web…
The reference implementations of the Model Context Protocol: the official server collection that defines what a well-built agent tool looks…
An MCP server that feeds agents current, version-specific library documentation at generation time, attacking the stale-training-data class…
OpenAI's first-party multi-agent framework: agents, handoffs, guardrails, and tracing in a deliberately small API surface.
GitHub's official MCP server: repos, issues, PRs, actions, and code scanning exposed as agent tools with GitHub's own auth and permission…
A universal memory layer for AI agents: extraction, storage, and retrieval of user and session memories with SDKs across the major agent…
Google's Agent Development Kit: code-first agent construction with built-in evaluation tooling and deployment paths into the Google Cloud…
140 domain skills plus 100+ database connectors that turn a coding agent into a working research assistant for biology, chemistry, medicine,…
A platform for stateful agents with self-editing memory, descended from the MemGPT research line: agents manage their own memory blocks…
An MCP toolkit that gives coding agents semantic code retrieval and editing: language-server-grade symbol operations instead of…
Input/output guarding for LLM applications: validator library plus enforcement framework, with correction strategies when checks fail.
Role-based multi-agent orchestration: crews of agents with roles, goals, and tasks, optimized for approachability over control-flow…
Microsoft's agentic programming framework: conversation-based multi-agent patterns from the original research lineage, in transition toward…
A temporal knowledge-graph memory layer for agents: facts extracted from conversations with validity intervals, so recall can answer what…
An open-source memory platform that builds knowledge graphs plus embeddings from agent data, aiming at reasoning-grade recall rather than…
A multi-harness plugin marketplace of role-specialized subagents (reviewer, architect, security, docs) installable across Claude Code, Codex…
Local-first agent memory over plain Markdown files with an MCP interface: knowledge persists as human-readable notes the agent reads and…
An AI task-management loop that decomposes a spec into ordered, dependency-aware tasks and drives an agent through them one at a time across…
A large library of named, reusable prompt patterns with a CLI for piping content through them. Prompt-layer infrastructure: patterns without…
OpenAI's original eval framework and benchmark registry. Historically foundational; maintenance has visibly slowed as evaluation moved into…
A security toolkit for LLM interactions: scanners for prompt injection, PII, toxicity, and secrets, applied to inputs and outputs.
A defense-tech company's internally-maintained skill set, published. Notable for governance discipline: explicit boundaries, scripts treated…
A minimal three-file task loop for AI dev agents: create a PRD, generate a task list, then execute one task at a time with human check-ins.
The largest MCP server aggregator: thousands of community servers organized by category. A discovery surface for the tool layer, with…
A 1000+ entry aggregator of agent skills across Claude Code, Codex, Gemini CLI, and Cursor. Wide coverage, minimal curation signal.