MemTrace: Tracing and Attributing Errors in Large Language Model Memory Systems

OpenAI Agents Tracing | Open-Source Tracing Dashboard including Costs & Usages

Evaluation of Multi-Agent Systems on Cloud Run with the GenAI Client in Vertex AI SDK

Local-first agent debugger with replay, failure memory, smart highlights, and drift detection.

Claude Code session capture and analysis. Trace tool calls, detect backtracks, analyze decisions, track edit chains, and measure plan drift. Local-first, zero-dependency observability.

Comprehensive agent analytics suite for AI agents built with the Google Agent Development Kit (ADK) , LangChain or other popular frameworks, powered by BigQuery Agent Analytics plugin and Grafana

Local replay debugger for Browser Use failures with screenshots, model I/O, failed-step timelines, and public-safe HTML exports.

Shared context substrate for AI agents. Retrieval that learns what's useful. Runs local or cloud.

Observability and governance SDK for AI Agents

tmam is an open-source observability platform that gives you deep, real-time visibility into your entire AI stack — from every LLM call and agent trace to GPU utilization and vector database performance.

AI coding agent observability and causal tracing for Claude Code, Codex CLI, OpenCode, and Python workflows

Homebrew tap for AgentTap - network-level AI agent observability

Capture and analyze Claude Code sessions locally to track every tool call, decision, and reasoning step without external dependencies.

Open-source evaluation framework for AI agents. Define test suites with rubrics, run your agent, get LLM-as-judge scores against criteria, inspect full execution traces, and diff runs to catch behavioral regressions.

Execution trace schema for AI agent pipelines.