AI · Agents · Blockchain · Crypto

Submit a project Sign in

Menu

Directory category

Agent Evaluation & Observability

Test, trace and monitor AI agents, including task evaluation, tool calls and execution logs. Compare official resources, requirements and limitations.

50 projects

Directory results

Agent Evaluation & Observability projects

O Oceangym OceanGym is a Python research environment and benchmark for evaluating embodied underwater agents in simulated ocean scenes.

A AutoPenBench AutoPenBench is a Python code repository that benchmarks generative agents on penetration-testing tasks using vulnerable containers and provides instructions for developing new benchmark machines.

V Vllora Vllora is a self-hostable Rust server and web UI for tracing and debugging AI-agent interactions routed through an OpenAI-compatible chat-completions gateway.

R Rogue Rogue is a developer tool for evaluating and red-teaming AI agents.

O OpenClaw Agent Dashboard OpenClaw Agent Dashboard is a self-hosted Node.js web application for monitoring and managing OpenClaw agents.

A AgentPrism AgentPrism is an open-source TypeScript library of React components that converts supported agent trace data into hierarchical visual views for debugging, including LLM calls, tool executions and workflows.

H Harness Score Harness Score is a TypeScript command-line developer tool that evaluates the repository-level guidance, skills, hooks, feedback systems, CI and hygiene surrounding AI coding agents.

W Watch Skill Watch Skill is a Python developer tool that indexes video, audio and screen activity into searchable, timestamped evidence and checks results against deterministic contracts.