Skip to content
Open
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -82,6 +82,7 @@ Collection of awesome Python resources for testing and generating test data.

## LLM & MCP Testing

- [agentest](https://github.com/srpadmanabhuni/agentest) - Offline, deterministic agentic evals for AI agents: 165 tests of OpenTelemetry GenAI traces, A2A AgentCards and MCP tool lists, with no LLM judge.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚪ Low · Testing tools appear out of order

When the section is expected to remain alphabetized, the agentest entry appears before agent-convergence-scorer, leaving the section out of alphabetical order for readers.

Move the agentest entry after agent-convergence-scorer.

Prompt for AI agents
In `README.md` at line 85:

**Testing tools appear out of order**

When the section is expected to remain alphabetized, the `agentest` entry appears before `agent-convergence-scorer`, leaving the section out of alphabetical order for readers.

Move the `agentest` entry after `agent-convergence-scorer`.

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 | Confidence: High

agent-convergence-scorer alphabetizes before agentest, so the addition breaks the requested ordering. The listing otherwise has the requested section and period-ending format.

Evidence: changed region in README.md; PR-head read of README.md.

- [agent-convergence-scorer](https://github.com/hermes-labs-ai/agent-convergence-scorer) - A CLI and Python library that scores how lexically similar N agent or LLM outputs are: exact-match rate, Jaccard token overlap, divergence point, and a composite convergence score over any list of runs. An eval primitive for measuring reproducibility and fan-out collapse. Zero deps.
- [mcp-server-fuzzer](https://github.com/Agent-Hellboy/mcp-server-fuzzer) - A comprehensive fuzzing tool designed specifically for testing Model Context Protocol (MCP) servers. It supports both tool argument fuzzing and protocol type fuzzing across multiple transport protocols.
- [mcpscore](https://github.com/mcp-box/mcpscore) - Audits a running MCP server and scores it 0-100 for protocol conformance, tool and schema quality, and security posture, with a suggested fix for every failed check. Deterministic, runs from the CLI or as a GitHub Action with SARIF output. MIT.
Expand Down