good-fixture
python -m mcp_gauntlet.fixtures.good_server
A
99.4/100
3 tools · agent gemini:gemini-flash-latest
Dimensions
Schema Health93.3 ×1
Description Quality (heuristic)100.0 ×1
Security Signals100.0 ×2
Agent Task Success100.0 ×3
Tool-Selection Accuracy100.0 ×1.5
Tool Reliability100.0 ×1
Robustness100.0 ×1
Agent evaluation
2 tasks × 2 repeat(s) gemini:gemini-flash-latest
| Task | Pass | Score | Tools |
|---|
| The user wants to know the result of adding 5 and 7, and then have the string 'Hello World' echoed back. The agent shoul | 2/2 | 100 | 100 |
| The user wants to reverse the string 'abcdefg'. The agent should use the reverse tool with text='abcdefg'. | 2/2 | 100 | 100 |
Findings
Schema Health
lowadd: property 'a' has no description
lowadd: property 'b' has no description
lowecho: property 'message' has no description
lowreverse: property 'text' has no description