With MCP vs Source Text
A reproducible HDL understanding benchmark comparing deterministic source-file inspection against a launched local pyslang-mcp stdio server. Generated 2026-04-26T04:13:05+00:00.
Accuracy By Category
MCPText-only
MCP Latency By Case
| Case | Category | Difficulty | Expected | Text-only | MCP | MCP ms |
|---|
Methodology
The text-only side is intentionally limited to source and filelist reading with deterministic regex helpers. It represents what an agent can ground from visible text without compiler APIs. The MCP side launches the local server and answers through structured tool calls.