secure-filesystem-server

npx -y @modelcontextprotocol/server-filesystem .
C
79.2/100
14 tools · agent gemini:gemini-flash-latest

Dimensions

Schema Health93.6 ×1
Description Quality (heuristic)100.0 ×1
Security Signals100.0 ×2
Agent Task Success35.0 ×3
Tool-Selection Accuracy100.0 ×1.5
Tool Reliability82.6 ×1
Robustness100.0 ×1

Agent evaluation

3 tasks × 2 repeat(s)  gemini:gemini-flash-latest
TaskPassScoreTools
Verify access to allowed directories using `list_allowed_directories`. Next, search for all JSON configuration files ins0/220100
Inspect all files in `/workspace/reports` using `list_directory_with_sizes`. Identify which file has the largest size in1/285100
Generate a recursive directory tree for `/workspace/project` using `directory_tree`, excluding temporary files and build0/20100
Excluded (possibly-mutating) tools: read_multiple_files, write_file, edit_file, create_directory, move_file

Findings

Schema Health
low
create_directory: property 'path' has no description
low
directory_tree: property 'excludePatterns' has no description
low
directory_tree: property 'path' has no description
low
edit_file: property 'edits' has no description
low
edit_file: property 'path' has no description
low
get_file_info: property 'path' has no description
low
list_directory: property 'path' has no description
low
list_directory_with_sizes: property 'path' has no description
low
move_file: property 'destination' has no description
low
move_file: property 'source' has no description
low
read_file: property 'path' has no description
low
read_media_file: property 'path' has no description
low
read_text_file: property 'path' has no description
low
search_files: property 'excludePatterns' has no description
low
search_files: property 'path' has no description
low
search_files: property 'pattern' has no description
low
write_file: property 'content' has no description
low
write_file: property 'path' has no description
Agent Task Success
medium
server: agent failed a task (0/2 passed) — tool errors blocked it (server signal)
Verify access to allowed directories using `list_allowed_directories`. Next, search for all JSON configuration files ins — The agent executed the required tool calls, but tool errors regarding directory permissions prevented it from accessing `/workspace/config/a
medium
server: agent failed a task (0/2 passed) — tool errors blocked it (server signal)
Generate a recursive directory tree for `/workspace/project` using `directory_tree`, excluding temporary files and build — The agent was unable to access `/workspace/project` due to path access restrictions and hit the maximum turn limit without completing the ta
low
server: agent failed a task (1/2 passed) — tool errors blocked it (server signal)
Inspect all files in `/workspace/reports` using `list_directory_with_sizes`. Identify which file has the largest size in — The agent correctly used `list_directory_with_sizes` and called `get_file_info` on the largest file (`reports/report.json`), but hit `max_tu
Tool Reliability
low
server: 8/46 agent tool calls returned an error