secure-filesystem-server

npx -y @modelcontextprotocol/server-filesystem .
D
67.3/100
14 tools · agent gemini:gemini-flash-latest

Dimensions

Schema Health93.6 ×1
Description Quality (heuristic)100.0 ×1
Security Signals100.0 ×2
Agent Task Success0.0 ×3
Tool-Selection Accuracy83.3 ×1.5
Tool Reliability79.1 ×1
Response Safety (runtime)76.0 ×1
Robustness100.0 ×1

Agent evaluation

3 tasks × 2 repeat(s)  gemini:gemini-flash-latest
TaskPassScoreTools
Locate all Python script files (*.py) in the directory '/workspace/project' and read the file '/workspace/project/main.p0/2075
Check the allowed root directories using list_allowed_directories, then list the files in '/workspace/data' sorted by si0/20100
Search for all PNG image files in '/workspace/assets' matching pattern '*.png', and then load '/workspace/assets/logo.pn0/2075
Excluded (possibly-mutating) tools: read_multiple_files, write_file, edit_file, create_directory, directory_tree, move_file, get_file_info

Findings

Schema Health
low
create_directory: property 'path' has no description
low
directory_tree: property 'excludePatterns' has no description
low
directory_tree: property 'path' has no description
low
edit_file: property 'edits' has no description
low
edit_file: property 'path' has no description
low
get_file_info: property 'path' has no description
low
list_directory: property 'path' has no description
low
list_directory_with_sizes: property 'path' has no description
low
move_file: property 'destination' has no description
low
move_file: property 'source' has no description
low
read_file: property 'path' has no description
low
read_media_file: property 'path' has no description
low
read_text_file: property 'path' has no description
low
search_files: property 'excludePatterns' has no description
low
search_files: property 'path' has no description
low
search_files: property 'pattern' has no description
low
write_file: property 'content' has no description
low
write_file: property 'path' has no description
Agent Task Success
medium
server: agent failed a task (0/2 passed) — tool errors blocked it (server signal)
Locate all Python script files (*.py) in the directory '/workspace/project' and read the file '/workspace/project/main.p — The agent failed to search or read files in '/workspace/project' due to tool errors and never determined the port number.
medium
server: agent failed a task (0/2 passed) — tool errors blocked it (server signal)
Check the allowed root directories using list_allowed_directories, then list the files in '/workspace/data' sorted by si — The tool call to list files in '/workspace/data' errored due to access restrictions, so the agent was unable to list the directory or identi
medium
server: agent failed a task (0/2 passed) — tool errors blocked it (server signal)
Search for all PNG image files in '/workspace/assets' matching pattern '*.png', and then load '/workspace/assets/logo.pn — The agent failed to search the specified path due to a tool error and never executed read_media_file to load the PNG image and verify its MI
Tool-Selection Accuracy
low
server: agent did not call all expected tools
Locate all Python script files (*.py) in the directory '/workspace/project' and read the file '/workspace/project/main.p (expected search_files, read_text_file)
low
server: agent did not call all expected tools
Search for all PNG image files in '/workspace/assets' matching pattern '*.png', and then load '/workspace/assets/logo.pn (expected search_files, read_media_file)
Tool Reliability
medium
server: 9/43 agent tool calls returned an error
Response Safety (runtime)
medium
list_directory: tool output references sensitive files or secrets
[FILE] .env[FILE] .env.example[DIR] .gaun… (obfuscating characters removed)
medium
search_files: tool output references sensitive files or secrets
…ude\Breakthrough\mcp-gauntlet\.env.exampleC:\GenAI\Claude\Breakt… (obfuscating characters removed)