โšก Open Source ยท MIT ยท By eulogik

Better Than
Sakana AI Fugu

Fugusashi is an intelligent model router and multi-agent orchestrator. It automatically picks the best AI model for each prompt, learns from every request, runs entirely on your infrastructure โ€” and it's free.

โญ Star on GitHub Get Started โ†’ ๐Ÿ“ฆ PyPI

Features

Everything Fugu does, plus what it can't.

๐Ÿง 

Intelligent Routing

Three strategies โ€” similarity, cost, and fallback โ€” pick the best model for every prompt in under 20ms.

๐Ÿ”„

Feedback Loop

Learns from every request. Auto-retrains after every 10 requests. Gets smarter over time.

๐Ÿ”

Fully Transparent

Every routing decision is visible. No black box. See which model was picked and why.

๐Ÿ 

Self-Hosting

Run entirely on-premise with local models via Ollama. Air-gapped capable. No cloud dependency.

๐Ÿ“Š

Live Dashboard

Real-time web dashboard showing routing decisions, model usage, costs, and latency.

๐Ÿ”Œ

OpenAI-Compatible

Drop-in replacement for OpenAI API. Works with any OpenAI SDK. 100+ providers via LiteLLM.

Fugusashi vs Sakana AI Fugu

See why developers are switching to open source.

FeatureSakana FuguFugusashi
Model Routingโœ“ Proprietaryโœ“ Open & transparent
Multi-Agent Orchestrationโœ“ Fugu Ultraโœ“ Phase 2
Self-HostingโŒ Cloud-onlyโœ“ Local-first
Cost$5-30/M tokensโœ“ Free
TransparencyโŒ Black boxโœ“ Every decision visible
Feedback LoopโŒ Staticโœ“ Learns from every request
Model PoolโŒ Fixed by Sakanaโœ“ You control
Training DataโŒ Proprietaryโœ“ Community + your traffic
LicenseProprietaryโœ“ MIT

Architecture

Two tiers. One fast router. One deep orchestrator.

Application (OpenAI-compatible API)
    โ”‚
    โ–ผ
Tier 1: Router (CPU, <20ms)
  โ”œโ”€ SimilarityRouter โ€” learns from history
  โ”œโ”€ CostRouter โ€” capability + price
  โ””โ”€ EnsembleRouter โ€” priority chain
    โ”‚
    โ”œโ”€โ”€โ†’ Single Model Call
    โ”‚
    โ””โ”€โ”€โ†’ Tier 2: Orchestrator (Phase 2)
        โ”œโ”€ Planner model
        โ”œโ”€ Specialist models
        โ””โ”€ Synthesizer

Quickstart

Up and running in 5 minutes.

# Install from PyPI
pip install fugusashi

# Or from source
git clone https://github.com/eulogik/fugusashi.git
cd fugusashi
pip install -e .

# Run
fugusashi serve --config config.yaml

# Use
curl http://localhost:6060/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{"model":"auto","messages":[{"role":"user","content":"Say hello"}]}'

# Open dashboard
open http://localhost:6060/dashboard

Feedback Loop

The killer feature Fugu doesn't have.

๐Ÿง 
Route
โ†’
โšก
Execute
โ†’
๐Ÿ“Š
Evaluate
โ†’
๐Ÿ“š
Learn
โ†บ

Benchmarks

85%
Routing Accuracy
90%
Code Task Accuracy
<20ms
Routing Latency
100+
Supported Providers

Links

๐ŸŒ Website

eulogik.com

๐Ÿ“– This Site

eulogik.github.io/fugusashi