Monster Breach - Fabric Arcade

📋 Overview

Welcome, Data Engineer! The realm of Fabricia is under attack. The Corruption Horde is trying to destroy the sacred data flows that power the kingdom.

Your mission: build data pipelines to transport precious Data Crystals from source to destination, while defending against waves of data corruption monsters!

Each level teaches you a new Pipeline Activity. Master them all to face the Final Boss: The Corruption King and save Fabricia!

🎮 Gameplay

┌─────────────────────────────────────────────────────────────────┐
│                                                                  │
│   💎 SOURCE                                     🏆 DESTINATION   │
│      │                                               ▲          │
│      ▼                                               │          │
│   ┌──────┐    ┌──────┐    ┌──────┐    ┌──────┐    ┌──────┐     │
│   │COPY  │───▶│FILTER│───▶│TRANS │───▶│LOOKUP│───▶│ LOAD │     │
│   │  📦  │    │  🔍  │    │  ⚙️  │    │  📖  │    │  📥  │     │
│   └──────┘    └──────┘    └──────┘    └──────┘    └──────┘     │
│                    │            │                               │
│                    │            │                               │
│              🐛 NULL BUG    👻 DUPLICATE                       │
│               attacking!       GHOST!                           │
│                                                                  │
│   ❤️❤️❤️  Lives: 3        💎 Crystals: 847/1000                 │
│   ⚡ 12    Pipeline Power   🏆 Level 4: Transform Temple        │
│                                                                  │
└─────────────────────────────────────────────────────────────────┘

🔧 Pipeline Activities (Your Tools)

Build your pipeline by placing activities. Each has a unique power:

📦

Copy Activity

Extract data from source

🔍

Filter Activity

Remove invalid rows

⚙️

Dataflow Activity

Transform data

📖

Lookup Activity

Enrich with reference data

🔄

ForEach Activity

Process multiple batches

❓

If Condition

Branch based on logic

🔀

Switch Activity

Multiple path routing

🛡️

Retry Policy

Auto-recover from errors

🐉 The Corruption Horde (Enemies)

These monsters attack your pipeline and corrupt your data:

🐛

Null Bug

Common • Wave 1+

Attack

Injects NULL values into your data

Counter

Filter Activity (remove nulls)

👻

Duplicate Ghost

Common • Wave 2+

Attack

Creates duplicate rows

Counter

Dataflow with Distinct

🔥

Schema Dragon

Rare • Wave 4+

Attack

Changes column types randomly

Counter

Schema Mapping activity

💀

Timeout Skeleton

Uncommon • Wave 3+

Attack

Slows pipeline to a crawl

Counter

Retry Policy + Timeout config

🌀

Infinite Loop Wraith

Rare • Wave 5+

Attack

Creates circular dependencies

Counter

ForEach with batch limits

☠️

Deadlock Demon

Elite • Wave 6+

Attack

Freezes entire pipeline

Counter

Sequential execution mode

🗺️ Campaign: The 8 Realms

Level 1

Tutorial Valley

Learn the basics: Copy Activity and simple source→destination flow

Level 2

Filter Forest

Face Null Bugs! Master the Filter Activity to clean your data

Level 3

Transform Temple

Duplicate Ghosts appear! Use Dataflow transformations

Level 4

Lookup Lagoon

Enrich data with Lookup Activity, face Schema Dragons

Level 5

Parallel Plains

Master ForEach loops to process massive data volumes

Level 6

Conditional Caves

If/Switch activities for complex branching logic

Level 7

Error Highlands

Timeout Skeletons attack! Configure retry policies and error handling

Level 8

Corruption Citadel

The Final Boss awaits...

👑 Final Challenge: The Corruption King

👑

THE CORRUPTION KING

Lord of Data Chaos • Final Boss • Level 8

10,000

HP

5

Phases

ALL

Monster Types

∞

Corruption Power

💀 Attack Pattern

Phase 1: Null Storm

Spawns waves of Null Bugs from all directions. Must filter constantly!
Phase 2: Schema Shift

Changes your pipeline schema every 30 seconds. Adapt or die!
Phase 3: Infinite Recursion

Creates loop dependencies. Break the cycle with proper ForEach limits!
Phase 4: Total Corruption

ALL monster types attack simultaneously. Use everything you've learned!
Phase 5: King's Wrath

Disables random activities. Build redundant pipelines to survive!

🛡️ How to Defeat

You must build a Master Pipeline that combines ALL activities you've learned:

SOURCE → COPY → FILTER → DATAFLOW → FOREACH ─┬─→ IF TRUE  → LOOKUP → SINK
                                              │
                                              └─→ IF FALSE → RETRY  → SINK

+ Error Handling on EVERY activity
+ Retry Policy: 3 attempts, exponential backoff
+ Timeout: 30 seconds per activity
+ Parallel execution where safe

🏆 Defeat the King to earn the title: Master Data Engineer

📊 Telemetry Events → Eventhouse

Every action generates real-time events for analytics:

PipelineStarted ActivityPlaced ActivityConnected CrystalProcessed MonsterSpawned MonsterDefeated DataCorrupted PipelineFailed LevelCompleted BossPhaseStarted BossDefeated GameCompleted

🔧 Workloads

Data Factory Real-Time Intelligence

📦 Fabric Items Deployed

🔄 Data Pipeline QuestPipeline

📊 Dataflow Gen2 QuestTransforms

🏠 Eventhouse QuestEventhouse

🌊 Eventstream QuestStream

📓 Notebook Quest_DataPipeline

🏢 Lakehouse QuestLakehouse

🎓 What You'll Learn

Skill	Fabric Feature	Level
Copy data between sources	Copy Activity	⭐
Filter and clean data	Filter Activity	⭐
Transform with Dataflow	Dataflow Gen2	⭐⭐
Enrich with lookups	Lookup Activity	⭐⭐
Parallel processing	ForEach Activity	⭐⭐
Conditional logic	If Condition / Switch	⭐⭐⭐
Error handling	Retry Policy / On Failure	⭐⭐⭐
Pipeline orchestration	Execute Pipeline	⭐⭐⭐

🎯 Scenarios

ETL/ELT Data Orchestration Error Handling Tower Defense

🚀 Quick Start

Coming soon! This game is currently in development.

# Coming in v0.2.0
from fabric_arcade import arcade

arcade.install("quest-data-pipeline")

Want to be notified? ⭐ Star the repo to get updates!