Concepts
The five primitives, the four replay modes, and the boundaries that keep NovaFabric local-first and CLI-first.
Five primitives
Asset Registry names every model, agent, prompt,
tool, dataset, evaluation, and deployment with name@version
identity. Promotion from development to production is gated by eval suites that pass or fail.
Run Capsule is a self-contained, schema-validated
record of one AI run: the command, every model call, every tool call, the environment, the assets
referenced. Stored as a directory under .novafabric/runs/.
Replay reconstructs a run under one of four modes with explicit guarantees. You always know what was real and what was reconstructed.
Lineage is the causation graph that links runs to the assets they consumed and the artifacts they produced — answers "what depended on what" without guesswork.
Evidence Bundle is the signed, portable proof of what happened: in-toto DSSE Statement v1, ed25519 signature, vendored schemas, a tamper-evident manifest hash.
Four replay modes
- exact — re-execute end-to-end. Available only for local models or fully containerized environments. Greyed out for remote LLMs because we will not pretend a remote API call is deterministic.
- mocked — re-execute the agent code, serve every model and tool call from the capsule's cache. Same control flow, same outputs, no network.
- semantic — re-execute, then a judge model compares meaning. Requires a judge model in real use. Useful for "did the meaning change?"
- forensic — no re-execution. Read-only inspection of what the capsule recorded. The audit mode.
Why local-first
AI runs accumulate sensitive data: prompts, intermediate reasoning, internal documents pulled by tools. Shipping that to a hosted service means signing a DPA, picking a region, paying per GB, waiting for a backup window when audit asks. NovaFabric keeps it on your machine until you choose otherwise. v0.7 adds an optional server mode for teams; v0.x stays single-machine.
Why CLI-first
Web UIs are expensive to build, maintain, and design well. They divert engineering effort from
the primitives. The CLI emits JSON; you can plug it into Grafana, Jaeger, Tempo, or a notebook.
A read-only browser viewer (nova serve) is planned
for v1.x — and this showcase site sets the visual bar so it doesn't get over-built.