Metadata-Version: 2.4
Name: baremetalrt
Version: 0.5.1
Summary: BareMetalRT — edge GPU compute mesh
Author-email: "Bare Metal AI, Inc." <brian@baremetalrt.ai>
License: Copyright (c) 2025-2026 BareMetalRT. All rights reserved.
        
        This software and associated documentation files (the "Software") are the
        proprietary property of BareMetalRT. The Software is licensed, not sold.
        
        Permission is hereby granted to use the Software solely for personal,
        non-commercial evaluation purposes, subject to the following conditions:
        
        1. You may not copy, modify, merge, publish, distribute, sublicense, or sell
           copies of the Software.
        
        2. You may not use the Software for commercial purposes without a separate
           commercial license agreement from BareMetalRT.
        
        3. You may not reverse engineer, decompile, or disassemble the Software,
           except to the extent that such activity is expressly permitted by
           applicable law.
        
        4. You may not remove or alter any proprietary notices, labels, or marks
           on the Software.
        
        THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
        IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
        FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
        AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
        LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
        OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
        SOFTWARE.
        
        ---
        
        Note: The TensorRT-LLM submodule (engine/tensorrt-llm/) is licensed separately
        under NVIDIA's Apache License 2.0. See engine/tensorrt-llm/LICENSE for details.
        
Project-URL: Homepage, https://baremetalrt.ai
Project-URL: Repository, https://github.com/baremetalrt/baremetalrt
Project-URL: Documentation, https://baremetalrt.ai/docs
Requires-Python: >=3.10
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: httpx>=0.24.0
Dynamic: license-file

# BareMetalRT

**The world's first global GPU-native edge compute mesh.**

Intelligence shouldn't be owned by the hyperscalers alone. BareMetalRT turns the 200+ million NVIDIA GPUs running Windows into a distributed compute mesh — using NVIDIA's own TensorRT-LLM CUDA kernels, the same engine that powers cloud inference APIs. Built for the edge, not the cloud.

**[Download Installer](https://github.com/baremetalrt/baremetalrt/releases/latest)** | **[Live Demo](https://baremetalrt.ai/demo)** | **[Documentation](https://baremetalrt.ai/docs)**

## How It Works

1. **Install** the BareMetalRT daemon on each Windows machine with an NVIDIA GPU
2. **Connect** your GPU to your account at [baremetalrt.ai](https://baremetalrt.ai)
3. **Run inference** — the system automatically shards models across your available GPUs

```
┌──────────────────────────────────┐
│  baremetalrt.ai                  │
│  Auth, routing, OpenAI-compat API│
└──────────────┬───────────────────┘
               │ WebSocket
    ┌──────────┼──────────┐
    │          │          │
┌───▼───┐ ┌───▼───┐ ┌───▼───┐
│Node A │ │Node B │ │Node C │
│3090   │ │4060   │ │3060   │
│24GB   │ │8GB    │ │12GB   │
│Daemon │ │Daemon │ │Daemon │
└───────┘ └───────┘ └───────┘
```

## System Requirements

- Windows 10/11 (64-bit)
- NVIDIA GPU (RTX 2000+ recommended)
- CUDA Toolkit 12.4+
- TensorRT 10.15+

## Quick Start

### 1. Download and Install

Download the latest installer from [GitHub Releases](https://github.com/baremetalrt/baremetalrt/releases/latest) and run it. The installer will check for NVIDIA prerequisites and guide you through setup.

### 2. Connect Your GPU

Sign in at [baremetalrt.ai/app](https://baremetalrt.ai/app) and link your GPU using the one-click claim flow.

### 3. Chat

Use the web interface at [baremetalrt.ai/app](https://baremetalrt.ai/app) or connect any OpenAI-compatible client:

```bash
curl https://baremetalrt.ai/v1/chat/completions \
  -H "Authorization: Bearer bmrt_your_api_key" \
  -H "Content-Type: application/json" \
  -d '{"model": "mistral-7b", "messages": [{"role": "user", "content": "Hello!"}]}'
```

## What's in This Repo

This is the **public product repo** — the server, web UI, installer, and documentation.

```
baremetalrt/
├── server/        # FastAPI server (auth, chat relay, node management)
├── web/           # Product web app (chat UI, account, downloads)
├── site/          # Landing page and demo
├── installer/     # Windows installer (Inno Setup)
├── docs/          # Documentation
└── paper/         # Technical paper
```

The inference engine, transport layer, and daemon are in a separate private repository.

## API

BareMetalRT exposes an OpenAI-compatible API. See [API docs](https://baremetalrt.ai/docs) or the [API reference](docs/API.md).

## Current Status

**v0.5.1-beta** — [Changelog](CHANGELOG.md)

- Single-GPU and TP=2 multi-GPU inference on Windows
- Mistral 7B at 12.5 tok/s across heterogeneous GPUs over TCP
- Web chat UI with streaming
- Windows installer with one-click GPU claiming
- OpenAI-compatible API

## Security

Found a vulnerability? See [SECURITY.md](SECURITY.md) for our responsible disclosure policy.

## License

BareMetalRT is proprietary software. See [LICENSE](LICENSE) for terms.
