Metadata-Version: 2.5
Name: mach-engine
Version: 0.1.2
Summary: Inference engine for Apple Silicon: serves Mach-1 packed checkpoints with fused decode-in-GEMV Metal kernels
Project-URL: Repository, https://github.com/SyzygyResearch/mach-engine
Project-URL: Documentation, https://withsyzygy.com/docs/mach
Project-URL: Issues, https://github.com/SyzygyResearch/mach-engine/issues
Author: Syzygy Research
License: Apache-2.0
License-File: LICENSE
License-File: NOTICE.md
Keywords: apple-silicon,huggingface,inference,llm,metal,mlx,quantization
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: MacOS
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.12
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Python: >=3.12
Requires-Dist: fastapi>=0.115
Requires-Dist: hf-transfer>=0.1
Requires-Dist: huggingface-hub>=0.24
Requires-Dist: ml-dtypes>=0.4
Requires-Dist: mlx>=0.20
Requires-Dist: numpy>=1.26
Requires-Dist: openai>=1.40
Requires-Dist: pillow>=10
Requires-Dist: pydantic>=2.8
Requires-Dist: safetensors>=0.4
Requires-Dist: sse-starlette>=2.1
Requires-Dist: tqdm>=4.66
Requires-Dist: transformers>=5.0
Requires-Dist: uvicorn[standard]>=0.32
Requires-Dist: xgrammar>=0.2
Requires-Dist: zstandard>=0.22
Provides-Extra: dev
Requires-Dist: httpx>=0.27; extra == 'dev'
Requires-Dist: lm-format-enforcer>=0.10; extra == 'dev'
Requires-Dist: mypy>=1.10; extra == 'dev'
Requires-Dist: pytest-asyncio>=0.24; extra == 'dev'
Requires-Dist: pytest>=8; extra == 'dev'
Requires-Dist: pyyaml>=6; extra == 'dev'
Requires-Dist: ruff<0.16,>=0.15; extra == 'dev'
Provides-Extra: dflash
Requires-Dist: dflash-mlx==0.1.7; extra == 'dflash'
Provides-Extra: grammar
Requires-Dist: lm-format-enforcer>=0.10; extra == 'grammar'
Requires-Dist: xgrammar>=0.2; extra == 'grammar'
Description-Content-Type: text/markdown

# mach

Run Mach-1 models on Apple Silicon.

```bash
pip install mach-engine
```

**Models** (downloaded automatically from HuggingFace on first use):

- [SyzygyResearch/Mach-1-Additive-35B](https://huggingface.co/SyzygyResearch/Mach-1-Additive-35B) — text, ~8.1 GB, fits 16 GB Macs
- [SyzygyResearch/Mach-1-Additive-35B-Multimodal](https://huggingface.co/SyzygyResearch/Mach-1-Additive-35B-Multimodal) — text + image input, ~9.0 GB

**Generate:**

```bash
mach generate SyzygyResearch/Mach-1-Additive-35B -p "Write a binary search in Python."
```

**Serve** an OpenAI- and Anthropic-compatible API on `http://127.0.0.1:8080/v1`:

```bash
mach serve SyzygyResearch/Mach-1-Additive-35B
```

Requires an Apple Silicon Mac (macOS) and Python 3.12+.

[Documentation](https://withsyzygy.com/docs/mach) · [Source](https://github.com/SyzygyResearch/mach-engine)
