Metadata-Version: 2.1
Name: qann
Version: 0.1.0a25
Summary: Fast nearest-neighbor vector search for Python: exact, IVF, HNSW and quantized indexes for dense vectors, inverted indexes for sparse vectors, with metadata filters, implemented in C++
Keywords: ann,vector search,nearest neighbors,product quantization,scalar quantization,ivf,hnsw,sparse vectors,bm25,splade,filtered search
Author: Maximilian Miller
License: MIT License
         
         Copyright (c) 2026 Maximilian Miller
         
         Permission is hereby granted, free of charge, to any person obtaining a copy
         of this software and associated documentation files (the "Software"), to deal
         in the Software without restriction, including without limitation the rights
         to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
         copies of the Software, and to permit persons to whom the Software is
         furnished to do so, subject to the following conditions:
         
         The above copyright notice and this permission notice shall be included in all
         copies or substantial portions of the Software.
         
         THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
         IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
         FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
         AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
         LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
         OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
         SOFTWARE.
         
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Science/Research
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: MacOS
Classifier: Operating System :: POSIX :: Linux
Classifier: Programming Language :: C++
Classifier: Programming Language :: Python :: 3
Classifier: Topic :: Scientific/Engineering :: Information Analysis
Classifier: Typing :: Typed
Project-URL: Homepage, https://github.com/maxtmiller/qann
Project-URL: Source, https://github.com/maxtmiller/qann
Project-URL: Issues, https://github.com/maxtmiller/qann/issues
Requires-Python: >=3.10
Requires-Dist: numpy
Provides-Extra: bench
Requires-Dist: matplotlib; extra == "bench"
Provides-Extra: test
Requires-Dist: pytest; extra == "test"
Requires-Dist: scipy; extra == "test"
Description-Content-Type: text/markdown

# QaNN

QaNN (**Q**uantized **N**earest **N**eighbors) is a Python library for fast nearest-neighbor search, written in multithreaded, SIMD-accelerated C++ and driven from NumPy and SciPy.

- **Dense vectors:** exact search, IVF and HNSW graph search, product and scalar quantization, exact re-ranking.
- **Sparse vectors** (BM25, SPLADE): exact and approximate inverted-index search.
- **Every index:** custom ids, deletion, metadata filters, saving and loading.

> **Alpha:** under active development. The API may change between releases.

## Install

```bash
pip install qann
pip install scipy   # only for the sparse indexes
```

- Wheels: Linux (x86_64, aarch64) and macOS (Apple Silicon, Intel), Python 3.10 to 3.14. x86_64 needs AVX2 and FMA.
- From source: `pip install .` in a checkout. Needs CMake 3.20+, a C++20 compiler and, on Linux, optionally OpenBLAS (much faster training).

## Quick start

```python
import numpy as np, qann

x = np.random.rand(100_000, 128).astype(np.float32)

ivf = qann.IVFIndex(128, nlist=1024, nprobe=16)
ivf.enable_pq(16)                           # store each vector in 16 bytes
ivf.train(x, seed=1)
index = qann.RefineIndex(ivf, k_factor=10)  # re-rank PQ candidates exactly
index.add(x)

ids, dists = index.batch_query(x[:5], 10)   # both shaped (5, 10)
```

## Conventions

- **Vectors** are 2D NumPy arrays of shape `(n, dim)`; single vectors (`query`) are `(dim,)`. float32 C-contiguous arrays are used without copying; anything else is converted first.
- **Ids** count up from 0 in insertion order, unless the index uses [custom ids](#custom-ids-and-deleting).
- **Distances** are smallest first: squared L2 by default, or cosine distance / negative inner product with another [metric](#metrics).
- **Results** from `batch_query` are an `int64` id array and a `float32` distance array, both `(num_queries, k)`. Missing hits are padded with id `-1` and distance `inf`.

## Indexes

Indexes come in two families, with one class per search algorithm:

| | Dense vectors (`qann.DenseIndex`) | Sparse vectors (`qann.SparseIndex`) |
| --- | --- | --- |
| Exact | `FlatIndex` | `InvertedIndex` |
| Approximate | `IVFIndex`, `HNSWIndex`, `RefineIndex` (exact re-ranking of either) | `SparseApproxIndex` |

- The algorithm is fixed when an index is created. Search settings such as `nprobe` or `ef_search` are properties you can change at any time. To switch type, rebuild: `new.add(old.get_vectors(old.ids()), ids=old.ids())` (ids only if `new` uses custom ids).
- Ids, deletion, metadata, filters and saving work the same in both families (`qann.IndexBase`).
- `qann.Index` is the old name of `qann.DenseIndex` and still works.
- `HybridIndex` combines a dense and a sparse index over the same documents; see [Hybrid search](#hybrid-search).

Methods every dense index has (sparse indexes take `scipy.sparse` matrices instead and have no `dim`):

| Method | Description |
| --- | --- |
| `add(data, ids=None, *, metadata=None)` | Add an `(n, dim)` array, plus ids if the index uses custom ids and optional [metadata](#metadata). Returns the ids. |
| `batch_query(queries, k, *, allowed=None, where=None)` | k nearest neighbors per row, in parallel. Returns `(ids, dists)`. See [Filtered search](#filtered-search) for `allowed` and `where`. |
| `query(query, k, *, allowed=None, where=None)` | k nearest neighbors of one `(dim,)` vector. Returns 1D `(ids, dists)`. |
| `remove(ids)` | Delete vectors by id. Returns how many were deleted. |
| `compact()` | Free the memory of deleted vectors. Returns how many were freed. |
| `size()`, `dim()` | Number of (non-deleted) vectors; vector dimension. |
| `ids()` | Every live id, ascending (sparse indexes too). |
| `get_vectors(ids)` | Copies of the stored vectors, `(n, dim)`, in the order given. Not on PQ or SQ indexes, which keep only codes (`stores_vectors` is `False`); a `RefineIndex` over them works. With `Cosine` they come back unit-length. |
| `save(path)` | Save to a file; see [Saving and loading](#saving-and-loading). |
| `metadata_schema`, `get_metadata`, `update_metadata`, `add_metadata_column`, `drop_metadata_column` | See [Metadata](#metadata). |

Which to pick: `FlatIndex` up to a few hundred thousand vectors; IVF + fast-scan + `RefineIndex` when you can train on representative data and build time matters; HNSW when you can't train up front or new kinds of vectors keep arriving. Benchmark on your own data; [measurements](https://github.com/maxtmiller/qann/blob/main/ARCHITECTURE.md#choosing-an-index).

### `FlatIndex(dim, *, custom_ids=False)`

Exact brute-force search: no training, 100% recall, cost linear in the number of vectors. Also useful as ground truth when measuring recall.

```python
index = qann.FlatIndex(128)
index.add(x)
ids, dists = index.batch_query(x[:10], 10)
```

### `IVFIndex(dim, nlist, nprobe=10, *, custom_ids=False)`

Clusters vectors into `nlist` lists with k-means, and scans only the `nprobe` lists nearest each query.

| Member | Description |
| --- | --- |
| `train(data, max_iters=25, seed=None)` | Learn the centroids from at least `nlist` vectors. Call once, before `add`. |
| `enable_pq(num_subspaces, centroids_per_subspace=None, *, fast_scan=False, rotate=False)` | Compress vectors with [product quantization](#product-quantization). Call before `train`. |
| `enable_sq(bits=8)` | Store 8 or 4 bits per dimension instead of floats ([SQ](#sq)). Call before `train`; not with PQ. |
| `nprobe` | Lists scanned per query: higher is slower and more accurate. |
| `pq_distance` | `qann.PQDistance.ADC` (default, more accurate) or `SDC`. |
| `precomputed_tables` | Lookup tables built at train time that speed up PQ queries. On by default; `False` frees them. |
| `fast_scan`, `sq_bits` | Read-only: the compression in use. |

- `nlist` must be 100 to 65535. Start with `nlist` around `sqrt(n)` to `4 * sqrt(n)`, and `nprobe` at 1% to 5% of `nlist`.
- **With PQ**, each vector is split into `num_subspaces` slices stored as one byte each: a 128-dim vector (512 bytes) with 16 subspaces takes 16 bytes. `dim` must divide evenly. Distances become approximate; wrap the index in a `RefineIndex` to recover recall.

```python
ivf = qann.IVFIndex(128, nlist=1024, nprobe=16)
ivf.enable_pq(16)
ivf.train(x, seed=1)
ivf.add(x)
ivf.nprobe = 32   # trade speed for recall
```

#### Fast-scan

`enable_pq(num_subspaces, fast_scan=True)` stores 4 bits per slice and scores 32 vectors per SIMD lookup, about 6x faster than regular PQ. Use twice the subspaces you would with regular PQ, and pair it with a `RefineIndex`:

```python
ivf = qann.IVFIndex(128, nlist=1024, nprobe=16)
ivf.enable_pq(64, fast_scan=True)          # 64 x 4 bits = 32 bytes per vector
ivf.train(x, seed=1)
refine = qann.RefineIndex(ivf, k_factor=16)
refine.add(x)
```

- `num_subspaces` must be even and at most 1024. `pq_distance` must stay `ADC`.
- Without a `RefineIndex`, recall is lower and distances are approximate.

#### Rotation

`enable_pq(..., rotate=True)` also learns a rotation that spreads information evenly over the subspaces. It helps when dimensions are correlated (SIFT: noticeably higher recall before re-ranking) and does nothing when they aren't (GloVe). Results stay valid either way. Measure on your data.

#### SQ

`enable_sq(8)` stores one byte per dimension (a quarter of the floats' memory) and `enable_sq(4)` half a byte. 8 bits loses little recall and needs no `RefineIndex`; 4 bits should be wrapped in `RefineIndex(k_factor=8)`.

```python
ivf = qann.IVFIndex(128, nlist=1024, nprobe=16)
ivf.enable_sq(8)
ivf.train(x, seed=1)
ivf.add(x)
```

[Fast-scan, rotation and SQ measurements](https://github.com/maxtmiller/qann/blob/main/ARCHITECTURE.md#ivf-fast-scan-rotation-and-sq).

### `HNSWIndex(dim, M=16, ef_construction=200, *, custom_ids=False, seed=None)`

A graph index: each vector links to `M` near neighbors, and a query walks the graph toward its target. No training, exact distances, builds on all cores; it uses more memory per vector and adds more slowly than IVF.

| Member | Description |
| --- | --- |
| `ef_search` | Candidates kept while searching (default 64): higher is slower and more accurate. |
| `M`, `ef_construction` | Read-only: the build settings. Higher builds a better graph, more slowly. |
| `enable_sq(bits=8)`, `train(x)` | Store 8- or 4-bit codes instead of floats. Call `enable_sq`, then `train` on a representative sample, before `add`. |
| `sq_bits` | Read-only: 8 or 4 with SQ, else 0. |

```python
index = qann.HNSWIndex(128, M=16, ef_construction=200)
index.add(x)
index.ef_search = 128   # trade speed for recall
ids, dists = index.batch_query(q, 10)
```

- **`M`:** 16 suits data like SIFT. For text embeddings use `M=32` to `48` with `ef_construction=300` to `400`.
- **Deleting** hides vectors from results. `compact()` rebuilds the graph, so call it after many deletes, not each one.
- **Reproducible builds** need `seed` and `qann.set_num_threads(1)`; parallel builds differ slightly run to run.
- **SQ:** wrap in a `RefineIndex`. `k_factor=2` is enough for 8 bits; 4 bits needs 4 to 8.

```python
index = qann.HNSWIndex(128)
index.enable_sq(8)
index.train(x)
refine = qann.RefineIndex(index, k_factor=2)
refine.add(x)
```

[HNSW measurements](https://github.com/maxtmiller/qann/blob/main/ARCHITECTURE.md#hnsw-m-deletes-and-sq).

### `RefineIndex(base, k_factor=10, *, custom_ids=False)`

Fetches `k * k_factor` candidates from an approximate `base`, then re-ranks them by exact distance using full copies of the vectors. This is the usual way to get PQ or SQ speed with near-exact ranking.

- `base` must be trained, empty, without custom ids and never compacted. Give the `RefineIndex` its own `custom_ids` instead.
- Add, remove and compact through the `RefineIndex`. Doing it on the base raises `ValueError`.
- Tune the base through the `base` property, e.g. `refine.base.nprobe = 32`. `k_factor` can change at any time.

### `InvertedIndex(*, custom_ids=False)`

Exact search over sparse vectors: BM25 weights or learned sparse vectors such as SPLADE, as `scipy.sparse` matrices (a column is a term id). Scores by dot product: distance is `-(q . d)`, largest dot product first.

```python
import scipy.sparse as sp

index = qann.InvertedIndex()
index.add(doc_matrix, metadata={"lang": langs})             # (n_docs, vocab) CSR
ids, dists = index.batch_query(query_matrix, 10, where="lang = 'en'")
ids, dists = index.query(query_matrix[[0]], 10)             # one row
```

- **Input:** any `scipy.sparse` matrix or array; term ids below 2^32. Duplicate entries in a row are summed, zeros dropped.
- **Results:** only documents sharing a term with the query come back, so a row can have fewer than `k`.
- **Pruning** (`pruning`, on by default) skips work that can't change the top `k`. Results are identical either way; it helps most at small `k`.
- **Size:** `terms` and `postings` count distinct terms and stored entries (8 bytes each).

### `SparseApproxIndex(*, custom_ids=False, query_terms=10, list_depth=10000, k_factor=10)`

Approximate sparse search for queries with many terms, such as SPLADE's. Same input and features as `InvertedIndex`, about twice its memory.

```python
index = qann.SparseApproxIndex()
index.add(doc_matrix)
ids, dists = index.batch_query(query_matrix, 10)
index.list_depth = 2000          # faster, lower recall
```

- A query uses its `query_terms` largest values, reads the `list_depth` heaviest entries of those terms, and re-scores the best `k * k_factor` exactly. `0` means all.
- Returned distances are exact; only which documents are found is approximate.
- The defaults reached 0.96 recall@10 at about 14x the speed of exact search on 1M SPLADE passages. [Measurements](https://github.com/maxtmiller/qann/blob/main/ARCHITECTURE.md#sparse-indexes).

### `make_index(type, dim, opts=IndexOptions())`

Builds any index from a type and an options object:

```python
opts = qann.IndexOptions()
opts.nlist, opts.nprobe, opts.pq_subspaces = 1024, 16, 16
ivf = qann.make_index(qann.IndexType.IVF, 128, opts)
```

`IndexType` is `Flat`, `IVF`, `HNSW`, `Inverted` or `SparseApprox` (sparse types ignore `dim`; pass 0). `IndexOptions` fields and defaults:

| For | Fields |
| --- | --- |
| all | `custom_ids` (False), `metric` (L2, dense only) |
| Flat | `capacity` (1024) |
| IVF | `nlist` (100), `nprobe` (10), `pq_subspaces` (0 = no PQ), `pq_centroids` (256), `ivf_sq_bits` (0) |
| HNSW | `hnsw_m` (16), `ef_construction` (200), `ef_search` (64), `hnsw_sq_bits` (0) |
| Inverted | `pruning` (True) |
| SparseApprox | `query_terms` (10), `list_depth` (10000), `k_factor` (10) |

## Metrics

Dense indexes take `metric=qann.Metric.L2` (default), `Cosine` or `InnerProduct`, fixed at construction, saved with the index and reported by `index.metric`. They work with every dense index and compression.

```python
index = qann.HNSWIndex(384, metric=qann.Metric.Cosine)
index.add(embeddings)
ids, dists = index.batch_query(query_embeddings, 10)   # dists = 1 - cosine similarity
```

- **Cosine** suits most text and image embeddings. Distance is `1 - cosine similarity` (0 to 2). Vectors are normalized for you; a zero vector raises `ValueError`.

### Inner product

Use `InnerProduct` when vector length matters: recommendation factors, multi-vector retrieval (ColBERT, MUVERA), models trained with a dot-product loss.

```python
index = qann.HNSWIndex(64, metric=qann.Metric.InnerProduct)
index.add(item_factors)
ids, dists = index.batch_query(user_factors, 10)   # dists = -(q . x)
```

- Distance is `-(q . x)`, so results stay smallest first. Nothing is normalized.
- PQ must use `ADC`, and `precomputed_tables` reads `False` (not needed).
- HNSW links its graph with a transform that makes inner product search work far better than linking by raw dot product. [Measurements](https://github.com/maxtmiller/qann/blob/main/ARCHITECTURE.md#inner-product).

## Custom ids and deleting

Create an index with `custom_ids=True` to use your own ids (database keys, document ids):

```python
index = qann.FlatIndex(128, custom_ids=True)
index.add(vectors, ids=doc_ids)               # one int per row
ids, dists = index.batch_query(queries, 10)   # ids are your doc_ids
index.remove([doc_ids[0], doc_ids[1]])        # returns 2
```

- **Ids** can be any integer array, list or `range`. They must be `>= 0` and unique; a bad batch adds nothing. Every add must pass them.
- **`remove`** skips unknown and already deleted ids. A deleted id can be added again.
- **`compact()`** frees deleted vectors' memory and keeps ids and results unchanged (HNSW rebuilds its graph, so its results can shift slightly). Call it after a large batch of deletes.
- **Default ids never repeat,** even after deletes and `compact()`. Keep the ids `add()` returns, or use custom ids for data that changes.

## Filtered search

To search only some vectors, pass the ids that may be returned as `allowed`, or filter on stored [metadata](#metadata) with `where`:

```python
in_stock = product_ids[stock > 0]
ids, dists = index.batch_query(queries, 10, allowed=in_stock)
```

- **Filtering happens during the search,** so a selective filter still returns `k` results when that many match.
- **Works on every index,** with recall close to unfiltered search. Very narrow filters switch to scoring the allowed vectors directly, which is exact.
- **Unknown and deleted ids in `allowed` are ignored.** One set applies to every row of a `batch_query`.
- **Tuning:** `HNSWIndex.filter_ef_scaling` and `IVFIndex.filter_probe_scaling` (both on, not saved) keep filtered recall near unfiltered. Turn them off for faster queries when filtered recall is already high on your data.

[How each index filters, and measurements](https://github.com/maxtmiller/qann/blob/main/ARCHITECTURE.md#filtered-search).

## Metadata

Store attributes with each vector and filter on them:

```python
index.add(vectors, metadata={"category": categories, "price": prices, "year": years})

f = qann.field
ids, dists = index.batch_query(queries, 10, where=(f("category") == "shoes") & (f("price") < 50))
ids, dists = index.batch_query(queries, 10, where=f("year").isin([2024, 2025]) | f("price").is_null())

# or as a SQL WHERE clause, with values passed separately
ids, dists = index.batch_query(queries, 10, where="category = 'shoes' AND price < 50")
ids, dists = index.batch_query(queries, 10, where=("user_id = ? AND year IN (?, ?)", [uid, 2024, 2025]))
```

- **Columns** hold ints, floats or strings, one value per vector. `None` is a null, and so is any column an add leaves out.
- **Nulls** fail every comparison. Use `f("price").is_null()` to select them. SQL's `NOT` excludes nulls; `~` includes them.
- **`qann.field` operators:** `==`, `!=`, `<`, `<=`, `>`, `>=`, `.isin([...])`, `.between(lo, hi)`, `.is_null()`, combined with `&`, `|`, `~`.
  - Parenthesize comparisons: `(f("a") < 1) & (f("b") == 2)`.
  - Python's `and` / `or` / `not` raise `TypeError`.
  - For long chains use `qann.any_of(...)` / `qann.all_of(...)`.
- **SQL:** comparisons, `[NOT] IN`, `IS [NOT] NULL`, `[NOT] BETWEEN`, `AND`, `OR`, `NOT` and parentheses. Bad syntax raises `ValueError`.
- **Parameters:** pass values as `(sql, [values])` for `?` or `(sql, {name: value})` for `:name`, never pasted into the string. `qann.where(sql, params)` returns a reusable filter.
- **Combining:** with both `where` and `allowed`, results must pass both.

Reading and changing metadata:

| Call | Does |
| --- | --- |
| `get_metadata(ids, columns=None)` | `{name: values}`, one value per id. Numbers come back as NumPy masked arrays (masked = null), strings as lists with `None`. |
| `update_metadata(ids, {"price": [10, None]})` | Overwrites those columns for those vectors in place. |
| `add_metadata_column(name, type, *, default=None, ids=None, values=None)` | New column (`'int'`, `'float'` or `'str'`): all `default`, or `values` for `ids` and null elsewhere. |
| `drop_metadata_column(name)` | Removes a column. |
| `metadata_schema` | Each column's name and type. |

Unknown, deleted or repeated ids raise `ValueError`. Metadata stays with its vector through `remove`, `compact`, `save` and `load`. [Types, SQL limits and costs](https://github.com/maxtmiller/qann/blob/main/ARCHITECTURE.md#metadata).

## Hybrid search

Dense and sparse retrievers miss different things: embeddings find paraphrases, keyword weights (BM25, SPLADE) find exact rare terms. A `HybridIndex` holds both representations of every document, searches both and fuses the rankings:

```python
dense = qann.HNSWIndex(384, metric=qann.Metric.Cosine)
sparse = qann.InvertedIndex()
hybrid = qann.HybridIndex(dense, sparse, custom_ids=True)

hybrid.add(embeddings, bm25_matrix, ids=doc_ids)          # row i of each is document doc_ids[i]
ids, scores = hybrid.batch_query(q_embeddings, q_bm25, 10, where="lang = 'en'")   # highest score first
```

- **One index, one set of ids.** The `HybridIndex` keeps the ids and metadata, and both parts stay aligned because only it changes them. `add` checks both representations first, so a bad row adds nothing anywhere. `remove`, `compact`, `save` and `qann.load` cover both parts.
- **Parts:** any empty dense index (trained, if it needs it; a `RefineIndex` works too) and any empty sparse index, neither with custom ids. Tune them through `hybrid.dense` and `hybrid.sparse` (e.g. `hybrid.dense.ef_search = 128`). Adding to them directly raises `ValueError`.
- **Fusion settings,** saved with the index:
  - `method`: `"linear"` (default) or `"rrf"`, as in `qann.fuse` below.
  - `weights`: `(dense, sparse)`, default `(1, 1)`.
  - `rrf_k`: default 60.
  - `depth_factor`: each side fetches `k * depth_factor` results before fusing, default 5.
- **Results** are `(ids, scores)`: fusion scores, higher is better, padded with `-1` / `0`. `query` takes one `(dim,)` vector and a one-row sparse matrix.
- **Measured on BEIR,** the default (linear, equal weights) beat RRF on every dataset and model tried, and beat the better single retriever in most; tuned weights added up to +0.05 nDCG@10. [Results](https://github.com/maxtmiller/qann/blob/main/ARCHITECTURE.md#hybrid-search).

**Tuning the weights.** The best `(dense, sparse)` weights depend on your data and models: when one side is much weaker, give it less weight. With a few dozen queries whose relevant documents you know, try a few settings and keep the best:

```python
def hit_rate(hybrid, q_dense, q_sparse, relevant, k=10):    # relevant: one set of doc ids per query
    ids, _ = hybrid.batch_query(q_dense, q_sparse, k)
    return np.mean([len(set(row) & rel) > 0 for row, rel in zip(ids, relevant)])

scores = {}
for w in [(1, 0.25), (1, 0.5), (1, 1), (0.5, 1)]:
    hybrid.weights = w
    scores[w] = hit_rate(hybrid, q_dense, q_sparse, relevant)
hybrid.weights = max(scores, key=scores.get)               # saved with the index
```

Any ranking metric works (hit rate, recall, nDCG); hold back some labeled queries to check the choice. `benchmarks/hybrid_beir.py` does this on BEIR.

**Fusing results yourself:** `qann.fuse(results, *, method="rrf", k=60, weights=None, limit=10)` merges any ranked lists, for example several dense models or results from another search engine:

```python
d = dense_a.batch_query(q_a, 50)              # fetch several times what you need
s = dense_b.batch_query(q_b, 50)
ids, scores = qann.fuse([d, s], limit=10)
```

- `"rrf"` (reciprocal rank fusion, the default): each id scores `weight / (k + rank)` in every list that has it. Only ranks count, so scores on different scales never need comparing: the safe choice.
- `"linear"`: each list's distances are rescaled per query to 1 (nearest) down to 0 (farthest returned), then summed with `weights`. With weights tuned on a few labeled queries it usually beats `"rrf"`.
- Inputs are `query` or `batch_query` results, all 1D or all 2D (`"rrf"` also takes plain id arrays). Ids must mean the same document in every list.

## Saving and loading

```python
index.save("vectors.qann")          # str or pathlib.Path
index = qann.load("vectors.qann")   # returns the saved class, e.g. IVFIndex or InvertedIndex
```

- **Everything is restored:** vectors, ids, deletions, training, graphs, metadata, the metric and settings. A loaded index gives identical results and keeps accepting adds.
- **A `RefineIndex` file includes its base.** Tune it through `loaded.base`.
- **Larger than RAM:** `qann.load(path, mmap=True)` leaves a `RefineIndex`'s raw vectors in the file and reads only the ones queries re-rank, so only the compressed base, ids and metadata take memory. Results are identical; keep the file in place while the index is open. [Details](https://github.com/maxtmiller/qann/blob/main/ARCHITECTURE.md#saving-and-loading).
- **Safe:** an interrupted save never leaves a partial file, and a corrupt or foreign file raises `RuntimeError`.
- **Versioned:** newer releases load files from older ones. [Details](https://github.com/maxtmiller/qann/blob/main/ARCHITECTURE.md#saving-and-loading).

`PQCodebook` on its own can't be saved yet; save the `IVFIndex` that uses it.

## Product quantization

`PQCodebook(dim, num_subspaces, centroids_per_subspace=256)` is the quantizer inside `IVFIndex`, for direct use:

| Method | Description |
| --- | --- |
| `train(data, max_iters=25, seed=None)` | k-means in each subspace over an `(n, dim)` array. |
| `encode(vec)` | A `(dim,)` vector to `num_subspaces` `uint8` codes. |
| `compute_adc_table(query)` | Distances from a `(dim,)` query to every centroid, reusable across codes. |
| `distance_adc(table, code)` | Approximate squared L2 between the table's query and a code. |
| `distance_sdc(query_code, code)` | Approximate squared L2 between two codes. |
| `dim()`, `num_subspaces()`, `centroids_per_subspace()` | Shape of the codebook. |

```python
pq = qann.PQCodebook(128, 16)
pq.train(x, seed=1)
codes = [pq.encode(v) for v in x[:1000]]
table = pq.compute_adc_table(x[0])
dists = [pq.distance_adc(table, c) for c in codes]
```

## Utilities

| Function | Description |
| --- | --- |
| `l2_distance(a, b)` | Row-wise squared L2 between two `(m, dim)` arrays. |
| `cosine_distance(a, b)` | Row-wise cosine distance between two `(m, dim)` arrays. |
| `set_num_threads(n)` | Threads for batch queries, adds and training. `0` (default) uses every core. |
| `num_threads()` | Thread count in effect. |
| `fuse(results, *, method="rrf", k=60, weights=None, limit=10)` | Merge ranked results from several retrievers; see [Hybrid search](#hybrid-search). |
| `__version__` | Installed version. |

## Threads and type hints

- **Thread-safe:** queries, adds and training release the GIL, and several threads can query one index at once. Adds and setting changes wait for running queries, so no query sees a half-updated index.
- **Typed:** wheels include type stubs for editors and type checkers.

## More

[ARCHITECTURE.md](https://github.com/maxtmiller/qann/blob/main/ARCHITECTURE.md) has the design, a file-by-file reference, the measurements behind this README and the benchmarks.
