Metadata-Version: 2.4
Name: atomic-datasets
Version: 0.1.0
Summary: An easy-to-use API for popular 3D molecular datasets
Author: Ameya Daigavane, Song Kim
License: MIT License
        
        Copyright (c) 2024 The Atomic Architects
        
        Permission is hereby granted, free of charge, to any person obtaining a copy
        of this software and associated documentation files (the "Software"), to deal
        in the Software without restriction, including without limitation the rights
        to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
        copies of the Software, and to permit persons to whom the Software is
        furnished to do so, subject to the following conditions:
        
        The above copyright notice and this permission notice shall be included in all
        copies or substantial portions of the Software.
        
        THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
        IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
        FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
        AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
        LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
        OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
        SOFTWARE.
        
Project-URL: Homepage, https://github.com/atomicarchitects/datasets
Project-URL: Repository, https://github.com/atomicarchitects/datasets.git
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Classifier: Topic :: Scientific/Engineering :: Physics
Classifier: Topic :: Scientific/Engineering :: Chemistry
Classifier: Topic :: Database
Requires-Python: >=3.10
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: numpy
Requires-Dist: pandas
Requires-Dist: ase
Requires-Dist: rdkit
Requires-Dist: GitPython
Requires-Dist: tqdm
Requires-Dist: sh
Requires-Dist: biotite
Provides-Extra: dev
Requires-Dist: pytest>=7.0; extra == "dev"
Requires-Dist: ruff>=0.2.0; extra == "dev"
Requires-Dist: ipykernel>=6.0; extra == "dev"
Dynamic: license-file

# atomic-datasets

[![Python 3.10+](https://img.shields.io/badge/python-3.10+-blue.svg)](https://www.python.org/downloads/)
[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)

This repository provides an easy (but fast!) interface to to popular 3D molecular datasets in pure [numpy](https://numpy.org/), with wrappers in [PyTorch](https://pytorch.org/) and [JAX](https://docs.jax.dev/en/latest/)!

<p align="center" width="100%">
<img width="2948" height="2303" alt="atomic-datasets" src="https://github.com/user-attachments/assets/6cd41eac-144d-4213-937e-494e57435195" />
</p>

Datasets supported:
- [QM9](https://www.nature.com/articles/sdata201422): ~134000 small organic molecules with quantum chemical properties.
- [GEOM (Drugs)](https://www.nature.com/articles/s41597-022-01288-4): a subset of the GEOM dataset containing ~300000 drug-like molecules with multiple conformers and properties.
- [tmQM](https://pubs.acs.org/doi/10.1021/acs.jcim.0c01041): ~86000 transition metal complexes with quantum chemical properties.
- [ChEMBL3D](https://chemrxiv.org/doi/10.26434/chemrxiv-2025-k4h7v): ~1800000 drug-like molecules with low-energy conformers and properties.
- [CrossDocked](https://pubs.acs.org/doi/full/10.1021/acs.jcim.0c00411?casa_token=2OPWUPi2RRYAAAAA%3A_1AHwm3Btx8fT00JW78Et9v8il5KU_F8mR49MPH3owHoFlVDWzlE521XtH-_Sudhskke8V9O5YL0): ~100000 protein-ligand pairs after filtering for high-quality pairs with binding pose RMSD less than 1Å.

Our hope is to standardize [processing](https://arxiv.org/abs/2505.00169v2) and splits which have long been [inconsistent](https://arxiv.org/abs/2505.00518) across different papers, and to provide a common interface across programming frameworks for working with these datasets. 

We have preliminary support for the [Miniproteins](https://pubmed.ncbi.nlm.nih.gov/35332283/) dataset, a collection of protein-binding proteins upto 65 residues in length.
We also provide some toy datasets (Platonic Solids, 3D Tetris) for testing.

## Installation

Install directly from PyPI with [pip](https://pypi.org/project/pip/):
```
pip install atomic-datasets
```
or, from source:
```bash
git clone https://github.com/atomicarchitects/datasets.git
cd datasets
pip install -e .
```

## Example
```python
from atomic_datasets import QM9, GEOMDrugs

# Initialization will trigger preprocessing which may take some time,
# but once preprocessed, load speeds should be fast!
dataset = QM9(
    root_dir="data/",
    split="train",
)
# Or, for example:
# dataset = GEOMDrugs(root_dir="data/", split="train")

for graph in dataset:
    positions = graph["nodes"]["positions"]   # (N, 3) array of 3D coordinates
    species = graph["nodes"]["species"]       # (N,) array of atomic species indices
    atom_types = graph["nodes"]["atom_types"] # (N,) array of element symbols
    properties = graph["properties"]          # dict of molecular properties
    
    print(f"Molecule: {properties['smiles']}")
    print(f"  Atoms: {atom_types}")
    print(f"  HOMO-LUMO gap: {properties['gap']:.4f} Ha")
```

We also provide some simple utilities. For example, to visualize a graph with [py3Dmol](https://pypi.org/project/py3Dmol/) in a notebook:
```python
from atomic_datasets import utils

utils.visualize(graph)
```
or save a graph as a `.xyz` file:
```python
utils.save_xyz(graph, "example_graph")
```

See [examples/viz.ipynb](./examples/viz.ipynb) for a simple example.

### Data Format

Each sample is a dictionary with the following structure:

```python
{
    "nodes": {
        "positions": np.ndarray,   # (N, 3) atomic coordinates
        "species": np.ndarray,     # (N,) integer species indices
        "atom_types": np.ndarray,  # (N,) element symbols (e.g., 'C', 'H', 'O')
    },
    "edges": ...,
    "senders": ...,
    "receivers": ...,
    "globals": ...,
    "n_node": np.ndarray,          # number of nodes per graph
    "n_edge": ...,
    "properties": {...},           # dataset-specific properties
}
```

Available properties vary by dataset. 

## Wrappers for PyTorch and JAX

We provide wrappers for both [PyTorch](https://pytorch.org/) via [PyTorch Geometric](https://pytorch-geometric.readthedocs.io/en/latest/):
```python
from atomic_datasets import Tetris
from atomic_datasets.wrappers.torch import PyTorchGeometricDataset
from torch_geometric.loader import DataLoader

dataset = PyTorchGeometricDataset(Tetris())
loader = DataLoader(dataset, batch_size=32, shuffle=True)

for batch in loader:
    print(batch.pos.shape)      # (total_atoms_in_batch, 3)
    print(batch.species.shape)  # (total_atoms_in_batch,)
    print(batch.batch.shape)    # (total_atoms_in_batch,)
```

and [JAX](https://docs.jax.dev/en/latest/) via [Jraph](https://github.com/google-deepmind/jraph):
```python
from atomic_datasets import Tetris
from atomic_datasets.wrappers.jax import JraphDataset
import jraph

dataset = JraphDataset(Tetris())
batch = jraph.batch([dataset[i] for i in range(4)])

print(batch.nodes["positions"].shape)  # (16, 3)
print(batch.nodes["species"].shape)    # (16,)
print(batch.n_node)                    # [4, 4, 4, 4]
```

To avoid any version conflicts, this repository does not have hard dependencies on PyTorch, JAX, or their respective graph libraries. You must install them separately if you want to use the wrappers.

See [examples/torch.ipynb](./examples/torch.ipynb) and [examples/jax.ipynb](./examples/jax.ipynb) for some simple examples.

## License

The code in this repository is released under the MIT License.

**Note:** The datasets themselves belong to their original authors and are subject to their respective licenses and terms of use. Please refer to the original sources and cite the appropriate papers (see below) when using these datasets in your work.

## Citation

If you use this repository, please cite:
```bibtex
@software{atomic_datasets,
	title        = {{atomic\_datasets}},
	author       = {Daigavane, Ameya and Kim, Song},
	year         = 2025,
	month        = may,
	url          = {https://github.com/atomicarchitects/datasets},
	version      = {1.0.0}
}
```

<details>
<summary><strong>Dataset-specific citations</strong> (click to expand)</summary>

### QM9
```bibtex
@article{qm9,
	author = {Ramakrishnan, Raghunathan and Dral, Pavlo O. and Rupp, Matthias and von Lilienfeld, O. Anatole},
	journal = {Scientific Data},
	number = {1},
	pages = {140022},
	title = {Quantum chemistry structures and properties of 134 kilo molecules},
	volume = {1},
	year = {2014}
}
```

### GEOM
```bibtex
@article{geom,
	author = {Axelrod, Simon and G{\'o}mez-Bombarelli, Rafael},
	journal = {Scientific Data},
	number = {1},
	pages = {185},
	title = {GEOM, energy-annotated molecular conformations for property prediction and molecular generation},
	volume = {9},
	year = {2022}
}
```

### tmQM
```bibtex
@article{tmQM,
	author = {Balcells, David and Skjelstad, Bastian Bjerkem},
	journal = {Journal of Chemical Information and Modeling},
	month = {12},
	number = {12},
	pages = {6135--6146},
	title = {tmQM Dataset---Quantum Geometries and Properties of 86k Transition Metal Complexes},
	volume = {60},
	year = {2020}
}
```

### ChEMBL3D
```bibtex
@article{nikitin2025scalable,
  title={Scalable Low-Energy Molecular Conformer Generation with Quantum Mechanical Accuracy},
  author={Nikitin, Filipp and Anstine, Dylan M and Zubatyuk, Roman and Paliwal, Saee Gopal and Isayev, Olexandr},
  year={2025}
}
```

### CATH
```bibtex
@article{cath2021,
	author = {Sillitoe, Ian and Bordin, Nicola and Dawson, Natalie and Waman, Vaishali P and Ashford, Paul and Scholes, Harry M and Pang, Camilla S M and Woodridge, Laurel and Rauer, Clemens and Sen, Neeladri and Abbasian, Mahnaz and Le Cornu, Sean and Lam, Su Datt and Berka, Karel and Varekova, Ivana Hutařová and Svobodova, Radka and Lees, Jon and Orengo, Christine A},
	title = {CATH: increased structural coverage of functional space},
	journal = {Nucleic Acids Research},
	volume = {49},
	number = {D1},
	pages = {D266--D273},
	year = {2021},
	doi = {10.1093/nar/gkaa1079}
}

@article{cath2024,
	author = {Waman, Vaishali P and Bordin, Nicola and Alcraft, Rachel and Vickerstaff, Robert and Rauer, Clemens and Chan, Qian and Sillitoe, Ian and Yamamori, Hazuki and Orengo, Christine},
	title = {CATH 2024: CATH-AlphaFlow Doubles the Number of Structures in CATH and Reveals Nearly 200 New Folds},
	journal = {Journal of Molecular Biology},
	volume = {436},
	number = {17},
	pages = {168551},
	year = {2024},
	doi = {10.1016/j.jmb.2024.168551}
}

@article{cath1997,
	author = {Orengo, C A and Michie, A D and Jones, S and Jones, D T and Swindells, M B and Thornton, J M},
	title = {CATH--a hierarchic classification of protein domain structures},
	journal = {Structure},
	volume = {5},
	number = {8},
	pages = {1093--1108},
	year = {1997},
	doi = {10.1016/s0969-2126(97)00260-8}
}

@article{gene3d,
	author = {Lewis, Tony E and Sillitoe, Ian and Dawson, Natalie and Lam, Su Datt and Clarke, Tristan and Lee, David and Orengo, Christine and Lees, Jonathan},
	title = {Gene3D: Extensive prediction of globular domains in proteins},
	journal = {Nucleic Acids Research},
	volume = {46},
	number = {D1},
	pages = {D1282},
	year = {2018},
	doi = {10.1093/nar/gkx1187}
}
```

### Miniproteins
```bibtex
@article{miniproteins,
	author = {Cao, Longxing and Coventry, Brian and Goreshnik, Inna and Huang, Buwei and Sheffler, William and Park, Joon Sung and Jude, Kevin M. and Markovi{\'c}, Iva and Kadam, Rameshwar U. and Verschueren, Koen H. G. and Verstraete, Kenneth and Walsh, Scott Thomas Russell and Bennett, Nathaniel and Phal, Ashish and Yang, Aerin and Kozodoy, Lisa and DeWitt, Michelle and Picton, Lora and Miller, Lauren and Strauch, Eva-Maria and DeBouver, Nicholas D. and Pires, Allison and Bera, Asim K. and Halabiya, Samer and Hammerson, Bradley and Yang, Wei and Bernard, Steffen and Stewart, Lance and Wilson, Ian A. and Ruohola-Baker, Hannele and Schlessinger, Joseph and Lee, Sangwon and Savvides, Savvas N. and Garcia, K. Christopher and Baker, David},
	journal = {Nature},
	number = {7910},
	pages = {551--560},
	title = {Design of protein-binding proteins from the target structure alone},
	volume = {605},
	year = {2022}
}
```

### CrossDocked
```bibtex
@article{doi:10.1021/acs.jcim.0c00411,
	author = {Francoeur, Paul G. and Masuda, Tomohide and Sunseri, Jocelyn and Jia, Andrew and Iovanisci, Richard B. and Snyder, Ian and Koes, David R.},
	title = {Three-Dimensional Convolutional Neural Networks and a Cross-Docked Data Set for Structure-Based Drug Design},
	journal = {Journal of Chemical Information and Modeling},
	volume = {60},
	number = {9},
	pages = {4200-4215},
	year = {2020},
	doi = {10.1021/acs.jcim.0c00411},
	note = {PMID: 32865404},
	url = {https://doi.org/10.1021/acs.jcim.0c00411},
	eprint = {https://doi.org/10.1021/acs.jcim.0c00411}
}
@inproceedings{sbdd,
	 author = {Luo, Shitong and Guan, Jiaqi and Ma, Jianzhu and Peng, Jian},
	 booktitle = {Advances in Neural Information Processing Systems},
	 editor = {M. Ranzato and A. Beygelzimer and Y. Dauphin and P.S. Liang and J. Wortman Vaughan},
	 pages = {6229--6239},
	 publisher = {Curran Associates, Inc.},
	 title = {A 3D Generative Model for Structure-Based Drug Design},
	 url = {https://proceedings.neurips.cc/paper_files/paper/2021/file/314450613369e0ee72d0da7f6fee773c-Paper.pdf},
	 volume = {34},
	 year = {2021}
}
```

### 3D Tetris
```bibtex
@phdthesis{tetris,
	author = {Smidt, Tess E.},
	title = {Toward the Systematic Design of Complex Materials from Structural Motifs},
	year = {2018},
	school = {University of California, Berkeley},
	url = {https://www.proquest.com/dissertations-theses/toward-systematic-design-complex-materials/docview/2137540057/se-2}
}
```

</details>

<details>
<summary><strong>Preprocessing code acknowledgments</strong> (click to expand)</summary>

Preprocessing code adapted from:

```bibtex
@misc{anderson2019cormorant,
	title = {Cormorant: Covariant Molecular Neural Networks},
	author = {Anderson, Brandon and Hy, Truong-Son and Kondor, Risi},
	year = {2019},
	eprint = {1906.04015},
	archivePrefix = {arXiv},
	primaryClass = {physics.comp-ph},
	url = {https://arxiv.org/abs/1906.04015}
}

@misc{hoogeboom2022edm,
	title = {Equivariant Diffusion for Molecule Generation in 3D},
	author = {Hoogeboom, Emiel and Garcia Satorras, Victor and Vignac, Cl{\'e}ment and Welling, Max},
	year = {2022},
	eprint = {2203.17003},
	archivePrefix = {arXiv},
	primaryClass = {cs.LG},
	url = {https://arxiv.org/abs/2203.17003}
}

@misc{morehead2024gcdiff,
	title = {Geometry-Complete Diffusion for 3D Molecule Generation and Optimization},
	author = {Morehead, Alex and Cheng, Jianlin},
	year = {2024},
	eprint = {2302.04313},
	archivePrefix = {arXiv},
	primaryClass = {cs.LG},
	url = {https://arxiv.org/abs/2302.04313}
}

@misc{nikitin2025geomrevisited,
	title = {GEOM-Drugs Revisited: Toward More Chemically Accurate Benchmarks for 3D Molecule Generation},
	author = {Nikitin, Filipp and Dunn, Ian and Koes, David Ryan and Isayev, Olexandr},
	year = {2025},
	eprint = {2505.00169},
	archivePrefix = {arXiv},
	primaryClass = {cs.LG},
	url = {https://arxiv.org/abs/2505.00169}
}

@misc{vignac2023midi,
	title = {MiDi: Mixed Graph and 3D Denoising Diffusion for Molecule Generation},
	author = {Vignac, Clement and Osman, Nagham and Toni, Laura and Frossard, Pascal},
	year = {2023},
	eprint = {2302.09048},
	archivePrefix = {arXiv},
	primaryClass = {cs.LG},
	url = {https://arxiv.org/abs/2302.09048}
}
```

</details>
