Metadata-Version: 2.4
Name: mailcellar
Version: 0.17.0
Summary: Gmail backups in gyb's format, with deduplication, offloading old mail, restore and reports
Author: The mailcellar authors
License-Expression: Apache-2.0
Project-URL: Repository, https://github.com/mailcellar/mailcellar
Project-URL: Documentation, https://mailcellar.github.io/mailcellar/
Project-URL: Issues, https://github.com/mailcellar/mailcellar/issues
Project-URL: Changelog, https://github.com/mailcellar/mailcellar/blob/main/CHANGELOG.md
Keywords: gmail,backup,archive,email,deduplication,gyb
Classifier: Development Status :: 4 - Beta
Classifier: Environment :: Console
Classifier: Intended Audience :: End Users/Desktop
Classifier: Operating System :: MacOS
Classifier: Operating System :: POSIX :: Linux
Classifier: Programming Language :: Python :: 3 :: Only
Classifier: Programming Language :: Python :: 3.14
Classifier: Topic :: Communications :: Email
Classifier: Topic :: System :: Archiving :: Backup
Requires-Python: >=3.14
Description-Content-Type: text/markdown
License-File: LICENSE
License-File: NOTICE
Requires-Dist: google-api-python-client>=2.201.0
Requires-Dist: google-auth-oauthlib>=1.5.0
Requires-Dist: certifi>=2026.10.19
Dynamic: license-file

# mailcellar

[![CI](https://github.com/mailcellar/mailcellar/actions/workflows/ci.yml/badge.svg?branch=main)](https://github.com/mailcellar/mailcellar/actions/workflows/ci.yml?query=branch%3Amain)
[![Docs](https://github.com/mailcellar/mailcellar/actions/workflows/docs.yml/badge.svg?branch=main)](https://mailcellar.github.io/mailcellar/)
[![PyPI](https://img.shields.io/pypi/v/mailcellar)](https://pypi.org/project/mailcellar/)
[![Python](https://img.shields.io/pypi/pyversions/mailcellar)](https://pypi.org/project/mailcellar/)
[![License](https://img.shields.io/github/license/mailcellar/mailcellar)](https://github.com/mailcellar/mailcellar/blob/main/LICENSE)

**Gmail full? Keep every email on your own disk, and free the space.**

Your mail lives on someone else's server, in a mailbox with a size limit.
When it fills up you can pay for more storage, or delete mail you may need
later. mailcellar gives you a third way: a complete, checked backup on your
own disk, then old mail taken out of the mailbox by rules you write and
review, still searchable and restorable whenever you need it. It works
with Gmail and Google Workspace, and with any IMAP mailbox: iCloud Mail,
Yahoo Mail, Fastmail, or your own server.

## Why mailcellar

- **Your storage is full.** Offload old mail by rule (older than five
  years, newsletters, large attachments) and keep it in the backup: the
  space comes back and nothing is lost.
- **You have no backup of your own.** Providers keep your mail safe from
  their own failures, not from a deletion, a compromised account, or being
  locked out. A provider's export copies everything again each time, with
  nothing to say it's complete. mailcellar fetches only what changed,
  compares each account with its backup (`count`) and checks the files
  (`verify`).
- **Old mail must stay findable.** `search` covers every backup, offloaded
  mail included, and `restore` puts back one message, a batch or a whole
  account.
- **Your mail is with more than one provider.** One backup, one search and
  one set of reports cover Gmail and IMAP accounts side by side.
- **You're moving to another provider.** `restore --to` copies mail from
  one account to another, Gmail to IMAP or back: labels become folders and
  folders labels, and the backup records what moved.

## What it does

- **Back up** every account incrementally, in
  [Got Your Back](https://github.com/GAM-team/got-your-back)'s format; an
  existing gyb backup carries on where it is.
- **Offload** old mail by rule, in stages you check: plan, review, mark,
  look in your mail client, then trash. The backup is checked for every
  message before it goes, and nothing is ever deleted permanently.
- **Find and restore**: search the backups, offloaded mail included, and
  put mail back into the same account or another.
- **Deduplicate, export and report**: remove duplicate copies within and
  across accounts, copy mail out as an mbox or a zip, and see what takes up
  the space.
- **Keep mail as it is**: a hash chain shows the backup hasn't changed
  since each message was saved (`verify --chain`), and a legal hold keeps
  the mail a dispute or an audit needs out of reach of offloading, pruning
  and dedup, in the mailbox and in the backup.

**What changes your mailbox.** Only `offload apply`, `dedup apply` and
`restore --yes`, and each is a dry run until you add a flag. Offload and
dedup mark mail for review, then move it to Trash: nothing is ever
permanently deleted, and Gmail keeps Trash for 30 days. On an IMAP server
this happens only where the server can move mail safely; elsewhere
mailcellar backs up only. `restore` only puts mail back: out of Trash, or
as an upload. Everything else, `backup` included, only reads
([details](https://mailcellar.github.io/mailcellar/reference/what-changes-gmail/)).

**Your mail stays yours.** mailcellar runs on your own computer: there is
no service in between, and your mail goes nowhere but between the mailbox
and your disk. Gmail is read through your own Google Cloud project (about
ten minutes to set up,
[guide](https://mailcellar.github.io/mailcellar/guide/google-cloud/)); an
IMAP account needs only its password (an app password, where the provider
asks for one). mailcellar is in beta: it is used
on real mailboxes, and its backups are in gyb's fixed format, but commands
and options may still change before 1.0. It runs on macOS and Linux and
needs Python 3.14, which uv installs for you.

## Commands

```
mailcellar setup   [ADDRESS]       add a Gmail account (OAuth client) or an IMAP one (--imap)
mailcellar backup  [ACCOUNT ...]   incremental backups in gyb's format
mailcellar count   [ACCOUNT ...]   compare the mailbox with the backup
mailcellar meta    [ACCOUNT ...]   fill the per-message sidecar for older mail
mailcellar verify  [ACCOUNT ...]   check that the backup's files are still intact
mailcellar schedule install|status|remove   run backups regularly, unattended
mailcellar dedup   …               find duplicates and remove them from the mailbox, in stages
mailcellar offload …               take old mail out of the mailbox, keeping it in the backup
mailcellar restore ACCOUNT …       put backed-up mail back, into its account or another
mailcellar export  ACCOUNT …       copy mail out as an mbox file or a zip of .eml files
mailcellar search  QUERY …         find mail in the backups, offloaded mail included
mailcellar hold    add|list|show|release   keep mail for a dispute or an audit
mailcellar report  …               storage, bulk mail, volume, threads, labels, correspondents,
                                   backup health, top senders
mailcellar config                  where the config and data live; each account's state
```

`backup`, `count` and `meta` take every configured account unless given
some (an address, a config name like `work`, or a unique part of an
address). Each command takes `--help`.

Results go to stdout; progress, warnings and errors go to stderr. Add `-v`
anywhere on the line to also see the server's retries and rate-limit waits
(waits of 10 seconds or more show without it), or `-q` to see only warnings
and errors.

How it fits together: [How it works](https://mailcellar.github.io/mailcellar/architecture/).

## Quick start

You need [uv](https://docs.astral.sh/uv/) (it provides Python 3.14).

1. **Install.**
   ```bash
   uv tool install mailcellar    # from PyPI; puts the mailcellar command on your PATH
   ```
   `pipx install mailcellar` works too, with Python 3.14. To run it from a
   clone instead, see [Development](#development).
2. **Add an account**, one of these two ways.

   **Gmail or Google Workspace.** Create an OAuth client in the
   [Google Cloud console](https://console.cloud.google.com/): a project with
   the **Gmail API** enabled, a consent screen with yourself as a test user,
   and an OAuth client of type **Desktop app**. Download its JSON. The step
   by step version, including *Testing* versus *In production* (Testing
   tokens expire after 7 days), is
   [Setting up Google Cloud](https://mailcellar.github.io/mailcellar/guide/google-cloud/).
   Then:
   ```bash
   mailcellar setup alex@example.org --client ~/Downloads/client_secret_*.json
   ```

   **Any other mailbox, over IMAP** (iCloud Mail, Yahoo Mail, Fastmail, your
   own server). Most providers want an app password, made in their account
   settings; give `setup` the server, and it asks for the password:
   ```bash
   mailcellar setup alex@example.org --imap imap.mail.yahoo.com
   ```

   | Provider | Server | Note |
   | --- | --- | --- |
   | iCloud Mail | `imap.mail.me.com` | `--username` with the part before `@`; backup only (no IMAP MOVE) |
   | Yahoo Mail | `imap.mail.yahoo.com` | add `--review folder` to offload: Yahoo keeps no custom keywords |
   | Fastmail | `imap.fastmail.com` | not yet tried with mailcellar |

   More in [Backing up an IMAP account](https://mailcellar.github.io/mailcellar/guide/imap/).

   Either way, `setup` signs in read-only, changes nothing in the mailbox,
   and names the account after the address (`alex`; `--name` chooses
   another). The backups go in `~/mailcellar`; to keep them elsewhere, set
   `data_dir` in `~/.config/mailcellar/settings.toml`
   ([Configuration](https://mailcellar.github.io/mailcellar/reference/configuration/)).
3. **Back up, then check.**
   ```bash
   mailcellar config         # the config and data folders; each account's state
   mailcellar backup alex    # the first backup; resumes where it left off if stopped
   mailcellar count alex     # what the mailbox has against what the backup has
   ```
4. **Schedule it.**
   ```bash
   mailcellar schedule install     # macOS: a launchd agent, weekly; elsewhere: a cron line
   ```
   For Gmail, back up at least every four weeks: Gmail keeps change history
   about that long, and a longer gap lists the whole mailbox again. If its
   consent screen is in *Testing*, tokens expire after 7 days: publish it,
   or renew with `mailcellar auth alex --scope readonly --renew`. An IMAP
   account has no token to renew. See
   [Scheduled backups](https://mailcellar.github.io/mailcellar/guide/scheduling/).

Then [keep the backup safe](https://mailcellar.github.io/mailcellar/guide/backing-up/), and when you are ready
to free space, [offload old mail](https://mailcellar.github.io/mailcellar/guide/offloading/).

## Documentation

The [documentation site](https://mailcellar.github.io/mailcellar/) has the guides and the reference.

**Guides**, in the order you will want them:

- [Setting up Google Cloud](https://mailcellar.github.io/mailcellar/guide/google-cloud/): the project and OAuth
  client mailcellar signs in with, and the first consent screen.
- [Backing up an IMAP account](https://mailcellar.github.io/mailcellar/guide/imap/): back up
  mail on another provider's server, or your own; offload, dedup and restore
  there too, where the server can move mail safely.
- [Workspace: backing up through a service account](https://mailcellar.github.io/mailcellar/guide/workspace-service-account/):
  unattended, read-only backups of a domain's mailboxes without each person signing in.
- [Backing up, and keeping the backup safe](https://mailcellar.github.io/mailcellar/guide/backing-up/): the
  routine, a second copy of the data root and checking it, `backup --prune`.
- [Scheduled backups](https://mailcellar.github.io/mailcellar/guide/scheduling/): run backups unattended, and
  what happens when a token needs signing in.
- [Migrating from gyb](https://mailcellar.github.io/mailcellar/guide/from-gyb/): continue an existing Got Your
  Back backup.
- [Finding mail, and deciding what to offload](https://mailcellar.github.io/mailcellar/guide/finding-and-sizing/):
  `search`, and which `report` answers what.
- [Offloading old mail safely](https://mailcellar.github.io/mailcellar/guide/offloading/): a worked example,
  from writing a rule to restoring.
- [Removing duplicate mail](https://mailcellar.github.io/mailcellar/guide/dedup/): a worked example, from
  matching to trashing.
- [Restoring mail](https://mailcellar.github.io/mailcellar/guide/restore/): undo an offload, recover one
  message, rebuild or copy an account, load a Takeout file.
- [Exporting mail](https://mailcellar.github.io/mailcellar/guide/exporting/): copy mail out as an mbox or a zip.
- [Keeping mail on hold](https://mailcellar.github.io/mailcellar/guide/legal-holds/): keep mail for a dispute or an
  audit, in Gmail and the backup, and hand it over.
- [Recovering when something goes wrong](https://mailcellar.github.io/mailcellar/guide/recovery/): an expired
  token, a long gap, an interrupted run, a lost data root.
- [Troubleshooting and FAQ](https://mailcellar.github.io/mailcellar/guide/troubleshooting/): slow runs, `count`
  results, chats, why not IMAP or Takeout.

**Command reference**, every command and option:

- [Backups](https://mailcellar.github.io/mailcellar/reference/backup/): `backup`, `count`, `meta`, `verify`
- [Configuration](https://mailcellar.github.io/mailcellar/reference/configuration/): the config folder, `accounts.toml`, `settings.toml`; `setup`, `auth`, `schedule`, `config`
- [What changes your mailbox](https://mailcellar.github.io/mailcellar/reference/what-changes-gmail/): the commands that write to Gmail, or to an IMAP server
- [Removing duplicates](https://mailcellar.github.io/mailcellar/reference/dedup/): `dedup`
- [Offloading old mail](https://mailcellar.github.io/mailcellar/reference/offload/): `offload`, and the rule keys
- [Restoring mail](https://mailcellar.github.io/mailcellar/reference/restore/): `restore`
- [Exporting mail](https://mailcellar.github.io/mailcellar/reference/export/): `export`
- [Searching mail](https://mailcellar.github.io/mailcellar/reference/search/): `search`
- [Reports](https://mailcellar.github.io/mailcellar/reference/report/): `report`

## Development

To run mailcellar from a clone, with the tests and tools:

```bash
git clone https://github.com/mailcellar/mailcellar.git
cd mailcellar
uv sync                                    # the dependencies, and mailcellar in editable mode
uv run mailcellar config                   # every command, run from the clone
uv run pytest                              # all tests; no network, never the real config or data
uv run pytest --cov                        # the same, with a branch-coverage report
uv run ruff format && uv run ruff check
```

The code is one package, `src/mailcellar/`: `cli.py` dispatches to
`backup/`, `dedup/`, `offload/`, `restore/` and `report/`, which share `paths.py`,
`gmailapi.py` and `message.py`. `uv sync` installs it in editable mode;
`python -m mailcellar` works too. See
[How it works](https://mailcellar.github.io/mailcellar/architecture/).

How to contribute, and the rules changes follow:
[CONTRIBUTING.md](https://github.com/mailcellar/mailcellar/blob/main/CONTRIBUTING.md).

## Acknowledgements

mailcellar's backups use the on-disk format of
[Got Your Back](https://github.com/GAM-team/got-your-back) (gyb) by the
GAM team, so backups made by either tool can be read by the other.
mailcellar is a separate project and shares no code with gyb.

mailcellar is not affiliated with or endorsed by Google or the gyb
project. Gmail and Google Workspace are trademarks of Google LLC.

## License

Apache License 2.0: see [LICENSE](https://github.com/mailcellar/mailcellar/blob/main/LICENSE) and [NOTICE](https://github.com/mailcellar/mailcellar/blob/main/NOTICE).
