Metadata-Version: 2.4
Name: frisket-data
Version: 0.1.1a70
Summary: Local-first AI spreadsheet workflows for journalists and researchers.
Keywords: ai,data-analysis,journalism,spreadsheet
Author: Jonathan Soma
Author-email: Jonathan Soma <jonathan.soma@gmail.com>
License-Expression: Apache-2.0
License-File: LICENSE
Classifier: Development Status :: 3 - Alpha
Classifier: Environment :: Web Environment
Classifier: Intended Audience :: End Users/Desktop
Classifier: Intended Audience :: Science/Research
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.12
Classifier: Topic :: Office/Business
Classifier: Topic :: Scientific/Engineering :: Information Analysis
Requires-Dist: argon2-cffi>=25.1.0
Requires-Dist: aiosqlite>=0.22.1
Requires-Dist: cryptography>=48.0.0
Requires-Dist: ddgs>=9.14.4
Requires-Dist: fastapi>=0.136.3
Requires-Dist: fastembed>=0.4
Requires-Dist: rapidocr>=3.8.1,<3.9
Requires-Dist: onnxruntime>=1.18.1,!=1.24.1,<1.27
Requires-Dist: pytesseract>=0.3.10
Requires-Dist: markitdown[docx,pdf]>=0.1.6
Requires-Dist: httpx>=0.28.1
Requires-Dist: itsdangerous>=2.2.0
Requires-Dist: jsonschema>=4.26.0
Requires-Dist: openpyxl>=3.1.5
Requires-Dist: opencv-python>=4.13.0.92,<5
Requires-Dist: scenedetect>=0.7,<0.8
Requires-Dist: psycopg[binary]>=3.3.4
Requires-Dist: pyjwt[crypto]>=2.13.0
Requires-Dist: pydantic>=2.13.4
Requires-Dist: pypdf>=5.1.0
Requires-Dist: python-multipart>=0.0.32
Requires-Dist: regex>=2026.5.9
Requires-Dist: sqlalchemy>=2.0.50
Requires-Dist: trafilatura>=2.1.0
Requires-Dist: uvicorn[standard]>=0.49.0
Requires-Dist: yt-dlp[default]>=2026.1.1
Requires-Dist: dateparser>=1.4.0
Requires-Dist: feedparser>=6.0.12
Requires-Dist: filelock>=3.29.1
Requires-Dist: mcp>=1.27.2,<2
Requires-Dist: pyarrow>=18.0.0
Requires-Dist: numpy>=2.0
Requires-Dist: requests>=2.34.2
Requires-Dist: lxml>=5.0
Requires-Dist: shapely>=2.0
Requires-Dist: rapidfuzz>=3.14.5
Requires-Dist: text-unidecode>=1.3
Requires-Dist: pydantic-ai-slim>=2.2.0
Requires-Dist: faster-whisper>=1.2.1 ; extra == 'asr'
Requires-Dist: onnx-asr==0.11.0 ; extra == 'asr'
Requires-Dist: onnxruntime>=1.18.1,!=1.24.1,<1.27 ; extra == 'asr'
Requires-Dist: huggingface-hub>=0.30.2,<2 ; extra == 'asr'
Requires-Dist: av>=11 ; extra == 'asr'
Requires-Dist: playwright>=1.40 ; extra == 'browser'
Requires-Dist: modal>=1.4.0 ; extra == 'cloud'
Requires-Dist: spacy>=3.8,<3.9 ; extra == 'complete'
Requires-Dist: faster-whisper>=1.2.1 ; extra == 'complete'
Requires-Dist: onnx-asr==0.11.0 ; extra == 'complete'
Requires-Dist: onnxruntime>=1.18.1,!=1.24.1,<1.27 ; extra == 'complete'
Requires-Dist: huggingface-hub>=0.30.2,<2 ; extra == 'complete'
Requires-Dist: av>=11 ; extra == 'complete'
Requires-Dist: ctranslate2>=4 ; extra == 'complete'
Requires-Dist: sentencepiece>=0.2 ; extra == 'complete'
Requires-Dist: huggingface-hub>=0.24 ; extra == 'complete'
Requires-Dist: natural-pdf>=0.6.5 ; extra == 'complete'
Requires-Dist: playwright>=1.40 ; extra == 'complete'
Requires-Dist: modal>=1.4.0 ; extra == 'complete'
Requires-Dist: docling>=2.97.0 ; extra == 'complete'
Requires-Dist: llama-cpp-python>=0.3 ; extra == 'complete'
Requires-Dist: followthemoney>=4.9.2 ; extra == 'complete'
Requires-Dist: followthemoney>=4.9.2 ; extra == 'entities'
Requires-Dist: docling>=2.97.0 ; extra == 'models'
Requires-Dist: spacy>=3.8,<3.9 ; extra == 'ner-spacy'
Requires-Dist: natural-pdf>=0.6.5 ; extra == 'pdf'
Requires-Dist: spacy>=3.8,<3.9 ; extra == 'standard'
Requires-Dist: faster-whisper>=1.2.1 ; extra == 'standard'
Requires-Dist: onnx-asr==0.11.0 ; extra == 'standard'
Requires-Dist: onnxruntime>=1.18.1,!=1.24.1,<1.27 ; extra == 'standard'
Requires-Dist: huggingface-hub>=0.30.2,<2 ; extra == 'standard'
Requires-Dist: av>=11 ; extra == 'standard'
Requires-Dist: ctranslate2>=4 ; extra == 'standard'
Requires-Dist: sentencepiece>=0.2 ; extra == 'standard'
Requires-Dist: huggingface-hub>=0.24 ; extra == 'standard'
Requires-Dist: natural-pdf>=0.6.5 ; extra == 'standard'
Requires-Dist: playwright>=1.40 ; extra == 'standard'
Requires-Dist: ctranslate2>=4 ; extra == 'translate'
Requires-Dist: sentencepiece>=0.2 ; extra == 'translate'
Requires-Dist: huggingface-hub>=0.24 ; extra == 'translate'
Requires-Dist: llama-cpp-python>=0.3 ; extra == 'translate-gguf'
Requires-Python: >=3.12
Project-URL: Homepage, https://frisket.dev
Project-URL: Repository, https://github.com/frisket-dev/frisket
Project-URL: Issues, https://github.com/frisket-dev/frisket/issues
Provides-Extra: asr
Provides-Extra: browser
Provides-Extra: cloud
Provides-Extra: complete
Provides-Extra: entities
Provides-Extra: models
Provides-Extra: ner-spacy
Provides-Extra: pdf
Provides-Extra: standard
Provides-Extra: translate
Provides-Extra: translate-gguf
Description-Content-Type: text/markdown

# Frisket

I wanted a spreadsheet that did AI things for investigative journalism. The NYT [made one for itself](https://www.niemanlab.org/2026/02/how-the-new-york-times-uses-a-custom-ai-tool-to-track-the-manosphere/), so I made one for the rest of us. Use Frisket to analyze zillions of documents, decades of audio, centuries of video, all in a friendly (???) spreadsheet format.

![A screenshot](sample.png)

## Quickstart

Use the [cloud version](https://app.frisket.dev/) or run locally with Python 3.12:

```
pip install 'frisket-data[standard]'
frisket ./my-workspace
```

## What Frisket can do

Frisket can analyze spreadsheets, PDFs, images, videos, probably a hundred other things. You drop content in, then run AI against it in a structured way. It's a new way to do projects like:

- Extract and cross-reference [every company mentioned over thousands of legal documents](https://www.icij.org/investigations/fincen-files/mining-sars-data/)
- Find [every time datacenters are mentioned](https://datacentersexposed.com/hearings) in a YouTube channel of city council meetings
- Split a video at scene changes to [analyze popular streamers](https://www.bloomberg.com/features/2026-stake-drake-crypto-casino-adin-ross-gambling/)
- Download and translate TikTok videos [to track misinformation](https://documentedny.com/2025/01/07/tiktok-misinformation-data-ai-machine-learning/)
- Get an email or Slack message [summarizing this week's new podcast eps](https://www.niemanlab.org/2026/02/how-the-new-york-times-uses-a-custom-ai-tool-to-track-the-manosphere/)
- Convert recipes into [structured lists of ingredients and amounts](https://archive.nytimes.com/open.blogs.nytimes.com/2015/04/09/extracting-structured-data-from-recipes-using-conditional-random-fields/) (it isn't journalism but hey)
- Summarize, [categorize](https://www.wsj.com/tech/elon-musk-politics-trump-social-media-267d34c8), restructure, and clean documents
- Automatically perform cited research on the web

Those were all done the old-fashioned hard-work way, though. No one has done *anything* with Frisket yet, so you can be the first.

## Installation

Frisket requires Python 3.12.

### Single-user

If you just want to run Frisket on your own computer, use **solo mode**.

```
pip install 'frisket-data[standard]'
frisket ./my-workspace
```

If you want more shiny extras, use `pip install 'frisket-data[complete]'`.

### Team

If you're running Frisket on a server or want to support multiple uers, go for **team mode**.

1. [Download the server install bundle](https://github.com/frisket-dev/frisket/releases) (`frisket-server-<version>.tar.gz`)
2. Extract it, then run `sudo ./frisket-install` from the extracted directory
3. The installer asks a few questions and then you should be good to go. It can keep Frisket behind an SSH tunnel or serve a public domain using Caddy for HTTPS.

Codex claims it requires Linux, Docker Engine, and Docker Compose. It installs Frisket under `/srv/frisket`.

### Hosted (cloud)

You're lazy, I get it! [Go to app.frisket.dev](https://app.frisket.dev/) and request access. This is a Frisket instance that I personally run.

### CAVEAT: The big, fancy parts

Frisket is split into a few parts, including a lightweight server and a heavier sidecar to optionally offload intensive work. As a result, different installs have slightly different features.

For example, for OCR local/team installs can add [Surya 2](https://www.datalab.to/blog/surya-2) natively with the sidecar's `ocr` extra and an upstream-supported inference backend. The standard sidecar container and Cloud uses [dots.mocr](https://github.com/studio-dots-ai/dots.ocr) instead. **I haven't set the local sidecar up to easily publish yet** but I promise you can ask your agentic coding environment and it can walk you through the process.

For the models included in the standard sidecar container, build the image yourself by downloading the repo and running the following commands from the repo root.

```
docker build -t frisket-models:local ./sidecar
```

Then run the sidecar and connect it to Frisket.

```
MODELS_TOKEN="$(openssl rand -hex 32)"

docker run -d \
    --name frisket-models \
    --restart unless-stopped \
    -p 127.0.0.1:8500:8500 \
    -e FRISKET_MODELS_TOKEN="$MODELS_TOKEN" \
    -v frisket-models-cache:/models \
    frisket-models:local

export FRISKET_MODELS_URL=http://127.0.0.1:8500
export FRISKET_MODELS_TOKEN="$MODELS_TOKEN"

frisket ./my-workspace
```

## Extras

### Local models

> Fair warning: some of these aren't yet available without some additional setup.

It's easy to set up an API key to talk to AI providers like OpenAI, Anthropic, OpenRouter and Gemini. But! You can also do most everything on the privacy of your own machine.

- LM Studio and Ollama are supported out-of-the-box for local LLMs/VLMs
- Local transcription can be powered by Parakeet, Whisper, MOSS, VibeVoice-ASR
- spaCy or GLiNER for local entity extraction
- Plenty of OCR engines like RapidOCR, Surya 2, dots.mocr, PaddleOCR-VL, Tesseract
- PDF to Markdown conversion with Markitdown, Docling

## Write a plugin

Plugins can add actions, panels, imports, integrations: pretty much anything. They're easy to make!

```
frisket plugin init --id example.my-plugin --output ./my-plugin --with action
frisket plugin build ./my-plugin
frisket plugin validate ./my-plugin
```
## Me

Hi, I'm [Soma](https://twitter.com/dangerscarf)!

I teach data journalism at Columbia's J-School where I run a year-long [Data Journalism MS](https://journalism.columbia.edu/ms-data-journalism) and a nice short [summer program](https://ledeprogram.com/). I give a lot of [talks on AI](https://jonathansoma.com/) and wrote history's friendliest [PDF-processing library](https://jsoma.github.io/natural-pdf-workshop/).

Email me at [jonathan.soma@gmail.com](mailto:jonathan.soma@gmail.com).

People say things like "oh buy me a coffee if you like this" but no, I'm more demanding: go [look at these poor cats](https://www.instagram.com/catrepublic) and then [donate to my cat rescue](https://catrepublic.com/donate/).
