Metadata-Version: 2.4
Name: dbt-spark-on-k8s
Version: 0.1.0
Summary: Experimental invocation-scoped Spark on Kubernetes adapter for dbt Core
Keywords: dbt,dbt-core,spark,kubernetes,spark-connect,spark-on-k8s
Author: Hussein Awala
Author-email: Hussein Awala <hussein@awala.fr>
License-Expression: Apache-2.0
License-File: LICENSE
Classifier: Development Status :: 3 - Alpha
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Requires-Dist: spark-on-k8s[connect]>=0.13.0,<0.14
Requires-Dist: dbt-core==1.12.6
Requires-Dist: dbt-spark==1.11.0
Requires-Dist: pyhive[hive-pure-sasl]==0.7.0
Requires-Dist: thrift>=0.25.0,<0.26
Requires-Dist: pyspark-client==4.3.0
Requires-Python: >=3.11, <3.14
Project-URL: Repository, https://github.com/hussein-awala/spark-on-k8s
Project-URL: Bug Tracker, https://github.com/hussein-awala/spark-on-k8s/issues
Project-URL: Documentation, https://hussein.awala.fr/spark-on-k8s/latest/user-guide/dbt/
Description-Content-Type: text/markdown

# Experimental dbt adapter

Run dbt Core SQL workloads on invocation-scoped Spark compute, using Thrift or
Spark Connect. `spark-on-k8s-dbt run -- build` creates the server lazily, shares
it across dbt threads, and deletes owned compute when the command finishes;
`spark-on-k8s-dbt run -- seed -- build` runs both commands on one server.

This is an opt-in, separately installed experimental distribution. Its API and
profile format may change. See the
[managed dbt guide](https://hussein.awala.fr/spark-on-k8s/latest/user-guide/dbt/) for installation, profiles,
recovery and support limits. This distribution is not published by the main
package release workflow.
