Metadata-Version: 2.3
Name: cdlake
Version: 0.1.4
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Dist: pyarrow
Requires-Dist: pylance
Requires-Dist: pandas ; extra == 'pandas'
Requires-Dist: polars ; extra == 'polars'
Provides-Extra: pandas
Provides-Extra: polars
License-File: LICENSE
Summary: Connected Data Lake Framework
Keywords: cdl,cdlake,connecteddatalake,datalake
Home-Page: https://github.com/ulagbulag/connected-data-lake
Author: Ho Kim <ho.kim@ulagbulag.io>
Author-email: Ho Kim <ho.kim@ulagbulag.io>
License: AGPL-3.0-or-later
Requires-Python: >=3.10
Description-Content-Type: text/markdown; charset=UTF-8; variant=GFM
Project-URL: documentation, https://github.com/ulagbulag/connected-data-lake
Project-URL: repository, https://github.com/ulagbulag/connected-data-lake

# Connected Data Lake

## Usage

```bash
docker run --rm 'quay.io/ulagbulag/connected-data-lake:latest'
```

## Install K8S Operator

```bash
# Register the Connected Data Lake repository
helm repo add cdl "https://smartx-team.github.io/connected-data-lake"

# Deploy a Connected Data Lake operator
helm install -n "cdl-operator" "cdl-operator" "cdl/cdl-operator"
```

### Install Dependencies on Ubuntu 24.04

```bash
# Install os dependencies
sudo apt-get update
sudo apt-get install -y \
  build-essential \
  fuse \
  libfuse-dev \
  libprotoc-dev \
  protobuf-compiler \
  rustup

# Install & Update the latest stable rust
rustup default stable
```

## Build on the local machine

### Build Requirements

- gcc
- fuse
- protobuf
- rust >=1.82

### Build CDL rust CLI

```bash
cargo run --release --
```

### Build CDL python API

Please check your python virtual environment (i.e. conda) before running.

```bash
cd python
maturin develop --release
```

### Build K8S Operator

Please check your kubernetes config file `~/.kube/config` before running.

```bash
cargo run --package 'cdl-k8s-operator' --release --
```

