dbt-meshify-demo

This repo is intended to test out dbt-meshify in a jaffle shop sandbox environment! Set up your duckdb instance following the steps below (~10m) and try out the available commands.

Full documentation for the dbt-meshify package is here.

Some example commands:

# create a group of all models tagged with "finance"
# leaf nodes and nodes with cross-group dependencies will be `public`
dbt-meshify operation create-group finance --owner name Monopoly Man --select +tag:finance

# add a contract to the marts models
dbt-meshify add-contract -s models/marts

# perform steps one and two in one go!
# contracts will be added to any public models from the grouping stage
dbt-meshify group finance --owner name Monopoly Man --select +tag:finance

# use the add-version operation to add a new version to a model
dbt-meshify operation add-version -s orders

Set up Project with Data

This project is optimized for running in a container. If you'd like to use it locally outside of container you'll need to follow the instructions below.

1. Create a python virtual environment and install the dependencies.

python3 -m venv .venv
source .venv/bin/activate
python -m pip install --upgrade pip
python -m pip install -r requirements.txt

2. Install meltano with pipx. And install meltano's dependencies.

pipx install meltano
meltano install

3. Run the EL pipeline.

meltano run el

4. Install dbt dependencies and build the dbt project.

dbt deps
dbt build