Skip to content

Commit

Permalink
init
Browse files Browse the repository at this point in the history
fix grammar case
  • Loading branch information
KhaiHuy123 committed Aug 24, 2024
1 parent 5461b25 commit a653c5f
Show file tree
Hide file tree
Showing 2 changed files with 7 additions and 7 deletions.
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -148,11 +148,11 @@ References: [Open Data NYC](https://opendata.cityofnewyork.us/data/)

- Everytime you execute pipeline, MinIO will store all versions of data. MinIO is used as GitHub in this case.

## How to use this pipline?
## How to use this pipeline?

- First, you need to create Mother Duck account. [Mother Duck](https://motherduck.com/) is the Cloud Service that provide us availability of using [DuckDB](https://duckdb.org/) on cloud enviroment.
- First, you need to create Mother Duck account. [Mother Duck](https://motherduck.com/) is the Cloud Service that provide us availability of using [DuckDB](https://duckdb.org/) on cloud environment.

- Next, make sure you have installed [Docker](https://www.docker.com/) on your local machine. If not, that's ok, because they will help you with that. How to use Docker Desstop ? [Watch this](https://www.youtube.com/watch?v=7y50rZItKCQ)
- Next, make sure you have installed [Docker](https://www.docker.com/) on your local machine. If not, that's ok, because they will help you with that. How to use Docker Desktop ? [Watch this](https://www.youtube.com/watch?v=7y50rZItKCQ)

- Finally, you can clone this respository and execute pipeline. Read [run.md](https://github.com/KhaiHuy123/taxi-nyc-processing-pipeline/blob/main/run.md) for more details.

Expand Down
8 changes: 4 additions & 4 deletions docker-compose.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ services:
- ./datasource_init/warehouse_setup/:/docker-entrypoint-initdb.d/
- ./datasource_init/data:/data/
- ./postgresql:/var/lib/postgresql/data/
- ./shared_volume:/shared_data/
- shared_volume:/shared_data/
ports:
- "5432:5432"
env_file:
Expand All @@ -34,7 +34,7 @@ services:
container_name: thes_mysql
volumes:
- ./datasource_process/warehouse_setup/:/docker-entrypoint-initdb.d/
- ./shared_volume:/shared_data/
- shared_volume:/shared_data/
ports:
- "3306:3306"
environment:
Expand Down Expand Up @@ -75,8 +75,8 @@ services:
env_file:
- .env
volumes:
- ./shared_volume:/opt/dagster/app/datasource_init/data
- ./shared_volume_app:/opt/dagster/app/processed_data
- shared_volume:/opt/dagster/app/datasource_init/data
- shared_volume_app:/opt/dagster/app/processed_data

networks:
- thes_network
Expand Down

0 comments on commit a653c5f

Please sign in to comment.