Skip to content

Commit

Permalink
Resolved #68.
Browse files Browse the repository at this point in the history
  • Loading branch information
j3-signalroom committed Oct 8, 2024
1 parent 7954137 commit 718943b
Showing 1 changed file with 5 additions and 3 deletions.
8 changes: 5 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -75,11 +75,13 @@ To help you start quickly, the repo comes with **_Docker containers_** for Mac M
git clone https://github.com/j3-signalroom/apache_flink-kickstarter.git
```

3. Set up your Terraform Cloud environment locally or use GitHub workflows/actions to easily create the full environment. Here's what you'll get:
3. Set up your Terraform Cloud environment locally or leverage GitHub Actions to create the complete setup effortlessly. Here's what you can expect:
- A Confluent Cloud environment with a Kafka Cluster, complete with pre-configured example Kafka topics, ready for use.
- A Confluent Cloud environment featuring a Kafka Cluster, fully equipped with pre-configured example Kafka topicsready to power your data streaming needs.
- AWS Secrets Manager storing the API Key Secrets for the sample Kafka Cluster, and AWS Systems Manager Parameter Store set up with Kafka Consumer and Producer properties. Additionally, an AWS S3 Bucket is created as the landing spot for Apache Iceberg files generated by the Flink Apps.
- AWS Secrets Manager securely storing API Key Secrets for the Kafka Cluster, along with AWS Systems Manager Parameter Store containing Kafka Consumer and Producer properties for easy integration.
- An AWS S3 bucket with a dedicated `warehouse` folder, serving as the landing zone for Apache Iceberg tables populated by two Python-based Flink apps, bringing your data streaming architecture to life.
4. Run Apache Flink locally on your Mac, or use the provided Docker containers from the repository to launch Apache Flink and Apache Iceberg seamlessly on your machine.
Expand Down

0 comments on commit 718943b

Please sign in to comment.