Merge pull request #318 from j3-signalroom/github_issue-317

GitHub issue 317

CHANGELOG.md

@@ -3,6 +3,14 @@ All notable changes to this project will be documented in this file.
 
 The format is base on [Keep a Changelog](https://keepachangelog.com/en/1.1.0/), and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
 
+## [0.35.00.000] - 2024-10-10
+### Added
+- Added the `KNOWNISSUES.md`.
+
+### Changed
+- Refactored the Java models.
+- Refactored the Dockerfiles.
+
 ## [0.30.10.000] - 2024-10-08
 ### Added
 - Sink the data in DataGeneratorApp datastreams to Apache Iceberg tables.

KNOWNISSUES.md

@@ -0,0 +1,5 @@
+# Known Issues
+All notable known issues to this project will be documented in this file.
+
+- Issue [#315](https://github.com/j3-signalroom/apache_flink-kickstarter/issues/315):  Cannot sink the `flight_duration` and `ticket_price` fields to the Apache Iceberg tables.
+- Issue [#316](https://github.com/j3-signalroom/apache_flink-kickstarter/issues/316):  The `FlyerStatsApp` Java-based Flink App prematurely shutdowns.

README.md

@@ -29,6 +29,7 @@ Explore the repo, run the Docker containers (compatible with both Mac M chips an
     - [3.1 Java-based Flink Apps](#31-java-based-flink-apps)
     - [3.2 Python-based Flink Apps](#32-python-based-flink-apps)
 + [4.0 Resources](#40-resources)
++ [5.0 Special Notes](#50-special-notes)
 <!-- tocstop -->
 
 ## 1.0 Are these examples better described as Flink Jobs or Flink Applications-—and why does the distinction matter?
@@ -199,3 +200,6 @@ To learn more about this script, click [here](.blog/run-flink-locally-script-exp
 [Building Apache Flink Applications in Java](https://developer.confluent.io/courses/flink-java/overview/)
 
 [J3's techStack Lexicon](https://github.com/j3-signalroom/j3-techstack-lexicon/blob/main/README.md)
+
+## 5.0 Special Notes
+[Known Issues](KNOWNISSUES.md)

linux-Dockerfile

@@ -69,7 +69,7 @@ RUN if [ "$FLINK_LANGUAGE" = "python" ]; then \
     curl -L "${MAVEN_ROOT_URL}iceberg/iceberg-flink-runtime-${APACHE_FLINK_VERSION}/${ICEBERG_VERSION}/iceberg-flink-runtime-${APACHE_FLINK_VERSION}-${ICEBERG_VERSION}.jar" -o "${FLINK_LIB_DIR}iceberg-flink-runtime-${APACHE_FLINK_VERSION}-${ICEBERG_VERSION}.jar" && \
     curl -L "${MAVEN_ROOT_URL}iceberg/iceberg-aws-bundle/${ICEBERG_VERSION}/iceberg-aws-bundle-${ICEBERG_VERSION}.jar" -o "${FLINK_LIB_DIR}iceberg-aws-bundle-${ICEBERG_VERSION}.jar" && \
     curl -L "${MAVEN_ROOT_URL}hadoop/hadoop-common/${HADOOP_VERSION}/hadoop-common-${HADOOP_VERSION}.jar" -o "${FLINK_LIB_DIR}hadoop-common-${HADOOP_VERSION}.jar" && \
-    curl -L "${MAVEN_ROOT_URL}hadoop/hadoop-hdfs-client/${HADOOP_VERSION}/hadoop-hdfs-client-${HADOOP_VERSION}.jar" -o "/opt/flink/lib/hadoop-hdfs-client-${HADOOP_VERSION}.jar" && \
+    curl -L "https://repo1.maven.org/maven2/org/apache/hadoop/hadoop-hdfs-client/3.4.0/hadoop-hdfs-client-3.4.0.jar" -o "/opt/flink/lib/hadoop-hdfs-client-${HADOOP_VERSION}.jar" && \
     curl -L "${MAVEN_ROOT_URL}flink/flink-sql-connector-kafka/3.2.0-${APACHE_FLINK_VERSION}/flink-sql-connector-kafka-3.2.0-${APACHE_FLINK_VERSION}.jar" -o "${FLINK_LIB_DIR}flink-sql-connector-kafka-3.2.0-${APACHE_FLINK_VERSION}.jar" && \
     curl -L "${MAVEN_ROOT_URL}flink/flink-connector-kafka/3.2.0-${APACHE_FLINK_VERSION}/flink-connector-kafka-3.2.0-${APACHE_FLINK_VERSION}.jar" -o "${FLINK_LIB_DIR}flink-connector-kafka-3.2.0-${APACHE_FLINK_VERSION}.jar" && \
     curl -L "${MAVEN_ROOT_URL}flink/flink-json/${APACHE_FLINK_VERSION_WITH_PATCH}/flink-json-${APACHE_FLINK_VERSION_WITH_PATCH}.jar" -o "${FLINK_LIB_DIR}flink-json-${APACHE_FLINK_VERSION_WITH_PATCH}.jar" && \