Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DBZ-PGYB] Run tests against yugabyted in GitHub Actions #134

Open
wants to merge 31 commits into
base: ybdb-debezium-2.5.2
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
82cefff
added workflow to build connector
vaibhav-yb May 20, 2024
0c133a8
fixed command
vaibhav-yb May 20, 2024
2ebef02
skip tests
vaibhav-yb May 20, 2024
9791580
added checkstyle and formatting check
vaibhav-yb May 20, 2024
3a597e5
add caching support
vaibhav-yb May 20, 2024
4c42eb3
potential fix for checkstyle check not working
vaibhav-yb May 20, 2024
f301c6c
remove checkstyle job
vaibhav-yb May 20, 2024
b8e536f
add test job
vaibhav-yb Jun 25, 2024
c63ed42
changed option
vaibhav-yb Jun 25, 2024
de76070
added ls
vaibhav-yb Jun 25, 2024
d10edf0
added ls
vaibhav-yb Jun 25, 2024
8c65968
moved post install step
vaibhav-yb Jun 25, 2024
320313e
changed yb version
vaibhav-yb Jun 25, 2024
bfe2abd
added gflags
vaibhav-yb Jun 25, 2024
2f05d87
resolved merge conflicts
vaibhav-yb Jun 25, 2024
d3f80bc
Merge branch 'ybdb-debezium-2.5.2' into github-actions
vaibhav-yb Jul 15, 2024
94f2502
added pipeline to push image to quay on demand
vaibhav-yb Jul 15, 2024
48cbc0d
Delete .github/workflows/yb-release-quay.yml
vaibhav-yb Aug 5, 2024
8f43081
Update yb-pg-tests.yml
vaibhav-yb Aug 5, 2024
e468a8c
Run replica identity tests
vaibhav-yb Aug 5, 2024
50c5ef1
Caching local maven repository
vaibhav-yb Aug 5, 2024
3076e5d
Update yb-pg-tests.yml
vaibhav-yb Aug 5, 2024
2c5be8e
Update yb-pg-tests.yml
vaibhav-yb Aug 5, 2024
2641a07
Update yb-pg-tests.yml
vaibhav-yb Aug 5, 2024
ed8b8f5
Update yb-pg-tests.yml
vaibhav-yb Aug 5, 2024
727bb9f
Update yb-pg-tests.yml
vaibhav-yb Aug 5, 2024
7981e8d
Update yb-pg-tests.yml
vaibhav-yb Aug 5, 2024
4c65932
Update yb-pg-tests.yml
vaibhav-yb Aug 5, 2024
0a89140
Running action on 20.04
vaibhav-yb Aug 7, 2024
fd3bc6d
Update yb-pg-tests.yml
vaibhav-yb Aug 7, 2024
040f777
Update yb-pg-tests.yml
vaibhav-yb Aug 7, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions .github/workflows/yb-pg-parity.yml
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
name: YugabyteDB PG parity sanity
name: YBPG build sanity

on:
push:
Expand All @@ -23,4 +23,4 @@ jobs:
java-version: 17

- name: Download dependencies
run: ./mvnw clean install -Dquick -pl debezium-connector-postgres -am
run: ./mvnw clean install -Dquick -pl debezium-connector-postgres -am
128 changes: 128 additions & 0 deletions .github/workflows/yb-pg-tests.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,128 @@
name: YugabyteDB connector tests

on:
push:
branches:
- ybdb-debezium-2.5.2
pull_request:
branches:
- ybdb-debezium-2.5.2

env:
YUGABYTEDB_VERSION: 2024.1.1.0
YUGABYTEDB_BUILD: b137

jobs:
build:
name: Build and run PG tests
runs-on: ubuntu-22.04
steps:
- name: Download YugabyteDB
uses: wei/wget@v1
with:
args: -O yugabytedb-linux.tar.gz https://downloads.yugabyte.com/releases/${YUGABYTEDB_VERSION}/yugabyte-${YUGABYTEDB_VERSION}-${YUGABYTEDB_BUILD}-linux-x86_64.tar.gz
- name: Extract YugabyteDB package
uses: a7ul/tar-action@v1.2.0
id: extract
with:
command: x
cwd: ./
files: yugabytedb-linux.tar.gz
outPath: ./
- name: Complete post install actions for YugabyteDB
run: ./yugabyte-${YUGABYTEDB_VERSION}/bin/post_install.sh
- name: Start yugabyted
run: >
./yugabyte-${YUGABYTEDB_VERSION}/bin/yugabyted start
--advertise_address 127.0.0.1 --ui=false
--master_flags="ysql_cdc_active_replication_slot_window_ms=0"
--tserver_flags="allowed_preview_flags_csv={cdcsdk_enable_dynamic_table_support},cdcsdk_enable_dynamic_table_support=true,ysql_cdc_active_replication_slot_window_ms=0,ysql_sequence_cache_method=server,cdcsdk_publication_list_refresh_interval_secs=3"
- name: Checkout Action
uses: actions/checkout@v4

- name: Cache local Maven repository
uses: actions/cache@v3
with:
path: ~/.m2/repository
key: ${{ runner.os }}-maven-${{ hashFiles('**/pom.xml') }}
restore-keys: |
${{ runner.os }}-maven-

- name: Set up Java 17
uses: actions/setup-java@v4
with:
distribution: 'temurin'
java-version: 17

- name: Download dependencies
run: ./mvnw clean install -Dquick -pl debezium-connector-postgres -pl debezium-bom -pl support/ide-configs -am

- name: Run SourceInfoTest
id: sourceinfotest
if: success() || failure()
run: mvn test -Ddocker.skip.build=true -Ddocker.skip.run=true -Duser.timezone=UTC -pl debezium-connector-postgres -Dtest=SourceInfoTest

- name: Run ReplicaIdentityTestMapperTest
id: replicaidentitytestmappertest
if: success() || failure()
run: mvn test -Ddocker.skip.build=true -Ddocker.skip.run=true -Duser.timezone=UTC -pl debezium-connector-postgres -Dtest=ReplicaIdentityTestMapperTest

# - name: Run PostgresSkipMessagesWithoutChangeConfigIT
# id: postgresskipmessageswithoutchangeconfigit
# if: success() || failure()
# run: mvn test -Ddocker.skip.build=true -Ddocker.skip.run=true -Duser.timezone=UTC -pl debezium-connector-postgres -Dtest=PostgresSkipMessagesWithoutChangeConfigIT

- name: Run PostgresOffsetContextTest
id: postgresoffsetcontexttest
if: success() || failure()
run: mvn test -Ddocker.skip.build=true -Ddocker.skip.run=true -Duser.timezone=UTC -pl debezium-connector-postgres -Dtest=PostgresOffsetContextTest

# - name: Run PostgresMoneyIT
# id: postgresmoneyit
# if: success() || failure()
# run: mvn test -Ddocker.skip.build=true -Ddocker.skip.run=true -Duser.timezone=UTC -pl debezium-connector-postgres -Dtest=PostgresMoneyIT

- name: Run PostgresConnectorConfigDefTest
id: postgresconnectorconfigdeftest
if: success() || failure()
run: mvn test -Ddocker.skip.build=true -Ddocker.skip.run=true -Duser.timezone=UTC -pl debezium-connector-postgres -Dtest=PostgresConnectorConfigDefTest

- name: Run PostgresErrorHandlerTest
id: postgreserrorhandlertest
if: success() || failure()
run: mvn test -Ddocker.skip.build=true -Ddocker.skip.run=true -Duser.timezone=UTC -pl debezium-connector-postgres -Dtest=PostgresErrorHandlerTest

- name: Run FieldTest
id: fieldtest
if: success() || failure()
run: mvn test -Ddocker.skip.build=true -Ddocker.skip.run=true -Duser.timezone=UTC -pl debezium-connector-postgres -Dtest=FieldTest

- name: Run PostgresPartitionTest
id: postgrespartitiontest
if: success() || failure()
run: mvn test -Ddocker.skip.build=true -Ddocker.skip.run=true -Duser.timezone=UTC -pl debezium-connector-postgres -Dtest=PostgresPartitionTest

# - name: Run DebeziumEngineIT
# id: debeziumengineit
# if: success() || failure()
# run: mvn test -Ddocker.skip.build=true -Ddocker.skip.run=true -Duser.timezone=UTC -pl debezium-connector-postgres -Dtest=DebeziumEngineIT

# - name: Run TransactionMetadataIT
# id: transactionmetadatait
# if: success() || failure()
# run: mvn test -Ddocker.skip.build=true -Ddocker.skip.run=true -Duser.timezone=UTC -pl debezium-connector-postgres -Dtest=TransactionMetadataIT

- name: Run YugabyteReplicaIdentityIT
id: yugabytereplicaidentityit
if: success() || failure()
run: mvn test -Ddocker.skip.build=true -Ddocker.skip.run=true -Duser.timezone=UTC -pl debezium-connector-postgres -Dtest=YugabyteReplicaIdentityIT

# - name: Run YBRecordsStreamProducerIT
# id: ybrecordsstreamproducerit
# if: success() || failure()
# run: mvn test -Ddocker.skip.build=true -Ddocker.skip.run=true -Duser.timezone=UTC -pl debezium-connector-postgres -Dtest=YBRecordsStreamProducerIT

# - name: Run PostgresConnectorIT
# id: postgresconnectorit
# if: success() || failure()
# run: mvn test -Ddocker.skip.build=true -Ddocker.skip.run=true -Duser.timezone=UTC -pl debezium-connector-postgres -Dtest=PostgresConnectorIT
Loading