-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
25 changed files
with
3,926 additions
and
72 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,182 @@ | ||
| Data Directory : is running | ||
| Result Directory : is running | ||
| Dashboard : is running | ||
| Message Queue : is running | ||
| Experiment : has code 1729531508 | ||
| Experiment : starts at 2024-10-21 19:25:08.143360 (4267448.267341745) | ||
| Experiment : This experiment compares run time and resource consumption of Benchbase queries in different DBMS. | ||
| Benchbase data is generated and loaded using several threads. | ||
| Benchmark is 'tpcc'. Scaling factor (e.g., number of warehouses) is 16. Benchmarking runs for 1 minutes. Target is based on multiples of '1024'. Factors for benchmarking are [8]. | ||
| Benchmark is limited to DBMS ['MariaDB']. | ||
| Import is handled by 1 processes (pods). | ||
| Loading is fixed to cl-worker19. | ||
| Benchmarking is fixed to cl-worker19. | ||
| SUT is fixed to cl-worker11. | ||
| Database is persisted to disk of type shared and size 50Gi. | ||
| Loading is tested with [1] threads, split into [1] pods. | ||
| Benchmarking is tested with [16] threads, split into [1] pods. | ||
| Benchmarking is run as [1] times the number of benchmarking pods. | ||
| Experiment is run 2 times. | ||
| Cluster monitoring : is running | ||
| done | ||
| MariaDB-1-1-1024 : will start now | ||
| - waiting 30s - : done | ||
| MariaDB-1-1-1024 : is not loaded yet | ||
| MariaDB-1-1-1024 : will start loading but not before 2024-10-21 17:27:08 (that is in 60 secs) | ||
| - waiting 30s - : done | ||
| MariaDB-1-1-1024 : is not loaded yet | ||
| MariaDB-1-1-1024 : will start loading but not before 2024-10-21 17:27:08 | ||
| done | ||
| MariaDB-1-1-1024 : is not loaded yet | ||
| MariaDB-1-1-1024 : start asynch loading scripts of type loaded | ||
| MariaDB-1-1-1024 : is loading | ||
| - waiting 30s - : done | ||
| MariaDB-1-1-1024 : is loading | ||
| - waiting 30s - : done | ||
| MariaDB-1-1-1024 : is loading | ||
| - waiting 30s - : done | ||
| MariaDB-1-1-1024 : is loading | ||
| - waiting 30s - : done | ||
| MariaDB-1-1-1024 : is loading | ||
| - waiting 30s - : done | ||
| MariaDB-1-1-1024 : is loading | ||
| - waiting 30s - : done | ||
| MariaDB-1-1-1024 : is loading | ||
| - waiting 30s - : done | ||
| MariaDB-1-1-1024 : is loading | ||
| - waiting 30s - : done | ||
| MariaDB-1-1-1024 : is loading | ||
| - waiting 30s - : done | ||
| MariaDB-1-1-1024 : is loading | ||
| - waiting 30s - : done | ||
| MariaDB-1-1-1024 : is loading | ||
| done | ||
| MariaDB-1-1-1024 : showing loader times | ||
| MariaDB-1-1-1024 : loader timespan (first to last [s]) = 325 | ||
| MariaDB-1-1-1024 : benchmarks done 0 of 2. This will be client 1 | ||
| MariaDB-1-1-1024 : we will change parameters of benchmark as {'PARALLEL': '1', 'SF': '16', 'BENCHBASE_BENCH': 'tpcc', 'BENCHBASE_PROFILE': 'mariadb', 'BEXHOMA_DATABASE': 'benchbase', 'BENCHBASE_TARGET': 8192, 'BENCHBASE_TERMINALS': 16, 'BENCHBASE_TIME': 60, 'BENCHBASE_ISOLATION': 'TRANSACTION_READ_COMMITTED'} | ||
| MariaDB-1-1-1024-1-1 : start benchmarking | ||
| MariaDB-1-1-1024 : benchmarking results in folder /home/perdelt/benchmarks/1729531508 | ||
| - waiting 10s - : done | ||
| MariaDB-1-1-1024 : benchmarking is waiting for job bexhoma-benchmarker-mariadb-1-1-1024-1729531508-1-1-x4w8g: found | ||
| - waiting 30s - : done | ||
| MariaDB-1-1-1024 : has running benchmarks | ||
| done | ||
| MariaDB-1-1-1024 : has running benchmarks | ||
| MariaDB-1-1-1024-1-1 : showing benchmarker times | ||
| MariaDB-1-1-1024-1-1 : benchmarker timespan (start to end single container [s]) = 71 | ||
| MariaDB-1-1-1024-1-1 : benchmarker times (start/end per pod and container) = [(1729531965, 1729532031)] | ||
| MariaDB-1-1-1024-1-1 : found and updated times {'benchmarker': [(1729531965, 1729532031)]} | ||
| done | ||
| MariaDB-1-1-1024 : can be stopped | ||
| MariaDB-1-1-1024 : still being removed | ||
| done | ||
| MariaDB-1-1-1024 : starts again | ||
| MariaDB-1-1-1024 : storage exists bexhoma-storage-mariadb-benchbase-16 | ||
| MariaDB-1-1-1024 : loading is set to finished | ||
| - waiting 10s - : done | ||
| - waiting 30s - : done | ||
| MariaDB-1-1-1024 : will start benchmarking but not before 2024-10-21 17:36:36 (that is in 60 secs) | ||
| - waiting 30s - : done | ||
| MariaDB-1-1-1024 : will start benchmarking but not before 2024-10-21 17:36:36 | ||
| done | ||
| MariaDB-1-1-1024 : benchmarks done 1 of 2. This will be client 1 | ||
| MariaDB-1-1-1024 : we will change parameters of benchmark as {'PARALLEL': '1', 'SF': '16', 'BENCHBASE_BENCH': 'tpcc', 'BENCHBASE_PROFILE': 'mariadb', 'BEXHOMA_DATABASE': 'benchbase', 'BENCHBASE_TARGET': 8192, 'BENCHBASE_TERMINALS': 16, 'BENCHBASE_TIME': 60, 'BENCHBASE_ISOLATION': 'TRANSACTION_READ_COMMITTED'} | ||
| MariaDB-1-1-1024-2-1 : start benchmarking | ||
| MariaDB-1-1-1024 : benchmarking results in folder /home/perdelt/benchmarks/1729531508 | ||
| - waiting 10s - : done | ||
| MariaDB-1-1-1024 : benchmarking is waiting for job bexhoma-benchmarker-mariadb-1-1-1024-1729531508-2-1-9q8jk: found | ||
| - waiting 30s - : done | ||
| MariaDB-1-1-1024 : has running benchmarks | ||
| done | ||
| MariaDB-1-1-1024 : has running benchmarks | ||
| MariaDB-1-1-1024-2-1 : showing benchmarker times | ||
| MariaDB-1-1-1024-2-1 : benchmarker timespan (start to end single container [s]) = 71 | ||
| MariaDB-1-1-1024-2-1 : benchmarker times (start/end per pod and container) = [(1729532201, 1729532263)] | ||
| MariaDB-1-1-1024-2-1 : found and updated times {'benchmarker': [(1729532201, 1729532263)]} | ||
| done | ||
| MariaDB-1-1-1024 : can be stopped | ||
| Experiment ends at 2024-10-21 19:38:21.570796 (4268241.69477506): 793.4274333147332s total | ||
| Experiment : downloading partial results | ||
| Experiment : uploading full results | ||
| Experiment : uploading workload file | ||
| Benchmarking connection ... Latency Distribution.Average Latency (microseconds) | ||
| connection_pod ... | ||
| MariaDB-1-1-1024-2-1-1 MariaDB-1-1-1024-2-1 ... 29917 | ||
| MariaDB-1-1-1024-1-1-1 MariaDB-1-1-1024-1-1 ... 40909 | ||
|
|
||
| [2 rows x 36 columns] | ||
| Workflow {'MariaDB-1-1-1024': [[1], [1]]} | ||
| Result workflow complete | ||
|
|
||
| ## Show Summary | ||
|
|
||
| ### Workload | ||
| Benchbase Workload SF=16 (warehouses for TPC-C) | ||
| Type: benchbase | ||
| Duration: 794s | ||
| Code: 1729531508 | ||
| This includes no queries. Benchbase runs the benchmark | ||
| This experiment compares run time and resource consumption of Benchbase queries in different DBMS. | ||
| Benchbase data is generated and loaded using several threads. | ||
| Benchmark is 'tpcc'. Scaling factor (e.g., number of warehouses) is 16. Benchmarking runs for 1 minutes. Target is based on multiples of '1024'. Factors for benchmarking are [8]. | ||
| Benchmark is limited to DBMS ['MariaDB']. | ||
| Import is handled by 1 processes (pods). | ||
| Loading is fixed to cl-worker19. | ||
| Benchmarking is fixed to cl-worker19. | ||
| SUT is fixed to cl-worker11. | ||
| Database is persisted to disk of type shared and size 50Gi. | ||
| Loading is tested with [1] threads, split into [1] pods. | ||
| Benchmarking is tested with [16] threads, split into [1] pods. | ||
| Benchmarking is run as [1] times the number of benchmarking pods. | ||
| Experiment is run 2 times. | ||
|
|
||
| ### Connections | ||
| MariaDB-1-1-1024-1-1 uses docker image mariadb:11.4.2 | ||
| RAM:541008605184 | ||
| CPU:AMD Opteron(tm) Processor 6378 | ||
| Cores:64 | ||
| host:5.15.0-116-generic | ||
| node:cl-worker11 | ||
| disk:250323480 | ||
| datadisk:1940452 | ||
| volume_size:50G | ||
| volume_used:1.9G | ||
| requests_cpu:4 | ||
| requests_memory:16Gi | ||
| MariaDB-1-1-1024-2-1 uses docker image mariadb:11.4.2 | ||
| RAM:541008605184 | ||
| CPU:AMD Opteron(tm) Processor 6378 | ||
| Cores:64 | ||
| host:5.15.0-116-generic | ||
| node:cl-worker11 | ||
| disk:250323476 | ||
| datadisk:1980233 | ||
| volume_size:50G | ||
| volume_used:1.9G | ||
| requests_cpu:4 | ||
| requests_memory:16Gi | ||
|
|
||
| ### Execution | ||
| experiment_run terminals target pod_count time Throughput (requests/second) Latency Distribution.95th Percentile Latency (microseconds) Latency Distribution.Average Latency (microseconds) | ||
| MariaDB-1-1-1024-1-1 1 16 8192 1 60.0 376.43 35970.0 40909.0 | ||
| MariaDB-1-1-1024-2-1 2 16 8192 1 60.0 534.45 34873.0 29917.0 | ||
|
|
||
| Warehouses: 16 | ||
|
|
||
| ### Workflow | ||
|
|
||
| #### Actual | ||
| DBMS MariaDB-1-1-1024 - Pods [[1], [1]] | ||
|
|
||
| #### Planned | ||
| DBMS MariaDB-1-1-1024 - Pods [[1], [1]] | ||
|
|
||
| ### Loading | ||
| time_load terminals pods Imported warehouses [1/h] | ||
| MariaDB-1-1-1024-1-1 325.0 1.0 1.0 177.230769 | ||
| MariaDB-1-1-1024-2-1 325.0 1.0 1.0 177.230769 | ||
|
|
||
| ### Tests | ||
| TEST passed: Throughput (requests/second) contains no 0 or NaN | ||
| TEST passed: Workflow as planned |
Oops, something went wrong.