Code

Implementing BDN Perf pipeline#758

Code

Merged

darrenge merged 62 commits intomainmicrosoft/garnet:mainfrom darrenge/BDNPerfmicrosoft/garnet:darrenge/BDNPerfCopy head branch name to clipboardDec 11, 2024

+365-5

Commits

Commits on Sep 9, 2024

• The CI scripts, YML and config files to check perf using BDN benchmarking. Also, a fix in ClusterBench for and renamed Lua Runner benchmarking

  darrenge

  committed
  a81a31e

  Copy full SHA for a81a31e

• Cleaned up the debug message and updated couple expected values

  darrenge

  committed
  f66f63f

  Copy full SHA for f66f63f

• Updated SAddRem - windows - to 130 from 118. Also removed unncesssary build statement in YML

  darrenge

  committed
  b0c8cc4

  Copy full SHA for b0c8cc4

• Proof of concept for Performance run on ADO using BDN

  darrenge

  committed
  2b0ec1f

  Copy full SHA for 2b0ec1f

• Comment out number of Cores check so can try proof of concept on ADO perf machines

  darrenge

  committed
  ebd13e4

  Copy full SHA for ebd13e4

Commits on Oct 8, 2024

• Merged

  darrenge

  committed
  fb8ee2b

  Copy full SHA for fb8ee2b

• Getting close to having BDN working

  darrenge

  committed
  37d12df

  Copy full SHA for 37d12df

• Fixed RespLuaStress

  darrenge

  committed
  b97f807

  Copy full SHA for b97f807

• Fixed issue in Lua Runner Stress

  darrenge

  committed
  ba45091

  Copy full SHA for ba45091

Commits on Oct 9, 2024

• Updated config values, set charting and commit comment as separate tasks

  darrenge

  committed
  bff5a21

  Copy full SHA for bff5a21

• Updated config values

  darrenge

  committed
  83169ef

  Copy full SHA for 83169ef

• Minor change to YML (remove pull requests) and updated LuaRunner config value

  darrenge

  committed
  cd17683

  Copy full SHA for cd17683

• One more config value fix

  darrenge

  committed
  b334f65

  Copy full SHA for b334f65

• Added a task to do the push

  darrenge

  committed
  4df29ee

  Copy full SHA for 4df29ee

Commits on Oct 10, 2024

• Putting back to push chart in the chart task and not a separate one

  darrenge

  committed
  82f6f15

  Copy full SHA for 82f6f15

• Moved the permissions to full workflow

  darrenge

  committed
  58038d1

  Copy full SHA for 58038d1

• Just minor to add commits

  darrenge

  committed
  5875d87

  Copy full SHA for 5875d87

• Adding actions: write permit since actions default to read only

  darrenge

  committed
  d69a07b

  Copy full SHA for d69a07b

Commits on Oct 14, 2024

• Set up the commit comment for BDN as well as summary to show current vs previous BDN perf numbers

  darrenge

  committed
  68d0972

  Copy full SHA for 68d0972

• A few fixes

  darrenge

  committed
  f8ddb6c

  Copy full SHA for f8ddb6c

Commits on Oct 16, 2024

• Updated BDN perf YML, config files and ps1 script

  darrenge

  committed
  8e05865

  Copy full SHA for 8e05865

• Versioning issue with BDN test files, fixed now

  darrenge

  committed
  4008726

  Copy full SHA for 4008726

• Merge branch 'main' into darrenge/BDNPerf

  darrenge

  committed
  82881ff

  Copy full SHA for 82881ff

• Bump threshold to 35% (135%) to trigger perf failure

  darrenge

  committed
  cdf2d25

  Copy full SHA for cdf2d25

• Set to Linux only to reduce number of consectutive tests which caused push collisions with GitHub

  darrenge

  committed
  00b3674

  Copy full SHA for 00b3674

• Just Windows only test run

  darrenge

  committed
  414168e

  Copy full SHA for 414168e

• Putting it back to both OS for the tests

  darrenge

  committed
  28ccbb4

  Copy full SHA for 28ccbb4

• Set threshhold to 50% (150%) as seeing BDN ran twice on same code sometimes is in 40%+ range of difference.

  darrenge

  committed
  23296d6

  Copy full SHA for 23296d6

Commits on Oct 18, 2024

• Big change where using continuousbenchmark branch for all data for continuous benchmarking and also changed to where script is only checking allocated values and let github-action-benchmark compare…

  Show description for 1f36768
  darrenge

  committed
  1f36768

  Copy full SHA for 1f36768

• Updated ClusterBench to get main changes

  darrenge

  committed
  ef0cf7b

  Copy full SHA for ef0cf7b

• Merge branch 'main' into darrenge/BDNPerf

  darrenge

  committed
  df16e9c

  Copy full SHA for df16e9c

• Fix issue with Cluster BDN is not able to access folder so setting to tmp which does have access

  darrenge

  committed
  d5953a2

  Copy full SHA for d5953a2

• Bumping threshold to 50% (150%) as mean value in RespParseStress can vary into the 40% from run to run.

  darrenge

  committed
  d58bf0d

  Copy full SHA for d58bf0d

Commits on Oct 21, 2024

• Merged Main

  darrenge

  committed
  6414fac

  Copy full SHA for 6414fac

Commits on Oct 22, 2024

• First update

  darrenge

  committed
  75e78c3

  Copy full SHA for 75e78c3

• Merge branch 'main' into darrenge/BDNPerf

  darrenge

  committed
  40e111c

  Copy full SHA for 40e111c

• Hiding the Gen0 column for Lua benchmark

  darrenge

  committed
  e22218c

  Copy full SHA for e22218c

Commits on Oct 28, 2024

• Merge branch 'main' into darrenge/BDNPerf

  darrenge

  committed
  b609c0c

  Copy full SHA for b609c0c

• Updated BDN test infrastructure to match the new BDN org.

  darrenge

  committed
  f9a963b

  Copy full SHA for f9a963b

• Fix bug in ObjectOperations

  darrenge

  committed
  665bda1

  Copy full SHA for 665bda1

• Set max items on chart to 50 ... can modify later if want

  darrenge

  committed
  0d1fd6f

  Copy full SHA for 0d1fd6f

Commits on Oct 29, 2024

• Merge branch 'main' into darrenge/BDNPerf

  darrenge

  committed
  da030c6

  Copy full SHA for da030c6

• Added the run on push to main

  darrenge

  committed
  6725d99

  Copy full SHA for 6725d99

• Put Performance Pipeline back

  darrenge

  committed
  da6b517

  Copy full SHA for da6b517

• Fixed the default case when no parameters sent to ps1

  darrenge

  committed
  3871a3f

  Copy full SHA for 3871a3f

Commits on Oct 30, 2024

• Merge branch 'main' into darrenge/BDNPerf

  darrenge

  authored
  3d6d7b2

  Copy full SHA for 3d6d7b2

Commits on Oct 31, 2024

• Merge branch 'main' into darrenge/BDNPerf

  darrenge

  authored
  591fadc

  Copy full SHA for 591fadc

• Cleaned up config files:

  Show description for bf06727
  darrenge

  committed
  bf06727

  Copy full SHA for bf06727

Commits on Nov 7, 2024

• Merge branch 'main' into darrenge/BDNPerf

  darrenge

  committed
  4b0e0b4

  Copy full SHA for 4b0e0b4

Commits on Nov 25, 2024

• Merge branch 'main' into darrenge/BDNPerf

  darrenge

  authored
  eb98c20

  Copy full SHA for eb98c20

• Merge branch 'darrenge/BDNPerf' of https://github.com/microsoft/garnet into darrenge/BDNPerf

  darrenge

  committed
  4346f0d

  Copy full SHA for 4346f0d

Commits on Dec 2, 2024

• Merge branch 'main' into darrenge/BDNPerf

  darrenge

  authored
  a05e91e

  Copy full SHA for a05e91e

• Merge branch 'darrenge/BDNPerf' of https://github.com/microsoft/garnet into darrenge/BDNPerf

  darrenge

  committed
  fa25852

  Copy full SHA for fa25852

• Big update to where moved to a single config file and the ps1 file does not need to be updated when new BDNs are added.

  darrenge

  committed
  ef9d9f0

  Copy full SHA for ef9d9f0

Commits on Dec 9, 2024

• Added workflow_dispatch: to deploy website yml so we can manually deploy website if we want

  darrenge

  committed
  0f0e6c9

  Copy full SHA for 0f0e6c9

Commits on Dec 10, 2024

• Merge branch 'main' into darrenge/BDNPerf

  darrenge

  authored
  76e5d5b

  Copy full SHA for 76e5d5b

• Merge branch 'darrenge/BDNPerf' of https://github.com/microsoft/garnet into darrenge/BDNPerf

  darrenge

  committed
  5b792e2

  Copy full SHA for 5b792e2

• Updated alert-threshold from 150% to 140%. If too many false positives we can raise it back. Also, removed darrenge from the alert CC line as no need for that.

  darrenge

  committed
  5571602

  Copy full SHA for 5571602

• Removed the commit comment / comparison to previous commit task. Still will get summary data in the specific workflow run and still uploads data to charts (when pushing to main).

  darrenge

  committed
  7799136

  Copy full SHA for 7799136

Commits on Dec 11, 2024

• Minor update - comments only

  darrenge

  committed
  4e1975f

  Copy full SHA for 4e1975f

• Merge branch 'main' into darrenge/BDNPerf

  darrenge

  authored
  ca49fd5

  Copy full SHA for ca49fd5

• Merge branch 'main' into darrenge/BDNPerf

  darrenge

  authored
  4016ec4

  Copy full SHA for 4016ec4