forked from mlcommons/inference
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge branch 'master' into fix_test04
- Loading branch information
Showing
110 changed files
with
6,428 additions
and
1,226 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,34 @@ | ||
| name: Auto-Update Dev Branch from Master | ||
|
|
||
| on: | ||
| push: | ||
| branches: | ||
| - master # Trigger workflow on commits to 'dev' branch | ||
|
|
||
| jobs: | ||
| update-main: | ||
| runs-on: ubuntu-latest | ||
| permissions: | ||
| contents: write # Required to push to protected branches | ||
|
|
||
| steps: | ||
| - name: Checkout Main Branch | ||
| uses: actions/checkout@v4 | ||
| with: | ||
| ref: dev | ||
| fetch-depth: 0 | ||
| ssh-key: ${{ secrets.DEPLOY_KEY }} | ||
|
|
||
| - name: Configure Git User | ||
| run: | | ||
| git config user.name "github-actions" | ||
| git config user.email "github-actions@github.com" | ||
| - name: Merge auto-update into dev | ||
| run: | | ||
| git fetch origin master:master | ||
| git merge --no-ff master -m "Auto-merge updates from master branch" | ||
| - name: Push Changes to Main | ||
| run: | | ||
| git push origin dev |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -7,7 +7,6 @@ on: | |
| branches: | ||
| - master | ||
| - loadgen-release | ||
| - dev | ||
| paths: | ||
| - loadgen/** | ||
|
|
||
|
|
||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,42 @@ | ||
| name: Reset Current Branch to Upstream After Squash Merge | ||
|
|
||
| on: | ||
| workflow_dispatch: | ||
| inputs: | ||
| branch: | ||
| description: 'Branch to reset (leave blank for current branch)' | ||
| required: false | ||
| default: 'dev' | ||
|
|
||
| jobs: | ||
| reset-branch: | ||
| runs-on: ubuntu-latest | ||
|
|
||
| steps: | ||
| - name: Checkout Repository | ||
| uses: actions/checkout@v4 | ||
| with: | ||
| fetch-depth: 0 | ||
|
|
||
| - name: Detect Current Branch | ||
| if: ${{ inputs.branch == '' }} | ||
| run: echo "branch=$(git rev-parse --abbrev-ref HEAD)" >> $GITHUB_ENV | ||
|
|
||
| - name: Use Input Branch | ||
| if: ${{ inputs.branch != '' }} | ||
| run: echo "branch=${{ inputs.branch }}" >> $GITHUB_ENV | ||
|
|
||
| - name: Add Upstream Remote | ||
| run: | | ||
| git remote add upstream https://github.com/mlcommons/inference.git | ||
| git fetch upstream | ||
| - name: Reset Branch to Upstream | ||
| run: | | ||
| git checkout ${{ env.branch }} | ||
| git reset --hard upstream/${{ env.branch }} | ||
| if: success() | ||
|
|
||
| - name: Force Push to Origin | ||
| run: | | ||
| git push origin ${{ env.branch }} --force-with-lease | ||
| if: success() |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,38 @@ | ||
| name: Test for MLPerf inference rgat submission generation using CM script automation | ||
|
|
||
| on: | ||
| pull_request: | ||
| branches: [ "master", "dev" ] | ||
| paths: | ||
| - graph/R-GAT/** | ||
| - loadgen/** | ||
| - tools/submission/** | ||
| - .github/workflows/test-rgat.yml | ||
| - '!**.md' | ||
|
|
||
| env: | ||
| PR_HEAD_REF: ${{ github.event.pull_request.head.ref }} | ||
|
|
||
| jobs: | ||
| build: | ||
|
|
||
| runs-on: ubuntu-latest | ||
| strategy: | ||
| fail-fast: false | ||
| matrix: | ||
| python-version: [ "3.11" ] | ||
| backend: [ "pytorch" ] | ||
| loadgen-flag: [ "" ] | ||
|
|
||
| steps: | ||
| - uses: actions/checkout@v3 | ||
| - name: Set up Python ${{ matrix.python-version }} | ||
| uses: actions/setup-python@v3 | ||
| with: | ||
| python-version: ${{ matrix.python-version }} | ||
| - name: Install dependencies | ||
| run: | | ||
| python3 -m pip install cm4mlops | ||
| - name: Test R-GAT and end to end submission generation | ||
| run: | | ||
| cm run script --tags=run,mlperf,inference,generate-run-cmds,_submission,_short --quiet --submitter="MLCommons" --category=datacenter --hw_name=default --model=rgat --implementation=reference --backend=${{ matrix.backend }} --device=cpu --scenario=Offline --test_query_count=500 --adr.compiler.tags=gcc --adr.inference-src.tags=_branch.$PR_HEAD_REF,_repo.${{ github.event.pull_request.head.repo.html_url }} --adr.inference-src-loadgen.tags=_branch.$PR_HEAD_REF,_repo.${{ github.event.pull_request.head.repo.html_url }} --adr.inference-src-loadgen.version=custom --adr.loadgen.version=custom ${{ matrix.loadgen-flag }} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,52 @@ | ||
| # This workflow will test the submission generation using MLPerf Automation | ||
|
|
||
| name: CM based Submission Generation | ||
|
|
||
| on: | ||
| pull_request: | ||
| branches: [ "master", "dev" ] | ||
| paths: | ||
| - '.github/workflows/test-submission-generation.yml' | ||
| - '**' | ||
| - '!**.md' | ||
| jobs: | ||
| submission_generation: | ||
| runs-on: ${{ matrix.os }} | ||
| strategy: | ||
| fail-fast: false | ||
| matrix: | ||
| os: [ubuntu-latest, windows-latest, macos-latest] | ||
| python-version: [ "3.12" ] | ||
| division: ["closed", "open", "closed-open"] | ||
| category: ["datacenter", "edge"] | ||
| case: ["closed"] | ||
| action: ["run", "docker"] | ||
| exclude: | ||
| - os: macos-latest | ||
| - os: windows-latest | ||
| - category: "edge" | ||
|
|
||
| steps: | ||
| - uses: actions/checkout@v4 | ||
| - name: Set up Python ${{ matrix.python-version }} | ||
| uses: actions/setup-python@v3 | ||
| with: | ||
| python-version: ${{ matrix.python-version }} | ||
| - name: Install dependencies | ||
| run: | | ||
| pip install cm4mlops | ||
| - name: Pull repo where test cases are uploaded | ||
| run: | | ||
| git clone -b submission-generation-examples https://github.com/mlcommons/inference.git submission_generation_examples | ||
| - name: Run Submission Generation - ${{ matrix.case }} ${{ matrix.action }} ${{ matrix.category }} ${{ matrix.division }} | ||
| continue-on-error: true | ||
| run: | | ||
| if [ "${{ matrix.case }}" == "closed" ]; then | ||
| description="Test submission - contains closed edge and datacenter" | ||
| elif [ "${{ matrix.case }}" == "closed-power" ]; then | ||
| description="Test submission - contains closed-power edge and datacenter results" | ||
| fi | ||
| # Dynamically set the log group to simulate a dynamic step name | ||
| echo "::group::$description" | ||
| cm ${{ matrix.action }} script --tags=generate,inference,submission --adr.compiler.tags=gcc --version=v5.0 --clean --preprocess_submission=yes --submission_base_dir=mysubmissions --results_dir=$PWD/submission_generation_tests/${{ matrix.case }}/ --run-checker --submitter=MLCommons --tar=yes --division=${{ matrix.division }} --env.CM_DETERMINE_MEMORY_CONFIGURATION=yes --quiet | ||
| cm ${{ matrix.action }} script --tags=run,submission,checker --submitter_id_off=mysubmitter_id --tar=yes --submission_dir=mysubmissions/submissions --submission_tar_file=mysubmission.tar.gz |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -2,3 +2,4 @@ loadgen/build/ | |
| libmlperf_loadgen.a | ||
| __pycache__/ | ||
| generated/ | ||
| *.swp | ||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,14 @@ | ||
| ## Reference implementation fo automotive 3D detection benchmark | ||
|
|
||
| ## TODO: Instructions for dataset download after it is uploaded somewhere appropriate | ||
|
|
||
| ## TODO: Instructions for checkpoints downloads after it is uploaded somewhere appropriate | ||
|
|
||
| ## Running with docker | ||
| ``` | ||
| docker build -t auto_inference -f dockerfile.gpu . | ||
| docker run --gpus=all -it -v <directory to inference repo>/inference/:/inference -v <directory to waymo dataset>/waymo:/waymo --rm auto_inference | ||
| cd /inference/automotive/3d-object-detection | ||
| python main.py --dataset waymo --dataset-path /waymo/kitti_format/ --lidar-path <checkpoint_path>/pp_ep36.pth --segmentor-path <checkpoint_path>/best_deeplabv3plus_resnet50_waymo_os16.pth --mlperf_conf /inference/mlperf.conf |
Oops, something went wrong.