We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Command used:
mlc run script --tags=run-mlperf,inference,_r5.0-dev \ --model=resnet50 \ --implementation=reference \ --framework=onnxruntime \ --category=edge \ --scenario=SingleStream \ --execution_mode=valid \ --device=cpu \ --quiet
Error:
[2025-02-07 15:23:02,751 main.py:159 WARNING] - Warning: /home/junikki/MLC/repos/GATEOverflow@mlperf-automations/meta.yaml not found. Skipping... [2025-02-07 15:23:05,136 module.py:574 INFO] - * mlcr run-mlperf,inference,_r5.0-dev [2025-02-07 15:23:05,146 module.py:574 INFO] - * mlcr detect,os [2025-02-07 15:23:05,151 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:05,151 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh [2025-02-07 15:23:05,203 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py [2025-02-07 15:23:05,259 module.py:574 INFO] - * mlcr detect,cpu [2025-02-07 15:23:05,275 module.py:574 INFO] - * mlcr detect,os [2025-02-07 15:23:05,285 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:05,285 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh [2025-02-07 15:23:05,312 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py [2025-02-07 15:23:05,324 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:05,324 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/run.sh from tmp-run.sh [2025-02-07 15:23:05,449 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/customize.py [2025-02-07 15:23:05,462 module.py:574 INFO] - * mlcr get,python3 [2025-02-07 15:23:05,469 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json [2025-02-07 15:23:05,469 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3 [2025-02-07 15:23:05,469 module.py:2234 INFO] - Python version: 3.12.3 [2025-02-07 15:23:05,487 module.py:574 INFO] - * mlcr get,mlcommons,inference,src [2025-02-07 15:23:05,493 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-mlperf-inference-src_a07181d4/mlc-cached-state.json [2025-02-07 15:23:05,503 module.py:574 INFO] - * mlcr get,sut,description [2025-02-07 15:23:05,512 module.py:574 INFO] - * mlcr detect,os [2025-02-07 15:23:05,517 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:05,517 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh [2025-02-07 15:23:05,549 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py [2025-02-07 15:23:05,564 module.py:574 INFO] - * mlcr detect,cpu [2025-02-07 15:23:05,579 module.py:574 INFO] - * mlcr detect,os [2025-02-07 15:23:05,585 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:05,585 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh [2025-02-07 15:23:05,622 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py [2025-02-07 15:23:05,637 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:05,637 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/run.sh from tmp-run.sh [2025-02-07 15:23:05,695 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/customize.py [2025-02-07 15:23:05,710 module.py:574 INFO] - * mlcr get,python3 [2025-02-07 15:23:05,711 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json [2025-02-07 15:23:05,712 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3 [2025-02-07 15:23:05,712 module.py:2234 INFO] - Python version: 3.12.3 [2025-02-07 15:23:05,725 module.py:574 INFO] - * mlcr get,compiler [2025-02-07 15:23:05,732 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-llvm_5712a1be/mlc-cached-state.json [2025-02-07 15:23:05,796 module.py:574 INFO] - * mlcr get,generic-python-lib,_package.dmiparser [2025-02-07 15:23:05,816 module.py:574 INFO] - * mlcr get,python3 [2025-02-07 15:23:05,817 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json [2025-02-07 15:23:05,817 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3 [2025-02-07 15:23:05,818 module.py:2234 INFO] - Python version: 3.12.3 [2025-02-07 15:23:05,818 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:05,818 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh [2025-02-07 15:23:05,984 module.py:5501 INFO] - ! call "detect_version" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py Detected version: 5.1 [2025-02-07 15:23:06,032 module.py:574 INFO] - * mlcr get,python3 [2025-02-07 15:23:06,033 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json [2025-02-07 15:23:06,033 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3 [2025-02-07 15:23:06,034 module.py:2234 INFO] - Python version: 3.12.3 [2025-02-07 15:23:06,035 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-generic-python-lib_6d752be3/mlc-cached-state.json [2025-02-07 15:23:06,045 module.py:574 INFO] - * mlcr get,cache,dir,_name.mlperf-inference-sut-descriptions [2025-02-07 15:23:06,050 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-cache-dir_1d7ae6e0/mlc-cached-state.json Generating SUT description file for junikki-onnxruntime [2025-02-07 15:23:06,059 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-mlperf-inference-sut-description/customize.py [2025-02-07 15:23:06,071 module.py:574 INFO] - * mlcr get,mlperf,inference,results,dir,_version.r5.0-dev [2025-02-07 15:23:06,077 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-mlperf-inference-results-dir_7dbef0e6/mlc-cached-state.json [2025-02-07 15:23:06,084 module.py:574 INFO] - * mlcr install,pip-package,for-cmind-python,_package.tabulate [2025-02-07 15:23:06,088 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/install-pip-package-for-cmind-python_bfa97df5/mlc-cached-state.json [2025-02-07 15:23:06,095 module.py:574 INFO] - * mlcr get,mlperf,inference,utils [2025-02-07 15:23:06,115 module.py:574 INFO] - * mlcr get,mlperf,inference,src [2025-02-07 15:23:06,116 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-mlperf-inference-src_a07181d4/mlc-cached-state.json [2025-02-07 15:23:06,120 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-mlperf-inference-utils/customize.py Using MLCommons Inference source from /home/junikki/MLC/repos/local/cache/get-git-repo_09ef9823/inference Running loadgen scenario: SingleStream and mode: performance [2025-02-07 15:23:06,272 module.py:574 INFO] - * mlcr app,mlperf,inference,generic,_reference,_resnet50,_onnxruntime,_cpu,_valid,_r5.0-dev_default,_singlestream [2025-02-07 15:23:06,285 module.py:574 INFO] - * mlcr detect,os [2025-02-07 15:23:06,290 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:06,290 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh [2025-02-07 15:23:06,322 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py [2025-02-07 15:23:06,338 module.py:574 INFO] - * mlcr get,sys-utils-cm [2025-02-07 15:23:06,340 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-sys-utils-cm_b9703e08/mlc-cached-state.json [2025-02-07 15:23:06,348 module.py:574 INFO] - * mlcr get,python [2025-02-07 15:23:06,349 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json [2025-02-07 15:23:06,350 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3 [2025-02-07 15:23:06,350 module.py:2234 INFO] - Python version: 3.12.3 [2025-02-07 15:23:06,370 module.py:574 INFO] - * mlcr get,mlcommons,inference,src [2025-02-07 15:23:06,372 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-mlperf-inference-src_f3820db3/mlc-cached-state.json [2025-02-07 15:23:06,379 module.py:574 INFO] - * mlcr get,mlperf,inference,utils [2025-02-07 15:23:06,428 module.py:574 INFO] - * mlcr get,mlperf,inference,src [2025-02-07 15:23:06,430 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-mlperf-inference-src_f3820db3/mlc-cached-state.json [2025-02-07 15:23:06,434 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-mlperf-inference-utils/customize.py [2025-02-07 15:23:06,447 module.py:574 INFO] - * mlcr get,dataset-aux,imagenet-aux [2025-02-07 15:23:06,449 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-dataset-imagenet-aux_f0ba00e8/mlc-cached-state.json [2025-02-07 15:23:06,559 module.py:574 INFO] - * mlcr app,mlperf,reference,inference,_onnxruntime,_singlestream,_cpu,_resnet50,_fp32 [2025-02-07 15:23:06,575 module.py:574 INFO] - * mlcr detect,os [2025-02-07 15:23:06,579 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:06,579 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh [2025-02-07 15:23:06,619 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py [2025-02-07 15:23:06,636 module.py:574 INFO] - * mlcr detect,cpu [2025-02-07 15:23:06,645 module.py:574 INFO] - * mlcr detect,os [2025-02-07 15:23:06,650 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:06,651 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh [2025-02-07 15:23:06,676 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py [2025-02-07 15:23:06,690 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:06,690 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/run.sh from tmp-run.sh [2025-02-07 15:23:06,745 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/customize.py [2025-02-07 15:23:06,760 module.py:574 INFO] - * mlcr get,sys-utils-cm [2025-02-07 15:23:06,761 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-sys-utils-cm_b9703e08/mlc-cached-state.json [2025-02-07 15:23:06,776 module.py:574 INFO] - * mlcr get,python [2025-02-07 15:23:06,777 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json [2025-02-07 15:23:06,778 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3 [2025-02-07 15:23:06,778 module.py:2234 INFO] - Python version: 3.12.3 [2025-02-07 15:23:06,985 module.py:574 INFO] - * mlcr get,generic-python-lib,_onnxruntime [2025-02-07 15:23:06,998 module.py:574 INFO] - * mlcr get,python3 [2025-02-07 15:23:06,999 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json [2025-02-07 15:23:07,000 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3 [2025-02-07 15:23:07,000 module.py:2234 INFO] - Python version: 3.12.3 [2025-02-07 15:23:07,000 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:07,000 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh [2025-02-07 15:23:07,093 module.py:5501 INFO] - ! call "detect_version" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py Detected version: 1.20.1 [2025-02-07 15:23:07,109 module.py:574 INFO] - * mlcr get,python3 [2025-02-07 15:23:07,110 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json [2025-02-07 15:23:07,111 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3 [2025-02-07 15:23:07,111 module.py:2234 INFO] - Python version: 3.12.3 [2025-02-07 15:23:07,111 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-generic-python-lib_ae88eefc/mlc-cached-state.json [2025-02-07 15:23:07,186 module.py:574 INFO] - * mlcr get,ml-model,image-classification,resnet50,raw,_onnx,_fp32 [2025-02-07 15:23:07,192 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-ml-model-resnet50_6e42d8eb/mlc-cached-state.json [2025-02-07 15:23:07,193 module.py:2234 INFO] - Path to the ML model: /home/junikki/MLC/repos/local/cache/download-file_62719d73/resnet50_v1.onnx [2025-02-07 15:23:07,273 module.py:574 INFO] - * mlcr get,dataset,image-classification,imagenet,preprocessed,_NCHW [2025-02-07 15:23:07,282 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0a21fb11/mlc-cached-state.json [2025-02-07 15:23:07,303 module.py:574 INFO] - * mlcr get,dataset-aux,image-classification,imagenet-aux [2025-02-07 15:23:07,304 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-dataset-imagenet-aux_f0ba00e8/mlc-cached-state.json [2025-02-07 15:23:07,322 module.py:574 INFO] - * mlcr generate,user-conf,mlperf,inference [2025-02-07 15:23:07,331 module.py:574 INFO] - * mlcr detect,os [2025-02-07 15:23:07,336 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:07,336 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh [2025-02-07 15:23:07,370 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py [2025-02-07 15:23:07,387 module.py:574 INFO] - * mlcr detect,cpu [2025-02-07 15:23:07,395 module.py:574 INFO] - * mlcr detect,os [2025-02-07 15:23:07,401 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:07,401 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh [2025-02-07 15:23:07,428 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py [2025-02-07 15:23:07,442 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:07,443 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/run.sh from tmp-run.sh [2025-02-07 15:23:07,503 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/customize.py [2025-02-07 15:23:07,535 module.py:574 INFO] - * mlcr get,python [2025-02-07 15:23:07,539 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json [2025-02-07 15:23:07,541 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3 [2025-02-07 15:23:07,541 module.py:2234 INFO] - Python version: 3.12.3 [2025-02-07 15:23:07,565 module.py:574 INFO] - * mlcr get,mlcommons,inference,src [2025-02-07 15:23:07,567 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-mlperf-inference-src_f3820db3/mlc-cached-state.json [2025-02-07 15:23:07,575 module.py:574 INFO] - * mlcr get,sut,configs [2025-02-07 15:23:07,584 module.py:574 INFO] - * mlcr get,cache,dir,_name.mlperf-inference-sut-configs [2025-02-07 15:23:07,585 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-cache-dir_87e54fb9/mlc-cached-state.json [2025-02-07 15:23:07,587 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-mlperf-inference-sut-configs/customize.py Using MLCommons Inference source from '/home/junikki/MLC/repos/local/cache/get-git-repo_09ef9823/inference' Original configuration value 0.1 target_latency Adjusted configuration value 0.04000000000000001 target_latency Output Dir: '/home/junikki/MLC/repos/local/cache/get-mlperf-inference-results-dir_7dbef0e6/valid_results/junikki-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/singlestream/performance/run_1' resnet50.SingleStream.target_latency = 0.04000000000000001 resnet50.SingleStream.max_duration = 660000 [2025-02-07 15:23:07,659 module.py:574 INFO] - * mlcr get,loadgen [2025-02-07 15:23:07,663 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-mlperf-inference-loadgen_becfd7bd/mlc-cached-state.json [2025-02-07 15:23:07,664 module.py:2234 INFO] - Path to the tool: /home/junikki/MLC/repos/local/cache/get-mlperf-inference-loadgen_becfd7bd/install [2025-02-07 15:23:07,714 module.py:574 INFO] - * mlcr get,mlcommons,inference,src [2025-02-07 15:23:07,717 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-mlperf-inference-src_f3820db3/mlc-cached-state.json [2025-02-07 15:23:07,770 module.py:574 INFO] - * mlcr get,mlcommons,inference,src [2025-02-07 15:23:07,772 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-mlperf-inference-src_a07181d4/mlc-cached-state.json [2025-02-07 15:23:07,978 module.py:574 INFO] - * mlcr get,generic-python-lib,_package.psutil [2025-02-07 15:23:07,991 module.py:574 INFO] - * mlcr get,python3 [2025-02-07 15:23:07,991 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json [2025-02-07 15:23:07,992 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3 [2025-02-07 15:23:07,992 module.py:2234 INFO] - Python version: 3.12.3 [2025-02-07 15:23:07,993 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:07,993 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh [2025-02-07 15:23:08,094 module.py:5501 INFO] - ! call "detect_version" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py Detected version: 6.1.1 [2025-02-07 15:23:08,113 module.py:574 INFO] - * mlcr get,python3 [2025-02-07 15:23:08,114 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json [2025-02-07 15:23:08,114 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3 [2025-02-07 15:23:08,115 module.py:2234 INFO] - Python version: 3.12.3 [2025-02-07 15:23:08,115 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-generic-python-lib_eb259fd2/mlc-cached-state.json [2025-02-07 15:23:08,324 module.py:574 INFO] - * mlcr get,generic-python-lib,_opencv-python [2025-02-07 15:23:08,337 module.py:574 INFO] - * mlcr get,python3 [2025-02-07 15:23:08,338 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json [2025-02-07 15:23:08,338 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3 [2025-02-07 15:23:08,339 module.py:2234 INFO] - Python version: 3.12.3 [2025-02-07 15:23:08,339 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:08,339 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh [2025-02-07 15:23:08,441 module.py:5501 INFO] - ! call "detect_version" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py Detected version: 4.11.0.86 [2025-02-07 15:23:08,459 module.py:574 INFO] - * mlcr get,python3 [2025-02-07 15:23:08,461 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json [2025-02-07 15:23:08,461 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3 [2025-02-07 15:23:08,461 module.py:2234 INFO] - Python version: 3.12.3 [2025-02-07 15:23:08,462 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-generic-python-lib_1791e3ac/mlc-cached-state.json [2025-02-07 15:23:08,671 module.py:574 INFO] - * mlcr get,generic-python-lib,_numpy [2025-02-07 15:23:08,684 module.py:574 INFO] - * mlcr get,python3 [2025-02-07 15:23:08,685 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json [2025-02-07 15:23:08,685 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3 [2025-02-07 15:23:08,685 module.py:2234 INFO] - Python version: 3.12.3 [2025-02-07 15:23:08,686 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:08,686 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh [2025-02-07 15:23:08,784 module.py:5501 INFO] - ! call "detect_version" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py Detected version: 1.26.4 [2025-02-07 15:23:08,802 module.py:574 INFO] - * mlcr get,python3 [2025-02-07 15:23:08,803 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json [2025-02-07 15:23:08,804 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3 [2025-02-07 15:23:08,804 module.py:2234 INFO] - Python version: 3.12.3 [2025-02-07 15:23:08,804 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:08,805 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh [2025-02-07 15:23:08,905 module.py:5501 INFO] - ! call "detect_version" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py Detected version: 1.26.4 [2025-02-07 15:23:08,941 module.py:574 INFO] - * mlcr get,python3 [2025-02-07 15:23:08,945 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json [2025-02-07 15:23:08,947 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3 [2025-02-07 15:23:08,947 module.py:2234 INFO] - Python version: 3.12.3 [2025-02-07 15:23:08,950 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-generic-python-lib_b0eede39/mlc-cached-state.json [2025-02-07 15:23:09,167 module.py:574 INFO] - * mlcr get,generic-python-lib,_pycocotools [2025-02-07 15:23:09,180 module.py:574 INFO] - * mlcr get,python3 [2025-02-07 15:23:09,181 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json [2025-02-07 15:23:09,181 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3 [2025-02-07 15:23:09,182 module.py:2234 INFO] - Python version: 3.12.3 [2025-02-07 15:23:09,182 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:09,182 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/validate_cache.sh from tmp-run.sh [2025-02-07 15:23:09,291 module.py:5501 INFO] - ! call "detect_version" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/get-generic-python-lib/customize.py Detected version: 2.0.8 [2025-02-07 15:23:09,311 module.py:574 INFO] - * mlcr get,python3 [2025-02-07 15:23:09,312 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-python3_1165d524/mlc-cached-state.json [2025-02-07 15:23:09,313 module.py:2234 INFO] - Path to Python: /media/junikki/research/mlcommons/mlc/bin/python3 [2025-02-07 15:23:09,313 module.py:2234 INFO] - Python version: 3.12.3 [2025-02-07 15:23:09,314 module.py:1288 INFO] - ! load /home/junikki/MLC/repos/local/cache/get-generic-python-lib_1077e419/mlc-cached-state.json Using MLCommons Inference source from '/home/junikki/MLC/repos/local/cache/get-git-repo_09ef9823/inference' [2025-02-07 15:23:09,323 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/app-mlperf-inference-mlcommons-python/customize.py [2025-02-07 15:23:09,340 module.py:574 INFO] - * mlcr benchmark-mlperf [2025-02-07 15:23:09,349 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/benchmark-program-mlperf/customize.py [2025-02-07 15:23:09,364 module.py:574 INFO] - * mlcr benchmark-program,program [2025-02-07 15:23:09,375 module.py:574 INFO] - * mlcr detect,cpu [2025-02-07 15:23:09,384 module.py:574 INFO] - * mlcr detect,os [2025-02-07 15:23:09,391 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:09,391 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/run.sh from tmp-run.sh [2025-02-07 15:23:09,430 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-os/customize.py [2025-02-07 15:23:09,445 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:09,445 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/run.sh from tmp-run.sh [2025-02-07 15:23:09,511 module.py:5501 INFO] - ! call "postprocess" from /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/detect-cpu/customize.py *************************************************************************** CM script::benchmark-program/run.sh Run Directory: /home/junikki/MLC/repos/local/cache/get-git-repo_09ef9823/inference/vision/classification_and_detection CMD: ./run_local.sh onnxruntime resnet50 cpu --scenario SingleStream --threads 8 --user_conf '/home/junikki/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/f17b58b1597544b9b563770c755a704a.conf' --use_preprocessed_dataset --cache_dir /home/junikki/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0a21fb11 --dataset-list /home/junikki/MLC/repos/local/cache/extract-file_0b41141c/val.txt 2>&1 | tee '/home/junikki/MLC/repos/local/cache/get-mlperf-inference-results-dir_7dbef0e6/valid_results/junikki-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/singlestream/performance/run_1/console.out'; echo \${PIPESTATUS[0]} > exitstatus [2025-02-07 15:23:09,522 module.py:5354 INFO] - ! cd /media/junikki/research/mlcommons [2025-02-07 15:23:09,522 module.py:5355 INFO] - ! call /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/benchmark-program/run-ubuntu.sh from tmp-run.sh ./run_local.sh onnxruntime resnet50 cpu --scenario SingleStream --threads 8 --user_conf '/home/junikki/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/f17b58b1597544b9b563770c755a704a.conf' --use_preprocessed_dataset --cache_dir /home/junikki/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0a21fb11 --dataset-list /home/junikki/MLC/repos/local/cache/extract-file_0b41141c/val.txt 2>&1 | tee '/home/junikki/MLC/repos/local/cache/get-mlperf-inference-results-dir_7dbef0e6/valid_results/junikki-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/singlestream/performance/run_1/console.out'; echo ${PIPESTATUS[0]} > exitstatus python3 python/main.py --profile resnet50-onnxruntime --model "/home/junikki/MLC/repos/local/cache/download-file_62719d73/resnet50_v1.onnx" --dataset-path /home/junikki/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0a21fb11 --output "/home/junikki/MLC/repos/local/cache/get-mlperf-inference-results-dir_7dbef0e6/valid_results/junikki-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/singlestream/performance/run_1" --scenario SingleStream --threads 8 --user_conf /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/f17b58b1597544b9b563770c755a704a.conf --use_preprocessed_dataset --cache_dir /home/junikki/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0a21fb11 --dataset-list /home/junikki/MLC/repos/local/cache/extract-file_0b41141c/val.txt INFO:main:Namespace(dataset='imagenet', dataset_path='/home/junikki/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0a21fb11', dataset_list='/home/junikki/MLC/repos/local/cache/extract-file_0b41141c/val.txt', data_format=None, profile='resnet50-onnxruntime', scenario='SingleStream', max_batchsize=32, model='/home/junikki/MLC/repos/local/cache/download-file_62719d73/resnet50_v1.onnx', output='/home/junikki/MLC/repos/local/cache/get-mlperf-inference-results-dir_7dbef0e6/valid_results/junikki-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/singlestream/performance/run_1', inputs=None, outputs=['ArgMax:0'], backend='onnxruntime', device=None, model_name='resnet50', threads=8, qps=None, cache=0, cache_dir='/home/junikki/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0a21fb11', preprocessed_dir=None, use_preprocessed_dataset=True, accuracy=False, find_peak_performance=False, debug=False, user_conf='/home/junikki/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/f17b58b1597544b9b563770c755a704a.conf', audit_conf='audit.config', time=None, count=None, performance_sample_count=None, max_latency=None, samples_per_query=8) INFO:imagenet:Loading 50000 preprocessed images using 8 threads INFO:imagenet:loaded 50000 images, cache=0, already_preprocessed=True, took=2.2sec INFO:main:starting TestScenario.SingleStream ./run_local.sh: line 30: 31308 Killed python3 python/main.py --profile resnet50-onnxruntime --model "/home/junikki/MLC/repos/local/cache/download-file_62719d73/resnet50_v1.onnx" --dataset-path /home/junikki/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0a21fb11 --output "/home/junikki/MLC/repos/local/cache/get-mlperf-inference-results-dir_7dbef0e6/valid_results/junikki-reference-cpu-onnxruntime-v1.20.1-default_config/resnet50/singlestream/performance/run_1" --scenario SingleStream --threads 8 --user_conf /home/junikki/MLC/repos/mlcommons@mlperf-automations/script/generate-mlperf-inference-user-conf/tmp/f17b58b1597544b9b563770c755a704a.conf --use_preprocessed_dataset --cache_dir /home/junikki/MLC/repos/local/cache/get-preprocessed-dataset-imagenet_0a21fb11 --dataset-list /home/junikki/MLC/repos/local/cache/extract-file_0b41141c/val.txt Traceback (most recent call last): File "/media/junikki/research/mlcommons/mlc/bin/mlc", line 8, in <module> sys.exit(main()) ^^^^^^ File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1414, in main res = method(run_args) ^^^^^^^^^^^^^^^^ File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1185, in run return self.call_script_module_function("run", run_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1165, in call_script_module_function result = automation_instance.run(run_args) # Pass args to the run method ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 225, in run r = self._run(i) ^^^^^^^^^^^^ File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 1786, in _run r = customize_code.preprocess(ii) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/script/run-mlperf-inference-app/customize.py", line 286, in preprocess r = mlc.access(ii) ^^^^^^^^^^^^^^ File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 93, in access result = method(self, options) ^^^^^^^^^^^^^^^^^^^^^ File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1185, in run return self.call_script_module_function("run", run_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1165, in call_script_module_function result = automation_instance.run(run_args) # Pass args to the run method ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 225, in run r = self._run(i) ^^^^^^^^^^^^ File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 1856, in _run r = self._call_run_deps(prehook_deps, self.local_env_keys, local_env_keys_from_meta, env, state, const, const_state, add_deps_recursive, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 3552, in _call_run_deps r = script._run_deps(deps, local_env_keys, env, state, const, const_state, add_deps_recursive, recursion_spaces, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 3722, in _run_deps r = self.action_object.access(ii) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 93, in access result = method(self, options) ^^^^^^^^^^^^^^^^^^^^^ File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1185, in run return self.call_script_module_function("run", run_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1165, in call_script_module_function result = automation_instance.run(run_args) # Pass args to the run method ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 225, in run r = self._run(i) ^^^^^^^^^^^^ File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 1872, in _run r = prepare_and_run_script_with_postprocessing( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 5508, in prepare_and_run_script_with_postprocessing r = script_automation._call_run_deps(posthook_deps, local_env_keys, local_env_keys_from_meta, env, state, const, const_state, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 3552, in _call_run_deps r = script._run_deps(deps, local_env_keys, env, state, const, const_state, add_deps_recursive, recursion_spaces, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 3722, in _run_deps r = self.action_object.access(ii) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 93, in access result = method(self, options) ^^^^^^^^^^^^^^^^^^^^^ File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1185, in run return self.call_script_module_function("run", run_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1165, in call_script_module_function result = automation_instance.run(run_args) # Pass args to the run method ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 225, in run r = self._run(i) ^^^^^^^^^^^^ File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 1899, in _run r = self._run_deps(post_deps, clean_env_keys_post_deps, env, state, const, const_state, add_deps_recursive, recursion_spaces, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/junikki/MLC/repos/mlcommons@mlperf-automations/automation/script/module.py", line 3722, in _run_deps r = self.action_object.access(ii) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 93, in access result = method(self, options) ^^^^^^^^^^^^^^^^^^^^^ File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1185, in run return self.call_script_module_function("run", run_args) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/media/junikki/research/mlcommons/mlc/lib/python3.12/site-packages/mlc/main.py", line 1175, in call_script_module_function raise ScriptExecutionError(f"Script {function_name} execution failed. Error : {error}") mlc.main.ScriptExecutionError: Script run execution failed. Error : MLC script failed (name = benchmark-program, return code = 35072) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Please file an issue at https://github.com/mlcommons/mlperf-automations/issues along with the full MLC command being run and the relevant or full console log.
The text was updated successfully, but these errors were encountered:
Same issue: #2100 ?
Sorry, something went wrong.
Can you use --target_latency=10?
--target_latency=10
It worked. Thanks
No branches or pull requests
Command used:
Error:
The text was updated successfully, but these errors were encountered: