(Single-card) Device perf regressions #5165
Annotations
6 errors, 10 warnings, and 5 notices
|
N300 WH B0 tests:
models/demos/falcon7b_common/tests/test_falcon_device_perf.py#L72
test_device_perf_wh_bare_metal[wormhole_b0-True-1-prefill_seq128_bfloat16-dram-falcon_7b]
AssertionError: Output PCC, k_cache_pcc, or v_cache_pcc is either lower or higher than [0.99, 0.99, 0.99]. See earlier warnings for more details.
|
|
N300 WH B0 tests:
models/demos/falcon7b_common/tests/test_falcon_device_perf.py#L72
test_device_perf_wh_bare_metal[wormhole_b0-True-1-prefill_seq1024_bfloat16-dram-falcon_7b]
AssertionError: Output PCC, k_cache_pcc, or v_cache_pcc is either lower or higher than [0.99, 0.99, 0.99]. See earlier warnings for more details.
|
|
N300 WH B0 tests:
models/demos/falcon7b_common/tests/test_falcon_device_perf.py#L72
test_device_perf_wh_bare_metal[wormhole_b0-True-1-prefill_seq2048_bfloat16-dram-falcon_7b]
AssertionError: Output PCC, k_cache_pcc, or v_cache_pcc is either lower or higher than [0.99, 0.99, 0.99]. See earlier warnings for more details.
|
|
N300 WH B0 tests:
models/demos/falcon7b_common/tests/test_falcon_device_perf.py#L72
test_device_perf_wh_bare_metal[wormhole_b0-True-1-decode_seq128_bfloat16-l1_sharded-falcon_7b]
AssertionError: Output PCC, k_cache_pcc, or v_cache_pcc is either lower or higher than [0.9, 0.91, 0.91]. See earlier warnings for more details.
|
|
N300 WH B0 tests:
models/demos/falcon7b_common/tests/test_falcon_device_perf.py#L72
test_device_perf_wh_bare_metal[wormhole_b0-True-1-decode_seq1024_bfloat16-l1_sharded-falcon_7b]
AssertionError: Output PCC, k_cache_pcc, or v_cache_pcc is either lower or higher than [0.93, 0.94, 0.96]. See earlier warnings for more details.
|
|
N300 WH B0 tests:
models/demos/falcon7b_common/tests/test_falcon_device_perf.py#L72
test_device_perf_wh_bare_metal[wormhole_b0-True-1-decode_seq2047_bfloat16-l1_sharded-falcon_7b]
AssertionError: Output PCC, k_cache_pcc, or v_cache_pcc is either lower or higher than [0.92, 0.93, 0.94]. See earlier warnings for more details.
|
|
N300 WH B0 tests:
models/demos/wormhole/stable_diffusion/tests/test_unet_2d_condition_model.py#L63
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
|
N300 WH B0 tests:
usr/local/lib/python3.8/dist-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
N300 WH B0 tests:
work/models/demos/wormhole/stable_diffusion/custom_preprocessing.py#L32
The use of `x.T` on tensors of dimension other than 2 to reverse their shape is deprecated and it will throw an error in a future release. Consider `x.mT` to transpose batches of matrices or `x.permute(*torch.arange(x.ndim - 1, -1, -1))` to reverse the dimensions of a tensor. (Triggered internally at ../aten/src/ATen/native/TensorShape.cpp:3637.)
|
|
N300 WH B0 tests:
models/demos/wormhole/stable_diffusion/tests/test_perf.py#L206
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
|
N300 WH B0 tests:
work/tt_metal/tools/profiler/process_model_log.py#L26
Columns (39,40,41,46,47,48,53,54,55,67,68,69,74,75,76) have mixed types. Specify dtype option on import or set low_memory=False.
|
|
N300 WH B0 tests:
tests/ttnn/integration_tests/distilbert/test_ttnn_distilbert.py#L20
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
|
N300 WH B0 tests:
usr/local/lib/python3.8/dist-packages/huggingface_hub/file_download.py#L1142
`resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
|
|
N300 WH B0 tests:
models/demos/distilbert/tests/test_perf_distilbert.py#L143
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
|
N300 WH B0 tests:
tests/ttnn/integration_tests/vgg/test_ttnn_vgg11.py#L27
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
|
N300 WH B0 tests:
tests/ttnn/integration_tests/vgg/test_ttnn_vgg16.py#L27
record_property is incompatible with junit_family 'xunit2' (use 'legacy' or 'xunit1')
|
|
Set up runner
Disk usage is 65 %
|
|
Set up runner
Touching and printing out SMI info
|
|
Set up runner
tt-smi reset was successful
|
|
Set up runner
Hugepages service found. Command returned with exit code 3. Restarting it so we can ensure hugepages are available
|
|
Set up runner
Hugepages is now setup.
|
Loading