Running Llama2-70B TP2 on L40s (with fp8
quantization)
#709
Job | Run time |
---|---|
0s | |
0s | |
0s | |
0s | |
0s |
fp8
quantization)
#709
Job | Run time |
---|---|
0s | |
0s | |
0s | |
0s | |
0s |