Skip to content

性能压测:Qwen2.5-72B-Instruct-GPTQ-Int4的RPS比Qwen2-72B-Instruct-GPTQ-Int4要低,平均耗时高 #1019

kartikzheng started this conversation in General
Discussion options

You must be logged in to vote

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
2 participants