Skip to content

Commit

Permalink
Set topK=1 for faqgenfixed
Browse files Browse the repository at this point in the history
Signed-off-by: Wang, Kai Lawrence <kai.lawrence.wang@intel.com>
  • Loading branch information
wangkl2 committed Dec 20, 2024
1 parent 33641c6 commit 4c79f8a
Showing 1 changed file with 5 additions and 1 deletion.
6 changes: 5 additions & 1 deletion evals/benchmark/stresscli/locust/faqgenfixed.py
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,11 @@ def getUrl():


def getReqData():
return {"messages": "Text Embeddings Inference (TEI) is a toolkit for deploying and serving open source text embeddings and sequence classification models. TEI enables high-performance extraction for the most popular models, including FlagEmbedding, Ember, GTE and E6.", "max_tokens": 128}
return {
"messages": "Text Embeddings Inference (TEI) is a toolkit for deploying and serving open source text embeddings and sequence classification models. TEI enables high-performance extraction for the most popular models, including FlagEmbedding, Ember, GTE and E6.",
"max_tokens": 128,
"top_k": 1,
}


def respStatics(environment, reqData, respData):
Expand Down

0 comments on commit 4c79f8a

Please sign in to comment.