Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

multilingual e5 small CLI failure #957

Closed
isaac-chung opened this issue Jun 19, 2024 · 0 comments
Closed

multilingual e5 small CLI failure #957

isaac-chung opened this issue Jun 19, 2024 · 0 comments
Assignees

Comments

@isaac-chung
Copy link
Collaborator

isaac-chung commented Jun 19, 2024

Running this (added as test case in the branch e5-model-test:

mteb run -m intfloat/multilingual-e5-small -t BornholmBitextMining --verbosity 3 --output_folder tests/results/test_model --model_revision e4ce9877abf3edfe10b0d82785e83bdcb973e22e

gives

...
  File "/home/ubuntu/isaac/work/mteb/mteb/evaluation/evaluators/model_encode.py", line 26, in model_encode
    embeddings = model.encode(sentences, **kwargs)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/isaac/work/mteb/mteb/models/e5_models.py", line 134, in encode
    return self.encode_queries(sentences, batch_size=batch_size, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/isaac/work/mteb/mteb/models/e5_models.py", line 138, in encode_queries
    emb = self.mdl.encode(sentences, batch_size=batch_size, **kwargs)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/ubuntu/miniconda3/lib/python3.11/site-packages/sentence_transformers/SentenceTransformer.py", line 451, in encode
    raise ValueError(
ValueError: Prompt name 'BornholmBitextMining' not found in the configured prompts dictionary with keys [].

Seems to be related to the changes introduced in #888

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant