Replies: 1 comment
-
stupid me, had set the stop parameter to "None" |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi, I am using the chatcompletion API.
I am using a prompt that asks to rewrite a code snippet, e.g.
However, the response from the chatcompletion is truncated after "->".
If I delete "-> None" it stops after "n3 is not"
It smells as if the answer from the model was tokenized and "None" tokens were converted to python None, stopping the output.
Has anybody observed a similar behavior? Is there a solution or workaround?
Regards
Jochen
Beta Was this translation helpful? Give feedback.
All reactions