cuda error
#451
Replies: 1 comment
-
|
Sometimes it runs fine, but sometimes there will be an error message like \llama.cpp\ggml\src\ggml-cuda\ggml-cuda.cu:75: CUDA error. How to solve this? I'm using a 4070ti super GPU. I checked the VRAM and it seems sufficient. Could it be that the CUDA version is too high? It's 12.8. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
\llama.cpp\ggml\src\ggml-cuda\ggml-cuda.cu:75: CUDA error
Beta Was this translation helpful? Give feedback.
All reactions