Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add vulkan builds for x86_64 #705

Open
alaviss opened this issue Feb 1, 2025 · 2 comments
Open

Add vulkan builds for x86_64 #705

alaviss opened this issue Feb 1, 2025 · 2 comments

Comments

@alaviss
Copy link

alaviss commented Feb 1, 2025

Vulkan images at https://quay.io/repository/ramalama/vulkan?tab=tags are only built for aarch64.

I've confirmed that the associated Containerfile can be built and works flawlessly with ramalama (using --image and --gpu flags) on x86_64 with very good performance (tested with a RX 580, not supported by ROCm).

@nikAizuddin
Copy link

Actually I didn't know Vulkan can do machine learning stuff, so I decided to benchmark my Vega 56 GPU and compare with ROCm. I've found that Vulkan is faster than ROCm.

ROCm benchmark:
Image

Vulkan benchmark:
Image

@azlan
Copy link

azlan commented Feb 2, 2025

Sharing my benchmark result for 5700 XT

Image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants