Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add native tile support for concat #18656

Open
yugi957 opened this issue Mar 5, 2025 · 0 comments
Open

Add native tile support for concat #18656

yugi957 opened this issue Mar 5, 2025 · 0 comments
Assignees

Comments

@yugi957
Copy link
Contributor

yugi957 commented Mar 5, 2025

On cases where the concat dim is on a tile dim (last two dims of a tensor) AND tile padding exists for the tensor (last 2 dims are not tile-aligned) concat falls back to untilizing the tensor, performing the RM op, and retilizing.

Depending on the tensor shapes, this can cause tile input concat to be much more expensive than rm input concat:

Image
@yugi957 yugi957 self-assigned this Mar 5, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant