Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[BUG] Fix illegal memory access in linalg::reduction (#2592)
Illegal memory access occurs when calling `mean` for a large matrix, specifically, when `extent(0) * extent(1)` exceeds INT_MAX. This PR fixes it. Although I think it is safer to use `uint64_t` or `size_t` than `IdxType` as the index type in the kernel, I follow the [coalescedReduction kernels](https://github.com/rapidsai/raft/blob/branch-25.04/cpp/include/raft/linalg/detail/coalesced_reduction-inl.cuh). Authors: - tsuki (https://github.com/enp1s0) Approvers: - Micka (https://github.com/lowener) - Corey J. Nolet (https://github.com/cjnolet) URL: #2592
- Loading branch information