Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[RELEASE] raft v24.02 #2134

Merged
merged 81 commits into from
Feb 12, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
81 commits
Select commit Hold shift + click to select a range
06979df
v24.02 Updates [skip ci]
raydouglass Nov 14, 2023
e875e04
Merge pull request #1992 from rapidsai/branch-23.12
GPUtester Nov 14, 2023
8dd6a79
Merge pull request #2001 from rapidsai/branch-23.12
GPUtester Nov 15, 2023
d67c3b2
Fix dynamic version in pyproject.toml files (#2002)
vyasr Nov 16, 2023
5e6e50a
Merge pull request #2004 from rapidsai/branch-23.12
GPUtester Nov 16, 2023
7754040
Merge pull request #2007 from rapidsai/branch-23.12
GPUtester Nov 16, 2023
fd1ac0c
Merge pull request #2010 from rapidsai/branch-23.12
GPUtester Nov 17, 2023
b5b5202
Merge pull request #2012 from rapidsai/branch-23.12
GPUtester Nov 17, 2023
7e307b9
Fix `ci/checks/copyright.py` to mirror RAPIDS reference (#2008)
divyegala Nov 17, 2023
bf16c50
Merge pull request #2014 from rapidsai/branch-23.12
GPUtester Nov 17, 2023
bdc5117
Export Pareto frontier in `raft-ann-bench.data_export` (#2009)
divyegala Nov 18, 2023
a03749b
Merge pull request #2015 from rapidsai/branch-23.12
GPUtester Nov 18, 2023
ea8c3ed
Merge pull request #2019 from rapidsai/branch-23.12
GPUtester Nov 21, 2023
88e9a55
Enable host dataset for IVF-Flat (#1635)
tfeher Nov 28, 2023
736a8bf
Updating cagra build constraint (#2016)
cjnolet Nov 28, 2023
ed272c1
Fixing json parse error in `raft-ann-bench.data_export` (#2025)
cjnolet Nov 29, 2023
04fa426
Add usage example for brute_force::build (#2029)
benfred Nov 30, 2023
ff60d3a
Update to fmt 10.1.1 and spdlog 1.12.0. (#1957)
bdice Nov 30, 2023
4ba0139
Remove selection_faiss (#2027)
benfred Nov 30, 2023
b8c026b
Add filtering to vector search tutorial (#1996)
lowener Dec 1, 2023
712ba0e
Fix ucx-py version pinning in dependencies.yaml. (#2035)
bdice Dec 1, 2023
8e1c62c
Merge pull request #2038 from rapidsai/branch-23.12
GPUtester Dec 4, 2023
42e9f15
Make device_resources accessed from device_resources_manager thread-s…
wphicks Dec 5, 2023
c3a9c78
Fixing small bug in raft-ann-bench (#2041)
cjnolet Dec 6, 2023
ecd292b
[REVIEW] Fix typos in parameter tuning guide (#2034)
abc99lr Dec 6, 2023
b333b74
Merge pull request #2044 from rapidsai/branch-23.12
GPUtester Dec 6, 2023
339878d
Remove RAFT_BUILD_WHEELS and standardize Python builds (#2040)
vyasr Dec 6, 2023
9ce20bf
Update dependencies.yaml to new pip index (#2042)
vyasr Dec 7, 2023
bc35f2b
Correct function that wasn't returning a value (#2045)
robertmaynard Dec 7, 2023
d2210a2
Add brute_force index serialization (#2036)
wphicks Dec 7, 2023
e999100
Add support for 1024+ dim vectors in CAGRA search (#1994)
enp1s0 Dec 8, 2023
5e80c1d
Use cuda::proclaim_return_type on device lambda. (#2048)
bdice Dec 8, 2023
addb059
Removing code that explicitly compares equality of rmm memory resourc…
cjnolet Dec 9, 2023
d9a7290
Fix ann-bench multithreading (#2021)
achirkin Dec 13, 2023
6c95f9c
Fix a crash in FAISS benchmark wrapper introduced in #2021 (#2062)
achirkin Dec 13, 2023
80a48ca
Switch to scikit-build-core (#2051)
vyasr Dec 13, 2023
1beb556
[BUG] fix empty initialization of device_ndarray in pylibraft (#2061)
mfoerste4 Dec 15, 2023
2962169
Update to CCCL 2.2.0. (#2049)
bdice Dec 19, 2023
7e098b2
Benchmark brute force knn (#2063)
benfred Dec 20, 2023
bae049b
Update `raft-ann-bench` output filenames and add features to plotting…
divyegala Dec 21, 2023
dc442d8
Fix a typo (#2070)
narangvivek10 Jan 2, 2024
6d3572b
Fix errors with ingroup exposed by doxygen 1.10 (#2079)
wphicks Jan 3, 2024
0d65954
Implement maybe-owning multi-dimensional container (mdbuffer) (#1999)
wphicks Jan 4, 2024
6762fe5
Remove hardcoded limit in `print_results` function (#2080)
narangvivek10 Jan 4, 2024
3b88d17
Improve parallelism of refine host (#2059)
anaruse Jan 9, 2024
1484a03
Fix `max_queries` for CAGRA (#2081)
lowener Jan 9, 2024
26d310b
Add public enum for select-k algorithm selection (#2046)
benfred Jan 10, 2024
93a504e
refactor CUDA versions in dependencies.yaml (#2086)
jameslamb Jan 11, 2024
856288a
Add IVF-PQ example into the template project (#2091)
achirkin Jan 11, 2024
7d5bb3c
Properly taking ownership of nccl subcomm (and destroying it) (#2094)
cjnolet Jan 12, 2024
0c75bb1
Remove usages of rapids-env-update (#2095)
KyleFromNVIDIA Jan 12, 2024
1d9adab
Add AIR-Top-k reference (#2031)
tfeher Jan 16, 2024
3c7586f
[FEA] Add support for SDDMM by wrapping the cusparseSDDMM (#2067) (#2…
rhdong Jan 16, 2024
b75fbd0
Update to use rapids-cmake for all deps (#2096)
robertmaynard Jan 17, 2024
dbc33ea
Provide explicit pool size for pool_memory_resources and clean up inc…
harrism Jan 17, 2024
fafb8ed
[DOC] Documentation updates for release 24.02 (#2093)
cjnolet Jan 17, 2024
1e4961e
Fix compile failure on RTX 4090 (#2076)
JieFengWang Jan 17, 2024
7cab0c3
Replace call to mr::get_mem_info() (#2099)
harrism Jan 18, 2024
72f48ae
Support for fp16 in CAGRA and IVF-PQ (#2085)
achirkin Jan 19, 2024
db8e21f
Remove unneeded CI symbol excludes (#2098)
robertmaynard Jan 19, 2024
d7eebc6
Remove extraneous host pinnings from libraft-headers-only. (#2102)
bdice Jan 19, 2024
9c35f73
Add random subsampling for IVF methods (#2077)
tfeher Jan 23, 2024
558dc8f
Replace GEMM backend: cublas.gemm -> cublaslt.matmul (#1736)
achirkin Jan 23, 2024
d89ab1b
[BUG] Fix `num_cta_per_query` div (#2107)
lowener Jan 23, 2024
0586fc3
Allow topk larger than 1024 in CAGRA (#2097)
benfred Jan 23, 2024
70e806a
Fixing small bug in CUSPARSE spmm w/ CUDA 12.2 (#2117)
cjnolet Jan 24, 2024
ac2d1ae
Add eps-neighbor search via RBC (#2028)
mfoerste4 Jan 24, 2024
71fce1c
Remove get_mem_info functions from RAFT custom memory resources (#2108)
harrism Jan 24, 2024
dbb5e66
add half/bfloat support to myInf and abs (#1592)
Kh4ster Jan 24, 2024
8743ac9
[BUG] Fix `SPMM` strided view (#2124)
lowener Jan 24, 2024
3ce00d3
ANN bench fix latency measurement overhead (#2084)
tfeher Jan 24, 2024
dbf3f74
Adding license info for wiki-all dataset (#2129)
cjnolet Jan 25, 2024
e272176
Subsampling for IVF-PQ codebook generation (#2052)
abc99lr Jan 25, 2024
2822532
`libraft` and `pylibraft` API for CAGRA build and HNSW search (#2022)
divyegala Jan 26, 2024
f876491
conditionally include hnsw source (#2135)
divyegala Jan 29, 2024
c70d17a
Pin to pytest 7. (#2137)
bdice Jan 31, 2024
7edd372
[HOTFIX] 24.02 Revert Random Sampling (#2144)
cjnolet Feb 1, 2024
5bd12a5
Exclude tests from builds (#2162)
vyasr Feb 7, 2024
9446430
Fix failing C++ tests and revert #2097, #2085. (#2168)
cjnolet Feb 9, 2024
dc75590
fix is_row/col_order for strided layouts (#2173)
mfoerste4 Feb 12, 2024
04a9c95
Update Changelog [skip ci]
raydouglass Feb 12, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
4 changes: 2 additions & 2 deletions .devcontainer/cuda11.8-conda/devcontainer.json
Original file line number Diff line number Diff line change
Expand Up @@ -5,12 +5,12 @@
"args": {
"CUDA": "11.8",
"PYTHON_PACKAGE_MANAGER": "conda",
"BASE": "rapidsai/devcontainers:23.12-cpp-llvm16-cuda11.8-mambaforge-ubuntu22.04"
"BASE": "rapidsai/devcontainers:24.02-cpp-llvm16-cuda11.8-mambaforge-ubuntu22.04"
}
},
"hostRequirements": {"gpu": "optional"},
"features": {
"ghcr.io/rapidsai/devcontainers/features/rapids-build-utils:23.12": {}
"ghcr.io/rapidsai/devcontainers/features/rapids-build-utils:24.2": {}
},
"overrideFeatureInstallOrder": [
"ghcr.io/rapidsai/devcontainers/features/rapids-build-utils"
Expand Down
6 changes: 3 additions & 3 deletions .devcontainer/cuda11.8-pip/devcontainer.json
Original file line number Diff line number Diff line change
Expand Up @@ -5,13 +5,13 @@
"args": {
"CUDA": "11.8",
"PYTHON_PACKAGE_MANAGER": "pip",
"BASE": "rapidsai/devcontainers:23.12-cpp-llvm16-cuda11.8-ubuntu22.04"
"BASE": "rapidsai/devcontainers:24.02-cpp-llvm16-cuda11.8-ubuntu22.04"
}
},
"hostRequirements": {"gpu": "optional"},
"features": {
"ghcr.io/rapidsai/devcontainers/features/ucx:23.12": {"version": "1.14.1"},
"ghcr.io/rapidsai/devcontainers/features/rapids-build-utils:23.12": {}
"ghcr.io/rapidsai/devcontainers/features/ucx:24.2": {"version": "1.14.1"},
"ghcr.io/rapidsai/devcontainers/features/rapids-build-utils:24.2": {}
},
"overrideFeatureInstallOrder": [
"ghcr.io/rapidsai/devcontainers/features/ucx",
Expand Down
4 changes: 2 additions & 2 deletions .devcontainer/cuda12.0-conda/devcontainer.json
Original file line number Diff line number Diff line change
Expand Up @@ -5,12 +5,12 @@
"args": {
"CUDA": "12.0",
"PYTHON_PACKAGE_MANAGER": "conda",
"BASE": "rapidsai/devcontainers:23.12-cpp-mambaforge-ubuntu22.04"
"BASE": "rapidsai/devcontainers:24.02-cpp-mambaforge-ubuntu22.04"
}
},
"hostRequirements": {"gpu": "optional"},
"features": {
"ghcr.io/rapidsai/devcontainers/features/rapids-build-utils:23.12": {}
"ghcr.io/rapidsai/devcontainers/features/rapids-build-utils:24.2": {}
},
"overrideFeatureInstallOrder": [
"ghcr.io/rapidsai/devcontainers/features/rapids-build-utils"
Expand Down
6 changes: 3 additions & 3 deletions .devcontainer/cuda12.0-pip/devcontainer.json
Original file line number Diff line number Diff line change
Expand Up @@ -5,13 +5,13 @@
"args": {
"CUDA": "12.0",
"PYTHON_PACKAGE_MANAGER": "pip",
"BASE": "rapidsai/devcontainers:23.12-cpp-llvm16-cuda12.0-ubuntu22.04"
"BASE": "rapidsai/devcontainers:24.02-cpp-llvm16-cuda12.0-ubuntu22.04"
}
},
"hostRequirements": {"gpu": "optional"},
"features": {
"ghcr.io/rapidsai/devcontainers/features/ucx:23.12": {"version": "1.14.1"},
"ghcr.io/rapidsai/devcontainers/features/rapids-build-utils:23.12": {}
"ghcr.io/rapidsai/devcontainers/features/ucx:24.2": {"version": "1.14.1"},
"ghcr.io/rapidsai/devcontainers/features/rapids-build-utils:24.2": {}
},
"overrideFeatureInstallOrder": [
"ghcr.io/rapidsai/devcontainers/features/ucx",
Expand Down
16 changes: 8 additions & 8 deletions .github/workflows/build.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ concurrency:
jobs:
cpp-build:
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/conda-cpp-build.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/conda-cpp-build.yaml@branch-24.02
with:
build_type: ${{ inputs.build_type || 'branch' }}
branch: ${{ inputs.branch }}
Expand All @@ -37,7 +37,7 @@ jobs:
python-build:
needs: [cpp-build]
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/conda-python-build.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/conda-python-build.yaml@branch-24.02
with:
build_type: ${{ inputs.build_type || 'branch' }}
branch: ${{ inputs.branch }}
Expand All @@ -46,7 +46,7 @@ jobs:
upload-conda:
needs: [cpp-build, python-build]
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/conda-upload-packages.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/conda-upload-packages.yaml@branch-24.02
with:
build_type: ${{ inputs.build_type || 'branch' }}
branch: ${{ inputs.branch }}
Expand All @@ -57,7 +57,7 @@ jobs:
if: github.ref_type == 'branch'
needs: python-build
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/custom-job.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/custom-job.yaml@branch-24.02
with:
arch: "amd64"
branch: ${{ inputs.branch }}
Expand All @@ -69,7 +69,7 @@ jobs:
sha: ${{ inputs.sha }}
wheel-build-pylibraft:
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/wheels-build.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/wheels-build.yaml@branch-24.02
with:
build_type: ${{ inputs.build_type || 'branch' }}
branch: ${{ inputs.branch }}
Expand All @@ -79,7 +79,7 @@ jobs:
wheel-publish-pylibraft:
needs: wheel-build-pylibraft
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/wheels-publish.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/wheels-publish.yaml@branch-24.02
with:
build_type: ${{ inputs.build_type || 'branch' }}
branch: ${{ inputs.branch }}
Expand All @@ -89,7 +89,7 @@ jobs:
wheel-build-raft-dask:
needs: wheel-publish-pylibraft
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/wheels-build.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/wheels-build.yaml@branch-24.02
with:
build_type: ${{ inputs.build_type || 'branch' }}
branch: ${{ inputs.branch }}
Expand All @@ -99,7 +99,7 @@ jobs:
wheel-publish-raft-dask:
needs: wheel-build-raft-dask
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/wheels-publish.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/wheels-publish.yaml@branch-24.02
with:
build_type: ${{ inputs.build_type || 'branch' }}
branch: ${{ inputs.branch }}
Expand Down
28 changes: 14 additions & 14 deletions .github/workflows/pr.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -25,49 +25,49 @@ jobs:
- wheel-tests-raft-dask
- devcontainer
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/pr-builder.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/pr-builder.yaml@branch-24.02
checks:
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/checks.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/checks.yaml@branch-24.02
with:
enable_check_generated_files: false
conda-cpp-build:
needs: checks
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/conda-cpp-build.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/conda-cpp-build.yaml@branch-24.02
with:
build_type: pull-request
node_type: cpu16
conda-cpp-tests:
needs: conda-cpp-build
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/conda-cpp-tests.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/conda-cpp-tests.yaml@branch-24.02
with:
build_type: pull-request
conda-cpp-checks:
needs: conda-cpp-build
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/conda-cpp-post-build-checks.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/conda-cpp-post-build-checks.yaml@branch-24.02
with:
build_type: pull-request
enable_check_symbols: true
symbol_exclusions: (void (thrust::|cub::)|_ZN\d+raft_cutlass)
symbol_exclusions: _ZN\d+raft_cutlass
conda-python-build:
needs: conda-cpp-build
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/conda-python-build.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/conda-python-build.yaml@branch-24.02
with:
build_type: pull-request
conda-python-tests:
needs: conda-python-build
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/conda-python-tests.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/conda-python-tests.yaml@branch-24.02
with:
build_type: pull-request
docs-build:
needs: conda-python-build
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/custom-job.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/custom-job.yaml@branch-24.02
with:
build_type: pull-request
node_type: "gpu-v100-latest-1"
Expand All @@ -77,34 +77,34 @@ jobs:
wheel-build-pylibraft:
needs: checks
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/wheels-build.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/wheels-build.yaml@branch-24.02
with:
build_type: pull-request
script: ci/build_wheel_pylibraft.sh
wheel-tests-pylibraft:
needs: wheel-build-pylibraft
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/wheels-test.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/wheels-test.yaml@branch-24.02
with:
build_type: pull-request
script: ci/test_wheel_pylibraft.sh
wheel-build-raft-dask:
needs: wheel-tests-pylibraft
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/wheels-build.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/wheels-build.yaml@branch-24.02
with:
build_type: pull-request
script: "ci/build_wheel_raft_dask.sh"
wheel-tests-raft-dask:
needs: wheel-build-raft-dask
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/wheels-test.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/wheels-test.yaml@branch-24.02
with:
build_type: pull-request
script: ci/test_wheel_raft_dask.sh
devcontainer:
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/build-in-devcontainer.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/build-in-devcontainer.yaml@branch-24.02
with:
build_command: |
sccache -z;
Expand Down
12 changes: 6 additions & 6 deletions .github/workflows/test.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -16,33 +16,33 @@ on:
jobs:
conda-cpp-checks:
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/conda-cpp-post-build-checks.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/conda-cpp-post-build-checks.yaml@branch-24.02
with:
build_type: nightly
branch: ${{ inputs.branch }}
date: ${{ inputs.date }}
sha: ${{ inputs.sha }}
enable_check_symbols: true
symbol_exclusions: (void (thrust::|cub::)|_ZN\d+raft_cutlass)
symbol_exclusions: _ZN\d+raft_cutlass
conda-cpp-tests:
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/conda-cpp-tests.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/conda-cpp-tests.yaml@branch-24.02
with:
build_type: nightly
branch: ${{ inputs.branch }}
date: ${{ inputs.date }}
sha: ${{ inputs.sha }}
conda-python-tests:
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/conda-python-tests.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/conda-python-tests.yaml@branch-24.02
with:
build_type: nightly
branch: ${{ inputs.branch }}
date: ${{ inputs.date }}
sha: ${{ inputs.sha }}
wheel-tests-pylibraft:
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/wheels-test.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/wheels-test.yaml@branch-24.02
with:
build_type: nightly
branch: ${{ inputs.branch }}
Expand All @@ -51,7 +51,7 @@ jobs:
script: ci/test_wheel_pylibraft.sh
wheel-tests-raft-dask:
secrets: inherit
uses: rapidsai/shared-workflows/.github/workflows/wheels-test.yaml@branch-23.12
uses: rapidsai/shared-workflows/.github/workflows/wheels-test.yaml@branch-24.02
with:
build_type: nightly
branch: ${{ inputs.branch }}
Expand Down
4 changes: 2 additions & 2 deletions .pre-commit-config.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ repos:
types_or: [python, cython]
additional_dependencies: ["flake8-force"]
- repo: https://github.com/pre-commit/mirrors-mypy
rev: 'v0.971'
rev: 'v1.3.0'
hooks:
- id: mypy
additional_dependencies: [types-cachetools]
Expand Down Expand Up @@ -101,7 +101,7 @@ repos:
args: ["--toml", "pyproject.toml"]
exclude: (?x)^(^CHANGELOG.md$)
- repo: https://github.com/rapidsai/dependency-file-generator
rev: v1.5.1
rev: v1.8.0
hooks:
- id: rapids-dependency-file-generator
args: ["--clean"]
Expand Down
Loading
Loading