Code

Remote IO: http support#464

Code

Merged

rapids-bot[bot] merged 73 commits intorapidsai:branch-24.12rapidsai/kvikio:branch-24.12from madsbk:remote-iomadsbk/kvikio:remote-ioCopy head branch name to clipboardOct 8, 2024

+1,305-2

Commits

Commits on Sep 30, 2024

• Impl. basic remote handle

  madsbk

  committed
  a01dc53

  Copy full SHA for a01dc53

• RemoteHandle::read()

  madsbk

  committed
  a6467d5

  Copy full SHA for a6467d5

• ci: rangehttpserver

  madsbk

  committed
  127b782

  Copy full SHA for 127b782

• libcurl>=7.75.0 # Need <https://curl.se/libcurl/c/CURLOPT_AWS_SIGV4.html>

  madsbk

  committed
  089397f

  Copy full SHA for 089397f

• cmake

  madsbk

  committed
  5f1fca0

  Copy full SHA for 5f1fca0

• fix ci rangehttpserver

  madsbk

  committed
  eaacacf

  Copy full SHA for eaacacf

• cleanup

  madsbk

  committed
  59595a8

  Copy full SHA for 59595a8

• get_file_size(): check -1

  madsbk

  committed
  f803220

  Copy full SHA for f803220

• Read(): check file size

  madsbk

  committed
  dd06044

  Copy full SHA for dd06044

• LibCurl get/set: use lock

  madsbk

  committed
  06dcb35

  Copy full SHA for 06dcb35

• test_no_range_support

  madsbk

  committed
  7501600

  Copy full SHA for 7501600

• bump libcurl>=7.87.0

  madsbk

  committed
  7e6315e

  Copy full SHA for 7e6315e

• ci: more libcurl>=7.87.0

  madsbk

  committed
  4f9ab63

  Copy full SHA for 4f9ab63

• cmake: CURL 7.87.0

  madsbk

  committed
  a20774c

  Copy full SHA for a20774c

• ci_debug

  madsbk

  committed
  43421ed

  Copy full SHA for 43421ed

• CURLOPT_FOLLOWLOCATION

  madsbk

  committed
  7df0e9f

  Copy full SHA for 7df0e9f

• overflow_error

  madsbk

  committed
  40b4be3

  Copy full SHA for 40b4be3

• RemoteEndpoint

  madsbk

  committed
  943e30b

  Copy full SHA for 943e30b

• cpp_RemoteEndpoint

  madsbk

  committed
  e8f6b12

  Copy full SHA for e8f6b12

• from_http_url

  madsbk

  committed
  5f73677

  Copy full SHA for 5f73677

• Update cpp/include/kvikio/remote_handle.hpp

  Show description for 5dbe2e5
  

  madsbk

  and

  wence-

  committed
  5dbe2e5

  Copy full SHA for 5dbe2e5

• setopt(): use CURLoption

  madsbk

  committed
  f9873c0

  Copy full SHA for f9873c0

• comment: need CURL_WRITEFUNC_ERROR

  madsbk

  committed
  4896452

  Copy full SHA for 4896452

• LibCurl: use vector

  madsbk

  committed
  e53b761

  Copy full SHA for e53b761

• UniqueHandlePtr

  madsbk

  committed
  4ba4eb4

  Copy full SHA for 4ba4eb4

• get_handle() / retain_handle()

  madsbk

  committed
  bf716be

  Copy full SHA for bf716be

• clean up

  madsbk

  committed
  83774e3

  Copy full SHA for 83774e3

• doc

  madsbk

  committed
  e884d3c

  Copy full SHA for e884d3c

• utils: LocalHttpServer

  madsbk

  committed
  6637089

  Copy full SHA for 6637089

• http benchmark

  madsbk

  committed
  a0098e9

  Copy full SHA for a0098e9

• test_http_io

  madsbk

  committed
  0e6dc7a

  Copy full SHA for 0e6dc7a

• example

  madsbk

  committed
  f0b2f9f

  Copy full SHA for f0b2f9f

• cleanup

  madsbk

  committed
  8e7e2cf

  Copy full SHA for 8e7e2cf

• cmake: rapids_cpm_find CURL

  madsbk

  committed
  fa67219

  Copy full SHA for fa67219

• cleanup

  madsbk

  committed
  9906a14

  Copy full SHA for 9906a14

• doc

  madsbk

  committed
  d38121b

  Copy full SHA for d38121b

• cleanup

  madsbk

  committed
  bdc1e22

  Copy full SHA for bdc1e22

• Merge branch 'branch-24.10' of https://github.com/rapidsai/kvikio into remote-io

  madsbk

  committed
  51057f6

  Copy full SHA for 51057f6

• clean up

  madsbk

  committed
  383fa4c

  Copy full SHA for 383fa4c

• docs

  madsbk

  committed
  0055373

  Copy full SHA for 0055373

Commits on Oct 1, 2024

• doc

  madsbk

  committed
  628e525

  Copy full SHA for 628e525

• fix virtual dtor

  madsbk

  committed
  8726f87

  Copy full SHA for 8726f87

• Merge branch 'branch-24.12' of https://github.com/rapidsai/kvikio into remote-io

  madsbk

  committed
  3222c92

  Copy full SHA for 3222c92

• fix benckmark

  madsbk

  committed
  c94121d

  Copy full SHA for c94121d

• clean up

  madsbk

  committed
  0c764ba

  Copy full SHA for 0c764ba

• libcurl.hpp

  madsbk

  committed
  91d953b

  Copy full SHA for 91d953b

• rename: RemoteFile.open_http

  madsbk

  committed
  94e47ee

  Copy full SHA for 94e47ee

• doc

  madsbk

  committed
  fcb9358

  Copy full SHA for fcb9358

• cleanup

  madsbk

  committed
  e8018d1

  Copy full SHA for e8018d1

• PushAndPopContext outside callback_device_memory()

  madsbk

  committed
  bb737b9

  Copy full SHA for bb737b9

Commits on Oct 2, 2024

• Merge branch 'branch-24.12' of https://github.com/rapidsai/kvikio into remote-io

  madsbk

  committed
  f3f46f8

  Copy full SHA for f3f46f8

• more nvtx

  madsbk

  committed
  b8a9c0a

  Copy full SHA for b8a9c0a

Commits on Oct 3, 2024

• Apply suggestions from code review

  Show description for 9cffe1c
  

  3 peopleauthored
  9cffe1c

  Copy full SHA for 9cffe1c

• Merge branch 'branch-24.12' of https://github.com/rapidsai/kvikio into remote-io

  madsbk

  committed
  792f43f

  Copy full SHA for 792f43f

• std::function<decltype(curl_easy_cleanup)>

  madsbk

  committed
  1257a9f

  Copy full SHA for 1257a9f

• getinfo: take output pointer

  madsbk

  committed
  1006b24

  Copy full SHA for 1006b24

• STATUS

  madsbk

  committed
  9ba9752

  Copy full SHA for 9ba9752

• close

  madsbk

  committed
  128e3dd

  Copy full SHA for 128e3dd

• test_http_io: check is_remote_file_available

  madsbk

  committed
  0df1726

  Copy full SHA for 0df1726

• std::ptrdiff_t

  madsbk

  committed
  96af5ac

  Copy full SHA for 96af5ac

• Apply suggestions from code review

  Show description for feccdd9
  

  madsbk

  and

  bdice

  authored
  feccdd9

  Copy full SHA for feccdd9

• Merge branch 'remote-io' of github.com:madsbk/kvikio into remote-io

  madsbk

  committed
  119c025

  Copy full SHA for 119c025

• use conda's rangehttpserver

  madsbk

  committed
  7dcc8f3

  Copy full SHA for 7dcc8f3

• doc

  madsbk

  committed
  60f7331

  Copy full SHA for 60f7331

• CallbackContext ctor

  madsbk

  committed
  13e0b7a

  Copy full SHA for 13e0b7a

• host: libcurl==7.87.0

  madsbk

  committed
  474e694

  Copy full SHA for 474e694

• run: remove libcurl>=7.87.0

  madsbk

  committed
  9022b18

  Copy full SHA for 9022b18

• curl-7_87_0

  madsbk

  committed
  8bbb33b

  Copy full SHA for 8bbb33b

• Merge branch 'branch-24.12' of https://github.com/rapidsai/kvikio into remote-io

  madsbk

  committed
  46b9300

  Copy full SHA for 46b9300

• kvikio/meta.yaml: libcurl==7.87.0

  madsbk

  committed
  1176b67

  Copy full SHA for 1176b67

• Merge branch 'branch-24.12' of https://github.com/rapidsai/kvikio into remote-io

  madsbk

  committed
  4ed88a2

  Copy full SHA for 4ed88a2

Commits on Oct 7, 2024

• Merge branch 'branch-24.12' of https://github.com/rapidsai/kvikio into remote-io

  madsbk

  committed
  cc7b291

  Copy full SHA for cc7b291

• cmake clean up

  madsbk

  committed
  58e3054

  Copy full SHA for 58e3054