Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] submodule sync failed due to missing OpenSSL package #2475

Closed
jlowe opened this issue Oct 8, 2024 · 2 comments · Fixed by #2476
Closed

[BUG] submodule sync failed due to missing OpenSSL package #2475

jlowe opened this issue Oct 8, 2024 · 2 comments · Fixed by #2476
Assignees
Labels
bug Something isn't working build

Comments

@jlowe
Copy link
Contributor

jlowe commented Oct 8, 2024

Recent cudf submodule sync job failed with the following error:

[INFO]      [exec] CMake Error at /usr/local/cmake-3.26.4-linux-x86_64/share/cmake-3.26/Modules/FindPackageHandleStandardArgs.cmake:230 (message):
[INFO]      [exec]   Could NOT find OpenSSL, try to set the path to OpenSSL root folder in the
[INFO]      [exec]   system variable OPENSSL_ROOT_DIR (missing: OPENSSL_CRYPTO_LIBRARY
[INFO]      [exec]   OPENSSL_INCLUDE_DIR)
[INFO]      [exec] Call Stack (most recent call first):
[INFO]      [exec]   /usr/local/cmake-3.26.4-linux-x86_64/share/cmake-3.26/Modules/FindPackageHandleStandardArgs.cmake:600 (_FPHSA_FAILURE_MESSAGE)
[INFO]      [exec]   /usr/local/cmake-3.26.4-linux-x86_64/share/cmake-3.26/Modules/FindOpenSSL.cmake:670 (find_package_handle_standard_args)
[INFO]      [exec]   /home/jlowe/src/spark-rapids-jni/target/libcudf/cmake-build/_deps/curl-src/CMakeLists.txt:449 (find_package)

Looks like something in cudf (either directly or via a dependency) now pulls in a curl dependency that in turn needs OpenSSL.

@jlowe jlowe added ? - Needs Triage bug Something isn't working build labels Oct 8, 2024
@jlowe jlowe self-assigned this Oct 8, 2024
@jlowe
Copy link
Contributor Author

jlowe commented Oct 8, 2024

Looks like this is caused by rapidsai/kvikio#464 which added curl as a dependency.

@jlowe
Copy link
Contributor Author

jlowe commented Oct 8, 2024

Adding openssl-devel to the CI Dockerfile allows the build to pass, but it adds dynamic dependencies on libcudf.so that may not be present in the runtime environment:

$ ldd target/jni/cmake-build/libcudf.so
	linux-vdso.so.1 (0x00007ffcb4fde000)
	libnvcomp.so.4 => /home/jlowe/src/spark-rapids-jni/target/libcudf-install/lib64/libnvcomp.so.4 (0x000070253a800000)
	librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007025470c0000)
	libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007025470bb000)
	libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007025470b6000)
	libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x000070254709a000)
	libssl.so.1.1 => not found
	libcrypto.so.1.1 => not found
	libstdc++.so.6 => /lib/x86_64-linux-gnu/libstdc++.so.6 (0x000070253a400000)
	libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x0000702546fb1000)
	libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x0000702546f91000)
	libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x000070253a000000)
	/lib64/ld-linux-x86-64.so.2 (0x00007025470dd000)

Thankfully kvikio added a cmake option to turn off the remote I/O feature which drops the curl/openssl dependency.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working build
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants