transient build failures on osx with cmake errorring with libzstd.1.dylib' (no such file)

[akrherz]

I fully expect that the issue is elsewhere, but for recent GDAL feedstock builds on conda-forge (example), we have seen a number of transient failures like so on osx

dyld[80185]: Library not loaded: @rpath/libzstd.1.dylib
  Referenced from: <DFBAC4C1-2C51-3DC0-8AD6-6FBBABC3BCC2> /Users/runner/miniforge3/pkgs/cmake-3.31.2-h477996e_1/bin/cmake
  Reason: tried: '/Users/runner/miniforge3/pkgs/cmake-3.31.2-h477996e_1/bin/../lib/libzstd.1.dylib' (no such file), '/Users/runner/miniforge3/pkgs/cmake-3.31.2-h477996e_1/bin/../lib/libzstd.1.dylib' (no such file), '/usr/local/lib/libzstd.1.dylib' (no such file), '/usr/lib/libzstd.1.dylib' (no such file, not in dyld cache)
2024-12-12T20:39:24.2924450Z /Users/runner/miniforge3/conda-bld/libgdal-core_1734032386716/work/build_plugin.sh: line 37: 80185 Abort trap: 6           cmake "-U*LATER_PLUGIN" -DBUILD_PYTHON_BINDINGS:BOOL=OFF ${CMAKE_ARGS} ${SRC_DIR}

Restarting the build seems to be having about a 33% success rate. Any ideas on where this could be coming from? Thanks for your time and I fully understand if you burn this issue with 🔥

[h-vetinari]

There's some discussion on this here. It seems to happen sporadically and people haven't been able to figure out yet what's causing it.

See also conda-forge/gdal-feedstock#990 (and I remember commenting the zulip link elsewhere but cannot find it anymore... 😑).

Restarting the build seems to be having about a 33% success rate.

That however is by far the lowest success rate I've seen. 😱 Usually it's way beyond 90%. On the flipside, maybe this helps with debugging? 🤞

@isuruf @JeanChristopheMorinPerso

[h-vetinari]

For someone trying to chase this down, the builds for conda-forge/sentencepiece-feedstock@57668fb seem to be unusually prone to this. I've had it happen 3 times out of 5 runs just now.

[isuruf]

Can you set conda's log_level to Debug?

[h-vetinari]

Can you set conda's log_level to Debug?

Feel free to commit into conda-forge/sentencepiece-feedstock#63