Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rsc: Recover from missing blobs #1629

Merged
merged 4 commits into from
Aug 13, 2024
Merged

Conversation

V-FEXrt
Copy link
Contributor

@V-FEXrt V-FEXrt commented Aug 12, 2024

The client side of the RSC is required to be very tolerant to all sorts of faults. One that was always planned but somehow missed was being tolerant of a failure to download the blob listed as part of the cache hit. This PR fixes/implements that missing feature.

Main things of note:

  • We touch the destination after rming in in the http library so the curl job always "outputs" a file to be hashed
  • When any part of the job hydration process fails we fall back to manually running the job without attempting to cache it

Copy link
Contributor

@colinschmidt colinschmidt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM except for one question in the else

@V-FEXrt V-FEXrt merged commit 8d33ed4 into master Aug 13, 2024
9 checks passed
@V-FEXrt V-FEXrt deleted the rsc-recover-from-missing-blob branch August 13, 2024 22:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants