pref: Optimize xrefmap download performance #9637
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR is intended to resolve #9558
What's included in this PR
80KB
is default buffer size that used byStream::CopyTo
.What's tested
I've manually tested xrefmap download with following configuration.
And confirmed server returns following HTTP Response headers. And download size is reduced. (
316MB
->16MB
)TODO Tasks
I'll create another PR later relating #9558.
(Because YamlDotNet based JsonDeserializer is 5x slower than
System.Text.Json
based deserialization)xrefmap compressed by gzip
(xrefmap.json.gz
) from local disk.