Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-38725: [Java] decompression in Lz4CompressionCodec.java does not set writer index #38840

Merged
merged 2 commits into from
Dec 21, 2023

Conversation

vibhatha
Copy link
Collaborator

@vibhatha vibhatha commented Nov 22, 2023

Rationale for this change

The doDecompress function in Lz4CompressionCodec misses writing the index when it is compared with the functionality in ZstdCompressionCodec. This PR fixes that issue.

What changes are included in this PR?

Writes the index for the decompressed ArrowBuf.

Are these changes tested?

No

Are there any user-facing changes?

No

Copy link

⚠️ GitHub issue #38725 has been automatically assigned in GitHub to PR creator.

@danepitkin
Copy link
Member

LGTM! Maybe a very small test could be to assert that writerIndex > 0 after decompressing? You could probably add the assert to an existing test case.

@vibhatha vibhatha marked this pull request as ready for review December 21, 2023 06:43
@vibhatha vibhatha requested a review from lidavidm as a code owner December 21, 2023 06:43
@vibhatha vibhatha changed the title GH-38725: [Java] deconpression in Lz4CompressionCodec.java does not set writer index GH-38725: [Java] decompression in Lz4CompressionCodec.java does not set writer index Dec 21, 2023
Copy link

⚠️ GitHub issue #38725 has been automatically assigned in GitHub to PR creator.

@vibhatha
Copy link
Collaborator Author

@danepitkin Thank you for the previous review and sorry about the delay in addressing reviews.
It is ready for another round of reviews.

Copy link
Contributor

@davisusanibar davisusanibar left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @vibhatha, LGTM.

@github-actions github-actions bot added awaiting committer review Awaiting committer review and removed awaiting review Awaiting review labels Dec 21, 2023
@github-actions github-actions bot added awaiting merge Awaiting merge and removed awaiting committer review Awaiting committer review labels Dec 21, 2023
@lidavidm lidavidm merged commit 596259e into apache:main Dec 21, 2023
18 checks passed
@lidavidm lidavidm removed the awaiting merge Awaiting merge label Dec 21, 2023
Copy link

After merging your PR, Conbench analyzed the 5 benchmarking runs that have been run so far on merge-commit 596259e.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 1 possible false positive for unstable benchmarks that are known to sometimes produce them.

clayburn pushed a commit to clayburn/arrow that referenced this pull request Jan 23, 2024
… not set writer index (apache#38840)

### Rationale for this change

The `doDecompress` function in `Lz4CompressionCodec` misses writing the index when it is compared with the functionality in `ZstdCompressionCodec`. This PR fixes that issue. 

### What changes are included in this PR?

Writes the index for the decompressed ArrowBuf. 

### Are these changes tested?

No

### Are there any user-facing changes?

No
* Closes: apache#38725

Lead-authored-by: Vibhatha Lakmal Abeykoon <vibhatha@gmail.com>
Co-authored-by: vibhatha <vibhatha@gmail.com>
Signed-off-by: David Li <li.davidm96@gmail.com>
dgreiss pushed a commit to dgreiss/arrow that referenced this pull request Feb 19, 2024
… not set writer index (apache#38840)

### Rationale for this change

The `doDecompress` function in `Lz4CompressionCodec` misses writing the index when it is compared with the functionality in `ZstdCompressionCodec`. This PR fixes that issue. 

### What changes are included in this PR?

Writes the index for the decompressed ArrowBuf. 

### Are these changes tested?

No

### Are there any user-facing changes?

No
* Closes: apache#38725

Lead-authored-by: Vibhatha Lakmal Abeykoon <vibhatha@gmail.com>
Co-authored-by: vibhatha <vibhatha@gmail.com>
Signed-off-by: David Li <li.davidm96@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[java]deconpression in Lz4CompressionCodec.java does not set writer index
4 participants