Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-39339: [C++] Add ForceCachedHierarchicalNamespaceSupport to help with testing #39340

Merged
merged 4 commits into from
Dec 21, 2023

Conversation

felipecrv
Copy link
Contributor

@felipecrv felipecrv commented Dec 21, 2023

Rationale for this change

This ensures all the branches in the AzureFileSystem code operations are tested.
For instance, many operations executed on a missing container, wouldn't
get a HNSSupport::kContainerNotFound error if the cached HNSSupport was
already known due to a previous operation that cached the HNSSupport value.

What changes are included in this PR?

Introduction of the helper that overrides cached_hns_support_ and enumeration of the scenarios.

Are these changes tested?

Yes. This is a test improvement PR.

Copy link

⚠️ GitHub issue #39339 has been automatically assigned in GitHub to PR creator.

@felipecrv
Copy link
Contributor Author

@kou @Tom-Newton

@github-actions github-actions bot added awaiting review Awaiting review awaiting committer review Awaiting committer review and removed awaiting review Awaiting review awaiting committer review Awaiting committer review labels Dec 21, 2023
@felipecrv felipecrv requested a review from pitrou December 21, 2023 16:54
@felipecrv
Copy link
Contributor Author

The only CI failure is a s3 test timeout, so I'm merging.

@felipecrv felipecrv merged commit e5145bf into apache:main Dec 21, 2023
32 of 33 checks passed
@felipecrv felipecrv removed the awaiting committer review Awaiting committer review label Dec 21, 2023
@felipecrv felipecrv deleted the cached_hns branch December 21, 2023 18:31
Copy link

After merging your PR, Conbench analyzed the 6 benchmarking runs that have been run so far on merge-commit e5145bf.

There were 3 benchmark results indicating a performance regression:

The full Conbench report has more details. It also includes information about 3 possible false positives for unstable benchmarks that are known to sometimes produce them.

clayburn pushed a commit to clayburn/arrow that referenced this pull request Jan 23, 2024
…help with testing (apache#39340)

### Rationale for this change

This ensures all the branches in the `AzureFileSystem` code operations are tested.
For instance, many operations executed on a missing container, wouldn't
get a `HNSSupport::kContainerNotFound` error if the cached `HNSSupport` was
already known due to a previous operation that cached the `HNSSupport` value.

### What changes are included in this PR?

Introduction of the helper that overrides `cached_hns_support_` and enumeration of the scenarios.

### Are these changes tested?

Yes. This is a test improvement PR.

* Closes: apache#39339

Authored-by: Felipe Oliveira Carvalho <felipekde@gmail.com>
Signed-off-by: Felipe Oliveira Carvalho <felipekde@gmail.com>
dgreiss pushed a commit to dgreiss/arrow that referenced this pull request Feb 19, 2024
…help with testing (apache#39340)

### Rationale for this change

This ensures all the branches in the `AzureFileSystem` code operations are tested.
For instance, many operations executed on a missing container, wouldn't
get a `HNSSupport::kContainerNotFound` error if the cached `HNSSupport` was
already known due to a previous operation that cached the `HNSSupport` value.

### What changes are included in this PR?

Introduction of the helper that overrides `cached_hns_support_` and enumeration of the scenarios.

### Are these changes tested?

Yes. This is a test improvement PR.

* Closes: apache#39339

Authored-by: Felipe Oliveira Carvalho <felipekde@gmail.com>
Signed-off-by: Felipe Oliveira Carvalho <felipekde@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[C++][FS] Allow overriding the cached value of the Hierarchical Namespace support in azurefs.cc unit tests
2 participants