Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update docs for AWS Endpoint parameter for all S3 + Path Style URL Parameter #19366

Merged
merged 2 commits into from
Feb 14, 2025

Conversation

kathancox
Copy link
Contributor

@kathancox kathancox commented Feb 11, 2025

Fixes DOC-11949, DOC-12079

This PR adds:

  • the AWS_ENDPOINT parameter to the AWS S3 section of the docs on the cloud storage and backup pages. (23.1 through v25.1)
  • the new AWS_USE_PATH_STYLE parameter to the same docs (24.1 – 25.1)
  • a couple of small fixes while working in the area (clarified some descriptions, added missing parameters, etc.)

Copy link

netlify bot commented Feb 11, 2025

Deploy Preview for cockroachdb-api-docs canceled.

Name Link
🔨 Latest commit 3129bd8
🔍 Latest deploy log https://app.netlify.com/sites/cockroachdb-api-docs/deploys/67af6ed1d9f1790008e949ee

Copy link

netlify bot commented Feb 11, 2025

Deploy Preview for cockroachdb-interactivetutorials-docs canceled.

Name Link
🔨 Latest commit 3129bd8
🔍 Latest deploy log https://app.netlify.com/sites/cockroachdb-interactivetutorials-docs/deploys/67af6ed124670c00081b62eb

Copy link

netlify bot commented Feb 11, 2025

Netlify Preview

Name Link
🔨 Latest commit 3129bd8
🔍 Latest deploy log https://app.netlify.com/sites/cockroachdb-docs/deploys/67af6ed143234a0008c18d77
😎 Deploy Preview https://deploy-preview-19366--cockroachdb-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@kathancox kathancox marked this pull request as ready for review February 12, 2025 14:56
@kathancox kathancox requested a review from benbardin February 12, 2025 14:56
@kathancox kathancox changed the title Update docs for AWS Endpoint parameter for all S3 Update docs for AWS Endpoint parameter for all S3 + Path Style URL Parameter Feb 12, 2025
@@ -97,6 +97,9 @@ Query parameter | Value | Description
----------------+-------+------------
`ASSUME_ROLE` | [`STRING`]({% link {{ page.version.version }}/string.md %}) |{% include {{ page.version.version }}/misc/assume-role-description.md %} Refer to [Cloud Storage Authentication]({% link {{ page.version.version }}/cloud-storage-authentication.md %}) for setup details.
`AUTH` | [`STRING`]({% link {{ page.version.version }}/string.md %}) | The authentication parameter can define either `specified` (default) or `implicit` authentication. To use `specified` authentication, pass your [Service Account](https://cloud.google.com/iam/docs/understanding-service-accounts) credentials with the URI. To use `implicit` authentication, configure these credentials via an environment variable. Refer to the [Cloud Storage Authentication page]({% link {{ page.version.version }}/cloud-storage-authentication.md %}) page for examples of each of these.
`AWS_ENDPOINT` | Specify a custom endpoint for Amazon S3 or S3-compatible services. Use to define a particular region or a Virtual Private Cloud (VPC) endpoint.
`AWS_SESSION_TOKEN` | (Optional) Use as part of temoporary security credentials when accessing AWS S3. For more information, refer to Amazon's guide on [temporary credentials](https://docs.aws.amazon.com/IAM/latest/UserGuide/id_credentials_temp_use-resources.html).
{% include_cached new-in.html version="v24.1.10" %} `AWS_USE_PATH_STYLE` | Change the URL format to path style from the default AWS S3 virtual-hosted–style URLs when connecting to Amazon S3 or S3-compatible services.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So, not exactly - that's true on 24.3+. But on 24.1/24.2, the param exists but does nothing. Path style is actually the only available system on those versions. For 24.3, we changed the behavior. We added AWS_USE_PATH_STYLE to force the old behavior on 24.3+, and backported the param as a noop to 24.1/24.2 so users who need it could set it in advance of upgrading.

@@ -96,6 +96,9 @@ N/A | Back up the cluster. For an example of a fu
Query parameter | Value | Description
----------------+-------+------------
`ASSUME_ROLE` | [`STRING`]({% link {{ page.version.version }}/string.md %}) |{% include {{ page.version.version }}/misc/assume-role-description.md %} Refer to [Cloud Storage Authentication]({% link {{ page.version.version }}/cloud-storage-authentication.md %}) for setup details.
`AUTH` | [`STRING`]({% link {{ page.version.version }}/string.md %}) | The authentication parameter can define either `specified` (default) or `implicit` authentication. To use `specified` authentication, pass your [Service Account](https://cloud.google.com/iam/docs/understanding-service-accounts) credentials with the URI. To use `implicit` authentication, configure these credentials via an environment variable. Refer to the [Cloud Storage Authentication page]({% link {{ page.version.version }}/cloud-storage-authentication.md %}) page for examples of each of these.
`AWS_ENDPOINT` | Specify a custom endpoint for Amazon S3 or S3-compatible services. Use to define a particular region or a Virtual Private Cloud (VPC) endpoint.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ENDPOINT and SESSION TOKEN comments look good throughout, thank you!

@@ -97,6 +97,9 @@ Query parameter | Value | Description
----------------+-------+------------
`ASSUME_ROLE` | [`STRING`]({% link {{ page.version.version }}/string.md %}) |{% include {{ page.version.version }}/misc/assume-role-description.md %} Refer to [Cloud Storage Authentication]({% link {{ page.version.version }}/cloud-storage-authentication.md %}) for setup details.
`AUTH` | [`STRING`]({% link {{ page.version.version }}/string.md %}) | The authentication parameter can define either `specified` (default) or `implicit` authentication. To use `specified` authentication, pass your [Service Account](https://cloud.google.com/iam/docs/understanding-service-accounts) credentials with the URI. To use `implicit` authentication, configure these credentials via an environment variable. Refer to the [Cloud Storage Authentication page]({% link {{ page.version.version }}/cloud-storage-authentication.md %}) page for examples of each of these.
`AWS_ENDPOINT` | Specify a custom endpoint for Amazon S3 or S3-compatible services. Use to define a particular region or a Virtual Private Cloud (VPC) endpoint.
`AWS_SESSION_TOKEN` | (Optional) Use as part of temoporary security credentials when accessing AWS S3. For more information, refer to Amazon's guide on [temporary credentials](https://docs.aws.amazon.com/IAM/latest/UserGuide/id_credentials_temp_use-resources.html).
{% include_cached new-in.html version="v24.1.10" %} `AWS_USE_PATH_STYLE` | Set the URL format to path style. In v24.3+, the default URL format is AWS S3 virtual-hosted–style URLs when connecting to Amazon S3 or S3-compatible services. Before upgrading to v24.3+, use `AWS_USE_PATH_STYLE` to keep the URL format as path style.
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@benbardin Ah! Yes, apologies. Does this change cover it?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

great! thank you!

@kathancox
Copy link
Contributor Author

Thanks for the quick review @benbardin !

@kathancox kathancox requested a review from rmloveland February 12, 2025 17:09
Copy link
Contributor

@rmloveland rmloveland left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@kathancox
Copy link
Contributor Author

TFTRs!

@kathancox kathancox merged commit 268bc5e into main Feb 14, 2025
6 checks passed
@kathancox kathancox deleted the aws-endpoint-all-s3 branch February 14, 2025 16:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants