Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[UII] Add remote cluster instructions for syncing integrations #211997

Merged
merged 5 commits into from
Feb 21, 2025

Conversation

jen-huang
Copy link
Contributor

@jen-huang jen-huang commented Feb 21, 2025

Summary

Resolves #206239. This PR adds instructions for configuring the remote cluster to enable syncing integrations (for a Remote Elasticsearch output).

It also hides extra fields when Sync integrations is not enabled:

image

When enabled:

image

Checklist

Check the PR satisfies following conditions.

Reviewers should verify this PR satisfies this list as well.

@jen-huang jen-huang added release_note:fix backport:skip This commit does not require backporting Team:Fleet Team label for Observability Data Collection Fleet team v9.1.0 labels Feb 21, 2025
@jen-huang jen-huang self-assigned this Feb 21, 2025
@jen-huang jen-huang requested a review from a team as a code owner February 21, 2025 00:32
@elasticmachine
Copy link
Contributor

Pinging @elastic/fleet (Team:Fleet)

<EuiSpacer size="m" />
<FormattedMessage
id="xpack.fleet.settings.remoteClusterConfiguration.description"
defaultMessage="The Remote Elasticsearch output must have additional configuration to sync integrations from this cluster. {documentationLink}."
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kilfoyle I would appreciate some wordsmithing magic on all the text added in this callout :) There's sort of a two-way "remote cluster" situation which I found hard to explain.

The user is setting up a "remote Elasticsearch" output on this local cluster. In order to automatically sync integration assets to that remote ES, we need them to connect this local cluster to that remote cluster. From that cluster's perspective, this local cluster is considered the "remote cluster." Does it make sense? 😅

Copy link
Contributor

@kilfoyle kilfoyle Feb 21, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure! How about this? Just some slight changes from the original. For the third step, to shorten it a bit I suppose we can omit the "allow this cluster to read integration status" as they'll gather what it's for.

To sync integrations from this cluster, the remote Elasticsearch output needs additional configuration. [Learn more ↗.]

  1. In the remote cluster, open Kibana and go to Stack Management > Remote Clusters, and follow the steps to add this cluster.

  2. Go to Stack Management > Cross-Cluster Replication and create a follower index using the cluster from Step 1. The leader index fleet-synced-integrations from this cluster should be replicated to the follower index fleet-synced-integrations-ccr-<output name> on the remote cluster.

  3. Below, provide the access details for the remote cluster's Kibana instance.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, updated!

@jen-huang jen-huang requested a review from a team as a code owner February 21, 2025 00:44
defaultMessage="The Remote Elasticsearch output must have additional configuration to sync integrations from this cluster. {documentationLink}."
values={{
documentationLink: (
<EuiLink external={true} href={docLinks.links.fleet.remoteESOoutput}>
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kilfoyle I expect we'll file a docs request when #187323 is near completion and I think it probably makes sense for the new content to live on the same remote ES output docs page, but we can update the link here if not.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yup! That makes sense to me. Best to keep all the remote ES stuff together on the same page.

Copy link
Contributor

@juliaElastic juliaElastic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@kilfoyle kilfoyle left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! 🎸
I added some small suggestions for the UI text.

@elasticmachine
Copy link
Contributor

💛 Build succeeded, but was flaky

Failed CI Steps

Test Failures

  • [job] [logs] x-pack/test_serverless/functional/test_suites/security/common_configs/config.group5.ts / discover/group1 discover test nested query should support querying on nested fields

Metrics [docs]

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
aiAssistantManagementSelection 92.5KB 92.5KB -28.0B
fleet 1.7MB 1.7MB +2.9KB
lists 136.5KB 136.5KB -28.0B
total +2.8KB

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id before after diff
core 474.6KB 474.6KB -28.0B

History

cc @jen-huang

@jen-huang jen-huang merged commit f0797db into elastic:main Feb 21, 2025
9 checks passed
@jen-huang jen-huang deleted the feat/sync/follower-instructions branch February 21, 2025 22:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport:skip This commit does not require backporting release_note:fix Team:Fleet Team label for Observability Data Collection Fleet team v9.1.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Fleet] Add manual instructions to set up follower index with CCR on remote cluster
4 participants