[Fleet] Additional datastreams permissions API

[nchaulet]

Summary

Related to #203585

Add a new additional_datastreams_permissions properties to the fleet package policies API

POST kbn:/api/fleet/package_policies
{
 ...,
 "additional_datastreams_permissions": ["logs-test-default", "metrics-test-*"]

}

That property allow to define extra permissions that will be added to the generated agent policy. This is usefull for user using the reroute processor in their ingest pipeline.

Tests

I added API integration tests.

Working on adding a e2e test with a reroute processor.

You can test by creating a package policy with additional_datastreams_permissions and check the permission are in the generated policy

[elasticmachine]

Pinging @elastic/fleet (Team:Fleet)

[jeramysoucy]

Kibana Security changes LGTM. No changes to encrypted saved object types.

[juliaElastic]

Tested locally, looks good:

[elasticmachine]

💔 Build Failed

• Buildkite Build
• Commit: 5a0ae07

Failed CI Steps

• Jest Tests #8
• Jest Tests #8
• Jest Tests #9
• Jest Tests #9
• Jest Tests #20
• Fleet Cypress Tests #1

Test Failures

• [job] [logs] Jest Tests #8 / Fleet - validatePackagePolicy() works for packages with multiple policy templates (aka integrations) returns errors for invalid package policy
• [job] [logs] Jest Tests #8 / Fleet - validatePackagePolicy() works for packages with multiple policy templates (aka integrations) returns errors for invalid package policy
• [job] [logs] Jest Tests #8 / Fleet - validatePackagePolicy() works for packages with single policy template (aka no integrations) returns errors for invalid package policy
• [job] [logs] Jest Tests #8 / Fleet - validatePackagePolicy() works for packages with single policy template (aka no integrations) returns errors for invalid package policy
• [job] [logs] Jest Tests #8 / Fleet - validatePackagePolicy() works for packages with single policy template (aka no integrations) returns no errors for disabled inputs
• [job] [logs] Jest Tests #8 / Fleet - validatePackagePolicy() works for packages with single policy template (aka no integrations) returns no errors for disabled inputs
• [job] [logs] Jest Tests #8 / Fleet - validatePackagePolicy() works for packages with single policy template (aka no integrations) returns no errors for packages with no inputs
• [job] [logs] Jest Tests #8 / Fleet - validatePackagePolicy() works for packages with single policy template (aka no integrations) returns no errors for packages with no inputs
• [job] [logs] Jest Tests #8 / Fleet - validatePackagePolicy() works for packages with single policy template (aka no integrations) returns no errors for packages with no package policies
• [job] [logs] Jest Tests #8 / Fleet - validatePackagePolicy() works for packages with single policy template (aka no integrations) returns no errors for packages with no package policies
• [job] [logs] Jest Tests #8 / Fleet - validatePackagePolicy() works for packages with single policy template (aka no integrations) returns no errors for valid package policy
• [job] [logs] Jest Tests #8 / Fleet - validatePackagePolicy() works for packages with single policy template (aka no integrations) returns no errors for valid package policy
• [job] [logs] Jest Tests #8 / Fleet - validatePackagePolicy() works for packages with single policy template (aka no integrations) returns no errors when required field is present but empty
• [job] [logs] Jest Tests #8 / Fleet - validatePackagePolicy() works for packages with single policy template (aka no integrations) returns no errors when required field is present but empty
• [job] [logs] Jest Tests #8 / Fleet - validatePackagePolicy() works for packages with single policy template (aka no integrations) returns only package policy and input-level errors for disabled streams
• [job] [logs] Jest Tests #8 / Fleet - validatePackagePolicy() works for packages with single policy template (aka no integrations) returns only package policy and input-level errors for disabled streams
• [job] [logs] Jest Tests #20 / SolutionFilter when the owner is a single solution should call onChange with selected solution id when no option selected yet
• [job] [logs] Jest Tests #9 / StepDefinePackagePolicy default API response should display namespace from agent policy when there's no package policy namespace
• [job] [logs] Jest Tests #9 / StepDefinePackagePolicy default API response should display namespace from agent policy when there's no package policy namespace
• [job] [logs] Jest Tests #9 / StepDefinePackagePolicy default API response should fallback to the default namespace when namespace is not set in package policy and there's no agent policy
• [job] [logs] Jest Tests #9 / StepDefinePackagePolicy default API response should fallback to the default namespace when namespace is not set in package policy and there's no agent policy

Metrics [docs]

Public APIs missing comments

Total count of every public API that lacks a comment. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats comments for more detailed information.

id	before	after	diff
fleet	1324	1327	+3

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id	before	after	diff
fleet	1.7MB	1.7MB	+1.2KB

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id	before	after	diff
fleet	174.7KB	175.3KB	+683.0B

Unknown metric groups

API count

id	before	after	diff
fleet	1451	1454	+3

History

• 💚 Build #275651 succeeded d22795d
• 💔 Build #275628 failed d77ea63
• 💔 Build #275596 failed 04e8c3c
• 💔 Build #275384 failed 602f3e6

[juliaElastic]

LGTM