You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
With the Smoke Test Framework (issue #5223) now established, we have successfully onboarded multiple OpenSearch plugins—including Index Management, Security, SQL, and K-NN—to ensure reliable pre-release validation.
To further improve integration and visibility, we aim to enhance the smoke tests with a reporting and notification mechanism. Ideally, after each run, the framework should generate a structured test report similar to the integration test report, capturing test results and associated logs.
The generated report will be:
Improving visibility into test results.
Consumed by metric dashboards for more insights.
Used for automated failure notifications, enabling faster issue resolution.
Tasks
Enhance the smoke test workflow to record test results and generate a structured component YAML file.
Integrate with the reporting workflow to produce an indexable test-report.yml containing test outcomes.
Work on indexing the new test report into existing metric dashboards for monitoring and analysis.
This improvement will provide greater transparency, automation, and efficiency in OpenSearch distribution testing.
The text was updated successfully, but these errors were encountered:
Overview
With the Smoke Test Framework (issue #5223) now established, we have successfully onboarded multiple OpenSearch plugins—including Index Management, Security, SQL, and K-NN—to ensure reliable pre-release validation.
To further improve integration and visibility, we aim to enhance the smoke tests with a reporting and notification mechanism. Ideally, after each run, the framework should generate a structured test report similar to the integration test report, capturing test results and associated logs.
The generated report will be:
Tasks
This improvement will provide greater transparency, automation, and efficiency in OpenSearch distribution testing.
The text was updated successfully, but these errors were encountered: