[META] Automate performance benchmark for OpenSearch and components

[rishabh6788]

This meta issue is to track all the completed and upcoming features related to automating performance benchmarks on OpenSearch.

Features

• Automate nightly benchmarks for OpenSearch mainline, 2x and 1x line. [META] Analysis, Results Aggregation, and Reporting opensearch-benchmark#102. Onboard opensearch-benchmarks for performance testing #3100
• Support running benchmarks against user's cluster endpoint. [Benchmark] Add support to run benchmark against user provided cluster endpoint #4478
• Support running performance benchmarks on OpenSearch pull requests. [PROPOSAL] Run performance benchmarks on pull requests OpenSearch#14553
• Add feature to also publish baseline comparison results on pull request runs. Add baseline comparison results to pull requests for performance benchmarks OpenSearch#14826
• [ ] Control plane for submitting ad-hoc benchmark runs. [RFC] Control plane for submitting benchmark runs. #4231 Create public rest api for users to be able to submit benchmark jobs #4788
• Alerting and monitoring on benchmark metrics. Add alerting and enable anomaly-detection over benchmark metrics #3647