Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Onboard basic RAG preset #369

Merged
merged 5 commits into from
Sep 12, 2024
Merged

Conversation

ohltyler
Copy link
Member

@ohltyler ohltyler commented Sep 11, 2024

Description

Adds a basic RAG preset to the library. Pre-populates:

  • ML search response processor with an LLM to generate results (defaults to many-to-one)
  • collapse response processor to only return unique ML responses (in many-to-one case, this will be one result)

More details:

  • onboards collapse search response processor
  • adds an llmResponse quick-config field, and default quick-config field values for the new RAG usecase
  • fixes bug of input transform fetching failing on search response processors when no prior search request or search response processors
  • refactors helper fns in QuickConfigureModal and makes them more generic

Notes:

Demo video, showing a RAG usecase using a deployed LLM model with some sample review documents. The model does not have an interface or configured prompt template, so both are manually filled in. The final result is a single response containing the LLM's summary of the documents found during search.

screen-capture.17.webm

Check List

  • Commits are signed per the DCO using --signoff

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
…ch req

Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
@ohltyler
Copy link
Member Author

This is the last "building block" use case. After this is merged, we can explore common combinations - semantic search with RAG, hybrid search with semantic search and semantic analysis, hybrid search with plaintext search and semantic analysis, with RAG, etc.....

@saimedhi saimedhi merged commit 3d08de9 into opensearch-project:main Sep 12, 2024
6 checks passed
opensearch-trigger-bot bot pushed a commit that referenced this pull request Sep 12, 2024
* Onboard collapse processor

Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>

* handle edge case of default search pipeline on search resp w/ no search req

Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>

* Add metadata (no quick config fields)

Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>

* add quickconfig fields

Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>

* cleanup

Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>

---------

Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
(cherry picked from commit 3d08de9)
ohltyler added a commit that referenced this pull request Sep 12, 2024
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
(cherry picked from commit 3d08de9)

Co-authored-by: Tyler Ohlsen <ohltyler@amazon.com>
@ohltyler ohltyler deleted the rag-preset branch September 12, 2024 23:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants