-
Notifications
You must be signed in to change notification settings - Fork 11
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Onboard basic RAG preset #369
Merged
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
…ch req Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com>
This is the last "building block" use case. After this is merged, we can explore common combinations - semantic search with RAG, hybrid search with semantic search and semantic analysis, hybrid search with plaintext search and semantic analysis, with RAG, etc..... |
saimedhi
approved these changes
Sep 12, 2024
opensearch-trigger-bot bot
pushed a commit
that referenced
this pull request
Sep 12, 2024
* Onboard collapse processor Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com> * handle edge case of default search pipeline on search resp w/ no search req Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com> * Add metadata (no quick config fields) Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com> * add quickconfig fields Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com> * cleanup Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com> --------- Signed-off-by: Tyler Ohlsen <ohltyler@amazon.com> (cherry picked from commit 3d08de9)
ohltyler
added a commit
that referenced
this pull request
Sep 12, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Adds a basic RAG preset to the library. Pre-populates:
collapse
response processor to only return unique ML responses (in many-to-one case, this will be one result)More details:
collapse
search response processorllmResponse
quick-config field, and default quick-config field values for the new RAG usecaseQuickConfigureModal
and makes them more genericNotes:
full_response_path
when implementing transforms with JSON path. See tracking issue Enforcefull_response_path=true
when users configure JSON Path in ML processors #368Demo video, showing a RAG usecase using a deployed LLM model with some sample review documents. The model does not have an interface or configured prompt template, so both are manually filled in. The final result is a single response containing the LLM's summary of the documents found during search.
screen-capture.17.webm
Check List
--signoff
By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.