-
Notifications
You must be signed in to change notification settings - Fork 1
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
issue #4: llama index deployment design
- Loading branch information
Showing
13 changed files
with
461 additions
and
23 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,32 +1,44 @@ | ||
# API Key for Azure OpenAI | ||
API_KEY= | ||
# Storage Account Connection String. Obtain this from your Azure Storage account | ||
# in the Azure Portal under "Access keys". | ||
STORAGE_ACCOUNT_CONN_STRING= | ||
|
||
# Endpoint URL for Azure OpenAI | ||
# API Key for Azure OpenAI. Same value for both. Get this from the Azure portal | ||
# under your Azure OpenAI Service resource. | ||
OPENAI_API_KEY= | ||
AZURE_OPENAI_API_KEY= | ||
|
||
# Endpoint URL for Azure OpenAI. Find this in the Overview section of your Azure | ||
# OpenAI Service resource in the Azure portal. | ||
AZURE_ENDPOINT= | ||
|
||
# API Version for Azure OpenAI | ||
API_VERSION= | ||
# API Version for Azure OpenAI Check the Azure OpenAI documentation for the | ||
# current API version | ||
# OPENAI_API_VERSION=2023-07-01-preview | ||
|
||
# Language Model for Azure OpenAI. | ||
# LLM_MODEL= | ||
# Language Model for Azure OpenAI. Specify the model you wish to use. | ||
# LLM_MODEL=gpt-4 | ||
|
||
# Language Model Deployment Name for Azure OpenAI | ||
# LLM_DEPLOYMENT_NAME= | ||
# Language Model Deployment Name for Azure OpenAI If you have a custom | ||
# deployment, specify its name here. Otherwise, leave commented | ||
# LLM_DEPLOYMENT_NAME=ailab-llm | ||
|
||
# Embedding Model for Azure OpenAI | ||
# EMBED_MODEL= | ||
# Embedding Model for Azure OpenAI Specify the embedding model you wish to use. | ||
# Check Azure OpenAI documentation for available models | ||
# EMBED_MODEL=ada | ||
|
||
# Embedding Model Deployment Name for Azure OpenAI | ||
# EMBED_DEPLOYMENT_NAME= | ||
# Embedding Model Deployment Name for Azure OpenAI. | ||
# EMBED_DEPLOYMENT_NAME=text-embedding-ada-002 | ||
|
||
# Database Connection Configuration | ||
# Database Connection Configuration These details will be specific to your | ||
# database. Obtain them from your database administrator or setup | ||
DB_SCHEME= | ||
DB_HOST= | ||
DB_PORT= | ||
DB_USER= | ||
DB_PASSWORD= | ||
DB_NAME= | ||
|
||
# Table and Column for Querying the Database | ||
# Table and Column for Querying the Database Specify the table and column you | ||
# wish to query. This will depend on your database schema | ||
# TABLE_NAME= | ||
# COLUMN= |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -56,3 +56,12 @@ venv/ | |
ENV/ | ||
env.bak/ | ||
venv.bak/ | ||
|
||
# Index files | ||
index/ | ||
|
||
# Pickle files | ||
*.pkl | ||
|
||
# OS specific | ||
.DS_Store |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,24 @@ | ||
@startuml components | ||
left to right direction | ||
interface REST | ||
|
||
component "LlamaIndex API" as api { | ||
package app as "flask app" | ||
package LlamaIndex as "llamaIndex_db" { | ||
package llama_index | ||
} | ||
} | ||
app --> LlamaIndex: uses | ||
REST -- api | ||
|
||
folder Container as "Index folder" { | ||
file doc as "default__vector_store.json" | ||
file index as "docstore.json" | ||
file vector as "graph_store.json" | ||
file graph as "image__vector_store.json" | ||
file image as "index_store.json" | ||
} | ||
|
||
llama_index --> Container : reads | ||
|
||
@enduml |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,16 @@ | ||
@startuml deployment | ||
left to right direction | ||
interface REST | ||
|
||
cloud Azure { | ||
node docker as "Docker container" { | ||
component "LlamaIndex API" as api | ||
} | ||
database volume as "Docker Volume" { | ||
folder Container as "Index folder" | ||
} | ||
} | ||
|
||
REST -- api | ||
api --> Container : reads | ||
@enduml |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Oops, something went wrong.