Skip to content

Commit

Permalink
lvm-uservice: adapt to config changes
Browse files Browse the repository at this point in the history
Adapt to config changes of lvm source code.

Signed-off-by: Lianhao Lu <lianhao.lu@intel.com>
  • Loading branch information
lianhao committed Jan 24, 2025
1 parent cdd4180 commit ef19602
Show file tree
Hide file tree
Showing 2 changed files with 5 additions and 1 deletion.
4 changes: 3 additions & 1 deletion helm-charts/common/lvm-uservice/templates/configmap.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,7 @@ metadata:
data:
{{- if eq "TGI" .Values.LVM_BACKEND }}
LVM_COMPONENT_NAME: "OPEA_TGI_LLAVA_LVM"
MAX_IMAGES: {{ .Values.MAX_IMAGES | default 1 | quote }}
{{- if not .Values.LVM_ENDPOINT }}
LVM_ENDPOINT: "http://{{ .Release.Name }}-tgi"
{{- end }}
Expand All @@ -19,10 +20,11 @@ data:
{{- end }}
{{- if eq "LLaVA" .Values.LVM_BACKEND }}
LVM_COMPONENT_NAME: "OPEA_LLAVA_LVM"
MAX_IMAGES: {{ .Values.MAX_IMAGES | default 1 | quote }}
{{- else if eq "VideoLlama" .Values.LVM_BACKEND }}
LVM_COMPONENT_NAME: "OPEA_VIDEO_LLAMA_LVM"
{{- else if eq "LlamaVision" .Values.LVM_BACKEND }}
LVM_COMPONENT_NAME: "OPEA_LLAVA_VISION_LVM"
LVM_COMPONENT_NAME: "OPEA_LLAMA_VISION_LVM"
{{- else if eq "PredictionGuard" .Values.LVM_BACKEND }}
LVM_COMPONENT_NAME: "OPEA_PREDICTION_GUARD_LVM"
{{- else }}
Expand Down
2 changes: 2 additions & 0 deletions helm-charts/common/lvm-uservice/values.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,8 @@
LOGFLAG: ""
# backend inference engine to use, i.e. TGI, LLaVA, VideoLlama, LlamaVision, PredictionGuard
LVM_BACKEND: "TGI"
# maximum image number sent to backend, only valid for TGI, LLaVa backend
MAX_IMAGES: 1
# inference engine service URL, e.g. http://tgi:80
LVM_ENDPOINT: ""

Expand Down

0 comments on commit ef19602

Please sign in to comment.