-
LLM serving
- Local server (1* RTX 6000)
- Docker
- HuggingFace pipeline
-
LLM Finetuning
- Original model from KoAlpaca-Polyglot-5.8B
- Finetuned using Peft+LoRA
-
- ChromaDB
- FastAPI
- Docker
-
Gradio
- Original code from Baize
-
Prompoting
...
LLM serving
LLM Finetuning
Gradio
Prompoting
...