Improved containerization for use on GCP, etc.#1546

Merged

copybara-service[bot] merged 40 commits intodevfrom lit-on-gcp

Oct 16, 2024

+813-406

Commits on Oct 11, 2024

Converting hosted demos images to multi-stage builds
RyanMullins
committed
Adding initial dockerfile for GCP use case
RyanMullins
committed
Update lit-on-gcp requirements.

llcourage
authored and
RyanMullins
committed
Updating date on license declaration
RyanMullins
committed
Updating dockerfile for LIT on GCP
RyanMullins
committed
Add model_server to lit-on-gcp,

llcourage
authored and
RyanMullins
committed
Updating copyright year in Dockerfile
RyanMullins
committed
Add unit test for model_server.

llcourage
authored and
RyanMullins
committed
Add webtest package to lit_on_gcp requirement file.

llcourage
authored and
RyanMullins
committed
Adding gunicorn config for model_server.py
RyanMullins
committed
Add unit test for model_server of lit on GCP.

llcourage
authored and
RyanMullins
committed
Update pyproject.toml and requirment_test files.

llcourage
authored and
RyanMullins
committed
Fetch model_name from model_config for lit-on-gcp model server.

llcourage
authored and
RyanMullins
committed
Fixing KeyError in tests related to default name change
RyanMullins
committed
Fixing requirements and udpating README
RyanMullins
committed
Adding testing instructions to README
RyanMullins
committed
Correct the model name of model_server.

llcourage
authored and
RyanMullins
committed
Fix wsgi handler name.

llcourage
authored and
RyanMullins
committed
Modify the output to be a list to ensure compatibility with JSON serialization.

llcourage
authored and
RyanMullins
committed
Adopting the generate_model_group_names() API from PD Utils
RyanMullins
committed
Using generate_model_group_names() API in model server test
RyanMullins
committed
Code health update on model server tests
RyanMullins
committed
Linting cleanup in the model server
RyanMullins
committed
Adds LIT app server code
RyanMullins
committed
Adding LIT App server for LIT LLMs on GCP
RyanMullins
committed
Fixing enum accessor in UTs
RyanMullins
committed
Migrate to updated pd_models.get_models kw args
RyanMullins
committed
Fix errors in gcp model_server and models.

llcourage
authored and
RyanMullins
committed
Combine vertexai docker image and gcp_server image.

llcourage
authored and
RyanMullins
committed
Add identity_token as LLM_ON_GCP init spec.

llcourage
authored and
RyanMullins
committed
Rename the model loader name.

llcourage
authored and
RyanMullins
committed
Updating requirements for TF 2.16 compatibility
RyanMullins
committed

Commits on Oct 15, 2024