Skip to content

Commit

Permalink
Merge pull request #80 from jina-ai/hotfix-rename-issues
Browse files Browse the repository at this point in the history
fix: issues of rename
  • Loading branch information
numb3r3 authored Sep 4, 2023
2 parents 6bf9e3b + a6b32cf commit 269dd02
Show file tree
Hide file tree
Showing 5 changed files with 16 additions and 47 deletions.
1 change: 0 additions & 1 deletion .github/workflows/docker-release.yml
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,6 @@ jobs:
echo "VCS_REF=$VCS_REF" >> $GITHUB_ENV
echo "Will build $VCS_REF"
echo "BUILD_DATE=$(date -u +'%Y-%m-%dT%H:%M:%SZ')" >> $GITHUB_ENV
echo "BUILD_TARGET=clip_executor" >> $GITHUB_ENV
VERSION=$(sed -n '/^__version__ = /p' ./run_gpt/__init__.py | cut -d \' -f2)
V_VERSION=v${VERSION}
Expand Down
6 changes: 3 additions & 3 deletions Dockerfiles/executor.Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -8,16 +8,16 @@ FROM mosaicml/pytorch:${TORCH_VERSION}_cu${CUDA_VERSION}-python3.10-ubuntu20.04
ENV DEBIAN_FRONTEND=noninteractive LANG=en_US.UTF-8 LC_ALL=en_US.UTF-8

# copy will almost always invalid the cache
COPY . /open_gpt/
WORKDIR /open_gpt
COPY . /run_gpt/
WORKDIR /run_gpt

RUN python3 -m pip install jina==3.18.0
RUN python3 -m pip install -e .

RUN echo -e "\
jtype: CausualLMExecutor\n\
py_modules:\n\
- open_gpt.serve.executors\n\
- run_gpt.serve.executors\n\
" > config.yml

ENTRYPOINT ["jina", "executor", "--uses", "config.yml", "--timeout-ready", "3600000"]
6 changes: 3 additions & 3 deletions Dockerfiles/gateway.Dockerfile
Original file line number Diff line number Diff line change
@@ -1,15 +1,15 @@
FROM jinaai/jina:3.18.0-py310-standard

COPY . /open_gpt/
WORKDIR /open_gpt
COPY . /run_gpt/
WORKDIR /run_gpt

RUN python3 -m pip install -e .


RUN echo "\
!Gateway\n\
py_modules:\n\
- open_gpt.serve.gateway\n\
- run_gpt.serve.gateway\n\
" > config.yml


Expand Down
46 changes: 9 additions & 37 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,25 +14,23 @@
[![PyPI](https://img.shields.io/pypi/v/run_gpt_torch)](https://pypi.org/project/run_gpt_torch/)
[![PyPI - License](https://img.shields.io/pypi/l/run_gpt_torch)](https://pypi.org/project/run_gpt_torch/)

**RunGPT** is an open-source _cloud-native_ large-scale **_multimodal models_** (LMMs) serving framework.
**RunGPT** is an open-source _cloud-native_ **_large-scale language models_** (LLMs) serving framework.
It is designed to simplify the deployment and management of large language models, on a distributed cluster of GPUs.
We aim to make it a one-stop solution for a centralized and accessible place to gather techniques for optimizing large-scale multimodal models and make them easy to use for everyone.
We aim to make it a one-stop solution for a centralized and accessible place to gather techniques for optimizing LLM and make them easy to use for everyone.


## Table of contents

- [Features](#features)
- [Supported models](#supported-models)
- [Get started](#get-started)
- [Build a model serving in one line](#build-a-model-serving-in-one-line)
- [Cloud-native deployment](#cloud-native-deployment)
- [Roadmap](#roadmap)

## Features

RunGPT provides the following features to make it easy to deploy and serve **large multi-modal models** (LMMs) at scale:
RunGPT provides the following features to make it easy to deploy and serve **large language models** (LLMs) at scale:

- Support for multi-modal models on top of large language models
- Scalable architecture for handling high traffic loads
- Optimized for low-latency inference
- Automatic model partitioning and distribution across multiple GPUs
Expand All @@ -41,35 +39,9 @@ RunGPT provides the following features to make it easy to deploy and serve **lar

## Updates

- **2023-05-12**: 🎉We have released the first version `v0.0.1` of RunGPT. You can install it with `pip install run_gpt_torch`.
- **2023-08-22**: The OpenGPT is now renamed to RunGPT. We have also released the first version `v0.1.0` of RunGPT. You can install it with `pip install rungpt`.
- **2023-05-12**: 🎉We have released the first version `v0.0.1` of OpenGPT. You can install it with `pip install open_gpt_torch`.

## Supported Models

<details>

RunGPT supports the following models out of the box:

- LLM (Large Language Model)

- [LLaMA](https://ai.facebook.com/blog/large-language-model-llama-meta-ai/): open and efficient foundation language models by Meta
- [Pythia](https://github.com/EleutherAI/pythia): a collection of models developed to facilitate interpretability research by EleutherAI
- [StableLM](https://github.com/Stability-AI/StableLM): series of large language models by Stability AI
- [Vicuna](https://vicuna.lmsys.org/): a chat assistant fine-tuned from LLaMA on user-shared conversations by LMSYS
- [MOSS](https://txsun1997.github.io/blogs/moss.html): conversational language model from Fudan University

- LMM (Large Multi-modal Model)

- [OpenFlamingo](https://github.com/mlfoundations/open_flamingo): an open source version of DeepMind's [Flamingo](https://www.deepmind.com/blog/tackling-multiple-tasks-with-a-single-visual-language-model) model
- [MiniGPT-4](https://minigpt-4.github.io/): aligns a frozen visual encoder with a frozen LLM, Vicuna, using just one projection layer.

For more details about the supported models, please see the [Model Zoo](./MODEL_ZOO.md).

</details>


## Roadmap

You can view our roadmap with features that are planned, started, and completed on the [Roadmap discussion](https://github.com/jina-ai/rungpt/discussions/categories/roadmap) category.

## Get Started

Expand All @@ -78,7 +50,7 @@ You can view our roadmap with features that are planned, started, and completed
Install the package with `pip`:

```bash
pip install run_gpt_torch
pip install rungpt
```

### Quickstart
Expand Down Expand Up @@ -269,8 +241,8 @@ dictionaries which contain role and content. For example:
import requests

messages = [
{"role": "user", "content": "Hello!"},
]
{"role": "user", "content": "Hello!"},
]

response = requests.post(
"http://localhost:51000/chat",
Expand Down Expand Up @@ -626,4 +598,4 @@ We welcome contributions from the community! To contribute, please submit a pull

## License

Rungpt is licensed under the Apache License, Version 2.0. See LICENSE for the full license text.
RunGPT is licensed under the Apache License, Version 2.0. See LICENSE for the full license text.
4 changes: 1 addition & 3 deletions setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -7,7 +7,7 @@
raise OSError(f'RunGPT requires Python >=3.8, but yours is {sys.version}')

try:
pkg_name = 'run-gpt-torch'
pkg_name = 'rungpt'
libinfo_py = path.join(path.dirname(__file__), 'run_gpt', '__init__.py')
libinfo_content = open(libinfo_py, 'r', encoding='utf8').readlines()
version_line = [l.strip() for l in libinfo_content if l.startswith('__version__')][
Expand Down Expand Up @@ -84,7 +84,6 @@
"Topic :: Software Development :: Libraries :: Python Modules",
],
project_urls={
'Documentation': 'https://rungpt.jina.ai',
'Source': 'https://github.com/jina-ai/rungpt/',
'Tracker': 'https://github.com/jina-ai/rungpt/issues',
},
Expand All @@ -94,7 +93,6 @@
"large-language-model",
"GPT",
"LLM",
"multi-modality",
"cloud-native",
"model-serving",
"model-inference",
Expand Down

0 comments on commit 269dd02

Please sign in to comment.