diff --git a/docs/Quickstart.md b/docs/Quickstart.md index 5f345f47..614eb139 100644 --- a/docs/Quickstart.md +++ b/docs/Quickstart.md @@ -2,7 +2,7 @@ ## Requirements -Llumnix requires python `3.8.1~3.10.0` and is currently built on top of vLLM (version 0.4.2). Therefore, the installation requirements are almost identical to those of vLLM. You can view the specific installation requirements for vLLM at the following link: +Llumnix requires python `3.9~3.10` and is currently built on top of vLLM (version 0.6.3.post1). Therefore, the installation requirements are almost identical to those of vLLM. You can view the specific installation requirements for vLLM at the following link: [vLLM Installation](https://docs.vllm.ai/en/v0.6.3.post1/getting_started/installation.html) diff --git a/docs/Supported_Models.md b/docs/Supported_Models.md index f0d50ad3..f1ce4a97 100644 --- a/docs/Supported_Models.md +++ b/docs/Supported_Models.md @@ -2,7 +2,7 @@ Llumnix serves as the request scheduling layer on top of the LLM backend engines. Therefore, all the models supported by the backend LLM engine should ideally be supported by Llumnix. We are also conducting full compatibility tests on different models. -Currently, Llumnix is developed on top of the vLLM (version 0.4.2), making its supported models identical to those of vLLM. Up to now, our primary testing of Llumnix has been conducted on Qwen and Llama models, including: +Currently, Llumnix is developed on top of the vLLM (version 0.6.3.post1), making its supported models identical to those of vLLM. Up to now, our primary testing of Llumnix has been conducted on Qwen and Llama models, including: - Llama - Llama2 diff --git a/setup.py b/setup.py index 1444d513..bcf3b486 100644 --- a/setup.py +++ b/setup.py @@ -34,7 +34,7 @@ def readme(): setup( name='llumnix', version='0.0.2', - python_requires='>=3.8.1, <3.11', + python_requires='>=3.9.0, <3.11', description='Efficient and easy multi-instance LLM serving', long_description=readme(), long_description_content_type="text/markdown", @@ -49,7 +49,6 @@ def readme(): platforms=["all"], classifiers=[ 'Programming Language :: Python', - 'Programming Language :: Python :: 3.8', 'Programming Language :: Python :: 3.9', 'Programming Language :: Python :: 3.10', "License :: OSI Approved :: Apache Software License",