Files

 main

/

examples

/

Copy path

Directory actions

More options

Directory actions

More options

Latest commit

Isotr0py

[Model][VLM] Support multi-images inputs for InternVL2 models (vllm-p…

Sep 7, 2024

e807125 · Sep 7, 2024

History

History

This branch is 2916 commits behind vllm-project/vllm:main.

/

examples

/

Top

Folders and files

Name		Name	Last commit message	Last commit date
parent directory ..
fp8		fp8	[Misc] Remove SqueezeLLM (vllm-project#8220)	Sep 6, 2024
production_monitoring		production_monitoring	[CI/Build] Pin OpenTelemetry versions and make errors clearer (vllm-p…	Aug 20, 2024
api_client.py		api_client.py	[bugfix] make args.stream work (vllm-project#6831)	Jul 27, 2024
aqlm_example.py		aqlm_example.py	[Frontend] Add FlexibleArgumentParser to support both underscore and …	Jun 20, 2024
cpu_offload.py		cpu_offload.py	[core][model] yet another cpu offload implementation (vllm-project#6496)	Jul 18, 2024
gguf_inference.py		gguf_inference.py	[Core] Support loading GGUF model (vllm-project#5191)	Aug 5, 2024
gradio_openai_chatbot_webserver.py		gradio_openai_chatbot_webserver.py	[CI] Try introducing isort. (vllm-project#3495)	Mar 25, 2024
gradio_webserver.py		gradio_webserver.py	Remove deprecated parameter: concurrency_count (vllm-project#2315)	Jan 3, 2024
llm_engine_example.py		llm_engine_example.py	[Frontend] Add FlexibleArgumentParser to support both underscore and …	Jun 20, 2024
logging_configuration.md		logging_configuration.md	[Doc][CI/Build] Update docs and tests to use vllm serve (vllm-proje…	Jul 17, 2024
lora_with_quantization_inference.py		lora_with_quantization_inference.py	[Feature][Kernel] Support bitsandbytes quantization and QLoRA (vllm-p…	Jun 1, 2024
multilora_inference.py		multilora_inference.py	[CI] Try introducing isort. (vllm-project#3495)	Mar 25, 2024
offline_inference.py		offline_inference.py	[Quality] Add code formatter and linter (vllm-project#326)	Jul 3, 2023
offline_inference_arctic.py		offline_inference_arctic.py	[Model] Snowflake arctic model implementation (vllm-project#4652)	May 9, 2024
offline_inference_audio_language.py		offline_inference_audio_language.py	[Model] Add Ultravox support for multiple audio chunks (vllm-project#…	Sep 4, 2024
offline_inference_chat.py		offline_inference_chat.py	Chat method for offline llm (vllm-project#5049)	Aug 16, 2024
offline_inference_distributed.py		offline_inference_distributed.py	[mypy] Enable type checking for test directory (vllm-project#5017)	Jun 15, 2024
offline_inference_embedding.py		offline_inference_embedding.py	[Model][Misc] Add e5-mistral-7b-instruct and Embedding API (vllm-proj…	May 11, 2024
offline_inference_encoder_decoder.py		offline_inference_encoder_decoder.py	[Core] Support serving encoder/decoder models (vllm-project#7258)	Aug 9, 2024
offline_inference_mlpspeculator.py		offline_inference_mlpspeculator.py	[BugFix] Fix cuda graph for MLPSpeculator (vllm-project#5875)	Jun 27, 2024
offline_inference_neuron.py		offline_inference_neuron.py	[Neuron] Adding support for context-lenght, token-gen buckets. (vllm-…	Aug 29, 2024
offline_inference_neuron_int8_quantization.py		offline_inference_neuron_int8_quantization.py	[Neuron] Adding support for adding/ overriding neuron configuration a… (	Sep 4, 2024
offline_inference_openai.md		offline_inference_openai.md	[Frontend] Support embeddings in the run_batch API (vllm-project#7132)	Aug 9, 2024
offline_inference_tpu.py		offline_inference_tpu.py	[CI/Build][TPU] Add TPU CI test (vllm-project#6277)	Jul 15, 2024
offline_inference_vision_language.py		offline_inference_vision_language.py	[MODEL] Qwen Multimodal Support (Qwen-VL / Qwen-VL-Chat) (vllm-projec…	Sep 5, 2024
offline_inference_vision_language_multi_image.py		offline_inference_vision_language_multi_image.py	[Model][VLM] Support multi-images inputs for InternVL2 models (vllm-p…	Sep 7, 2024
offline_inference_with_prefix.py		offline_inference_with_prefix.py	[Bugfix] Add warmup for prefix caching example (vllm-project#5235)	Jun 4, 2024
offline_inference_with_profiler.py		offline_inference_with_profiler.py	[misc] [doc] [frontend] LLM torch profiler support (vllm-project#7943)	Sep 7, 2024
openai_audio_api_client.py		openai_audio_api_client.py	[Model] Add UltravoxModel and UltravoxConfig (vllm-project#7615)	Aug 21, 2024
openai_chat_completion_client.py		openai_chat_completion_client.py	Add example scripts to documentation (vllm-project#4225)	Apr 22, 2024
openai_chat_completion_client_with_tools.py		openai_chat_completion_client_with_tools.py	[Feature] OpenAI-Compatible Tools API + Streaming for Hermes & Mistra…	Sep 4, 2024
openai_completion_client.py		openai_completion_client.py	lint: format all python file instead of just source code (vllm-projec…	Jan 23, 2024
openai_embedding_client.py		openai_embedding_client.py	[Bugfix]: Use float32 for base64 embedding (vllm-project#7855)	Aug 26, 2024
openai_example_batch.jsonl		openai_example_batch.jsonl	[docs] Fix typo in examples filename openi -> openai (vllm-project#4864)	May 16, 2024
openai_vision_api_client.py		openai_vision_api_client.py	[Doc] Indicate more information about supported modalities (vllm-proj…	Sep 5, 2024
run_cluster.sh		run_cluster.sh	[doc][distributed] doc for setting up multi-node environment (vllm-pr…	Jul 23, 2024
save_sharded_state.py		save_sharded_state.py	[Frontend] Add FlexibleArgumentParser to support both underscore and …	Jun 20, 2024
template_alpaca.jinja		template_alpaca.jinja	Support chat template and echo for chat API (vllm-project#1756)	Dec 1, 2023
template_baichuan.jinja		template_baichuan.jinja	Fix Baichuan chat template (vllm-project#3340)	Mar 16, 2024
template_blip2.jinja		template_blip2.jinja	[Model] Initial support for BLIP-2 (vllm-project#5920)	Jul 27, 2024
template_chatglm.jinja		template_chatglm.jinja	Add chat templates for ChatGLM (vllm-project#3418)	Mar 15, 2024
template_chatglm2.jinja		template_chatglm2.jinja	Add chat templates for ChatGLM (vllm-project#3418)	Mar 15, 2024
template_chatml.jinja		template_chatml.jinja	Support chat template and echo for chat API (vllm-project#1756)	Dec 1, 2023
template_falcon.jinja		template_falcon.jinja	Add chat templates for Falcon (vllm-project#3420)	Mar 15, 2024
template_falcon_180b.jinja		template_falcon_180b.jinja	Add chat templates for Falcon (vllm-project#3420)	Mar 15, 2024
template_inkbot.jinja		template_inkbot.jinja	Support chat template and echo for chat API (vllm-project#1756)	Dec 1, 2023
template_llava.jinja		template_llava.jinja	[Frontend] Add OpenAI Vision API Support (vllm-project#5237)	Jun 7, 2024
tensorize_vllm_model.py		tensorize_vllm_model.py	[Frontend] Add FlexibleArgumentParser to support both underscore and …	Jun 20, 2024
tool_chat_template_hermes.jinja		tool_chat_template_hermes.jinja	[Bugfix] Fix Hermes tool call chat template bug (vllm-project#8256)	Sep 7, 2024
tool_chat_template_mistral.jinja		tool_chat_template_mistral.jinja	[Feature] OpenAI-Compatible Tools API + Streaming for Hermes & Mistra…	Sep 4, 2024
tool_chat_template_mistral_parallel.jinja		tool_chat_template_mistral_parallel.jinja	[Feature] OpenAI-Compatible Tools API + Streaming for Hermes & Mistra…	Sep 4, 2024
View all files