Skip to content
#

internvideo

Star

Here is 1 public repository matching this topic...

NetEase-Media / grps_trtllm

Star 117

Higher performance OpenAI LLM service than vLLM serve: A pure C++ high-performance OpenAI LLM service implemented with GPRS+TensorRT-LLM+Tokenizers.cpp, supporting chat and function call, AI agents, distributed multi-GPU inference, multimodal capabilities, and a Gradio chat interface.

openai multi-modal phi function-call qwq ai-agent llm llama-index chatglm internvideo tensorrt-llm qwen2 llama3 internvl2 qwen2-vl deepseek-r1 janus-pro olmocr
  • Updated Mar 10, 2025
  • C++

Improve this page

Add a description, image, and links to the internvideo topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the internvideo topic, visit your repo's landing page and select "manage topics."

Learn more