Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ModelRunner] remove padding for vlm inputs #150

Merged
merged 1 commit into from
Feb 26, 2025

Conversation

MengqingCao
Copy link
Contributor

What this PR does / why we need it?

Remove padding for vlm inputs.
We don't need padding inputs now, this padding will break the input preparetion of VLMs.

Does this PR introduce any user-facing change?

N/A

Signed-off-by: MengqingCao <cmq0113@163.com>
@MengqingCao
Copy link
Contributor Author

cc @wangxiyuan

@wangxiyuan
Copy link
Collaborator

@ganyi1996ppo please double check. Thanks

@ganyi1996ppo
Copy link
Collaborator

LGTM

@wangxiyuan wangxiyuan merged commit 7776f2e into vllm-project:main Feb 26, 2025
10 checks passed
@wangxiyuan
Copy link
Collaborator

If this changed is needed for 0.7.3, feel free to cherry-pick

@MengqingCao
Copy link
Contributor Author

If this changed is needed for 0.7.3, feel free to cherry-pick

Yep, I'll do this soon, thx!

@MengqingCao MengqingCao deleted the fix branch February 26, 2025 02:30
wangxiyuan pushed a commit that referenced this pull request Feb 26, 2025
see #150

Signed-off-by: MengqingCao <cmq0113@163.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants