Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Beam search support #755

Open
mrcchef opened this issue Feb 3, 2025 · 1 comment
Open

Beam search support #755

mrcchef opened this issue Feb 3, 2025 · 1 comment

Comments

@mrcchef
Copy link

mrcchef commented Feb 3, 2025

Feature request

Lorax should support various decoding strategies like Beam search.

Motivation

It would be invaluable when the user wants to generate multiple responses and at the same time ensure that they are diverse to each other and the best possible generation as well based on the model's training

Your contribution

.

@mrcchef mrcchef changed the title Bean search support Beam search support Feb 6, 2025
@MrStrange124
Copy link

Yeahh!
I think beam Search support would be a great addition to Lorax. During, inference it would help generate more diverse and high-quality responses.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants