Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Support for DeepSeek LLM Integration #1110

Open
danielmerja opened this issue Jan 22, 2025 · 9 comments
Open

Add Support for DeepSeek LLM Integration #1110

danielmerja opened this issue Jan 22, 2025 · 9 comments

Comments

@danielmerja
Copy link
Contributor

Description:

DeepSeek is an advanced open-source LLM that rivals some of the most sophisticated models globally, such as OpenAI's offerings. Its latest version, DeepSeek-V3, delivers exceptional inference speed and accuracy across multiple benchmarks, including English, Chinese, code, and math reasoning tasks. Integrating DeepSeek into LangChainGo would expand its capabilities and provide users with an additional high-performance, open-source LLM option.

Current Behavior

LangChainGo currently supports various LLMs but lacks integration with DeepSeek, which is rapidly gaining recognition for its performance and open-source nature.

Expected Behavior

Adding DeepSeek support would allow LangChainGo users to:

  1. Leverage DeepSeek's superior inference speed and performance.
  2. Access its broad capabilities across multiple domains, such as reasoning, math, and code.
  3. Use a free, open-source alternative to proprietary models.

Why This Enhancement Is Useful

  1. Performance Leader: DeepSeek ranks highly on key benchmarks like MMLU and HumanEval, outperforming other open-source models and competing with closed-source solutions.
  2. Open Source: Aligns with the ethos of LangChainGo by providing more open-source alternatives.
  3. Multi-Domain Strength: Its versatility in handling diverse tasks makes it a valuable addition to the LangChainGo ecosystem.

References

@lifejwang11
Copy link
Contributor

It use with OpenAI starndard. @danielmerja

@danielmerja
Copy link
Contributor Author

It use with OpenAI starndard. @danielmerja

Is the finish_reason also supported in the llms/openai?

@lifejwang11
Copy link
Contributor

oh,I agree

@danielmerja
Copy link
Contributor Author

danielmerja commented Jan 22, 2025

oh,I agree

it would be very cost effective if we add these, and we can use DeepSeek API with their new reasoning model

Reasoning Model (deepseek-reasoner)

Image

@lifejwang11
Copy link
Contributor

Its a good feature.Every model have their own feature.I think it will support in the future.

@vMaroon
Copy link

vMaroon commented Jan 30, 2025

Any progress on this?

@lifejwang11
Copy link
Contributor

@vMaroon no,I don't have any time for this.

@semioz
Copy link
Contributor

semioz commented Jan 31, 2025

@danielmerja turns out finish_reason was already supported in the existing codebase but not the ReasoningContent. I quickly opened a PR let me know if i missed anything: https://github.com/tmc/langchaingo/pull/1121/files

@danielmerja
Copy link
Contributor Author

@danielmerja turns out finish_reason was already supported in the existing codebase but not the ReasoningContent. I quickly opened a PR let me know if i missed anything: https://github.com/tmc/langchaingo/pull/1121/files

Sweet! Thank you! I have pinged @FluffyKebab to take a look at it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants