Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP deep-inquire client #379

Draft
wants to merge 1 commit into
base: dev
Choose a base branch
from
Draft

WIP deep-inquire client #379

wants to merge 1 commit into from

Conversation

joulei
Copy link
Collaborator

@joulei joulei commented Mar 12, 2025

Running the deep-inquire agent

Install Dora Runtime

cargo install dora-cli

Verify installation

rustc --version
cargo --version
dora --version

Clone repository

git clone https://github.com/moxin-org/mofa.git

Enter docker directory

cd /mofa/python/docker

Build image

docker build -t mofa -f Dockerfile_x86 .

Run container

docker run -it --rm -p 8000:8000 mofa

Inside the container, navigate to deep-inquire

cd mofa/python/examples/deep-inquire

Create a .env.secret file with the following

LLM_API_KEY=
LLM_BASE_URL= # some AI provider endpoint, eg: https://api.openai.com/v1
LLM_MODEL_NAME= # any chat model
SERPER_API_KEY= # apply for a key at https://serper.dev/

Spin up the mofa dataflow

dora destroy
dora up
dora build deep-inquire-dataflow.yml
dora start deep-inquire-dataflow.yml --attach

The server should now be ready:

curl -X POST "http://localhost:8000/v3/chat/completions" \
  -H "Content-Type: application/json" \
  -H "Authorization: Bearer sk-jsha-1234567890" \
  -d '{
    "model": "gpt-4o-mini",
    "messages": [
      {"role": "system", "content": "You are a helpful assistant."},
      {"role": "user", "content": "test"}
    ],
    "stream": true
  }' \
  --no-buffer

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant