-
Notifications
You must be signed in to change notification settings - Fork 0
Example Usage
Lyrcaxis edited this page Oct 21, 2024
·
4 revisions
(see BatchingTest for in-project usage)
curl -X POST http://127.0.0.1:5059/chat/completion -H "Content-Type: application/json" -d '{"messages":[{"content":"Hello AI","role":"user"}], "stream":false}'
curl -X POST http://127.0.0.1:5059/batch -H "Content-Type: application/json" -d '{"chatQueries": [{"messages":[{"content":"Hello AI","role":"user"}]}, {"messages":[{"content":"Hello AI","role":"user"}]}], "stream":false}'