Support http string streaming requests #474
Labels
2-medium
Important issues we must fix, but not as important as high!
enhancement
New feature or request
typescript
Includes significant typescript work (more than just a new component or field)
It's possible to receive http responses as a string stream, which has some interesting applications. The most useful one is with AI NPCs, as we would not need to wait for the entire response to be ready, we can instead display the text as it is being generated, character by character.
This is also a lot simpler to implement than using an intermediary websockets server, as we did in the past.
This approach takes over an http channel while waiting for more responses, so it's not something to use abundantly, but since a scene can have up to 5 open http requests at a time, it's reasonable to dedicate one to an AI communication.
Will (ex Content Team) shared some insights that might be helpful to tackle this:
The text was updated successfully, but these errors were encountered: