Does TTS (Kokoro) support streaming?

[Madd0g]

It is a bit slow on my machine to wait for the entire response to generate.

Is streaming technically possible?

Thanks

[fedirz]

Is streaming technically possible?

Yes.

Is streaming currently supported?

It's not currently supported on the server, but you may break up your input text into multiple smaller inputs and make an API call for each input separately.

I'm doing this for the voice chat feature. The speech is generated from an LLM reply in sentence chunks (rather than generating the speech from the full reply). Take a look at the SentenceChunker class, and it's usage within the code.