Unresponsive Chat

[rosiecakes5]

Description

Chat stops responding, and resolves once restarting the app

Reproduction

This occurred when I began a new chat.

Expected behavior

Chat would send greeting message

Additional context

No response

Code of Conduct

• I agree to follow this project's Code of Conduct and Contributing Guidelines

[philippzagar]

Thanks for raising the issue @rosiecakes5! 🚀

Just to clarify: Does the chat stay in this "loading" state forever or does it throw an error at some point, e.g. a network timeout?

[PSchmiedmayer]

@philippzagar @rosiecakes5 I suspect that this is due to a log of tool calls in the background. If it stays there forever we might have a state management issue.

In the long run, we should use this as a motivation to highlight some of the underlying state (such as tool calls and other things) to the user in a very simple manner like OpenAI does it using their shimmering effect.

[philippzagar]

@philippzagar @rosiecakes5 I didn't experience an infinite hang in my extended testing yesterday. @jdisho What about you?
@rosiecakes5 Can you share a bit more about the exact error case here, especially if it really is an infinite hang?

Totally agree with @PSchmiedmayer, we should expose more information regarding such long-running function calls to the user: StanfordSpezi/SpeziLLM#108

[jdisho]

There were so many nasty errors yesterday but I do remember some instances that this ended up loading indefinitely. After working on #80 I didn't notice any kind of bug in this form.

[PSchmiedmayer]

Thank you @jdisho!