New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

FEATURE: track duration of AI calls #1082

Merged

SamSaffron merged 2 commits into main from predict_output

Jan 23, 2025

Member

SamSaffron commented Jan 22, 2025 •

edited

Loading

Tracks duration_msec (milliseconds) for all AI LLM completions.

This assists in debugging performance issues with LLMs


          FEATURE: track duration of AI calls

aa61568

romanrizzi approved these changes

View reviewed changes


          annotate

4be621b

SamSaffron merged commit 8bf3502 into main

6 checks passed

SamSaffron deleted the predict_output branch

January 23, 2025 00:32

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet