1.4.5

What's Changed

• OPIK-859: Reduce find spans query cost by @thiagohora in #1123
• [OPIK-860] Add text to Open trace button on experiment sidebars by @andriidudar in #1125
• [OPIK-700] [FE] Rule modal validation by @andriidudar in #1120
• [NA] Add truncate method to the search_spans and search_traces by @alexkuzmik in #1124
• Amorgan/small typo fixes by @anmorgan24 in #1118

Full Changelog: 1.4.4...1.4.5

1.4.4

What's Changed

• [OPIK-759] implement side dialog component and log a trace dialog by @awkoy in #1111
• [OPIK-680] [FR]: Cost Tracking for VertexAI and LangChain by @japdubengsub in #1055
• [NA] Relax litellm version and make litellm monitoring optional by @alexkuzmik in #1122

Full Changelog: 1.4.3...1.4.4

1.4.3

What's Changed

• OPIK-795: Create rule logs table by @thiagohora in #1060
• OPIK-665: Add Python code executor PoC Docker sandbox by @andrescrz in #1058
• Update Ragas notebook by @jverre in #1074
• Bump org.redisson:redisson from 3.42.0 to 3.43.0 in /apps/opik-backend by @dependabot in #1076
• Bump software.amazon.awssdk:bom from 2.29.9 to 2.30.2 in /apps/opik-backend by @dependabot in #1077
• [OPIK-744] fix providers' models list by @idoberko2 in #1041
• Add guidelines for local run by @liyaka in #983
• Add smaller code snippets for the quickstart page by @Lothiraldan in #1064
• [OPIK-656]: log experiments in the playground; by @aadereiko in #1072
• [OPIK-656]: improvements of experiment playground log pr's code; by @aadereiko in #1078
• [OPIK-656]: fix the bug when there is no dataset and avoid logging an experiment; by @aadereiko in #1080
• OPIK-663: Add Python Backend image builder by @andrescrz in #1082
• NA: Upgrade OpenTelemetry agent by @thiagohora in #1084
• OPIK-796: Implement ClickHouse user facing logs by @thiagohora in #1066
• Update pytest_integration.md by @SrBliss in #1087
• [OPIK-763] Updating Online Scoring into a distributed service using redis. by @ldaugusto in #1083
• NO-OPIK fix locator for next page buttons by @AndreiCautisanu in #1085
• OPIK-663: Add Sandbox Executor Python app by @andrescrz in #1090
• [DEV-2536] add python-backend service to helm chart by @liyaka in #1089
• Update template.py by @jverre in #1096
• [OPIK-839] [FE] Remove not leaves nodes(subtrees) from the autocomplete component in the rules popup by @andriidudar in #1099
• [OPIK-711]: playground Anthropic integration by @aadereiko in #1098
• [OPIK-706] remove close get-started section button by @awkoy in #1100
• [Opik-703] Add guardrails integration docs by @alexkuzmik in #1086
• Liya/dev 2536 fix python be service configuration by @liyaka in #1101
• Update evaluate_prompt.md by @anmorgan24 in #1104
• OPIK-663: Pull instead of building Sandbox Python Executor image by @andrescrz in #1102
• [OPIK-757] New endpoints for Comments by @BorisTkachenko in #1081
• [NA] fix gemini streaming by @idoberko2 in #1106
• OPIK-663: Add Python Backend to Docker compose by @andrescrz in #1110
• [OPIK-785] custom scroll hover for PC by @awkoy in #1113
• Improve demo project script (flush + batching) by @ferc in #1112
• OPIK-796: Add new automation rule evaluator logs endpoint by @thiagohora in #1115
• [OPIK-838] Add proper support for litellm completion kwargs by @alexkuzmik in #1114
• [OPIK-798] [FE] Add a button which opens a new tab to show all retrieved logs for a particular online scoring rule by @andriidudar in #1116
• [OPIK-750] sdk add the possibility to manually sets the cost of individual spans by @alexkuzmik in #1107
• Add minimal litellm version to setup.py by @alexkuzmik in #1119

New Contributors

• @SrBliss made their first contribution in #1087

Full Changelog: 1.4.2...1.4.3

1.4.2

What's new

• Update base version to 1.4.2 0c59576 @CometActions
• [OPIK-753] [FE] Autocomplete component for variable key select (#1067) 5268758 @andriidudar
• Implemented BLEU score, wrote unit tests and documentation for it. (#1006) e835dfd @kadamrahul18
• [OPIK-770] Fix haystack integration (#1070) 79501b1 @alexkuzmik
• Disable printing messages content (#1071) abffddd @alexkuzmik

New contributors

Special thanks to @kadamrahul18, our new external contributor, for implementing SentenceBLEU and CorpusBLEU metrics for our metrics library!

1.4.1

• Increment patch version (#1059) 720a0c3 @ferc
• [OPIK-781] Fix project not found illegal state (#1053) 395f686 @BorisTkachenko
• Jacques/fix code snippets (#1061) 6f0fed4 @jverre
• OPIK-802: add an option to use external clickhouse (#1065) 07cf99a @liyaka
• Contribution guide (#1062) 17b6cb6 @alexkuzmik
• [OPIK-706] simplify home page (#1063) fd48d17 @awkoy
• Temporary disable litellm import warnings (#1068) 40dc733 @alexkuzmik
• [OPIK-809] sdk sentry track decorator extract inputs may fail (#1069) 133b8a6 @alexkuzmik

1.4.0

• [OPIK-799] Can't add trace to dataset (#1056) 13d4327 @andriidudar
• Increment minor version (#1057) 42a6b30 @ferc

1.3.6

What's Changed

• [OPIK-611] support gemini models in playground by @idoberko2 in #987
• Updated changelog by @jverre in #1036
• [OPIK-702] [Docs] Crew AI integration docs by @japdubengsub in #1037
• [OPIK-743] Fix properties naming strategy by @thiagohora in #1035
• [OPIK-595]: Add Redis Caching part 1 by @thiagohora in #1015
• Update g_eval.md by @jverre in #1039
• Jacques/evaluate prompt by @jverre in #1023
• [OPIK-594] Triggering LLM calls to score after Traces are received by @ldaugusto in #1038
• [OPIK-698] [FE] Rules tab in project by @andriidudar in #1046
• OPIK-775 [FE] Add ability to edit dataset description from UI by @andriidudar in #1049
• Update docs by @jverre in #1048
• [OPIK-595] Automation rule evaluator cache by @thiagohora in #1042
• [OPIK-695] sdk sentry integration by @alexkuzmik in #1045
• [OPIK-718] quickstart page integrations update by @awkoy in #1034
• [OPIK-698] [FE] Rules tab in project by @andriidudar in #1051
• [OPIK-721] Return more detailed error message for Json deserialization errors by @BorisTkachenko in #1040
• [NA] Add misconfiguration check to Opik.init by @alexkuzmik in #1052
• [OPIK-751] Use Mustache for online scoring by @thiagohora in #1043

Full Changelog: 1.3.5...1.3.6

1.3.5

What's Changed

• Dspy integration docs by @jverre in #1005
• [OPIK-593] OnlineScoring sampling and preparing traces for Automation Rules by @ldaugusto in #1002
• [OPIK-737] redirect to project page after successful creation by @awkoy in #1012
• OPIK-653: Add integration with CrewAI by @japdubengsub in #988
• OPIK-364 feedback definitions crud tests by @AndreiCautisanu in #1013
• [OPIK-655]: finish initial dataset UI by @aadereiko in #1016
• [OPIK-735] Online Scoring: null projectId error when creating a rule by @ldaugusto in #1011
• NO-OPIK automation fixes by @AndreiCautisanu in #1017
• [OPIK-622] Remove deprecated dataset item fields by @BorisTkachenko in #1003
• [OPIK-655]: dataset playground fixes by @aadereiko in #1019
• [OPIK-655]: add truncate; by @aadereiko in #1020
• [OPIK-148] Implement batching for feedback scores, update and add new tests by @alexkuzmik in #1008
• Updated changelog by @jverre in #1024
• Bump org.redisson:redisson from 3.41.0 to 3.42.0 in /apps/opik-backend by @dependabot in #1025
• Bump com.diffplug.spotless:spotless-maven-plugin from 2.43.0 to 2.44.1 in /apps/opik-backend by @dependabot in #1026
• NA: Upgrade dependencies by @thiagohora in #1018
• Update the demo project by @robertlacok in #980
• [OPIK-655]: fix the dataset number; by @aadereiko in #1027
• [OPIK-719] add get-started page, update quickstart page by @awkoy in #1021
• [OPIK-736] Fix deserialization issue by @thiagohora in #1022
• [OPIK-739]: hide unsupported by ai proxy models; by @aadereiko in #1028
• [OPIK-720] Manually set span cost by @BorisTkachenko in #1014
• [OPIK-740]: handle adding provider by @aadereiko in #1031
• [NA] Autogenerated code by @BorisTkachenko in #1030
• [OPIK-742]: open an error tooltip for a disabled run button; by @aadereiko in #1032

New Contributors

• @awkoy made their first contribution in #1012

Full Changelog: 1.3.4...1.3.5

1.3.4

What's Changed

• [OPIK-558] Adapt Fern for TypeScript SDK by @ferc in #972
• [OPIK-679] fix feedback scores tests by @idoberko2 in #970
• Fix llamaIndex docs by @jverre in #974
• Bump org.redisson:redisson from 3.40.1 to 3.41.0 in /apps/opik-backend by @dependabot in #965
• OPIK-645 Return all feedback score names for project ids endpoint by @BorisTkachenko in #947
• [OPIK-558] Typescript SDK - basic client by @ferc in #919
• OPIK-672 [SDK] Fix cyclic reference/recursion issue in json_encoder by @japdubengsub in #964
• [OPIK-647] Return 409 instead of throwing exception for workspaceId or project mismatch by @BorisTkachenko in #977
• [OPIK-590] Online Scoring Automation Rules endpoints by @ldaugusto in #945
• Update to Opik roadmap by @jverre in #981
• [Docs]: Update quickstart.mdx by @connectwithprakash in #986
• [OPIK-709] fix NPE in find projects by @idoberko2 in #984
• [NA] apply spotless by @idoberko2 in #985
• [NA] Fix test visibility by @thiagohora in #989
• [OPIK-580] StreamExperimentItems endpoint return full content for experiment items by @BorisTkachenko in #973
• [OPIK-610] multi models support and anthropic implementation by @idoberko2 in #957
• NO-JIRA: Remove docker-compose.yaml port binding by @andrescrz in #991
• Automated testing for codeblocks in docs by @jverre in #992
• Update github actions by @jverre in #993
• NO-JIRA: Add OpenAPI server script by @andrescrz in #995
• [NA] apply spotless by @idoberko2 in #994
• edit prompt button name by @AndreiCautisanu in #998
• NO-JIRA: Add Spotless backend formatting workflow by @andrescrz in #999
• [OPIK-717] Fix click into a span in the tree-viewer in Safari by @ferc in #1001
• Add py.typed to package data by @alexkuzmik in #997
• NO-JIRA: Update locking service logs by @andrescrz in #1004

New Contributors

• @ldaugusto made their first contribution in #945
• @connectwithprakash made their first contribution in #986

Full Changelog: 1.3.3...1.3.4

1.3.3

What's Changed

• Added support for llms.txt by @jverre in #968
• Fix traces/spans aggregations for feedback scores by @ferc in #969

Full Changelog: 1.3.2...1.3.3