Commit graph

11139 commits

Author SHA1 Message Date
Lucca Zenóbio
78303b79ee
Merge branch 'main' into main 2024-05-02 09:46:34 -03:00
ffreemt
64d229caaa Add return_exceptions to litellm.batch_completion for optionally returing exceptions and partial resuslt instead of throwing exceptions 2024-05-02 19:30:01 +08:00
Krrish Dholakia
caf19478af fix(utils.py): fix pydantic object default values 2024-05-01 22:51:46 -07:00
Christian Privitelli
2d43153efa include methods in init import, add test, fix encode/decode param ordering 2024-05-02 15:49:22 +10:00
Krrish Dholakia
29aefaa7d7 fix(utils.py): fix default values 2024-05-01 22:24:37 -07:00
Krrish Dholakia
f7d7d34261 bump: version 1.35.35 → 1.35.36 2024-05-01 21:59:33 -07:00
Krrish Dholakia
0251543e7a refactor(main.py): trigger new build 2024-05-01 21:59:33 -07:00
Christian Privitelli
3449a5e446 update docs, allow use with encode/decode 2024-05-02 14:56:38 +10:00
Ishaan Jaff
761aa7e5c8 ui - new build 2024-05-01 21:43:00 -07:00
Krish Dholakia
24fc934622
Merge pull request #3379 from elisalimli/main
[chore] Improve type-safety in Message & Delta classes
2024-05-01 21:19:52 -07:00
Krish Dholakia
be8d01974b
Merge pull request #3389 from BerriAI/litellm_openmeter_integration
feat(openmeter.py): add support for user billing
2024-05-01 21:19:35 -07:00
Krish Dholakia
fffbb73465
Merge branch 'main' into litellm_openmeter_integration 2024-05-01 21:19:29 -07:00
Krrish Dholakia
cdd3e1eef3 build(ui): enable adding openmeter via proxy ui 2024-05-01 21:16:23 -07:00
Ishaan Jaff
3d9287602e ci/cd run again 2024-05-01 21:13:14 -07:00
Christian Privitelli
b4d4b42cfa fix docs 2024-05-02 14:11:03 +10:00
Christian Privitelli
2fd2e811fd add llama3 tokenizer and support for custom tokenizer 2024-05-02 14:05:38 +10:00
Ishaan Jaff
17a5a09028 ci/cd bump langfuse testing version 2024-05-01 21:04:31 -07:00
Ishaan Jaff
f3dfe5f2ab
Merge pull request #3262 from Manouchehri/update-langfuse-py-1
Update langfuse in `requirements.txt`
2024-05-01 21:03:23 -07:00
Ishaan Jaff
8a3d8f8ee4 fix bug where langfuse was reinitialized 2024-05-01 20:47:25 -07:00
Ishaan Jaff
9ac5d30cb7 fix - langfuse.py 2024-05-01 20:32:52 -07:00
Ishaan Jaff
1588453532
Merge pull request #2516 from marcklingen/patch-1
Add langfuse `sdk_integration`
2024-05-01 20:01:47 -07:00
Ishaan Jaff
b693060f09 bump: version 1.35.34 → 1.35.35 2024-05-01 19:58:59 -07:00
Ishaan Jaff
00969aa682 ui - new build 2024-05-01 19:52:57 -07:00
Ishaan Jaff
5870d2663d
Merge pull request #3391 from BerriAI/litellm_fix_langfuse_errant_prints
[Fix + Test] Errant prints on langfuse
2024-05-01 19:16:49 -07:00
Ishaan Jaff
533117f4d9 fix pre commit hook should test integrations 2024-05-01 19:14:08 -07:00
Krrish Dholakia
dbf999f56e refactor(langfuse.py): remove print statements 2024-05-01 19:11:59 -07:00
Ishaan Jaff
4e3ca5a26e fix - errant prints on langfuse 2024-05-01 19:07:56 -07:00
Krrish Dholakia
61d680143f docs(openmeter.md): add openmeter to docs 2024-05-01 18:31:45 -07:00
Ishaan Jaff
b3f5ff4d11
Merge pull request #3390 from BerriAI/litellm_show_slow_responses
[UI] show slow responses + num requests per deployment
2024-05-01 17:32:26 -07:00
Ishaan Jaff
789ef4566c ui - show slow responses 2024-05-01 17:29:52 -07:00
Ishaan Jaff
44f74c65e3 fix update slow responses based on selected model group 2024-05-01 17:25:42 -07:00
Krrish Dholakia
2a9651b3ca feat(openmeter.py): add support for user billing
open-meter supports user based billing. Closes https://github.com/BerriAI/litellm/issues/1268
2024-05-01 17:23:48 -07:00
Ishaan Jaff
5041b924ac ui - show slow responses on admin UI 2024-05-01 17:23:37 -07:00
Ishaan Jaff
26eda88b26 feat - show slow count and total count 2024-05-01 17:18:14 -07:00
Ishaan Jaff
f48f4a767c feat - return slow responses on admin UI 2024-05-01 17:16:33 -07:00
Ishaan Jaff
8c148506a0
Merge pull request #3388 from BerriAI/litellm_ui_latency_tracker
[UI] Fix show latency < 0.0001 for deployments that have low latency + only show non cache hits on latency UI
2024-05-01 16:58:03 -07:00
Ishaan Jaff
e9dd4bbe57 fix - dont show cache hits on model latency tracker 2024-05-01 16:51:15 -07:00
Ishaan Jaff
2b467a847a fix latency tracking tool tip 2024-05-01 16:47:30 -07:00
Ishaan Jaff
ccceff62df ui - fix latency tool tip 2024-05-01 16:47:12 -07:00
Krrish Dholakia
37eb7910d2 fix(utils.py): fix azure streaming content filter error chunk 2024-05-01 13:45:50 -07:00
Ishaan Jaff
56a75ee7fe (ci/cd) fix tests 2024-05-01 13:42:54 -07:00
Ishaan Jaff
adf3e90f45 ui - new build 2024-05-01 13:32:32 -07:00
Ishaan Jaff
b3161bb20b
Merge pull request #3384 from BerriAI/litellm_fix_details_to
fix - error sending details to log on sentry
2024-05-01 11:44:54 -07:00
Ishaan Jaff
8e75d07bd0 fix - error seeing details to log on sentry 2024-05-01 11:43:14 -07:00
Krish Dholakia
6cfd00e609
Merge pull request #3382 from paul-gauthier/main
Added cost & context metadata for openrouter/anthropic/claude-3-opus
2024-05-01 11:15:29 -07:00
Krrish Dholakia
608fef60a6 fix(utils.py): check if response_object["choices"] is not none and iterable 2024-05-01 11:08:44 -07:00
Krrish Dholakia
e96ccb8edf fix(utils.py): return received args for invalid model response object error
Addresses https://github.com/BerriAI/litellm/issues/3381
2024-05-01 10:47:26 -07:00
Paul Gauthier
500ac36bd9 Added cost & context metadata for openrouter/anthropic/claude-3-opus 2024-05-01 10:43:40 -07:00
Krish Dholakia
a24f32fb5a
Merge pull request #1526 from TheDiscoMole/litellm_ollama_tool_call_reponse
changing ollama response parsing to expected behaviour
2024-05-01 10:24:11 -07:00
Krish Dholakia
0714eb3526
Merge branch 'main' into litellm_ollama_tool_call_reponse 2024-05-01 10:24:05 -07:00