Commit graph

12928 commits

Author SHA1 Message Date
Krrish Dholakia
707a41fd6c docs(scheduler.md): add scheduler redis caching support to docs 2024-06-06 14:39:36 -07:00
Krrish Dholakia
b590e6607c feat(scheduler.py): support redis caching for req. prioritization
enables req. prioritization to work across multiple instances of litellm
2024-06-06 14:19:21 -07:00
Krrish Dholakia
7ddca8d834 fix(proxy_server.py): fix backoff attempt logging
make sure backoff uses our logging handler to log info to
2024-06-06 14:08:31 -07:00
Krrish Dholakia
6cca5612d2 refactor: replace 'traceback.print_exc()' with logging library
allows error logs to be in json format for otel logging
2024-06-06 13:47:43 -07:00
Ishaan Jaff
4427b4812b feat - custom OTEL service names 2024-06-06 12:45:14 -07:00
Ishaan Jaff
422b4b1728
Merge pull request #4039 from themrzmaster/main
fix tool usage null content using vertexai
2024-06-06 12:41:25 -07:00
Ishaan Jaff
64a9fe1827 docs - redacting messages from slack alerting 2024-06-06 12:30:56 -07:00
Ishaan Jaff
35684fdf4b fix - turn of message logging 2024-06-06 10:48:08 -07:00
Ishaan Jaff
1e8429bb20 feat - redact messages from slack alerting 2024-06-06 10:38:15 -07:00
Raymond1415926
38b44c301a
Merge branch 'BerriAI:main' into main 2024-06-06 10:12:20 -07:00
Raymond Huang
968f54a65c test 2024-06-06 10:11:27 -07:00
Ishaan Jaff
059c59f206 fix add_metadata_from_header 2024-06-06 09:53:12 -07:00
Krrish Dholakia
a7dcf25722 feat(router.py): enable settting 'order' for a deployment in model list
Allows user to control which model gets called first in model group
2024-06-06 09:46:51 -07:00
Ishaan Jaff
1b77171db3 docs - enforce params on LLM requests 2024-06-06 09:45:54 -07:00
Ishaan Jaff
a941b6d967 docs enforcing params 2024-06-06 09:37:29 -07:00
Ishaan Jaff
73d66e94c5 test - enforce params 2024-06-06 09:22:12 -07:00
Ishaan Jaff
aaf35c7966 feat - enforce enforced_params as a premium feature 2024-06-06 09:03:31 -07:00
Ishaan Jaff
d827557b82 feat - add enforced params 2024-06-06 08:55:40 -07:00
Ishaan Jaff
883ee08225 feat - enforce params in requests 2024-06-06 08:54:59 -07:00
Ishaan Jaff
7b2c163c53
Merge pull request #4035 from syGOAT/modify_docs_logging_langfuse
modified docs proxy->logging->langfuse
2024-06-06 08:53:38 -07:00
syGOAT
0dd562c1cc make LANGFUSE_HOST optional and specify the default value 2024-06-06 23:47:40 +08:00
Krish Dholakia
67be2e3ebf
Merge pull request #4020 from sha-ahammed/main
Add Ollama as a provider in proxy ui
2024-06-06 08:45:02 -07:00
sha-ahammed
575d94f5ef fix: poetry lock --no-update 2024-06-06 21:09:13 +05:30
sha-ahammed
76aab91d63 Revert "fix: Authentication Error, No module named 'nacl'."
This reverts commit 499933f943.
2024-06-06 20:56:16 +05:30
Sha Ahammed Roze
53ccc45978
Merge branch 'BerriAI:main' into main 2024-06-06 20:50:22 +05:30
Krrish Dholakia
58bd2b4ea6 fix(vertex_ai.py): support video + pdf for vertex ai 2024-06-06 08:06:20 -07:00
Krrish Dholakia
e01c0d9a44 build(pyproject.toml): add pynacl to extra_proxy deps
Closes https://github.com/BerriAI/litellm/issues/4018
2024-06-06 08:06:20 -07:00
Ishaan Jaff
9f230c2822
Merge pull request #3990 from ndrsfel/litellm_langfuse_metadata_from_header
feat: add langfuse metadata via proxy request headers
2024-06-06 07:52:40 -07:00
lucca
5e25979596
improve 2024-06-06 11:15:56 -03:00
lucca
1122a40374
fix function calling 2024-06-06 11:09:35 -03:00
Krish Dholakia
1523e26c8f
Merge pull request #4037 from paneru-rajan/SS-fix-typo-and-table-format
Table format fix and Typo
2024-06-06 06:32:47 -07:00
Rajan Paneru
2e25416c02 Table format fix and Typo
* Fixed marked down table formats because they were looking ugly in pycharm
* Typos Fixes.
2024-06-06 22:29:59 +09:30
Sha Ahammed Roze
a7087a44ce
Merge branch 'BerriAI:main' into main 2024-06-06 17:45:55 +05:30
Raymond Huang
f4c49755a0 fix token counter bug 2024-06-05 23:40:55 -07:00
afel
a24dbdf78c fix typo 2024-06-06 08:04:11 +02:00
afel
756fd69e1c update langfuse docs 2024-06-06 08:01:59 +02:00
afel
aad0ea80f6 address review comments 2024-06-06 08:01:42 +02:00
syGOAT
0f5da3ac85 modified docs proxy->logging->langfuse 2024-06-06 14:00:26 +08:00
Ishaan Jaff
2e95758ada ci/cd run again 2024-06-05 21:58:59 -07:00
Ishaan Jaff
27db329621 fix - test lowest cost routing 2024-06-05 21:42:41 -07:00
Sha Ahammed Roze
ea67803747
Merge branch 'BerriAI:main' into main 2024-06-06 10:02:15 +05:30
Krrish Dholakia
a76a9b7d11 feat(bedrock_httpx.py): add support for bedrock converse api
closes https://github.com/BerriAI/litellm/issues/4000
2024-06-05 21:20:36 -07:00
Ishaan Jaff
685d6e4400 bump: version 1.40.3 → 1.40.4 2024-06-05 21:09:16 -07:00
Ishaan Jaff
8e8509d848
Merge pull request #4030 from BerriAI/litellm_audit_logs_premium
[Feat] Audit Logs for Key, User, ProxyModel CRUD operations
2024-06-05 19:36:35 -07:00
Ishaan Jaff
ee04de4ad2 docs - audit logs 2024-06-05 19:29:09 -07:00
Ishaan Jaff
9e45619f33
Merge pull request #4027 from BerriAI/litellm_fix_redirecting_base_url_set
[FIX] Proxy redirect to `PROXY_BASE_URL/ui` after logging in
2024-06-05 19:19:55 -07:00
Ishaan Jaff
63cccba342 docs - audit logs 2024-06-05 19:18:01 -07:00
Ishaan Jaff
3dc05bff75 docs - audit logs 2024-06-05 19:17:49 -07:00
Ishaan Jaff
9d5ac193af feat - add audit logs for key create, update delete 2024-06-05 18:59:34 -07:00
Ishaan Jaff
7e89b242ba fix /team/new 2024-06-05 18:34:20 -07:00