Commit graph

2899 commits

Author SHA1 Message Date
Ishaan Jaff
51e02464a2 Merge pull request #4479 from BerriAI/litellm_fix_admin_ui_login_issue
[Fix] Admin UI - fix error users we're seeing when logging in (use correct  user_id  when creating key for admin ui)
2024-06-29 20:00:45 -07:00
Ishaan Jaff
d55c6b9b07 add better debugging on /spend/report 2024-06-29 18:01:25 -07:00
Ishaan Jaff
0c6725bdc0 Merge pull request #4474 from BerriAI/litellm_store_full_exception_inDB
[Fix] Proxy ErrorLogs store raw exception in error log
2024-06-29 17:46:24 -07:00
Ishaan Jaff
f5177e276a fix - use correct user_id when creating key for admin ui 2024-06-29 14:36:58 -07:00
Ishaan Jaff
6396c30a7b fix error logs store exception in DB 2024-06-29 12:15:14 -07:00
Ishaan Jaff
869819f8a9 raise error on /spend/report endpoint 2024-06-29 12:00:19 -07:00
Ishaan Jaff
8f661e972a feat - add spend report grouped by api key 2024-06-29 11:33:02 -07:00
Krrish Dholakia
510826c457 fix(vertex_httpx.py): fix streaming for cloudflare proxy calls 2024-06-29 09:09:56 -07:00
Ishaan Jaff
323ad1bd77 doc - pass through auth 2024-06-29 09:09:18 -07:00
Ishaan Jaff
3dc6430fef feat - setting up auth on pass through endpoint 2024-06-29 08:38:44 -07:00
Krrish Dholakia
b33af39bd5 fix(aws_secret_manager.py): fix typing error 2024-06-28 21:56:14 -07:00
Krish Dholakia
4d24c3b666 Merge pull request #4437 from BerriAI/litellm_aws_kms_decryption
fix(initial-commit): decrypts aws keys in entrypoint.sh
2024-06-28 21:10:52 -07:00
Ishaan Jaff
c0d6dba9ff pass through langfuse "/api/public/ingestion" 2024-06-28 17:29:11 -07:00
Ishaan Jaff
a7cb2ed21f test - pass through langfuse requests 2024-06-28 17:28:21 -07:00
Ishaan Jaff
033da54a03 feat - pass through langfuse requests 2024-06-28 17:27:13 -07:00
Ishaan Jaff
c57f06fd0a Merge pull request #4463 from BerriAI/docs_create_pass_through_routes_litellm_proxy
Docs create pass through routes litellm proxy (tutorial setup cohere Re-Rank Endpoint)
2024-06-28 16:55:44 -07:00
Krrish Dholakia
55637c9cfc fix(prisma_migration.py): support decrypting variables in a python script 2024-06-28 16:31:37 -07:00
Krrish Dholakia
4c5ee771e1 fix(proxy_cli.py): run aws kms decrypt before starting proxy server 2024-06-28 16:03:56 -07:00
Ishaan Jaff
69deb65c04 fix use os.environ/ vars for pass through endpoints 2024-06-28 15:30:31 -07:00
Ishaan Jaff
cf9636cc59 fix support pass through endpoints 2024-06-28 15:06:51 -07:00
Ishaan Jaff
a8c8138552 feat - support pass through endpoints 2024-06-28 15:03:21 -07:00
Krrish Dholakia
3e9ce534b4 docs(anthropic.md): add claude-3-5-sonnet example to docs 2024-06-28 11:00:36 -07:00
Krish Dholakia
014c032b00 Merge pull request #4446 from BerriAI/litellm_get_max_modified_tokens
fix(token_counter.py): New `get_modified_max_tokens' helper func
2024-06-27 21:43:23 -07:00
Krish Dholakia
134aa3cbd8 Merge pull request #4449 from BerriAI/litellm_azure_tts
feat(azure.py): azure tts support
2024-06-27 21:33:38 -07:00
Krish Dholakia
fa1cb7d903 Merge branch 'main' into litellm_response_cost_headers 2024-06-27 21:33:09 -07:00
Ishaan Jaff
bdb812ff97 Merge branch 'main' into litellm_fix_in_mem_usage 2024-06-27 21:12:06 -07:00
Ishaan Jaff
196d15967b fix pre call utils adding extra headers 2024-06-27 21:03:36 -07:00
Ishaan Jaff
1592de0b7f fix error message on v2/model info 2024-06-27 20:20:47 -07:00
Ishaan Jaff
fc8714fc9c fix secret redaction logic 2024-06-27 20:20:46 -07:00
Ishaan Jaff
0ac77551be forward otel traceparent in request headers 2024-06-27 20:20:46 -07:00
Ishaan Jaff
0bdbe55c7d fix cost tracking for whisper 2024-06-27 20:20:46 -07:00
Ishaan Jaff
8bde270d86 fix only use crypto imports when needed 2024-06-27 20:20:46 -07:00
Ishaan Jaff
bcde3ee27a fix - verify license without api request 2024-06-27 20:20:46 -07:00
Krrish Dholakia
bb098a8e5f fix(predibase.py): support json schema on predibase 2024-06-27 20:20:31 -07:00
Krrish Dholakia
111c20bdc1 fix(utils.py): predibase exception mapping - map 424 as a badrequest error 2024-06-27 20:20:31 -07:00
Ishaan Jaff
a5d40c2145 test secret detection 2024-06-27 20:20:31 -07:00
Ishaan Jaff
4c2d594bc7 init secret detection callback 2024-06-27 20:20:31 -07:00
Krrish Dholakia
d4ed74e946 fix(router.py): improve error message returned for fallbacks 2024-06-27 20:20:30 -07:00
Krrish Dholakia
a7aa8e28bd feat(router.py): support mock testing content policy + context window fallbacks 2024-06-27 20:20:30 -07:00
Ishaan Jaff
0a71b2e7b6 feat - add debug_utils 2024-06-27 20:20:30 -07:00
Ishaan Jaff
e6e614f8d0 /spend/calculate use model aliases on this endpoint 2024-06-27 20:20:30 -07:00
Krrish Dholakia
744791c4e2 fix(router.py): log rejected router requests to langfuse
Fixes issue where rejected requests weren't being logged
2024-06-27 20:20:30 -07:00
Ishaan Jaff
f6e07bec16 fix importing litellm 2024-06-27 20:20:29 -07:00
Ishaan Jaff
f612a33548 example cofnig with public routes 2024-06-27 20:20:29 -07:00
Ishaan Jaff
905c656ba7 add helper to check route_in_additonal_public_routes 2024-06-27 20:20:29 -07:00
Ishaan Jaff
71c3aa9f22 test - spend/calculate endpoints 2024-06-27 20:20:29 -07:00
Ishaan Jaff
3d317c54a0 feat - refactor /spend/calculate 2024-06-27 20:20:29 -07:00
Ishaan Jaff
6022207c4d example config with public routes 2024-06-27 20:20:29 -07:00
Ishaan Jaff
d832b88099 feat - allow user to define public routes 2024-06-27 20:20:29 -07:00
Krrish Dholakia
8707e65ea1 fix(vertex_httpx.py): cover gemini content violation (on prompt) 2024-06-27 20:20:29 -07:00