Commit graph

2899 commits

Author SHA1 Message Date
Ishaan Jaff
4910029eeb
Merge pull request #4479 from BerriAI/litellm_fix_admin_ui_login_issue
[Fix] Admin UI - fix error users we're seeing when logging in (use correct  user_id  when creating key for admin ui)
2024-06-29 20:00:45 -07:00
Ishaan Jaff
9eee36b449 add better debugging on /spend/report 2024-06-29 18:01:25 -07:00
Ishaan Jaff
22ad5b407e
Merge pull request #4474 from BerriAI/litellm_store_full_exception_inDB
[Fix] Proxy ErrorLogs store raw exception in error log
2024-06-29 17:46:24 -07:00
Ishaan Jaff
37352ba692 fix - use correct user_id when creating key for admin ui 2024-06-29 14:36:58 -07:00
Ishaan Jaff
c7e89a571e fix error logs store exception in DB 2024-06-29 12:15:14 -07:00
Ishaan Jaff
3a5d258e05 raise error on /spend/report endpoint 2024-06-29 12:00:19 -07:00
Ishaan Jaff
b09c283cc4 feat - add spend report grouped by api key 2024-06-29 11:33:02 -07:00
Krrish Dholakia
4f32f283a3 fix(vertex_httpx.py): fix streaming for cloudflare proxy calls 2024-06-29 09:09:56 -07:00
Ishaan Jaff
2a7592d026 doc - pass through auth 2024-06-29 09:09:18 -07:00
Ishaan Jaff
c578816434 feat - setting up auth on pass through endpoint 2024-06-29 08:38:44 -07:00
Krrish Dholakia
9556bfda81 fix(aws_secret_manager.py): fix typing error 2024-06-28 21:56:14 -07:00
Krish Dholakia
d0c89ddbe3
Merge pull request #4437 from BerriAI/litellm_aws_kms_decryption
fix(initial-commit): decrypts aws keys in entrypoint.sh
2024-06-28 21:10:52 -07:00
Ishaan Jaff
bc1c96ca35 pass through langfuse "/api/public/ingestion" 2024-06-28 17:29:11 -07:00
Ishaan Jaff
40d9278dcb test - pass through langfuse requests 2024-06-28 17:28:21 -07:00
Ishaan Jaff
6af1293384 feat - pass through langfuse requests 2024-06-28 17:27:13 -07:00
Ishaan Jaff
d0d1efcbdf
Merge pull request #4463 from BerriAI/docs_create_pass_through_routes_litellm_proxy
Docs create pass through routes litellm proxy (tutorial setup cohere Re-Rank Endpoint)
2024-06-28 16:55:44 -07:00
Krrish Dholakia
b78dd6416a fix(prisma_migration.py): support decrypting variables in a python script 2024-06-28 16:31:37 -07:00
Krrish Dholakia
b84d335624 fix(proxy_cli.py): run aws kms decrypt before starting proxy server 2024-06-28 16:03:56 -07:00
Ishaan Jaff
8f2931937a fix use os.environ/ vars for pass through endpoints 2024-06-28 15:30:31 -07:00
Ishaan Jaff
954c6ec9ed fix support pass through endpoints 2024-06-28 15:06:51 -07:00
Ishaan Jaff
f52cc18adb feat - support pass through endpoints 2024-06-28 15:03:21 -07:00
Krrish Dholakia
224148d613 docs(anthropic.md): add claude-3-5-sonnet example to docs 2024-06-28 11:00:36 -07:00
Krish Dholakia
7b54c9d5bc
Merge pull request #4446 from BerriAI/litellm_get_max_modified_tokens
fix(token_counter.py): New `get_modified_max_tokens' helper func
2024-06-27 21:43:23 -07:00
Krish Dholakia
1223b2b111
Merge pull request #4449 from BerriAI/litellm_azure_tts
feat(azure.py): azure tts support
2024-06-27 21:33:38 -07:00
Krish Dholakia
869275585a
Merge branch 'main' into litellm_response_cost_headers 2024-06-27 21:33:09 -07:00
Ishaan Jaff
3bcf9dd9fb
Merge branch 'main' into litellm_fix_in_mem_usage 2024-06-27 21:12:06 -07:00
Ishaan Jaff
413877d1c6 fix pre call utils adding extra headers 2024-06-27 21:03:36 -07:00
Ishaan Jaff
4cffcb5f28 fix error message on v2/model info 2024-06-27 20:20:47 -07:00
Ishaan Jaff
9b98269f59 fix secret redaction logic 2024-06-27 20:20:46 -07:00
Ishaan Jaff
b9bc16590d forward otel traceparent in request headers 2024-06-27 20:20:46 -07:00
Ishaan Jaff
c0c715b905 fix cost tracking for whisper 2024-06-27 20:20:46 -07:00
Ishaan Jaff
882b6dcab4 fix only use crypto imports when needed 2024-06-27 20:20:46 -07:00
Ishaan Jaff
85f463dff5 fix - verify license without api request 2024-06-27 20:20:46 -07:00
Krrish Dholakia
aa9e542d21 fix(predibase.py): support json schema on predibase 2024-06-27 20:20:31 -07:00
Krrish Dholakia
adfb9cda79 fix(utils.py): predibase exception mapping - map 424 as a badrequest error 2024-06-27 20:20:31 -07:00
Ishaan Jaff
1962a24802 test secret detection 2024-06-27 20:20:31 -07:00
Ishaan Jaff
350e87f1d6 init secret detection callback 2024-06-27 20:20:31 -07:00
Krrish Dholakia
c45d93b93a fix(router.py): improve error message returned for fallbacks 2024-06-27 20:20:30 -07:00
Krrish Dholakia
9b47ba72cb feat(router.py): support mock testing content policy + context window fallbacks 2024-06-27 20:20:30 -07:00
Ishaan Jaff
e471aca81f feat - add debug_utils 2024-06-27 20:20:30 -07:00
Ishaan Jaff
c5020878e4 /spend/calculate use model aliases on this endpoint 2024-06-27 20:20:30 -07:00
Krrish Dholakia
690c7f6e47 fix(router.py): log rejected router requests to langfuse
Fixes issue where rejected requests weren't being logged
2024-06-27 20:20:30 -07:00
Ishaan Jaff
412c1fc541 fix importing litellm 2024-06-27 20:20:29 -07:00
Ishaan Jaff
e7ff5014b1 example cofnig with public routes 2024-06-27 20:20:29 -07:00
Ishaan Jaff
fa5eb5c96f add helper to check route_in_additonal_public_routes 2024-06-27 20:20:29 -07:00
Ishaan Jaff
556ef8dd18 test - spend/calculate endpoints 2024-06-27 20:20:29 -07:00
Ishaan Jaff
2cb4d845ae feat - refactor /spend/calculate 2024-06-27 20:20:29 -07:00
Ishaan Jaff
bfae8c3da6 example config with public routes 2024-06-27 20:20:29 -07:00
Ishaan Jaff
e30410f700 feat - allow user to define public routes 2024-06-27 20:20:29 -07:00
Krrish Dholakia
6f2f89d7b2 fix(vertex_httpx.py): cover gemini content violation (on prompt) 2024-06-27 20:20:29 -07:00