phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 11:43:54 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
14667 commits 2497 branches 897 tags 550 MiB
Commit graph

2873 commits

Author SHA1 Message Date
Ishaan Jaff
2df7df7af2 fix lakera ai testing 2024-07-03 18:58:36 -07:00
Ishaan Jaff
da2be30aa0 feat- control lakera ai per llm call 2024-07-03 16:34:23 -07:00
Ishaan Jaff
d0dea9396f test - default on/off guardrails 2024-07-03 14:50:13 -07:00
Ishaan Jaff
67513cb4b7 Merge branch 'main' into litellm_allow_setting_guardrails_config 2024-07-03 14:21:51 -07:00
Ishaan Jaff
976ce2b286 init guardrails on proxy 2024-07-03 14:18:12 -07:00
Ishaan Jaff
746a9d6e25 fix checks on litellm license 2024-07-03 14:02:07 -07:00
Krrish Dholakia
80d54afa04 fix(user_api_key_auth.py): expose /health as an info route 
this still requires key access. Allows users to check model health
 2024-07-03 10:02:50 -07:00
Krrish Dholakia
131fcac7d8 fix(_service_logging.py): only trigger otel if in service_callback 
Fixes https://github.com/BerriAI/litellm/issues/4511
 2024-07-03 09:48:38 -07:00
Krish Dholakia
b2f2560e54 Merge branch 'main' into litellm_support_dynamic_rpm_limiting 2024-07-02 17:51:18 -07:00
Ishaan Jaff
424825be48 Merge pull request #4518 from BerriAI/litellm_fix_background_health_checks 
[Fix-Proxy] Background health checks use deep copy of model list for _run_background_health_check
 2024-07-02 16:42:34 -07:00
Krrish Dholakia
d09a78d7fd fix(slack_alerting.py): use in-memory cache for checking request status 2024-07-02 13:01:59 -07:00
Ishaan Jaff
46eb95da23 use deep copy of router for _run_background_health_check 2024-07-02 11:29:24 -07:00
Krrish Dholakia
f7e12f551e fix(aws_secret_manager.py): fix string replace 2024-07-02 00:42:12 -07:00
Krrish Dholakia
c1a1529582 fix(dynamic_rate_limiter.py): add rpm allocation, priority + quota reservation to docs 2024-07-01 23:35:42 -07:00
Krish Dholakia
01bdd104d0 Merge branch 'main' into litellm_disable_cooldowns 2024-07-01 23:10:10 -07:00
Krrish Dholakia
0bc08063e1 fix(dynamic_rate_limiter.py): support setting priority + reserving tpm/rpm 2024-07-01 23:08:54 -07:00
Ishaan Jaff
dcc44747c5 Merge pull request #4501 from BerriAI/litellm_return_Response_headers 
[Feat] Return Response headers for OpenAI / Azure OpenAI when `litellm.return_response_headers=True`
 2024-07-01 21:11:10 -07:00
Krrish Dholakia
f74490c69b test(test_dynamic_rate_limit_handler.py): refactor tests for rpm suppprt 2024-07-01 20:16:10 -07:00
Krrish Dholakia
d528e263c2 fix(dynamic_rate_limiter.py): support dynamic rate limiting on rpm 2024-07-01 17:45:10 -07:00
Krrish Dholakia
b6f509a745 fix(s3.py): fix s3 path logging on proxy 2024-07-01 17:22:31 -07:00
Ishaan Jaff
e0c111158c fix config 2024-07-01 17:02:15 -07:00
Krrish Dholakia
459d294e21 fix(router.py): disable cooldowns 
allow admin to disable model cooldowns
 2024-07-01 15:03:10 -07:00
Krrish Dholakia
43af7fc985 docs(configs.md): add wildcard model name to docs 2024-07-01 14:11:45 -07:00
Krrish Dholakia
1fb4979589 fix(aws_secret_manager.py): accept 'aws_kms' being in the key name 2024-07-01 13:46:20 -07:00
Ishaan Jaff
51e02464a2 Merge pull request #4479 from BerriAI/litellm_fix_admin_ui_login_issue 
[Fix] Admin UI - fix error users we're seeing when logging in (use correct  user_id  when creating key for admin ui)
 2024-06-29 20:00:45 -07:00
Ishaan Jaff
d55c6b9b07 add better debugging on /spend/report 2024-06-29 18:01:25 -07:00
Ishaan Jaff
0c6725bdc0 Merge pull request #4474 from BerriAI/litellm_store_full_exception_inDB 
[Fix] Proxy ErrorLogs store raw exception in error log
 2024-06-29 17:46:24 -07:00
Ishaan Jaff
f5177e276a fix - use correct user_id when creating key for admin ui 2024-06-29 14:36:58 -07:00
Ishaan Jaff
6396c30a7b fix error logs store exception in DB 2024-06-29 12:15:14 -07:00
Ishaan Jaff
869819f8a9 raise error on /spend/report endpoint 2024-06-29 12:00:19 -07:00
Ishaan Jaff
8f661e972a feat - add spend report grouped by api key 2024-06-29 11:33:02 -07:00
Krrish Dholakia
510826c457 fix(vertex_httpx.py): fix streaming for cloudflare proxy calls 2024-06-29 09:09:56 -07:00
Ishaan Jaff
323ad1bd77 doc - pass through auth 2024-06-29 09:09:18 -07:00
Ishaan Jaff
3dc6430fef feat - setting up auth on pass through endpoint 2024-06-29 08:38:44 -07:00
Krrish Dholakia
b33af39bd5 fix(aws_secret_manager.py): fix typing error 2024-06-28 21:56:14 -07:00
Krish Dholakia
4d24c3b666 Merge pull request #4437 from BerriAI/litellm_aws_kms_decryption 
fix(initial-commit): decrypts aws keys in entrypoint.sh
 2024-06-28 21:10:52 -07:00
Ishaan Jaff
c0d6dba9ff pass through langfuse "/api/public/ingestion" 2024-06-28 17:29:11 -07:00
Ishaan Jaff
a7cb2ed21f test - pass through langfuse requests 2024-06-28 17:28:21 -07:00
Ishaan Jaff
033da54a03 feat - pass through langfuse requests 2024-06-28 17:27:13 -07:00
Ishaan Jaff
c57f06fd0a Merge pull request #4463 from BerriAI/docs_create_pass_through_routes_litellm_proxy 
Docs create pass through routes litellm proxy (tutorial setup cohere Re-Rank Endpoint)
 2024-06-28 16:55:44 -07:00
Krrish Dholakia
55637c9cfc fix(prisma_migration.py): support decrypting variables in a python script 2024-06-28 16:31:37 -07:00
Krrish Dholakia
4c5ee771e1 fix(proxy_cli.py): run aws kms decrypt before starting proxy server 2024-06-28 16:03:56 -07:00
Ishaan Jaff
69deb65c04 fix use os.environ/ vars for pass through endpoints 2024-06-28 15:30:31 -07:00
Ishaan Jaff
cf9636cc59 fix support pass through endpoints 2024-06-28 15:06:51 -07:00
Ishaan Jaff
a8c8138552 feat - support pass through endpoints 2024-06-28 15:03:21 -07:00
Krrish Dholakia
3e9ce534b4 docs(anthropic.md): add claude-3-5-sonnet example to docs 2024-06-28 11:00:36 -07:00
Krish Dholakia
014c032b00 Merge pull request #4446 from BerriAI/litellm_get_max_modified_tokens 
fix(token_counter.py): New `get_modified_max_tokens' helper func
 2024-06-27 21:43:23 -07:00
Krish Dholakia
134aa3cbd8 Merge pull request #4449 from BerriAI/litellm_azure_tts 
feat(azure.py): azure tts support
 2024-06-27 21:33:38 -07:00
Krish Dholakia
fa1cb7d903 Merge branch 'main' into litellm_response_cost_headers 2024-06-27 21:33:09 -07:00
Ishaan Jaff
bdb812ff97 Merge branch 'main' into litellm_fix_in_mem_usage 2024-06-27 21:12:06 -07:00