phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 11:14:04 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
17681 commits 2484 branches 894 tags 537 MiB
Commit graph

3623 commits

Author SHA1 Message Date
Ishaan Jaff
f2c0e4d31e add hook for oauth2 proxy 2024-08-28 15:51:20 -07:00
Ishaan Jaff
f0ba94000d Merge pull request #5409 from BerriAI/litellm_ui_budgets 
[UI] Allow editing budget duration
 2024-08-28 14:43:57 -07:00
Ishaan Jaff
b8c092d430 new ui build 2024-08-28 14:43:33 -07:00
Ishaan Jaff
86d4504c7b fix checking request body 2024-08-28 14:10:09 -07:00
Ishaan Jaff
51d20628cd add checks for safe request body 2024-08-28 14:07:53 -07:00
Ishaan Jaff
5ff7e33dd8 add check for is_request_body_safe 2024-08-28 13:40:14 -07:00
Krrish Dholakia
ea3fe34105 fix(key_management_endpoints.py): expose 'key' param, for setting your own key value 2024-08-28 12:27:32 -07:00
Krrish Dholakia
276609f297 fix(rds_iam_token.py): support common aws env var's - AWS_ROLE_ARN, AWS_WEB_IDENTITY_TOKEN_FILE 2024-08-28 12:18:45 -07:00
Krrish Dholakia
cc2e1e1c43 fix(rds_iam_token.py): fix boto3 client init for rds 2024-08-28 12:15:57 -07:00
Krrish Dholakia
74081d31f6 fix(proxy/utils.py): fix model dump to exclude none values 2024-08-28 12:02:44 -07:00
Krrish Dholakia
b4c726d3e3 build(model_prices_and_context_window.json): add bedrock mistral small 2024-08-28 10:12:16 -07:00
Ishaan Jaff
d4db993130 add /rerank test 2024-08-27 17:50:37 -07:00
Ishaan Jaff
df4f1458e6 feat - add rerank on proxy 2024-08-27 17:36:40 -07:00
Ishaan Jaff
001882c14e Merge pull request #5392 from BerriAI/litellm_add_native_cohere_rerank 
[Feat] Add cohere rerank and together ai rerank
 2024-08-27 17:29:37 -07:00
Ishaan Jaff
359a003ac8 v0 add rerank on litellm proxy 2024-08-27 17:28:39 -07:00
Krrish Dholakia
d3105d8576 test(test_proxy_exception_mapping): loosen assert 2024-08-27 16:14:30 -07:00
Krrish Dholakia
722ccba323 fix(bedrock_httpx.py): support 'Auth' header as extra_header 
Fixes https://github.com/BerriAI/litellm/issues/5389#issuecomment-2313677977
 2024-08-27 16:08:54 -07:00
Krrish Dholakia
07dd3c640b perf(sagemaker.py): asyncify hf prompt template check 
leads to 189% improvement in RPS @ 100 users
 2024-08-27 07:37:06 -07:00
Ishaan Jaff
d682d5ed95 fix created_at and updated_at not existing error 2024-08-26 21:04:39 -07:00
Ishaan Jaff
ffb752d878 fix entrypoint 2024-08-26 20:32:23 -07:00
Ishaan Jaff
8059b6a7c3 ui new build 2024-08-26 19:01:35 -07:00
Ishaan Jaff
3ae7132cce enforce regenerating keys in enterprise tier 2024-08-26 18:54:50 -07:00
Ishaan Jaff
dd0d8658e1 update key name when regenerating a key 2024-08-26 18:40:51 -07:00
Ishaan Jaff
7e3f6ebf50 allow using hashed api keys on regen key 2024-08-26 18:15:52 -07:00
Ishaan Jaff
e69de5b426 add regenerate_key_fn 2024-08-26 17:59:44 -07:00
Ishaan Jaff
a6b5ba69ca fix schema 2024-08-26 17:27:06 -07:00
Ishaan Jaff
1f06f845a8 add key_state created at to token 2024-08-26 16:52:33 -07:00
Ishaan Jaff
ac39aefabe update schema 2024-08-26 16:52:19 -07:00
Krrish Dholakia
a3d403ec63 fix: fix tests 2024-08-24 19:32:22 -07:00
Krrish Dholakia
22bdc30f97 fix(utils.py): fix linting errors 2024-08-24 17:51:59 -07:00
Ishaan Jaff
7be10f1714 ui new build 2024-08-24 16:45:53 -07:00
Ishaan Jaff
99ea908257 fix linting errors when adding a new team member 2024-08-24 16:38:43 -07:00
Ishaan Jaff
d41f901346 Merge pull request #5352 from BerriAI/litellm_allow_setting_caching_mode 
[Feat-Caching] allow setting caching mode to default off
 2024-08-24 16:27:45 -07:00
Ishaan Jaff
8a72d1b9c1 fix set Caching Default Off 2024-08-24 09:43:39 -07:00
Krrish Dholakia
17a795a0f2 feat(team_endpoints.py): expose 2 new fields - updated_users and updated_team_memberships, on /team/member_add 
Fixes https://github.com/BerriAI/litellm/issues/5345#issuecomment-2307863265

Helps user see the stored budget per team member
 2024-08-24 09:22:16 -07:00
Krrish Dholakia
e7d914e96b fix(proxy_server.py): fix post /v1/batches endpoint 
Fixes https://github.com/BerriAI/litellm/issues/5279#issuecomment-2307919820
 2024-08-23 20:38:00 -07:00
Ishaan Jaff
b0db17bd5c Merge pull request #5346 from BerriAI/litellm_Add_vertex_text_to_speech 
[Feat-LiteLLM] Add Vertex AI - Text to speech support
 2024-08-23 18:29:53 -07:00
Ishaan Jaff
39efd58b1e docs on using vertex tts 2024-08-23 17:57:49 -07:00
Krrish Dholakia
26bd9a409a fix(proxy_server.py): support env vars for controlling global max parallel request retry/timeouts 
fixes issue where litellm module level settings weren't working for global retries, due to time of init
 2024-08-23 16:06:08 -07:00
Ishaan Jaff
54b4fabf31 Merge pull request #5342 from BerriAI/litellm_add_custom_guardrails 
[Feat-Proxy] Add Custom Guardrails
 2024-08-23 12:11:31 -07:00
Ishaan Jaff
ba20c6a35c feat add test for custom guardrails 2024-08-23 12:01:43 -07:00
Ishaan Jaff
dcd39dac00 init custom guardrail class 2024-08-23 10:54:42 -07:00
Ishaan Jaff
7e064f2dcd custom_callbacks 2024-08-23 09:52:52 -07:00
Ishaan Jaff
a8e192a868 fix use guardrail for pre call hook 2024-08-23 09:34:08 -07:00
Krrish Dholakia
2a6aa6da7a fix(utils.py): handle additionalProperties is False for vertex ai / gemini calls 
Fixes https://github.com/BerriAI/litellm/issues/5338

Also adds together ai json mode support
 2024-08-23 09:21:32 -07:00
Ishaan Jaff
6e3f27cf69 add custom guardrail reference 2024-08-23 08:32:07 -07:00
Ishaan Jaff
65e222b40f add the ability to init a custom guardrail 2024-08-23 08:21:07 -07:00
Krrish Dholakia
fa609c6d54 fix(litellm_pre_call_utils.py): don't override k-v pair sent in spend_logs_metadata by user 2024-08-23 07:10:18 -07:00
Krish Dholakia
11cbf60e4f Merge branch 'main' into litellm_azure_batch_apis 2024-08-22 19:07:54 -07:00
Ishaan Jaff
2864d16fa1 Merge branch 'main' into litellm_allow_using_azure_ad_token_auth 2024-08-22 18:21:24 -07:00