Commit graph

7487 commits

Author SHA1 Message Date
Krrish Dholakia
792b25c772 feat(proxy_server.py): enable batch completion fastest response calls on proxy
introduces new `fastest_response` flag for enabling the call
2024-05-28 20:09:31 -07:00
Krrish Dholakia
3676c00235 feat(router.py): support fastest response batch completion call
returns fastest response. cancels others.
2024-05-28 19:44:41 -07:00
Krish Dholakia
4a79bf775b Merge pull request #3883 from BerriAI/litellm_anthropic_parallel_streaming_fix
fix(anthropic.py): fix parallel streaming on anthropic.py
2024-05-28 17:21:57 -07:00
Krrish Dholakia
ccee9e4eb1 fix(anthropic.py): fix parallel streaming on anthropic.py
prevent parallel requests from cancelling each other

Fixes https://github.com/BerriAI/litellm/issues/3881
2024-05-28 16:29:09 -07:00
Krish Dholakia
13365876c4 Merge pull request #2888 from rick-github/ollama-image-handling
Update ollama.py for image handling
2024-05-28 10:25:06 -07:00
Ishaan Jaff
f8a2fc9201 ui - mount 2024-05-28 08:55:01 -07:00
Ishaan Jaff
b38196fbd9 fix app mounting ui 2024-05-28 08:14:15 -07:00
Ishaan Jaff
f1e1226e39 ui - new build, release 2024-05-28 08:10:34 -07:00
Ishaan Jaff
f0f00eb233 bump: version 1.38.11 → 1.38.12 2024-05-28 08:10:34 -07:00
Ishaan Jaff
f878c54986 Merge pull request #3874 from BerriAI/litellm_make_email_alerts_free
[Feat] Add, Test Email Alerts on Admin UI
2024-05-28 08:09:14 -07:00
frob
91f64c17a4 Fix typo 2024-05-28 17:00:08 +02:00
frob
66432c66e4 Add tests for ollama image handling 2024-05-28 16:48:15 +02:00
frob
f213742231 Merge branch 'BerriAI:main' into ollama-image-handling 2024-05-28 09:18:36 +02:00
Ishaan Jaff
c8d3af1117 fix - testing email alerting 2024-05-27 22:46:45 -07:00
Ishaan Jaff
c0658ddc70 fix - validation for email alerting 2024-05-27 22:38:17 -07:00
Krish Dholakia
e2c15e84a0 Merge branch 'main' into litellm_invite_users_via_link 2024-05-27 20:36:43 -07:00
Krrish Dholakia
b5e17de0bc feat(proxy_server.py): allow admin to invite users via invite link
Closes https://github.com/BerriAI/litellm/issues/3863
2024-05-27 20:32:25 -07:00
Ishaan Jaff
7414fc2108 Merge pull request #3872 from BerriAI/litellm_make_email_alerts_free
[Feat] Make Email alerting Free Tier, but customizing emails enterprise
2024-05-27 19:46:03 -07:00
Ishaan Jaff
46d506169a Merge pull request #3870 from BerriAI/litellm_rename_end_user
[Feat] Rename `/end/user/new` -> `/customer/new` (maintain backwards compatibility)
2024-05-27 19:42:14 -07:00
Ishaan Jaff
67675d3382 ffeat - make email alerting a free feature 2024-05-27 19:40:47 -07:00
Ishaan Jaff
2037d88719 fix - make email alerting free 2024-05-27 19:27:20 -07:00
Ishaan Jaff
a27b1dd13d fix - working customer/delete 2024-05-27 19:24:20 -07:00
Krish Dholakia
7f4a6ad956 Merge pull request #3869 from BerriAI/litellm_public_model_hubg
Admin UI - Public model hub
2024-05-27 19:14:11 -07:00
Krrish Dholakia
4aa7e0b17c fix(main.py): pass extra headers through for async calls 2024-05-27 19:11:40 -07:00
Ishaan Jaff
39936fa726 fix - /customer/update 2024-05-27 19:02:20 -07:00
Krrish Dholakia
0d3867ea5c test(test_bedrock_completion.py): refactor test bedrock headers test 2024-05-27 19:01:07 -07:00
Krrish Dholakia
2b729624e6 fix(openai.py): fix deepinfra config optional param 2024-05-27 18:36:34 -07:00
Ishaan Jaff
d9b7d078de feat - add validation for existing customers 2024-05-27 18:29:09 -07:00
Ishaan Jaff
a997e8f811 docs string - > end user /new 2024-05-27 18:20:44 -07:00
Krish Dholakia
01dc798876 Merge pull request #3847 from paneru-rajan/improve-validate-fallback-method
Improve validate-fallbacks method
2024-05-27 18:18:35 -07:00
Ishaan Jaff
a90b18a741 feat - rename end_user -> customer 2024-05-27 18:17:46 -07:00
Krrish Dholakia
2dd0606ab7 fix(openai.py): fix deepinfra supported params 2024-05-27 18:12:17 -07:00
Krrish Dholakia
abdc5b357f feat(model_hub.tsx): enable admin to expose a public model hub 2024-05-27 17:45:45 -07:00
Ishaan Jaff
5fed67dcc3 Merge pull request #3868 from BerriAI/litellm_show_updated_created_models
[Feat] Show Created at, Created by on `Models` Page
2024-05-27 16:32:29 -07:00
Ishaan Jaff
201595c043 Merge pull request #3865 from BerriAI/litellm_fix_model_activity
fix - Admin UI show activity by model_group
2024-05-27 16:32:03 -07:00
Ishaan Jaff
4d14366ae3 backend - add audit logs for adding models 2024-05-27 16:29:51 -07:00
Ishaan Jaff
d7043baf6d router - include updated at and created at in model info 2024-05-27 15:53:16 -07:00
Krrish Dholakia
23b28601b7 fix(fix-'get_model_group_info'-to-return-a-default-value-if-unmapped-model-group): allows model hub to return all model groupss 2024-05-27 13:53:01 -07:00
Ishaan Jaff
ddfb76a770 fix - show activity by model_group 2024-05-27 11:25:16 -07:00
Krish Dholakia
f5e9e43e58 Merge pull request #3857 from BerriAI/litellm_fix_user_tpm_rpm_limits
fix(parallel_request_limiter.py): fix user+team tpm/rpm limit check
2024-05-27 09:55:16 -07:00
Ishaan Jaff
000f23d005 Merge branch 'main' into litellm_show_openai_params_model_hub 2024-05-27 09:27:56 -07:00
Ishaan Jaff
2c08371080 ui - new build 2024-05-27 09:23:54 -07:00
Krrish Dholakia
23542fc1d2 fix(utils.py): support deepinfra optional params
Fixes https://github.com/BerriAI/litellm/issues/3855
2024-05-27 09:16:56 -07:00
Ishaan Jaff
4fedcb4b5c ui - new build 2024-05-27 09:16:24 -07:00
Ishaan Jaff
50f1cbb1dd fix - return supported_openai_params from get_model_info 2024-05-27 09:00:12 -07:00
Krrish Dholakia
4e97b42ffd refactor(proxy/utils.py): cleanup dead code 2024-05-27 08:52:01 -07:00
Ishaan Jaff
69ea7d57fb feat - show openai params on model hub ui 2024-05-27 08:49:51 -07:00
Krrish Dholakia
56fd0c60d1 fix(parallel_request_limiter.py): fix user+team tpm/rpm limit check
Closes https://github.com/BerriAI/litellm/issues/3788
2024-05-27 08:48:23 -07:00
frob
4f9b66ee83 Merge branch 'BerriAI:main' into ollama-image-handling 2024-05-27 17:42:30 +02:00
Ishaan Jaff
9a02e72c9e ui - new build 2024-05-26 14:50:31 -07:00