Commit graph

10374 commits

Author SHA1 Message Date
Ishaan Jaff
88fa9d4852 handle anthropic internal server errors 2024-08-08 23:23:38 -07:00
Ishaan Jaff
6d191b48ba testing skip internal server errors 2024-08-08 23:23:38 -07:00
Ishaan Jaff
8564d5da34 ci/cd skip ServiceUnavailableError 2024-08-08 23:23:38 -07:00
Ishaan Jaff
1afd16ee6e ui new build 2024-08-08 23:23:38 -07:00
Ishaan Jaff
04b23f8493 ui new build 2024-08-08 23:23:38 -07:00
Ishaan Jaff
0017f726af docs cachedContent endpoint 2024-08-08 23:23:31 -07:00
Ishaan Jaff
98f84a16b6 auto update the model in cachedContents request 2024-08-08 23:23:31 -07:00
Ishaan Jaff
8c2d63b6a2 add native cachedContents endpoint 2024-08-08 23:23:31 -07:00
Ishaan Jaff
16466f4672 add example using litellm proxy with gemini context caching 2024-08-08 23:23:04 -07:00
Krrish Dholakia
6d3f3f3230 fix(internal_user_endpoints.py): expose new 'internal_user_budget_duration' flag
Relevant to - https://github.com/BerriAI/litellm/issues/5106
2024-08-08 23:22:35 -07:00
Krrish Dholakia
2ac07c2e4f test: skip flaky langsmith tests 2024-08-08 23:22:14 -07:00
Krrish Dholakia
c8ae6cbd37 test(test_langsmith.py): fix test 2024-08-08 23:22:14 -07:00
Krrish Dholakia
5a2f9c4768 fix(user_api_key_auth.py): Fixes https://github.com/BerriAI/litellm/issues/5111 2024-08-08 23:22:14 -07:00
Krish Dholakia
f4b9f7c381
Merge pull request #5105 from prd-tuong-nguyen/feat/support-hash-prompt-in-caching
feat: hash prompt when caching
2024-08-08 20:32:10 -07:00
Krrish Dholakia
10eac728c7 fix(anthropic.py): fix translation 2024-08-08 19:21:08 -07:00
Ishaan Jaff
8262dc66d3 docs cachedContent endpoint 2024-08-08 19:21:07 -07:00
Ishaan Jaff
4b4800d572 auto update the model in cachedContents request 2024-08-08 19:20:59 -07:00
Ishaan Jaff
5f7e3e0c18 add native cachedContents endpoint 2024-08-08 19:20:59 -07:00
Ishaan Jaff
6b26de9edf add example using litellm proxy with gemini context caching 2024-08-08 19:20:18 -07:00
Krrish Dholakia
2957967b99 fix(anthropic.py): fix translation from /v1/messages format to openai format 2024-08-08 19:19:58 -07:00
Krrish Dholakia
bcd33cc54c fix(internal_user_endpoints.py): expose new 'internal_user_budget_duration' flag
Relevant to - https://github.com/BerriAI/litellm/issues/5106
2024-08-08 19:19:52 -07:00
Krrish Dholakia
ecc84bc81e test: skip flaky langsmith tests 2024-08-08 19:19:11 -07:00
Krrish Dholakia
642820d59a test(test_langsmith.py): fix test 2024-08-08 19:19:11 -07:00
Krrish Dholakia
c5c954809b fix(user_api_key_auth.py): Fixes https://github.com/BerriAI/litellm/issues/5111 2024-08-08 19:19:11 -07:00
Krrish Dholakia
1d39c0fb7d fix(management_helpers/utils.py): use user_default max_budget, budget duration on new user upsert during team member add
Fixes https://github.com/BerriAI/litellm/issues/5106
2024-08-08 19:14:43 -07:00
Ishaan Jaff
f862fddf2f handle anthropic internal server errors 2024-08-08 19:14:31 -07:00
Ishaan Jaff
62c1595497 testing skip internal server errors 2024-08-08 19:09:46 -07:00
Ishaan Jaff
0b64b51d55 ci/cd skip ServiceUnavailableError 2024-08-08 18:54:40 -07:00
Ishaan Jaff
b14b346e2e ui new build 2024-08-08 18:53:22 -07:00
Ishaan Jaff
3bb001f136 ui new build 2024-08-08 18:25:41 -07:00
Krrish Dholakia
6af9d9d2b3 test(test_proxy_server.py): unit testing to make sure internal user params don't impact admin 2024-08-08 17:59:30 -07:00
Krrish Dholakia
4b40563be3 fix(proxy_server.py): ensure internal_user params only apply to internal_user role 2024-08-08 17:50:29 -07:00
Krrish Dholakia
9839a7858c fix(anthropic.py): fix translation 2024-08-08 17:33:48 -07:00
Krrish Dholakia
97d57b8449 fix(proxy_server.py): respect internal_user_budget_duration for sso user 2024-08-08 17:28:28 -07:00
Krrish Dholakia
0bfe9bee54 fix(utils.py): handle anthropic overloaded error 2024-08-08 17:19:12 -07:00
Ishaan Jaff
67059266ca fix use get_file_check_sum 2024-08-08 17:19:12 -07:00
Krrish Dholakia
df7ffb5595 fix(factory.py): handle openai function message having tool call id 2024-08-08 17:19:12 -07:00
Ishaan Jaff
a1a11b2e08 add default_vertex_config 2024-08-08 17:19:12 -07:00
Ishaan Jaff
c7a3472641 docs cachedContent endpoint 2024-08-08 17:19:12 -07:00
Ishaan Jaff
a0385ff067 auto update the model in cachedContents request 2024-08-08 17:19:12 -07:00
Ishaan Jaff
cf054def4a add native cachedContents endpoint 2024-08-08 17:19:12 -07:00
Ishaan Jaff
e2e5e46979 add example using litellm proxy with gemini context caching 2024-08-08 17:19:12 -07:00
Ishaan Jaff
3178724579 add tests to make sure correct vertex ai route is used 2024-08-08 17:19:12 -07:00
Ishaan Jaff
ed125b90fd use v1beta1 when using cached_content 2024-08-08 17:19:12 -07:00
Ishaan Jaff
594a71cec3 fix handle case when service logger has no attribute prometheusServicesLogger 2024-08-08 17:19:12 -07:00
Krrish Dholakia
4ac0afef2c fix(anthropic.py): fix translation from /v1/messages format to openai format 2024-08-08 17:19:12 -07:00
Krrish Dholakia
2776d9cb0d fix(internal_user_endpoints.py): expose new 'internal_user_budget_duration' flag
Relevant to - https://github.com/BerriAI/litellm/issues/5106
2024-08-08 17:19:05 -07:00
Krrish Dholakia
8831f30e9d test: skip flaky langsmith tests 2024-08-08 17:18:59 -07:00
Krrish Dholakia
d262501344 test(test_langsmith.py): fix test 2024-08-08 17:18:59 -07:00
Krrish Dholakia
f75a31cd11 fix(user_api_key_auth.py): Fixes https://github.com/BerriAI/litellm/issues/5111 2024-08-08 17:18:59 -07:00