Commit graph

3588 commits

Author SHA1 Message Date
Krrish Dholakia
7df94100e8 build(model_prices_and_context_window.json): add model pricing for vertex ai llama 3.1 api 2024-07-23 17:36:07 -07:00
Krrish Dholakia
83ef52e180 feat(vertex_ai_llama.py): vertex ai llama3.1 api support
Initial working commit for vertex ai llama 3.1 api support
2024-07-23 17:07:30 -07:00
Krrish Dholakia
f64a3309d1 fix(utils.py): support raw response headers for streaming requests 2024-07-23 11:58:58 -07:00
Krrish Dholakia
dcb974dd1e feat(utils.py): support passing openai response headers to client, if enabled
Allows openai/openai-compatible provider response headers to be sent to client, if 'return_response_headers' is enabled
2024-07-23 11:30:52 -07:00
Krish Dholakia
e770ac48a2
Merge branch 'main' into litellm_braintrust_integration 2024-07-22 22:40:39 -07:00
Krish Dholakia
c4db6aa15e
Merge pull request #4810 from BerriAI/litellm_team_modify_guardrails
feat(auth_checks.py): Allow admin to disable team from turning on/off guardrails
2024-07-22 22:32:24 -07:00
Krrish Dholakia
1a83935aa4 fix(proxy/utils.py): add stronger typing for litellm params in failure call logging 2024-07-22 21:31:39 -07:00
Krrish Dholakia
92b1262caa test(test_braintrust.py): add testing for braintrust integration 2024-07-22 18:05:11 -07:00
Ishaan Jaff
69e52e0a47 test - openai content policy errors 2024-07-22 16:24:03 -07:00
Ishaan Jaff
a0600a30d8 fix using arize as success callback 2024-07-22 15:32:49 -07:00
Ishaan Jaff
55f0728a7e
Merge pull request #4827 from BerriAI/litellm_use_anthropic_sdk_proxy
[Fix-Proxy] Allow non admin keys to access /v1/messages Anthropic Routes
2024-07-22 14:49:29 -07:00
Ishaan Jaff
9345c5de2a add test for anthropic routes 2024-07-22 14:48:22 -07:00
Ishaan Jaff
673105c88f update tests 2024-07-22 14:44:47 -07:00
Ishaan Jaff
cdc8b4f037 test - arize ai basic logging 2024-07-22 11:30:24 -07:00
Krish Dholakia
227f55f370
Revert "Fix: use Bedrock region from environment variables before other region definitions" 2024-07-22 07:40:24 -07:00
Ishaan Jaff
48c365976f fix bedrock embedding test 2024-07-20 20:05:22 -07:00
Krish Dholakia
bb6b2c6872
Merge pull request #4613 from petermuller/main
Fix: use Bedrock region from environment variables before other region definitions
2024-07-20 19:19:05 -07:00
Ishaan Jaff
f6225623e9
Merge branch 'main' into litellm_return-response_headers 2024-07-20 19:05:56 -07:00
Krrish Dholakia
8b3c8102a7 feat(auth_checks.py): Allow admin to disable team from turning on/off guardrails. 2024-07-20 18:39:05 -07:00
Ishaan Jaff
2513b64ed4 ci/cd run tests again 2024-07-20 17:44:12 -07:00
Ishaan Jaff
5e4d291244 rename to _response_headers 2024-07-20 17:31:16 -07:00
Ishaan Jaff
5e52f50a82 return response headers 2024-07-20 15:26:44 -07:00
Krrish Dholakia
a27454b8e3 fix(openai.py): support completion, streaming, async_streaming 2024-07-20 15:23:42 -07:00
Ishaan Jaff
6039e0b2a7 test - response_headers 2024-07-20 15:08:54 -07:00
Krish Dholakia
f797597202
Merge branch 'main' into litellm_proxy_team_cache_update 2024-07-19 21:07:26 -07:00
Krish Dholakia
3053f52c43
Merge pull request #4801 from BerriAI/litellm_dynamic_params_oai_compatible_endpoints
fix(utils.py): support dynamic params for openai-compatible providers
2024-07-19 21:07:06 -07:00
Ishaan Jaff
3bb66ab939 ci/cd run again 2024-07-19 20:08:50 -07:00
Ishaan Jaff
d35aeb3f4f fix test_vertex_ai_medlm_completion_cost 2024-07-19 19:58:44 -07:00
Krrish Dholakia
95a0f6839f fix(utils.py): fix token_counter to handle empty tool calls in messages
Fixes https://github.com/BerriAI/litellm/pull/4749
2024-07-19 19:39:00 -07:00
Krrish Dholakia
e45956d77e fix(utils.py): fix get_llm_provider to support dynamic params for openai-compatible providers 2024-07-19 19:36:31 -07:00
Krrish Dholakia
e2d275f1b7 fix(utils.py): add exception mapping for bedrock image internal server error 2024-07-19 19:30:41 -07:00
Krrish Dholakia
4de19cb116 test(test_router_timeout.py): fix test 2024-07-19 19:00:55 -07:00
Krrish Dholakia
9e098326d0 test: skip duplicate test 2024-07-19 18:51:50 -07:00
Krrish Dholakia
99aa311083 fix(user_api_key_auth.py): update team values in token cache if refreshed more recently 2024-07-19 17:35:59 -07:00
Krrish Dholakia
35e640076b fix(user_api_key_auth.py): update valid token cache with updated team object cache 2024-07-19 17:06:49 -07:00
Ishaan Jaff
1797021d53 ci/cd run again 2024-07-19 14:05:22 -07:00
Ishaan Jaff
2e766a7b1f ci/cd run again 2024-07-19 08:25:56 -07:00
Ishaan Jaff
fa26d3f96f fix test 2024-07-18 22:40:51 -07:00
Ishaan Jaff
52d0f6a808 control using enable_tag_filtering 2024-07-18 22:40:51 -07:00
Ishaan Jaff
ad46e6a61f router - refactor to tag based routing 2024-07-18 22:40:51 -07:00
Krrish Dholakia
db3063d3d3 test: fix test 2024-07-18 22:40:51 -07:00
Krrish Dholakia
f2401d6d5e feat(vertex_ai_anthropic.py): support response_schema for vertex ai anthropic calls
allows passing response_schema for anthropic calls. supports schema validation.
2024-07-18 22:40:35 -07:00
Ishaan Jaff
f04397e19a
Merge pull request #4789 from BerriAI/litellm_router_refactor
[Feat-Router] - Tag based routing
2024-07-18 22:19:18 -07:00
Krrish Dholakia
a0ac3e3c7d test: fix test 2024-07-18 22:05:47 -07:00
Ishaan Jaff
331e2bbc17 fix test 2024-07-18 21:49:36 -07:00
Krish Dholakia
967964a51c
Merge branch 'main' into litellm_anthropic_response_schema_support 2024-07-18 20:40:16 -07:00
Ishaan Jaff
f8bdfe7cc3 fix test amazing vertex medlm 2024-07-18 20:35:14 -07:00
Ishaan Jaff
59d599d5fd test adding free / paid tier to metadata 2024-07-18 20:35:14 -07:00
Ishaan Jaff
0e70b5df14 router - use free paid tier routing 2024-07-18 20:35:14 -07:00
Ishaan Jaff
08adda7091 control using enable_tag_filtering 2024-07-18 19:39:04 -07:00