Krish Dholakia
11f85d883f
LiteLLM Minor Fixes + Improvements ( #5474 )
...
* feat(proxy/_types.py): add lago billing to callbacks ui
Closes https://github.com/BerriAI/litellm/issues/5472
* fix(anthropic.py): return anthropic prompt caching information
Fixes https://github.com/BerriAI/litellm/issues/5364
* feat(bedrock/chat.py): support 'json_schema' for bedrock models
Closes https://github.com/BerriAI/litellm/issues/5434
* fix(bedrock/embed/embeddings.py): support async embeddings for amazon titan models
* fix: linting fixes
* fix: handle key errors
* fix(bedrock/chat.py): fix bedrock ai21 streaming object
* feat(bedrock/embed): support bedrock embedding optional params
* fix(databricks.py): fix usage chunk
* fix(internal_user_endpoints.py): apply internal user defaults, if user role updated
Fixes issue where user update wouldn't apply defaults
* feat(slack_alerting.py): provide multiple slack channels for a given alert type
multiple channels might be interested in receiving an alert for a given type
* docs(alerting.md): add multiple channel alerting to docs
2024-09-02 14:29:57 -07:00
Ishaan Jaff
91c4338f01
ci/cd run again
2024-08-30 14:03:00 -07:00
Ishaan Jaff
d77d139e95
ci/cd run again
2024-08-27 22:59:21 -07:00
Ishaan Jaff
49f537a2ea
ci/cd run again
2024-08-27 22:53:18 -07:00
Ishaan Jaff
64398fe123
fix flaky tests
2024-08-27 22:47:11 -07:00
Krrish Dholakia
d8ecf55eca
test: fix test
2024-08-27 22:44:29 -07:00
Ishaan Jaff
54638adbe0
fix palm api is deactivated by google
2024-08-27 21:08:49 -07:00
Krish Dholakia
34eb1206c6
Merge pull request #5358 from BerriAI/litellm_fix_retry_after
...
fix retry after - cooldown individual models based on their specific 'retry-after' header
2024-08-27 11:50:14 -07:00
Krrish Dholakia
30bf8a4c1d
test: fix test
2024-08-27 10:46:57 -07:00
Krrish Dholakia
87644691be
test: fix test
2024-08-27 07:14:14 -07:00
Krrish Dholakia
aedc6652d4
feat(vertex_httpx.py): support functions param for gemini google ai studio + vertex ai
...
Closes https://github.com/BerriAI/litellm/issues/5344
2024-08-26 10:59:01 -07:00
Ishaan Jaff
150c226663
ci/cd run again
2024-08-26 08:36:58 -07:00
Krrish Dholakia
5a2e54c44d
fix(huggingface_restapi.py): fix tests
2024-08-23 21:40:27 -07:00
Ishaan Jaff
56402dca02
ci/cd run again
2024-08-22 18:41:10 -07:00
Krrish Dholakia
8f306f8e41
fix(cohere_chat.py): support passing 'extra_headers'
...
Fixes https://github.com/BerriAI/litellm/issues/4709
2024-08-22 10:17:36 -07:00
Ishaan Jaff
a39eff07df
fix tg ai -deprecated model
2024-08-21 12:14:39 -07:00
Krrish Dholakia
468768f19d
test(test_completion.py): fix gemini rate limit error
2024-08-21 07:17:27 -07:00
Krrish Dholakia
8487f1cbe4
test(test_completion.py): fix test
2024-08-21 07:01:02 -07:00
Krish Dholakia
b1e9017841
Merge pull request #5284 from BerriAI/litellm_fix_azure_api_version
...
feat(azure.py): support dynamic azure api versions
2024-08-20 11:46:55 -07:00
Krish Dholakia
969b724615
Merge pull request #5296 from BerriAI/litellm_azure_json_schema_support
...
feat(azure.py): support 'json_schema' for older models
2024-08-20 11:41:38 -07:00
Krish Dholakia
85c5d4f8c2
Merge branch 'main' into litellm_fix_azure_api_version
2024-08-20 11:40:53 -07:00
Ishaan Jaff
ca4b837062
ci/cd run again
2024-08-19 21:00:38 -07:00
Krrish Dholakia
d08479b52c
feat(azure.py): support dynamic api versions
...
Closes https://github.com/BerriAI/litellm/issues/5228
2024-08-19 12:17:43 -07:00
Krrish Dholakia
c5d1899940
feat(Support-pass-through-for-bedrock-endpoints): Allows pass-through support for bedrock endpoints
2024-08-17 17:57:43 -07:00
Krrish Dholakia
afcebac8ed
feat(azure.py): support 'json_schema' for older models
...
Converts the json schema input to a tool call, allows the call to still work on older azure models
2024-08-17 16:31:13 -07:00
Ishaan Jaff
7fa0539890
fix sagemaker tests
2024-08-15 18:34:20 -07:00
Ishaan Jaff
d0bdafa49c
run mock tests for test_completion_sagemaker
2024-08-15 14:49:21 -07:00
Krish Dholakia
bda1ee16a9
Merge branch 'main' into litellm_azure_ai_openai_support
2024-08-14 17:53:27 -07:00
Ishaan Jaff
d3bdfac7a2
Merge pull request #5210 from BerriAI/litellm_add_prompt_caching_support
...
[Feat] Add Anthropic API Prompt Caching Support
2024-08-14 17:43:01 -07:00
Ishaan Jaff
b17437e7b1
move claude prompt caching to diff file
2024-08-14 16:28:12 -07:00
Ishaan Jaff
0290b15333
add test for caching tool calls
2024-08-14 16:19:14 -07:00
Ishaan Jaff
30f24f6940
fix bedrock test
2024-08-14 15:27:20 -07:00
Ishaan Jaff
14bb0c670c
test test_anthropic_api_prompt_caching_basic
2024-08-14 15:06:10 -07:00
Ishaan Jaff
c14a432607
test amnthropic prompt caching
2024-08-14 14:59:46 -07:00
Krrish Dholakia
2f47348d8e
fix(factory.py): support assistant messages as a list of dictionaries - cohere messages api
...
Fixes https://github.com/BerriAI/litellm/pull/5121
2024-08-14 14:19:59 -07:00
Krrish Dholakia
3026e69926
fix(utils.py): support calling openai models via azure_ai/
2024-08-14 13:41:04 -07:00
Ishaan Jaff
55d6b3c234
fix ci/cd pipeline
2024-08-13 20:33:33 -07:00
Ishaan Jaff
e55c70e612
ci/cd run again
2024-08-09 19:13:52 -07:00
Krrish Dholakia
df4e84e14e
build(test_completion.py): ci/cd run again
2024-08-09 12:28:26 -07:00
Krrish Dholakia
8637988bc0
fix(huggingface_restapi.py): support passing 'wait_for_model' param on completion calls
2024-08-09 09:25:19 -07:00
Ishaan Jaff
1a4fae923c
handle anthropic internal server errors
2024-08-08 19:14:31 -07:00
Krrish Dholakia
35f08ece79
fix(factory.py): handle openai function message having tool call id
2024-08-08 17:06:50 -07:00
Krrish Dholakia
44b6036560
test(test_completion.py): fix merge error
2024-08-07 20:31:38 -07:00
Krish Dholakia
7d28b6ebc3
Merge branch 'main' into litellm_personal_user_budgets
2024-08-07 19:59:50 -07:00
Ishaan Jaff
6331bd6b4f
run that ci cd again
2024-08-07 18:47:11 -07:00
Ishaan Jaff
08fb9faae5
run that ci/cd again
2024-08-07 18:25:52 -07:00
Ishaan Jaff
fa0fa13b28
fix test for wildcard routing
2024-08-07 16:41:00 -07:00
Krrish Dholakia
afd89c8105
test(test_completion.py): handle gemini instability
2024-08-07 15:58:47 -07:00
Ishaan Jaff
21602ea703
ci/cd run again
2024-08-07 15:44:54 -07:00
Ishaan Jaff
ee6477e1ac
fix - someone resolved a merge conflict badly
2024-08-07 15:23:15 -07:00
