Ishaan Jaff
edac75b824
run again
2024-09-05 15:17:17 -07:00
Ishaan Jaff
935dba4470
Merge pull request #5484 from BerriAI/litellm_fix_redis
...
fix proxy server - always read redis for rate limiting logic
2024-09-04 12:39:15 -07:00
Krrish Dholakia
2eca308069
style: ci/cd run again
2024-09-04 08:32:35 -07:00
Ishaan Jaff
0fbf8f9b74
ci/cd run again
2024-09-04 07:41:08 -07:00
Krish Dholakia
8eb7cb5300
LiteLLM Minor fixes + improvements (08/03/2024) ( #5488 )
...
* fix(internal_user_endpoints.py): set budget_reset_at for /user/update
* fix(vertex_and_google_ai_studio_gemini.py): handle accumulated json
Fixes https://github.com/BerriAI/litellm/issues/5479
* fix(vertex_ai_and_gemini.py): fix assistant message function call when content is not None
Fixes https://github.com/BerriAI/litellm/issues/5490
* fix(proxy_server.py): generic state uuid for okta sso
* fix(lago.py): improve debug logs
Debugging for https://github.com/BerriAI/litellm/issues/5477
* docs(bedrock.md): add bedrock cross-region inferencing to docs
* fix(azure.py): return azure response headers on aembedding call
* feat(azure.py): return azure response headers for `/audio/transcription`
* fix(types/utils.py): standardize deepseek / anthropic prompt caching usage information
Closes https://github.com/BerriAI/litellm/issues/5285
* docs(usage.md): add docs on litellm usage object
* test(test_completion.py): mark flaky test
2024-09-03 21:21:34 -07:00
Ishaan Jaff
dc1b0ec182
Merge pull request #5478 from BerriAI/litellm_Add_ai21
...
[Feat] Add AI21 /chat API
2024-09-02 16:20:37 -07:00
Krish Dholakia
11f85d883f
LiteLLM Minor Fixes + Improvements ( #5474 )
...
* feat(proxy/_types.py): add lago billing to callbacks ui
Closes https://github.com/BerriAI/litellm/issues/5472
* fix(anthropic.py): return anthropic prompt caching information
Fixes https://github.com/BerriAI/litellm/issues/5364
* feat(bedrock/chat.py): support 'json_schema' for bedrock models
Closes https://github.com/BerriAI/litellm/issues/5434
* fix(bedrock/embed/embeddings.py): support async embeddings for amazon titan models
* fix: linting fixes
* fix: handle key errors
* fix(bedrock/chat.py): fix bedrock ai21 streaming object
* feat(bedrock/embed): support bedrock embedding optional params
* fix(databricks.py): fix usage chunk
* fix(internal_user_endpoints.py): apply internal user defaults, if user role updated
Fixes issue where user update wouldn't apply defaults
* feat(slack_alerting.py): provide multiple slack channels for a given alert type
multiple channels might be interested in receiving an alert for a given type
* docs(alerting.md): add multiple channel alerting to docs
2024-09-02 14:29:57 -07:00
Ishaan Jaff
d86abb4abe
docs add docs on supported params
2024-09-02 12:39:07 -07:00
Ishaan Jaff
93d556dbeb
fix linting
2024-09-02 12:15:14 -07:00
Ishaan Jaff
b1f3f27342
add ai21 model test
2024-09-02 12:14:13 -07:00
Ishaan Jaff
02c415a123
add streaming test for ai21
2024-09-02 11:58:15 -07:00
Ishaan Jaff
e1dacde1ec
add all ai21 params
2024-09-02 11:54:40 -07:00
Ishaan Jaff
59a32e56ce
test ai21
2024-09-02 11:47:48 -07:00
Ishaan Jaff
91c4338f01
ci/cd run again
2024-08-30 14:03:00 -07:00
Ishaan Jaff
d77d139e95
ci/cd run again
2024-08-27 22:59:21 -07:00
Ishaan Jaff
49f537a2ea
ci/cd run again
2024-08-27 22:53:18 -07:00
Ishaan Jaff
64398fe123
fix flaky tests
2024-08-27 22:47:11 -07:00
Krrish Dholakia
d8ecf55eca
test: fix test
2024-08-27 22:44:29 -07:00
Ishaan Jaff
54638adbe0
fix palm api is deactivated by google
2024-08-27 21:08:49 -07:00
Krish Dholakia
34eb1206c6
Merge pull request #5358 from BerriAI/litellm_fix_retry_after
...
fix retry after - cooldown individual models based on their specific 'retry-after' header
2024-08-27 11:50:14 -07:00
Krrish Dholakia
30bf8a4c1d
test: fix test
2024-08-27 10:46:57 -07:00
Krrish Dholakia
87644691be
test: fix test
2024-08-27 07:14:14 -07:00
Krrish Dholakia
aedc6652d4
feat(vertex_httpx.py): support functions param for gemini google ai studio + vertex ai
...
Closes https://github.com/BerriAI/litellm/issues/5344
2024-08-26 10:59:01 -07:00
Ishaan Jaff
150c226663
ci/cd run again
2024-08-26 08:36:58 -07:00
Krrish Dholakia
5a2e54c44d
fix(huggingface_restapi.py): fix tests
2024-08-23 21:40:27 -07:00
Ishaan Jaff
56402dca02
ci/cd run again
2024-08-22 18:41:10 -07:00
Krrish Dholakia
8f306f8e41
fix(cohere_chat.py): support passing 'extra_headers'
...
Fixes https://github.com/BerriAI/litellm/issues/4709
2024-08-22 10:17:36 -07:00
Ishaan Jaff
a39eff07df
fix tg ai -deprecated model
2024-08-21 12:14:39 -07:00
Krrish Dholakia
468768f19d
test(test_completion.py): fix gemini rate limit error
2024-08-21 07:17:27 -07:00
Krrish Dholakia
8487f1cbe4
test(test_completion.py): fix test
2024-08-21 07:01:02 -07:00
Krish Dholakia
b1e9017841
Merge pull request #5284 from BerriAI/litellm_fix_azure_api_version
...
feat(azure.py): support dynamic azure api versions
2024-08-20 11:46:55 -07:00
Krish Dholakia
969b724615
Merge pull request #5296 from BerriAI/litellm_azure_json_schema_support
...
feat(azure.py): support 'json_schema' for older models
2024-08-20 11:41:38 -07:00
Krish Dholakia
85c5d4f8c2
Merge branch 'main' into litellm_fix_azure_api_version
2024-08-20 11:40:53 -07:00
Ishaan Jaff
ca4b837062
ci/cd run again
2024-08-19 21:00:38 -07:00
Krrish Dholakia
d08479b52c
feat(azure.py): support dynamic api versions
...
Closes https://github.com/BerriAI/litellm/issues/5228
2024-08-19 12:17:43 -07:00
Krrish Dholakia
c5d1899940
feat(Support-pass-through-for-bedrock-endpoints): Allows pass-through support for bedrock endpoints
2024-08-17 17:57:43 -07:00
Krrish Dholakia
afcebac8ed
feat(azure.py): support 'json_schema' for older models
...
Converts the json schema input to a tool call, allows the call to still work on older azure models
2024-08-17 16:31:13 -07:00
Ishaan Jaff
7fa0539890
fix sagemaker tests
2024-08-15 18:34:20 -07:00
Ishaan Jaff
d0bdafa49c
run mock tests for test_completion_sagemaker
2024-08-15 14:49:21 -07:00
Krish Dholakia
bda1ee16a9
Merge branch 'main' into litellm_azure_ai_openai_support
2024-08-14 17:53:27 -07:00
Ishaan Jaff
d3bdfac7a2
Merge pull request #5210 from BerriAI/litellm_add_prompt_caching_support
...
[Feat] Add Anthropic API Prompt Caching Support
2024-08-14 17:43:01 -07:00
Ishaan Jaff
b17437e7b1
move claude prompt caching to diff file
2024-08-14 16:28:12 -07:00
Ishaan Jaff
0290b15333
add test for caching tool calls
2024-08-14 16:19:14 -07:00
Ishaan Jaff
30f24f6940
fix bedrock test
2024-08-14 15:27:20 -07:00
Ishaan Jaff
14bb0c670c
test test_anthropic_api_prompt_caching_basic
2024-08-14 15:06:10 -07:00
Ishaan Jaff
c14a432607
test amnthropic prompt caching
2024-08-14 14:59:46 -07:00
Krrish Dholakia
2f47348d8e
fix(factory.py): support assistant messages as a list of dictionaries - cohere messages api
...
Fixes https://github.com/BerriAI/litellm/pull/5121
2024-08-14 14:19:59 -07:00
Krrish Dholakia
3026e69926
fix(utils.py): support calling openai models via azure_ai/
2024-08-14 13:41:04 -07:00
Ishaan Jaff
55d6b3c234
fix ci/cd pipeline
2024-08-13 20:33:33 -07:00
Ishaan Jaff
e55c70e612
ci/cd run again
2024-08-09 19:13:52 -07:00
