Ishaan Jaff
9eb35e47ee
run ci/cd on main
2024-09-05 15:39:30 -07:00
Ishaan Jaff
4e392ebdb2
Merge pull request #5484 from BerriAI/litellm_fix_redis
...
fix proxy server - always read redis for rate limiting logic
2024-09-04 12:39:15 -07:00
Krrish Dholakia
e7855329e8
style: ci/cd run again
2024-09-04 08:32:35 -07:00
Ishaan Jaff
f5122e0325
ci/cd run again
2024-09-04 07:41:08 -07:00
Krish Dholakia
be3c7b401e
LiteLLM Minor fixes + improvements (08/03/2024) ( #5488 )
...
* fix(internal_user_endpoints.py): set budget_reset_at for /user/update
* fix(vertex_and_google_ai_studio_gemini.py): handle accumulated json
Fixes https://github.com/BerriAI/litellm/issues/5479
* fix(vertex_ai_and_gemini.py): fix assistant message function call when content is not None
Fixes https://github.com/BerriAI/litellm/issues/5490
* fix(proxy_server.py): generic state uuid for okta sso
* fix(lago.py): improve debug logs
Debugging for https://github.com/BerriAI/litellm/issues/5477
* docs(bedrock.md): add bedrock cross-region inferencing to docs
* fix(azure.py): return azure response headers on aembedding call
* feat(azure.py): return azure response headers for `/audio/transcription`
* fix(types/utils.py): standardize deepseek / anthropic prompt caching usage information
Closes https://github.com/BerriAI/litellm/issues/5285
* docs(usage.md): add docs on litellm usage object
* test(test_completion.py): mark flaky test
2024-09-03 21:21:34 -07:00
Ishaan Jaff
666dd6aca2
Merge pull request #5478 from BerriAI/litellm_Add_ai21
...
[Feat] Add AI21 /chat API
2024-09-02 16:20:37 -07:00
Krish Dholakia
f9e6507cd1
LiteLLM Minor Fixes + Improvements ( #5474 )
...
* feat(proxy/_types.py): add lago billing to callbacks ui
Closes https://github.com/BerriAI/litellm/issues/5472
* fix(anthropic.py): return anthropic prompt caching information
Fixes https://github.com/BerriAI/litellm/issues/5364
* feat(bedrock/chat.py): support 'json_schema' for bedrock models
Closes https://github.com/BerriAI/litellm/issues/5434
* fix(bedrock/embed/embeddings.py): support async embeddings for amazon titan models
* fix: linting fixes
* fix: handle key errors
* fix(bedrock/chat.py): fix bedrock ai21 streaming object
* feat(bedrock/embed): support bedrock embedding optional params
* fix(databricks.py): fix usage chunk
* fix(internal_user_endpoints.py): apply internal user defaults, if user role updated
Fixes issue where user update wouldn't apply defaults
* feat(slack_alerting.py): provide multiple slack channels for a given alert type
multiple channels might be interested in receiving an alert for a given type
* docs(alerting.md): add multiple channel alerting to docs
2024-09-02 14:29:57 -07:00
Ishaan Jaff
d4f77832c0
docs add docs on supported params
2024-09-02 12:39:07 -07:00
Ishaan Jaff
93650db380
fix linting
2024-09-02 12:15:14 -07:00
Ishaan Jaff
263e283126
add ai21 model test
2024-09-02 12:14:13 -07:00
Ishaan Jaff
ae25c5695f
add streaming test for ai21
2024-09-02 11:58:15 -07:00
Ishaan Jaff
0874885f04
add all ai21 params
2024-09-02 11:54:40 -07:00
Ishaan Jaff
0970475a3b
test ai21
2024-09-02 11:47:48 -07:00
Ishaan Jaff
69dea613ca
ci/cd run again
2024-08-30 14:03:00 -07:00
Ishaan Jaff
f1147696a3
ci/cd run again
2024-08-27 22:59:21 -07:00
Ishaan Jaff
c8fc5c44e1
ci/cd run again
2024-08-27 22:53:18 -07:00
Ishaan Jaff
3966c545b4
fix flaky tests
2024-08-27 22:47:11 -07:00
Krrish Dholakia
640e5d0dc9
test: fix test
2024-08-27 22:44:29 -07:00
Ishaan Jaff
1b04380540
fix palm api is deactivated by google
2024-08-27 21:08:49 -07:00
Krish Dholakia
415abc86c6
Merge pull request #5358 from BerriAI/litellm_fix_retry_after
...
fix retry after - cooldown individual models based on their specific 'retry-after' header
2024-08-27 11:50:14 -07:00
Krrish Dholakia
18b67a455e
test: fix test
2024-08-27 10:46:57 -07:00
Krrish Dholakia
b0f01e5b95
test: fix test
2024-08-27 07:14:14 -07:00
Krrish Dholakia
d13d2e8a62
feat(vertex_httpx.py): support functions param for gemini google ai studio + vertex ai
...
Closes https://github.com/BerriAI/litellm/issues/5344
2024-08-26 10:59:01 -07:00
Ishaan Jaff
735eb041b9
ci/cd run again
2024-08-26 08:36:58 -07:00
Krrish Dholakia
8c5ff150f6
fix(huggingface_restapi.py): fix tests
2024-08-23 21:40:27 -07:00
Ishaan Jaff
18cd905a1f
ci/cd run again
2024-08-22 18:41:10 -07:00
Krrish Dholakia
11bfc1dca7
fix(cohere_chat.py): support passing 'extra_headers'
...
Fixes https://github.com/BerriAI/litellm/issues/4709
2024-08-22 10:17:36 -07:00
Ishaan Jaff
9dbd1b089b
fix tg ai -deprecated model
2024-08-21 12:14:39 -07:00
Krrish Dholakia
8406016096
test(test_completion.py): fix gemini rate limit error
2024-08-21 07:17:27 -07:00
Krrish Dholakia
a6ee1e04fe
test(test_completion.py): fix test
2024-08-21 07:01:02 -07:00
Krish Dholakia
ad1e327208
Merge pull request #5284 from BerriAI/litellm_fix_azure_api_version
...
feat(azure.py): support dynamic azure api versions
2024-08-20 11:46:55 -07:00
Krish Dholakia
02eb6455b2
Merge pull request #5296 from BerriAI/litellm_azure_json_schema_support
...
feat(azure.py): support 'json_schema' for older models
2024-08-20 11:41:38 -07:00
Krish Dholakia
409306b266
Merge branch 'main' into litellm_fix_azure_api_version
2024-08-20 11:40:53 -07:00
Ishaan Jaff
8e7bcb42a6
ci/cd run again
2024-08-19 21:00:38 -07:00
Krrish Dholakia
49416e121c
feat(azure.py): support dynamic api versions
...
Closes https://github.com/BerriAI/litellm/issues/5228
2024-08-19 12:17:43 -07:00
Krrish Dholakia
663a0c1b83
feat(Support-pass-through-for-bedrock-endpoints): Allows pass-through support for bedrock endpoints
2024-08-17 17:57:43 -07:00
Krrish Dholakia
7ec7c9970b
feat(azure.py): support 'json_schema' for older models
...
Converts the json schema input to a tool call, allows the call to still work on older azure models
2024-08-17 16:31:13 -07:00
Ishaan Jaff
40dc27e72c
fix sagemaker tests
2024-08-15 18:34:20 -07:00
Ishaan Jaff
2c9e3e9bd7
run mock tests for test_completion_sagemaker
2024-08-15 14:49:21 -07:00
Krish Dholakia
435d39bb24
Merge branch 'main' into litellm_azure_ai_openai_support
2024-08-14 17:53:27 -07:00
Ishaan Jaff
1f631606a5
Merge pull request #5210 from BerriAI/litellm_add_prompt_caching_support
...
[Feat] Add Anthropic API Prompt Caching Support
2024-08-14 17:43:01 -07:00
Ishaan Jaff
76a5f5d433
move claude prompt caching to diff file
2024-08-14 16:28:12 -07:00
Ishaan Jaff
e0ff4823d0
add test for caching tool calls
2024-08-14 16:19:14 -07:00
Ishaan Jaff
fccc6dc928
fix bedrock test
2024-08-14 15:27:20 -07:00
Ishaan Jaff
96f9655a02
test test_anthropic_api_prompt_caching_basic
2024-08-14 15:06:10 -07:00
Ishaan Jaff
69a640e9c4
test amnthropic prompt caching
2024-08-14 14:59:46 -07:00
Krrish Dholakia
9b46ec05b0
fix(factory.py): support assistant messages as a list of dictionaries - cohere messages api
...
Fixes https://github.com/BerriAI/litellm/pull/5121
2024-08-14 14:19:59 -07:00
Krrish Dholakia
583a3b330d
fix(utils.py): support calling openai models via azure_ai/
2024-08-14 13:41:04 -07:00
Ishaan Jaff
a37f087b62
fix ci/cd pipeline
2024-08-13 20:33:33 -07:00
Ishaan Jaff
3320d76dd4
ci/cd run again
2024-08-09 19:13:52 -07:00
