Commit graph

14113 commits

Author SHA1 Message Date
James Braza
a30157d659 Ran 'poetry lock --no-update' 2024-07-02 13:02:07 -04:00
Krrish Dholakia
79670ab82e fix(main.py): get the region name from boto3 client if dynamic var not set 2024-07-02 09:24:07 -07:00
Krrish Dholakia
5aae2313f3 fix(aws_secret_manager.py): fix string replace 2024-07-02 00:42:12 -07:00
Krish Dholakia
4ab83f0f46
Merge pull request #4497 from BerriAI/litellm_disable_cooldowns
fix(router.py): disable cooldowns
2024-07-01 23:10:18 -07:00
Krish Dholakia
011e14eb08
Merge branch 'main' into litellm_disable_cooldowns 2024-07-01 23:10:10 -07:00
Ishaan Jaff
38770da2f6 docs prometheus tracking x-remaining tokens 2024-07-01 22:45:33 -07:00
Ishaan Jaff
5f04ef14a6 doc prometheus tracking 2024-07-01 22:41:52 -07:00
Ishaan Jaff
e2a2c2bde1 ci/cd run again 2024-07-01 21:36:30 -07:00
Ishaan Jaff
4cb098661a bump: version 1.41.2 → 1.41.3 2024-07-01 21:35:52 -07:00
Ishaan Jaff
4bb418acf3
Merge pull request #4504 from BerriAI/litellm_fix_exception_provider_not_known
fix exception provider not known
2024-07-01 21:22:20 -07:00
Ishaan Jaff
665d8fb250 test - test_azure_embedding_exceptions 2024-07-01 21:19:47 -07:00
Ishaan Jaff
402799c8db
Merge pull request #4503 from BerriAI/litellm_log_remaining_rate_limit_prometheus
[Feat-Enterprise]  log `"x-ratelimit-remaining-tokens"` and `"x-ratelimit-remaining-requests"` on prometheus
2024-07-01 21:11:42 -07:00
Ishaan Jaff
1c194f0275
Merge pull request #4501 from BerriAI/litellm_return_Response_headers
[Feat] Return Response headers for OpenAI / Azure OpenAI when `litellm.return_response_headers=True`
2024-07-01 21:11:10 -07:00
Ishaan Jaff
fcf65d5215 fix exception provider not known 2024-07-01 21:05:37 -07:00
Ishaan Jaff
4033302656 feat - return headers for openai audio transcriptions 2024-07-01 20:27:27 -07:00
Ishaan Jaff
568245b5c0 feat - set response headers in azure requests 2024-07-01 20:12:39 -07:00
Ishaan Jaff
c37d45d556 feat - prometheus log remaining headers 2024-07-01 20:00:47 -07:00
Ishaan Jaff
04a975d486 feat - add response_headers in litellm_logging_obj 2024-07-01 17:25:15 -07:00
Krrish Dholakia
b761ce9dd1 fix(s3.py): fix s3 path logging on proxy 2024-07-01 17:22:31 -07:00
Ishaan Jaff
140f7fe254 return azure response headers 2024-07-01 17:09:06 -07:00
Ishaan Jaff
48946f7528 fix config 2024-07-01 17:02:15 -07:00
Ishaan Jaff
4b7feb3261 feat - return response headers for async openai requests 2024-07-01 17:01:42 -07:00
Krrish Dholakia
a5439a621b docs(debugging.md): add docs on debugging common errors 2024-07-01 15:13:19 -07:00
Krrish Dholakia
051dfee421 docs(routing.md): add docs on how to disable cooldowns 2024-07-01 15:05:38 -07:00
Krrish Dholakia
ea74e01813 fix(router.py): disable cooldowns
allow admin to disable model cooldowns
2024-07-01 15:03:10 -07:00
Krrish Dholakia
bfab76a810 docs(configs.md): add wildcard model name to docs 2024-07-01 14:11:45 -07:00
Krrish Dholakia
223494a0e0 fix(aws_secret_manager.py): accept 'aws_kms' being in the key name 2024-07-01 13:46:20 -07:00
Krrish Dholakia
a389f6bff4 fix(core_helpers.py): map vertex ai 'RECITATION' finish reason to 'content_filter'
Fixes https://github.com/BerriAI/litellm/issues/4491
2024-07-01 12:48:56 -07:00
Krrish Dholakia
4c95782f74 fix(utils.py): fix openrouter tool calling params 2024-07-01 08:25:29 -07:00
Krrish Dholakia
5e521bd36e fix(utils.py): fix openrouter params
Fixes https://github.com/BerriAI/litellm/issues/4488
2024-07-01 08:24:06 -07:00
Krish Dholakia
49a72ffb51
Merge pull request #4486 from ubirdio/vertex-ai-beta-fix
Fix usage of parameter-based credentials when using vertex_ai_beta route
2024-07-01 08:15:49 -07:00
Krrish Dholakia
be3c98bc16 fix(main.py): copy messages - prevent modifying user input
Fixes https://github.com/BerriAI/litellm/discussions/4489
2024-07-01 08:14:46 -07:00
Ishaan Jaff
c31156e5e6
Merge pull request #4484 from Manouchehri/add-me-converse-shoes-1
fix(bedrock_httpx.py): Add anthropic.claude-3-5-sonnet-20240620-v1:0 to converse list
2024-07-01 07:37:19 -07:00
Ishaan Jaff
19464b2521 fix openai compatible doc quote 2024-07-01 07:36:06 -07:00
David Manouchehri
9a74364baa
fix(bedrock_httpx.py): Add anthropic.claude-3-5-sonnet-20240620-v1:0 to the converse list. 2024-07-01 14:18:23 +00:00
Ishaan Jaff
9be176140d
Merge pull request #4485 from sauravpanda/main
Update azure_ai.md
2024-07-01 07:15:59 -07:00
Indigo
d17816dd20
Fix usage of parameter-based credentials when using vertex_ai_beta route 2024-07-01 15:54:02 +10:00
Saurav Panda
afb615b5c9
Update azure_ai.md
Invalid key name for azure openai
2024-07-01 00:41:51 -04:00
Krrish Dholakia
46fe089204 docs(vertex.md): add vertex json schema details to docs 2024-06-30 09:14:43 -07:00
Ishaan Jaff
8b1b79e15b ci/cd run again 2024-06-29 20:56:29 -07:00
Ishaan Jaff
d25b079caf fix img gen test 2024-06-29 20:54:22 -07:00
Krish Dholakia
11338c409d
Merge pull request #4482 from BerriAI/litellm_vertex_anthropic_json_mode
Vertex anthropic json mode
2024-06-29 20:18:47 -07:00
Krish Dholakia
06eb361820
Merge branch 'main' into litellm_vertex_anthropic_json_mode 2024-06-29 20:18:41 -07:00
Krish Dholakia
58d0330cd7
Merge pull request #4478 from BerriAI/litellm_support_response_schema_param_vertex_ai_old
feat(vertex_httpx.py): support the 'response_schema' param for older vertex ai models
2024-06-29 20:17:39 -07:00
Ishaan Jaff
eac42bb473 ci/cd run again 2024-06-29 20:13:32 -07:00
Ishaan Jaff
bde34c79d7 bump: version 1.41.1 → 1.41.2 2024-06-29 20:03:17 -07:00
Ishaan Jaff
4910029eeb
Merge pull request #4479 from BerriAI/litellm_fix_admin_ui_login_issue
[Fix] Admin UI - fix error users we're seeing when logging in (use correct  user_id  when creating key for admin ui)
2024-06-29 20:00:45 -07:00
Krrish Dholakia
2ab6f2be63 style: trigger new build 2024-06-29 19:58:02 -07:00
Krrish Dholakia
1ec0c71a14 ci(config.yml): add jsonschema to ci/cd 2024-06-29 19:58:02 -07:00
Krrish Dholakia
824e0c5e39 build(pyproject.toml): remove ijson dep. add jsonschema dep. 2024-06-29 19:58:01 -07:00