Commit graph

102 commits

Author SHA1 Message Date
Krrish Dholakia
a2f6d0e9fe fix(azure.py): handle asyncio.CancelledError 2024-06-18 20:14:27 -07:00
David Manouchehri
52dd823d22 feat(azure.py): Add Azure AD cred caching for OIDC flow. 2024-06-11 15:54:44 +00:00
David Manouchehri
41b6c58ddc feat(util.py/azure.py): Add OIDC support when running in Azure Kubernetes Service (AKS). 2024-06-11 15:54:34 +00:00
Krrish Dholakia
129745da90 fix(azure.py): support dynamic drop params 2024-06-05 09:03:10 -07:00
Krrish Dholakia
8b4b783772 fix(azure.py): fix logprobs naming error
fixing string value
2024-06-05 08:54:53 -07:00
Krrish Dholakia
7728fe185b feat(assistants/main.py): support arun_thread_stream 2024-06-04 16:47:51 -07:00
Krrish Dholakia
20cb525a5c feat(assistants/main.py): add assistants api streaming support 2024-06-04 16:30:35 -07:00
Krish Dholakia
127d1457de Merge pull request #3996 from BerriAI/litellm_azure_assistants_api_support
feat(assistants/main.py): Azure Assistants API support
2024-06-03 21:05:03 -07:00
Krrish Dholakia
5b1e113c94 fix(main.py): cast to string only if var is not None 2024-06-03 19:25:59 -07:00
Krrish Dholakia
a2ba63955a feat(assistants/main.py): Closes https://github.com/BerriAI/litellm/issues/3993 2024-06-03 18:47:05 -07:00
Krrish Dholakia
594daef07a fix(utils.py): correctly instrument passing through api version in optional param check 2024-06-01 19:31:52 -07:00
Krrish Dholakia
23087295e1 fix(azure.py): support dropping 'tool_choice=required' for older azure API versions
Closes https://github.com/BerriAI/litellm/issues/3876
2024-06-01 18:44:50 -07:00
Krish Dholakia
7f64c61275 Merge pull request #3582 from BerriAI/litellm_explicit_region_name_setting
feat(router.py): allow setting model_region in litellm_params
2024-05-11 11:36:22 -07:00
Krrish Dholakia
691c185ff8 feat(router.py): support region routing for bedrock, vertex ai, watsonx 2024-05-11 11:04:00 -07:00
Krish Dholakia
997ef2e480 Merge pull request #3507 from Manouchehri/oidc-3505-part-1
Initial OIDC support (Google/GitHub/CircleCI -> Amazon Bedrock & Azure OpenAI)
2024-05-11 09:25:17 -07:00
Krish Dholakia
64ca2fde53 Merge branch 'main' into litellm_region_based_routing 2024-05-08 22:19:51 -07:00
Krrish Dholakia
0ea8222508 feat(router.py): enable filtering model group by 'allowed_model_region' 2024-05-08 22:10:17 -07:00
Krrish Dholakia
5f93cae3ff feat(proxy_server.py): return litellm version in response headers 2024-05-08 16:00:08 -07:00
David Manouchehri
ffa837eaa6 fix(azure.py): Correct invalid .get to a .post for OIDC 2024-05-07 20:01:46 +00:00
David Manouchehri
b48f95d9ef feat(azure.py): Support OIDC auth 2024-05-07 20:01:33 +00:00
Krrish Dholakia
7715a9d333 fix(bedrock.py): convert httpx.timeout to boto3 valid timeout
Closes https://github.com/BerriAI/litellm/issues/3398
2024-05-03 16:24:21 -07:00
Krrish Dholakia
ee68c0aaaa feat(utils.py): unify common auth params across azure/vertex_ai/bedrock/watsonx 2024-04-27 11:06:18 -07:00
Krrish Dholakia
5546f9f10a fix(main.py): support max retries for transcription calls 2024-04-01 18:37:53 -07:00
Krrish Dholakia
ae9eff5fc4 fix(azure.py): support cost tracking for azure/dall-e-3 2024-03-12 10:55:54 -07:00
Krrish Dholakia
b2ce963498 feat: add cost tracking + caching for transcription calls 2024-03-09 15:43:38 -08:00
Krish Dholakia
f461352908 Merge branch 'main' into litellm_load_balancing_transcription_endpoints 2024-03-08 23:08:47 -08:00
Krish Dholakia
75bc854294 Merge pull request #2401 from BerriAI/litellm_transcription_endpoints
feat(main.py): support openai transcription endpoints
2024-03-08 23:07:48 -08:00
Krrish Dholakia
7ab930f6ff fix(azure.py): add pre call logging for transcription calls 2024-03-08 22:23:21 -08:00
Krrish Dholakia
93615682fe feat(proxy_server.py): working /audio/transcription endpoint 2024-03-08 18:20:27 -08:00
Krrish Dholakia
e084b877f5 feat(azure.py): add support for calling whisper endpoints on azure 2024-03-08 13:48:38 -08:00
ishaan-jaff
6bc0694bef (fix) azure extra setting client 2024-03-08 13:44:39 -08:00
ishaan-jaff
f2c6bb9d3e (feat) set api_version for Azure 2024-03-08 13:38:29 -08:00
ishaan-jaff
079ba68197 (fix) use azure api_version 2024-03-08 13:33:58 -08:00
Krrish Dholakia
2a5a14d612 fix(utils.py): support image gen logging to langfuse 2024-02-16 16:12:52 -08:00
Krrish Dholakia
4e89be0e19 fix(azure_dall_e_2.py): handle azure not returning a 'retry-after' param 2024-01-22 12:02:02 -08:00
ishaan-jaff
118c53af26 (fix) using base_url Azure 2024-01-17 10:12:55 -08:00
ishaan-jaff
82954728a7 (feat) support base_url with /openai passed for Azure 2024-01-17 10:03:25 -08:00
ishaan-jaff
a49fa3abaf (v0) fixes for Azure GPT Vision enhancements 2024-01-17 09:57:16 -08:00
Krrish Dholakia
0e1ea4325c fix(azure.py): support health checks to text completion endpoints 2024-01-12 00:13:01 +05:30
Krrish Dholakia
556e7d4e1a fix(openai.py): fix exception raising logic 2024-01-09 11:58:30 +05:30
Krrish Dholakia
d105751643 fix(azure.py,-openai.py): raise the correct exceptions for image generation calls 2024-01-09 11:55:38 +05:30
Krrish Dholakia
807b64e68e perf(azure+openai-files): use model_dump instead of json.loads + model_dump_json 2024-01-06 15:50:05 +05:30
ishaan-jaff
70bbc2e446 (fix) azure+cf gateway, health check 2024-01-04 12:34:07 +05:30
Krrish Dholakia
b69ffb3738 fix: support dynamic timeouts for openai and azure 2023-12-30 12:14:02 +05:30
Krrish Dholakia
2285282ef8 feat(health_check.py): more detailed health check calls 2023-12-28 09:12:57 +05:30
Krrish Dholakia
db6ef70a68 fix(azure.py): raise streaming exceptions 2023-12-27 15:43:13 +05:30
Krrish Dholakia
fd5e6efb1d fix(azure.py,-openai.py): correctly raise errors if streaming calls fail 2023-12-27 15:08:37 +05:30
Krrish Dholakia
79978c44ba refactor: add black formatting 2023-12-25 14:11:20 +05:30
Krrish Dholakia
c084f04a35 fix(router.py): add support for async image generation endpoints 2023-12-21 14:38:44 +05:30
Krrish Dholakia
ee2a467708 fix(azure.py): correctly raise async exceptions 2023-12-21 12:23:07 +05:30