phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 03:34:10 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
13373 commits 2497 branches 897 tags 550 MiB
Commit graph

1113 commits

Author SHA1 Message Date
Krrish Dholakia
cc1ec55e5b fix(vertex_httpx.py): check if model supports system messages before sending separately 2024-06-17 17:32:38 -07:00
Krish Dholakia
18d9dcc4db Merge branch 'main' into litellm_gemini_refactoring 2024-06-17 17:28:50 -07:00
Krrish Dholakia
79c96030b8 docs(gemini.py): add refactor note to code 
\
 2024-06-17 16:51:19 -07:00
Ishaan Jaff
952b9fa482 Merge pull request #4247 from BerriAI/litellm_add_codestral_fim 
[Feat] Add Codestral FIM API
 2024-06-17 16:35:47 -07:00
Ishaan Jaff
c1981f5534 fix text completion response from codestral 2024-06-17 15:01:26 -07:00
Krrish Dholakia
d4ce17b87c fix(vertex_httpx.py): support async streaming for google ai studio gemini 2024-06-17 14:59:30 -07:00
Ishaan Jaff
9641533709 test - codestral streaming 2024-06-17 14:17:25 -07:00
Ishaan Jaff
87386b5cc3 feat - add fim codestral api 2024-06-17 13:46:03 -07:00
Krrish Dholakia
e31465d940 feat(main.py): initial commit - refactoring google ai studio to just use vertex httpx 
Uses the same calling logic for google ai studio/vertex ai. Simplifies logic, gives google ai studio integration all of vertex
ai features.
 2024-06-17 13:31:46 -07:00
Ishaan Jaff
2a5eabcceb feat add text completion config for mistral text 2024-06-17 12:48:46 -07:00
Krrish Dholakia
71a2fabc6a fix(bedrock.py): support custom prompt templates for all providers 
Fixes https://github.com/BerriAI/litellm/issues/4239
 2024-06-17 08:28:46 -07:00
Krish Dholakia
fa2d8bc794 Merge pull request #4216 from BerriAI/litellm_refactor_logging 
refactor(utils.py): Cut down utils.py to <10k lines.
 2024-06-15 15:19:42 -07:00
Krrish Dholakia
7de77ab677 fix(init.py): fix imports 2024-06-15 11:31:09 -07:00
Krrish Dholakia
9d7f5d503c refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines. 
Easier debugging

 Reference: https://github.com/BerriAI/litellm/issues/4206
 2024-06-15 10:57:20 -07:00
Ishaan Jaff
113b7e34ce refactor to use _get_async_httpx_client 2024-06-14 21:30:42 -07:00
Ishaan Jaff
8669a0e0be fix cached httpx client 2024-06-14 21:23:13 -07:00
Ishaan Jaff
d19efd62cf fix async client 2024-06-14 21:12:32 -07:00
Ishaan Jaff
56cd405972 cache anthropic httpx client 2024-06-14 20:55:40 -07:00
Krrish Dholakia
e2a3895dfc fix(http_handler.py): add retry logic on httpx.remoteprotocolerror 2024-06-13 14:05:29 -07:00
Krrish Dholakia
ed213ffdee fix(http_handler.py): retry on httpx connection errors 
Fixes https://github.com/BerriAI/litellm/issues/4097
 2024-06-13 12:54:58 -07:00
Krrish Dholakia
ab4b1d931b fix(vertex_httpx.py): support json schema 2024-06-12 21:46:43 -07:00
Krish Dholakia
50c74fce49 Merge branch 'main' into litellm_vertex_completion_httpx 2024-06-12 21:19:22 -07:00
Krrish Dholakia
e60b0e96e4 fix(vertex_httpx.py): add function calling support to httpx route 2024-06-12 21:11:00 -07:00
Ishaan Jaff
994b88118b feat - add azure ai studio models on litellm ui 2024-06-12 20:28:16 -07:00
Krrish Dholakia
afebf867f6 fix(vertex_httpx.py): support async completion calls 2024-06-12 20:15:03 -07:00
Krrish Dholakia
1dac2aa59f fix(vertex_httpx.py): support streaming via httpx client 2024-06-12 19:55:14 -07:00
Ishaan Jaff
2603f9fbca Merge pull request #4158 from BerriAI/litellm_fix_clarifai 
[Fix] Add ClarifAI support for LiteLLM Proxy
 2024-06-12 17:17:16 -07:00
Krrish Dholakia
29169b3039 feat(vertex_httpx.py): Moving to call vertex ai via httpx (instead of their sdk). Allows us to support all their api updates. 2024-06-12 16:47:00 -07:00
Ishaan Jaff
ffba5c6299 feat - add aysnc support for clarif ai 2024-06-12 16:33:56 -07:00
Ishaan Jaff
dbdf102a01 feat - add mistral embedding config 2024-06-12 15:00:00 -07:00
Ishaan Jaff
4d30182720 Merge pull request #4152 from BerriAI/litellm_support_vertex_text_input 
[Feat] Support `task_type`, `auto_truncate` params
 2024-06-12 13:25:45 -07:00
Krish Dholakia
58fa6e0cc8 Merge pull request #3861 from Manouchehri/aks-oidc-1852 
feat(util.py/azure.py): Add OIDC support when running LiteLLM on Azure + Azure Upstream caching
 2024-06-12 12:47:08 -07:00
Krish Dholakia
2d701e6e63 Merge pull request #3712 from Manouchehri/oidc-bedrock-httpx-caching-part-1 
Add IAM cred caching for OIDC flow
 2024-06-12 12:44:58 -07:00
Ishaan Jaff
ccfc988d71 vertex embeddings optional_params 2024-06-12 10:56:36 -07:00
Ishaan Jaff
910188df8d feat - support vertex text input 2024-06-12 10:11:44 -07:00
Ishaan Jaff
e4b36d71cf feat - support vertex ai dimensions 2024-06-12 09:29:51 -07:00
David Manouchehri
0a07b26b74 fix(bedrock_httpx.py): Add IAM caching for converse flow. 2024-06-11 17:00:18 +00:00
David Manouchehri
de5b85f309 fix(bedrock_httpx.py): Fix STS region endpoint for converse flow. 2024-06-11 16:35:03 +00:00
David Manouchehri
52dd823d22 feat(azure.py): Add Azure AD cred caching for OIDC flow. 2024-06-11 15:54:44 +00:00
David Manouchehri
41b6c58ddc feat(util.py/azure.py): Add OIDC support when running in Azure Kubernetes Service (AKS). 2024-06-11 15:54:34 +00:00
David Manouchehri
20e8df66bd fix(bedrock_httpx.py): Fix STS region endpoint. 2024-06-11 15:43:33 +00:00
David Manouchehri
6fa14f9ff2 feat(bedrock_httpx.py): Add AWS IAM cred caching for OIDC flow. 2024-06-11 15:43:15 +00:00
Krrish Dholakia
74a27df9ba feat(utils.py): bump tiktoken dependency to 0.7.0 
adds support for gpt-4o token counting
 2024-06-10 21:21:23 -07:00
Krish Dholakia
3a31e8011a Merge pull request #4106 from BerriAI/litellm_anthropic_bedrock_tool_calling_fix 
fix(bedrock_httpx.py): fix tool calling for anthropic bedrock calls w/ streaming
 2024-06-10 20:21:16 -07:00
Krrish Dholakia
5056fd5778 fix(bedrock_httpx.py): returning correct finish reason on streaming completion 2024-06-10 14:47:49 -07:00
Krrish Dholakia
2d95eaa5bc fix(bedrock_httpx.py): fix tool calling for anthropic bedrock calls w/ streaming 
Fixes https://github.com/BerriAI/litellm/issues/4091
 2024-06-10 14:20:25 -07:00
Krrish Dholakia
39ee6be477 fix(utils.py): improved predibase exception mapping 
adds unit testing + better coverage for predibase errors
 2024-06-08 14:32:43 -07:00
Krrish Dholakia
cbd39d665d fix(bedrock_httpx.py): fix post call success logging 2024-06-07 14:47:01 -07:00
Krish Dholakia
8f1e3aab7b Merge pull request #4055 from UsableMachines/additional-gemini-types 
Fix to support all file types supported by Gemini
 2024-06-07 13:24:06 -07:00
Krrish Dholakia
672dcf0c6f fix(factory.py): handle bedrock claude image url's 2024-06-07 10:04:03 -07:00