phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 11:43:54 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
17201 commits 2497 branches 897 tags 550 MiB
Commit graph

80 commits

Author SHA1 Message Date
Krish Dholakia
321b0961b5 fix: Minor LiteLLM Fixes + Improvements (29/08/2024) (#5436) 
* fix(model_checks.py): support returning wildcard models on `/v1/models`

Fixes https://github.com/BerriAI/litellm/issues/4903

* fix(bedrock_httpx.py): support calling bedrock via api_base

Closes https://github.com/BerriAI/litellm/pull/4587

* fix(litellm_logging.py): only leave last 4 char of gemini key unmasked

Fixes https://github.com/BerriAI/litellm/issues/5433

* feat(router.py): support setting 'weight' param for models on router

Closes https://github.com/BerriAI/litellm/issues/5410

* test(test_bedrock_completion.py): add unit test for custom api base

* fix(model_checks.py): handle no "/" in model
 2024-08-29 22:40:25 -07:00
David Manouchehri
f91232e130 (bedrock): Add new cross-region inference support for Bedrock. 2024-08-29 17:49:16 +00:00
Krrish Dholakia
722ccba323 fix(bedrock_httpx.py): support 'Auth' header as extra_header 
Fixes https://github.com/BerriAI/litellm/issues/5389#issuecomment-2313677977
 2024-08-27 16:08:54 -07:00
Krrish Dholakia
900d8ecbf0 feat(factory.py): enable 'user_continue_message' for interweaving user/assistant messages when provider requires it 
allows bedrock to be used with autogen
 2024-08-22 11:03:33 -07:00
Ishaan Jaff
98c9191f84 pass trace through for bedrock guardrails 2024-08-16 09:10:56 -07:00
Ishaan Jaff
6259d64cfd use BaseAWSLLM for bedrock getcredentials 2024-08-15 13:58:47 -07:00
Krrish Dholakia
76c48bf5d9 fix(bedrock_httpx.py): fix error code for not found provider/model combo to be 404 2024-08-13 20:36:12 -07:00
Krrish Dholakia
4a21554b4f fix(bedrock_httpx.py): raise bad request error if invalid bedrock model given 2024-08-13 19:27:06 -07:00
Krrish Dholakia
08a584035c fix(bedrock_httpx.py): handle empty stop string 2024-08-13 07:30:30 -07:00
Krrish Dholakia
8454cfb329 fix(bedrock_httpx.py): handle bedrock empty system message 2024-08-13 07:17:17 -07:00
Ishaan Jaff
e82656d59a init bedrock_tool_name_mappings 2024-08-09 17:09:19 -07:00
Krrish Dholakia
89273722ba fix(bedrock_httpx.py): handle empty arguments returned during tool calling streaming 2024-08-07 09:54:50 -07:00
Krish Dholakia
b12e9e36ce Merge pull request #4982 from Manouchehri/bedrock-sts-custom-1 
Allow Bedrock to set custom STS endpoint for OIDC flow
 2024-08-02 23:42:38 -07:00
Krrish Dholakia
70afbafd94 fix(bedrock_httpx.py): fix ai21 streaming 2024-08-01 22:03:24 -07:00
David Manouchehri
02822fde2c (bedrock_httpx.py) - Add support for custom STS endpoints, e.g. for FIPS. 2024-07-31 16:51:52 +00:00
Ishaan Jaff
316fb928ad feat - support guardrailConfig 2024-07-29 14:10:09 -07:00
Krrish Dholakia
139ebcd10a fix(bedrock_httpx.py): fix streaming error message 
Fixes https://github.com/BerriAI/litellm/issues/4900
 2024-07-26 10:42:47 -07:00
Krish Dholakia
a5cea7929d Merge branch 'main' into bedrock-llama3.1-405b 2024-07-25 19:29:10 -07:00
David Manouchehri
213227a7e0 Support tool calling for Llama 3.1 on Amazon bedrock. 2024-07-25 20:36:25 +00:00
David Manouchehri
c7fd02faf3 Add mistral.mistral-large-2407-v1:0 on Amazon Bedrock. 2024-07-25 20:04:03 +00:00
David Manouchehri
97d84ce860 Add Llama 3.1 405b for Bedrock 2024-07-25 19:30:13 +00:00
Krrish Dholakia
b94b9dcdea fix(bedrock_httpx.py): fix async client check 2024-07-24 12:43:52 -07:00
David Manouchehri
3ee6baabf7 Add Llama 3.1 for Bedrock. 2024-07-24 05:48:23 +00:00
Krrish Dholakia
eb4dcf67bc fix(bedrock_httpx.py): support jamba streaming 2024-07-18 19:36:50 -07:00
Krrish Dholakia
eeef4b25cf feat(bedrock_httpx.py): add ai21 jamba instruct as converse model 
initial commit for adding ai21 jamba instruct support through bedrock converse
 2024-07-18 18:24:06 -07:00
Krrish Dholakia
0f483e1e6d fix(bedrock_httpx.py): cache response stream shape 
Fixes https://github.com/BerriAI/litellm/issues/4774
 2024-07-18 17:41:31 -07:00
Ishaan Jaff
954410de64 fix exception raised in factory.py 2024-07-13 09:54:32 -07:00
Krrish Dholakia
4895cc7c01 fix(bedrock_httpx.py): handle user error - malformed system prompt 
if user passes in system prompt as a list of content blocks, handle that
 2024-07-12 08:28:50 -07:00
Krrish Dholakia
c69193c321 fix: move to using pydantic obj for setting values 2024-07-11 13:18:36 -07:00
Ishaan Jaff
a94be8b616 fix test_bedrock_httpx_streaming 2024-07-10 17:14:53 -07:00
Ishaan Jaff
0b0aa7c3cd fix bedrock better debugging for credentials 2024-07-09 22:02:17 -07:00
Krrish Dholakia
56410cfcd0 fix(proxy_server.py): support langfuse logging for rejected requests on /v1/chat/completions 2024-07-05 13:07:09 -07:00
David Manouchehri
7aac8d1d94 fix(bedrock_httpx.py): Add anthropic.claude-3-5-sonnet-20240620-v1:0 to the converse list. 2024-07-01 14:18:23 +00:00
Ishaan Jaff
05fd6965a3 fix param mapping for bedrock claude 2024-06-29 19:33:51 -07:00
Ishaan Jaff
695fb5118c fix bedrock claude test 2024-06-29 18:46:06 -07:00
Brian Schultheiss
195cab8e07 Resolve merge conflicts 2024-06-29 15:53:02 -07:00
Krrish Dholakia
7fe4b3d8f4 fix(bedrock_httpx.py): Fix https://github.com/BerriAI/litellm/issues/4415 2024-06-26 16:19:46 -07:00
Brian Schultheiss
02d40207fb Updated more references to AWS session token 2024-06-23 13:37:38 -07:00
Brian Schultheiss
d6925b40fe Support aws_session_token for bedrock client. https://github.com/BerriAI/litellm/issues/4346 2024-06-23 12:51:25 -07:00
Krrish Dholakia
4055381cdb fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions 
Fixes https://github.com/BerriAI/litellm/issues/4338
 2024-06-22 21:26:15 -07:00
Krish Dholakia
fa2d8bc794 Merge pull request #4216 from BerriAI/litellm_refactor_logging 
refactor(utils.py): Cut down utils.py to <10k lines.
 2024-06-15 15:19:42 -07:00
Krrish Dholakia
9d7f5d503c refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines. 
Easier debugging

 Reference: https://github.com/BerriAI/litellm/issues/4206
 2024-06-15 10:57:20 -07:00
Ishaan Jaff
113b7e34ce refactor to use _get_async_httpx_client 2024-06-14 21:30:42 -07:00
Ishaan Jaff
8669a0e0be fix cached httpx client 2024-06-14 21:23:13 -07:00
Ishaan Jaff
d19efd62cf fix async client 2024-06-14 21:12:32 -07:00
David Manouchehri
0a07b26b74 fix(bedrock_httpx.py): Add IAM caching for converse flow. 2024-06-11 17:00:18 +00:00
David Manouchehri
de5b85f309 fix(bedrock_httpx.py): Fix STS region endpoint for converse flow. 2024-06-11 16:35:03 +00:00
David Manouchehri
20e8df66bd fix(bedrock_httpx.py): Fix STS region endpoint. 2024-06-11 15:43:33 +00:00
David Manouchehri
6fa14f9ff2 feat(bedrock_httpx.py): Add AWS IAM cred caching for OIDC flow. 2024-06-11 15:43:15 +00:00
Krrish Dholakia
5056fd5778 fix(bedrock_httpx.py): returning correct finish reason on streaming completion 2024-06-10 14:47:49 -07:00