phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 11:43:54 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
16852 commits 2497 branches 897 tags 550 MiB
Commit graph

254 commits

Author SHA1 Message Date
Ishaan Jaff
228252b92d
Merge branch 'main' into litellm_allow_using_azure_ad_token_auth 2024-08-22 18:21:24 -07:00
Ishaan Jaff
7d55047ab9 add bedrock guardrails support 2024-08-22 16:09:55 -07:00
Ishaan Jaff
14a6ce367d add types for BedrockMessage 2024-08-22 15:40:58 -07:00
Ishaan Jaff
08fa3f346a add new litellm params for client_id, tenant_id etc 2024-08-22 11:37:30 -07:00
Krrish Dholakia
70bf8bd4f4 feat(factory.py): enable 'user_continue_message' for interweaving user/assistant messages when provider requires it 
allows bedrock to be used with autogen
 2024-08-22 11:03:33 -07:00
Ishaan Jaff
2a3bc8c190 add azure_ad_token_provider as all litellm params 2024-08-22 10:59:18 -07:00
Krrish Dholakia
f36e7e0754 fix(ollama_chat.py): fix passing assistant message with tool call param 
Fixes https://github.com/BerriAI/litellm/issues/5319
 2024-08-22 10:00:03 -07:00
Ishaan Jaff
dd524a4f50
Merge pull request #5326 from BerriAI/litellm_Add_vertex_multimodal_embedding 
[Feat] add vertex multimodal embedding support
 2024-08-21 17:06:43 -07:00
Krrish Dholakia
8a05ce77e9 feat(litellm_logging.py): add 'saved_cache_cost' to standard logging payload (s3) 2024-08-21 16:58:07 -07:00
Ishaan Jaff
dd00cf2a97 add VertexMultimodalEmbeddingRequest type 2024-08-21 14:25:47 -07:00
Ishaan Jaff
8d2c529e55 support lakera ai category thresholds 2024-08-20 17:19:24 -07:00
Ishaan Jaff
8cd1963c11 feat - guardrails v2 2024-08-19 18:24:20 -07:00
Krrish Dholakia
178139f18d feat(litellm_logging.py): support logging model price information to s3 logs 2024-08-16 16:21:34 -07:00
Ishaan Jaff
740d1fdb1c add provider_specific_fields to GenericStreamingChunk 2024-08-16 11:38:22 -07:00
Krish Dholakia
6c3f37f8b4
Merge pull request #5235 from BerriAI/litellm_fix_s3_logs 
fix(s3.py): fix s3 logging payload to have valid json values
 2024-08-15 23:00:18 -07:00
Ishaan Jaff
df4ea8fba6 refactor sagemaker to be async 2024-08-15 18:18:02 -07:00
Krrish Dholakia
f6dba82882 feat(litellm_logging.py): cleanup payload + add response cost to logged payload 2024-08-15 17:53:25 -07:00
Krrish Dholakia
3ddeb3297d fix(litellm_logging.py): fix standard payload 2024-08-15 17:33:40 -07:00
Krrish Dholakia
cda50e5d47 fix(s3.py): fix s3 logging payload to have valid json values 
Previously pydantic objects were being stringified, making them unparsable
 2024-08-15 17:09:02 -07:00
Ishaan Jaff
78a2013e51 add test for large context in system message for anthropic 2024-08-14 17:03:10 -07:00
Ishaan Jaff
b0651bd481 add anthropic cache controls 2024-08-14 14:56:49 -07:00
Krrish Dholakia
19bb95f781 build(model_prices_and_context_window.json): add 'supports_assistant_prefill' to model info map 
Closes https://github.com/BerriAI/litellm/issues/4881
 2024-08-10 14:15:12 -07:00
Krrish Dholakia
1553f7fa48 fix(types/utils.py): handle null completion tokens 
Fixes https://github.com/BerriAI/litellm/issues/5096
 2024-08-10 09:23:03 -07:00
Krrish Dholakia
6180c52cfe fix(router.py): fix types 2024-08-09 12:24:48 -07:00
Krrish Dholakia
7b6db63d30 fix(router.py): fallback on 400-status code requests 2024-08-09 12:16:49 -07:00
Krrish Dholakia
4919cc4d25 fix(anthropic.py): handle scenario where anthropic returns invalid json string for tool call while streaming 
Fixes https://github.com/BerriAI/litellm/issues/5063
 2024-08-07 09:24:11 -07:00
Krish Dholakia
c82fc0cac2
Merge branch 'main' into litellm_support_lakera_config_thresholds 2024-08-06 22:47:13 -07:00
Krrish Dholakia
834b437eb4 fix(utils.py): fix types 2024-08-06 12:23:22 -07:00
Krrish Dholakia
3c4c78a71f feat(caching.py): enable caching on provider-specific optional params 
Closes https://github.com/BerriAI/litellm/issues/5049
 2024-08-05 11:18:59 -07:00
Krrish Dholakia
cd94c3adc1 fix(types/router.py): remove model_info pydantic field 
Fixes https://github.com/BerriAI/litellm/issues/5042
 2024-08-05 09:58:44 -07:00
Krrish Dholakia
ac6c39c283 feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint 
Fixes https://github.com/BerriAI/litellm/issues/5011
 2024-08-03 20:16:19 -07:00
Krrish Dholakia
5add6687cc fix(types/utils.py): fix linting errors 2024-08-03 11:48:33 -07:00
Krrish Dholakia
c982ec88d8 fix(bedrock.py): fix response format for bedrock image generation response 
Fixes https://github.com/BerriAI/litellm/issues/5010
 2024-08-03 09:46:49 -07:00
Ishaan Jaff
4917aaefab fix vertex credentials 2024-08-03 08:40:35 -07:00
Ishaan Jaff
9dffe23108
Merge pull request #5030 from BerriAI/litellm_add_vertex_ft_proxy 
[Feat] Add support for Vertex AI Fine tuning on LiteLLM Proxy
 2024-08-03 08:29:11 -07:00
Ishaan Jaff
f840a5f6b4
Merge pull request #5028 from BerriAI/litellm_create_ft_job_gemini 
[Feat] Add support for Vertex AI fine tuning endpoints
 2024-08-03 08:22:55 -07:00
Ishaan Jaff
4fc27e87c5 add vertex ai ft on proxy 2024-08-02 18:26:36 -07:00
Ishaan Jaff
ac6224c2b1 translate response from vertex to openai 2024-08-02 18:02:24 -07:00
Krrish Dholakia
5d96ff6694 fix(utils.py): handle scenario where model="azure/*" and custom_llm_provider="azure" 
Fixes https://github.com/BerriAI/litellm/issues/4912
 2024-08-02 17:48:53 -07:00
Ishaan Jaff
d364d76bd0 add vertex FT spec 2024-08-02 17:24:25 -07:00
Ishaan Jaff
cff7050147 add vertex_credentials in router param 2024-08-02 16:58:17 -07:00
Krrish Dholakia
0a30ba9674 fix(types/utils.py): support passing prompt cache usage stats in usage object 
Passes deepseek prompt caching values through to end user
 2024-08-02 09:30:50 -07:00
Ishaan Jaff
d833c69acb
Merge pull request #4987 from BerriAI/litellm_add_ft_endpoints 
[Feat-Proxy] Add List fine-tuning jobs
 2024-07-31 16:49:59 -07:00
Ishaan Jaff
e4c73036fc validation for passing config file 2024-07-31 13:32:18 -07:00
Ishaan Jaff
ef5aeb17a1 fix pydantic obj for FT endpoints 2024-07-31 12:41:39 -07:00
Krrish Dholakia
46634af06f fix(utils.py): fix model registeration to model cost map 
Fixes https://github.com/BerriAI/litellm/issues/4972
 2024-07-30 18:15:00 -07:00
Ishaan Jaff
f18827cbc0 fix type errors 2024-07-29 20:10:03 -07:00
Ishaan Jaff
6abc49c611 fix linting 2024-07-29 20:01:12 -07:00
Ishaan Jaff
5123bf4e75 add types for FineTuningJobCreate OpenAI 2024-07-29 18:59:44 -07:00
Ishaan Jaff
e031359e67
Merge pull request #4946 from BerriAI/litellm_Add_bedrock_guardrail_config 
[Feat] Bedrock add support for Bedrock Guardrails
 2024-07-29 15:09:56 -07:00