phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-28 04:04:31 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
15993 commits 2497 branches 898 tags 558 MiB
Commit graph

229 commits

Author SHA1 Message Date
Krrish Dholakia
ec4051592b fix(anthropic.py): handle scenario where anthropic returns invalid json string for tool call while streaming 
Fixes https://github.com/BerriAI/litellm/issues/5063
 2024-08-07 09:24:11 -07:00
Krish Dholakia
0044fd0041 Merge branch 'main' into litellm_support_lakera_config_thresholds 2024-08-06 22:47:13 -07:00
Krrish Dholakia
2ec7cb4153 fix(utils.py): fix types 2024-08-06 12:23:22 -07:00
Krrish Dholakia
8500f6d087 feat(caching.py): enable caching on provider-specific optional params 
Closes https://github.com/BerriAI/litellm/issues/5049
 2024-08-05 11:18:59 -07:00
Krrish Dholakia
14d0ae6aa4 fix(types/router.py): remove model_info pydantic field 
Fixes https://github.com/BerriAI/litellm/issues/5042
 2024-08-05 09:58:44 -07:00
Krrish Dholakia
5810708c71 feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint 
Fixes https://github.com/BerriAI/litellm/issues/5011
 2024-08-03 20:16:19 -07:00
Krrish Dholakia
c1e5792ac4 fix(types/utils.py): fix linting errors 2024-08-03 11:48:33 -07:00
Krrish Dholakia
147ecc635e fix(bedrock.py): fix response format for bedrock image generation response 
Fixes https://github.com/BerriAI/litellm/issues/5010
 2024-08-03 09:46:49 -07:00
Ishaan Jaff
81bc8d8d16 fix vertex credentials 2024-08-03 08:40:35 -07:00
Ishaan Jaff
e07a38cca4 Merge pull request #5030 from BerriAI/litellm_add_vertex_ft_proxy 
[Feat] Add support for Vertex AI Fine tuning on LiteLLM Proxy
 2024-08-03 08:29:11 -07:00
Ishaan Jaff
496019edd5 Merge pull request #5028 from BerriAI/litellm_create_ft_job_gemini 
[Feat] Add support for Vertex AI fine tuning endpoints
 2024-08-03 08:22:55 -07:00
Ishaan Jaff
b2d4ab04a7 add vertex ai ft on proxy 2024-08-02 18:26:36 -07:00
Ishaan Jaff
264639fb25 translate response from vertex to openai 2024-08-02 18:02:24 -07:00
Krrish Dholakia
e6bc7e938a fix(utils.py): handle scenario where model="azure/*" and custom_llm_provider="azure" 
Fixes https://github.com/BerriAI/litellm/issues/4912
 2024-08-02 17:48:53 -07:00
Ishaan Jaff
e4a7698d17 add vertex FT spec 2024-08-02 17:24:25 -07:00
Ishaan Jaff
c614632ae9 add vertex_credentials in router param 2024-08-02 16:58:17 -07:00
Krrish Dholakia
c1513bfe42 fix(types/utils.py): support passing prompt cache usage stats in usage object 
Passes deepseek prompt caching values through to end user
 2024-08-02 09:30:50 -07:00
Ishaan Jaff
4f21ce2873 Merge pull request #4987 from BerriAI/litellm_add_ft_endpoints 
[Feat-Proxy] Add List fine-tuning jobs
 2024-07-31 16:49:59 -07:00
Ishaan Jaff
47cbd62347 validation for passing config file 2024-07-31 13:32:18 -07:00
Ishaan Jaff
b630ff6286 fix pydantic obj for FT endpoints 2024-07-31 12:41:39 -07:00
Krrish Dholakia
0bcfdafc58 fix(utils.py): fix model registeration to model cost map 
Fixes https://github.com/BerriAI/litellm/issues/4972
 2024-07-30 18:15:00 -07:00
Ishaan Jaff
4d1a653fea fix type errors 2024-07-29 20:10:03 -07:00
Ishaan Jaff
6db50886bb fix linting 2024-07-29 20:01:12 -07:00
Ishaan Jaff
93cbfb3ff8 add types for FineTuningJobCreate OpenAI 2024-07-29 18:59:44 -07:00
Ishaan Jaff
150179a985 Merge pull request #4946 from BerriAI/litellm_Add_bedrock_guardrail_config 
[Feat] Bedrock add support for Bedrock Guardrails
 2024-07-29 15:09:56 -07:00
Ishaan Jaff
6c88305d3b types add GuardrailConfigBlock 2024-07-29 13:14:53 -07:00
Krrish Dholakia
00dde68001 fix(utils.py): fix trim_messages to handle tool calling 
Fixes https://github.com/BerriAI/litellm/issues/4931
 2024-07-29 13:04:41 -07:00
Ishaan Jaff
582b047b0e add new BATCH_WRITE_TO_DB type for service logger 2024-07-27 11:36:51 -07:00
Krrish Dholakia
3a1eedfbf3 feat(ollama_chat.py): support ollama tool calling 
Closes https://github.com/BerriAI/litellm/issues/4812
 2024-07-26 21:51:54 -07:00
Ishaan Jaff
1103c614a0 Merge branch 'main' into litellm_proxy_support_all_providers 2024-07-25 20:15:37 -07:00
Krrish Dholakia
81e220a707 feat(custom_llm.py): initial working commit for writing your own custom LLM handler 
Fixes https://github.com/BerriAI/litellm/issues/4675

 Also Addresses https://github.com/BerriAI/litellm/discussions/4677
 2024-07-25 19:35:48 -07:00
Ishaan Jaff
5128f0e343 router support setting pass_through_all_models 2024-07-25 18:22:35 -07:00
Krrish Dholakia
54e1ca29b7 feat(custom_llm.py): initial working commit for writing your own custom LLM handler 
Fixes https://github.com/BerriAI/litellm/issues/4675

 Also Addresses https://github.com/BerriAI/litellm/discussions/4677
 2024-07-25 15:33:05 -07:00
Krish Dholakia
ce022ca4dd Merge branch 'main' into litellm_parallel_requests 2024-07-24 19:25:56 -07:00
Ishaan Jaff
344010e127 Pass litellm proxy specific metadata 2024-07-23 15:31:30 -07:00
Krrish Dholakia
14c5d6ff03 fix(proxy/utils.py): add stronger typing for litellm params in failure call logging 2024-07-22 21:31:39 -07:00
Krrish Dholakia
0c8196b3c7 feat(lakera_ai.py): control running prompt injection between pre-call and in_parallel 2024-07-22 20:04:42 -07:00
Ishaan Jaff
2dcbd5c534 rename to _response_headers 2024-07-20 17:31:16 -07:00
Ishaan Jaff
fb4aaeb540 return response_headers in response 2024-07-20 14:58:14 -07:00
Ishaan Jaff
cf7db1280f fix typing errors 2024-07-19 16:18:53 -07:00
Ishaan Jaff
cd40d58544 router - refactor to tag based routing 2024-07-18 19:22:09 -07:00
Ishaan Jaff
10ca47d431 litellm router - use free / paid tier 2024-07-18 16:55:50 -07:00
Ishaan Jaff
da2d6348a7 fix linting errors on main 2024-07-18 13:32:48 -07:00
Krish Dholakia
c010cd2dca Merge pull request #4729 from vingiarrusso/vgiarrusso/guardrails 
Add enabled_roles to Guardrails configuration, Update Lakera guardrail moderation hook
 2024-07-17 22:24:35 -07:00
Krish Dholakia
b6ede4eb1b Merge pull request #4716 from pamelafox/countfuncs 
Add token counting for OpenAI tools/tool_choice
 2024-07-16 07:21:31 -07:00
Vinnie Giarrusso
0535bd2d68 Add enabled_roles to Guardrails configuration, Update Lakera guardrail moderation hook 2024-07-16 01:52:08 -07:00
Ishaan Jaff
7944450074 Merge pull request #4724 from BerriAI/litellm_Set_max_file_size_transc 
[Feat] - set max file size on /audio/transcriptions
 2024-07-15 20:42:24 -07:00
Ishaan Jaff
4ec6d3847d max_file_size_mb in float 2024-07-15 19:58:41 -07:00
Krrish Dholakia
58ed852a25 fix(vertex_httpx.py): return grounding metadata 2024-07-15 19:43:37 -07:00
Ishaan Jaff
11ed40be80 allow setting max_file_size_mb 2024-07-15 19:25:24 -07:00