Commit graph

1391 commits

Author SHA1 Message Date
Ishaan Jaff
9b923e66e9 test azure fine tune job create 2024-07-30 16:46:06 -07:00
Ishaan Jaff
02736ac8b5 feat FT cancel and LIST endpoints for Azure 2024-07-30 16:03:31 -07:00
Ishaan Jaff
566dc43d96 add azure files api 2024-07-30 15:45:43 -07:00
Ishaan Jaff
63cbb6e634 add azure fine tuning apis 2024-07-30 15:45:15 -07:00
Ishaan Jaff
23769b3603 rename fine tuning apis 2024-07-30 13:44:16 -07:00
Ishaan Jaff
66211b42db fix linting errors 2024-07-30 12:51:39 -07:00
Ishaan Jaff
43a06f408c feat add support for alist_batches 2024-07-30 08:18:52 -07:00
Ishaan Jaff
36dca6bcce
Merge pull request #4956 from BerriAI/litellm_add_finetuning_Endpoints
[Feat] Add `litellm.create_fine_tuning_job()` , `litellm.list_fine_tuning_jobs()`, `litellm.cancel_fine_tuning_job()` finetuning endpoints
2024-07-30 07:47:29 -07:00
Krrish Dholakia
259e3b1245 fix(cohere_chat.py): handle tool_result + user message being passed in 2024-07-29 21:38:45 -07:00
Ishaan Jaff
dff8163f2c fix type errors 2024-07-29 20:10:33 -07:00
Ishaan Jaff
f18827cbc0 fix type errors 2024-07-29 20:10:03 -07:00
Ishaan Jaff
c9bea3a879 test - async ft jobs 2024-07-29 19:52:14 -07:00
Ishaan Jaff
4849df03ff add list fine tune endpoints 2024-07-29 19:46:55 -07:00
Ishaan Jaff
3802eaa6b5 feat - add cancel_fine_tuning_job 2024-07-29 19:22:23 -07:00
Ishaan Jaff
1202e1c645 add acreate_fine_tuning_job 2024-07-29 18:59:29 -07:00
Krrish Dholakia
528741a809 fix(factory.py): handle special keys for mistral chat template 2024-07-29 17:47:44 -07:00
Ishaan Jaff
c3ac6b098e fix linting error - cohere_chat 2024-07-29 17:19:28 -07:00
Ishaan Jaff
fc096ee9e0
Merge pull request #4949 from pat-cohere/patch-1
Fix bug in cohere_chat.py
2024-07-29 17:01:40 -07:00
pat-cohere
972df1f303
Update cohere_chat.py 2024-07-29 17:26:07 -04:00
pat-cohere
1ee8051c7c
Update cohere_chat.py
Add chat history to cohere chat call that was previously being dropped.
2024-07-29 17:23:04 -04:00
Ishaan Jaff
5154ec51a3 feat - support guardrailConfig 2024-07-29 14:10:09 -07:00
Krish Dholakia
442667434a
Merge pull request #4929 from BerriAI/litellm_vertex_mistral_cost_tracking
Support vertex mistral cost tracking
2024-07-27 22:38:33 -07:00
Krrish Dholakia
e0f3cd580c fix(factory.py): support mistral ai prefix:true in messages
Fixes https://github.com/BerriAI/litellm/issues/4882
2024-07-27 22:30:40 -07:00
Krrish Dholakia
6d5aedc48d feat(databricks.py): support vertex mistral cost tracking 2024-07-27 20:22:35 -07:00
Krrish Dholakia
6f9c29d39b fix(databricks.py): handle DONE chunk from databricks 2024-07-27 16:51:45 -07:00
Krrish Dholakia
c85ed01756 feat(utils.py): fix openai-like streaming 2024-07-27 15:32:57 -07:00
Krrish Dholakia
3c77f39751 fix(databricks.py): fix client used 2024-07-27 13:15:00 -07:00
Krrish Dholakia
5b71421a7b feat(vertex_ai_partner.py): initial working commit for calling vertex ai mistral
Closes https://github.com/BerriAI/litellm/issues/4874
2024-07-27 12:54:14 -07:00
Krrish Dholakia
b25d4a8cb3 feat(ollama_chat.py): support ollama tool calling
Closes https://github.com/BerriAI/litellm/issues/4812
2024-07-26 21:51:54 -07:00
Krrish Dholakia
a264d1ca8c feat(vertex_httpx.py): support logging citation metadata
Closes https://github.com/BerriAI/litellm/issues/3230
2024-07-26 20:54:59 -07:00
Krrish Dholakia
fe7f78fbf6 feat(vertex_httpx.py): support logging vertex ai safety results to langfuse
Closes https://github.com/BerriAI/litellm/issues/3230
2024-07-26 20:50:43 -07:00
Ishaan Jaff
2541d5f625 add verbose_logger.debug to retrieve batch 2024-07-26 18:26:39 -07:00
Krrish Dholakia
9a6ed8cabb fix(bedrock_httpx.py): fix streaming error message
Fixes https://github.com/BerriAI/litellm/issues/4900
2024-07-26 10:42:47 -07:00
Krrish Dholakia
ce210ddaf6 fix(vertex_ai_llama3.py): Fix llama3 streaming issue
Closes https://github.com/BerriAI/litellm/issues/4885
2024-07-25 22:30:55 -07:00
Krish Dholakia
b6ca4406b6
Merge branch 'main' into bedrock-llama3.1-405b 2024-07-25 19:29:10 -07:00
Ishaan Jaff
a0655b4192
Merge pull request #4884 from Manouchehri/add-mistral-large-2407-bedrock-1
Add mistral.mistral-large-2407-v1:0 on Amazon Bedrock
2024-07-25 19:22:46 -07:00
Krish Dholakia
c0c934d9cf
Merge pull request #4879 from fracapuano/main
Add Single-Token predictions support for Replicate
2024-07-25 19:10:57 -07:00
Krish Dholakia
a306b83b2d
Merge pull request #4887 from BerriAI/litellm_custom_llm
feat(custom_llm.py): Support Custom LLM Handlers
2024-07-25 19:05:29 -07:00
Krrish Dholakia
41abd51240 fix(custom_llm.py): pass input params to custom llm 2024-07-25 19:03:52 -07:00
Ishaan Jaff
f2443996d8 feat support audio health checks for azure 2024-07-25 17:30:15 -07:00
Ishaan Jaff
2432c90515 feat - support health check audio_speech 2024-07-25 17:26:14 -07:00
Ishaan Jaff
e3142b4294 fix whisper health check with litellm 2024-07-25 17:22:57 -07:00
Krrish Dholakia
060249c7e0 feat(utils.py): support async streaming for custom llm provider 2024-07-25 17:11:57 -07:00
Krrish Dholakia
b4e3a77ad0 feat(utils.py): support sync streaming for custom llm provider 2024-07-25 16:47:32 -07:00
Krrish Dholakia
9f97436308 fix(custom_llm.py): support async completion calls 2024-07-25 15:51:39 -07:00
Krrish Dholakia
6bf1b9353b feat(custom_llm.py): initial working commit for writing your own custom LLM handler
Fixes https://github.com/BerriAI/litellm/issues/4675

 Also Addresses https://github.com/BerriAI/litellm/discussions/4677
2024-07-25 15:33:05 -07:00
David Manouchehri
22c66991ed
Support tool calling for Llama 3.1 on Amazon bedrock. 2024-07-25 20:36:25 +00:00
David Manouchehri
5c4ee3ef3c
Add mistral.mistral-large-2407-v1:0 on Amazon Bedrock. 2024-07-25 20:04:03 +00:00
David Manouchehri
3293ad7458
Add Llama 3.1 405b for Bedrock 2024-07-25 19:30:13 +00:00
fracapuano
5553f84d51 fix: now supports single tokens prediction 2024-07-25 19:06:07 +02:00