Commit graph

1393 commits

Author SHA1 Message Date
Ishaan Jaff
81645b12cf feat support azure ft create endpoint 2024-07-31 13:57:58 -07:00
Ishaan Jaff
b630ff6286 fix pydantic obj for FT endpoints 2024-07-31 12:41:39 -07:00
Ishaan Jaff
4a9233a16b test azure fine tune job create 2024-07-30 16:46:06 -07:00
Ishaan Jaff
a6724072b0 feat FT cancel and LIST endpoints for Azure 2024-07-30 16:03:31 -07:00
Ishaan Jaff
e6989431d7 add azure files api 2024-07-30 15:45:43 -07:00
Ishaan Jaff
e23abcda8c add azure fine tuning apis 2024-07-30 15:45:15 -07:00
Ishaan Jaff
9828377b34 rename fine tuning apis 2024-07-30 13:44:16 -07:00
Ishaan Jaff
0a3dbe0659 fix linting errors 2024-07-30 12:51:39 -07:00
Ishaan Jaff
4d2e98802f feat add support for alist_batches 2024-07-30 08:18:52 -07:00
Ishaan Jaff
50222d808b Merge pull request #4956 from BerriAI/litellm_add_finetuning_Endpoints
[Feat] Add `litellm.create_fine_tuning_job()` , `litellm.list_fine_tuning_jobs()`, `litellm.cancel_fine_tuning_job()` finetuning endpoints
2024-07-30 07:47:29 -07:00
Krrish Dholakia
ac543d8b1e fix(cohere_chat.py): handle tool_result + user message being passed in 2024-07-29 21:38:45 -07:00
Ishaan Jaff
1996f4b29e fix type errors 2024-07-29 20:10:33 -07:00
Ishaan Jaff
4d1a653fea fix type errors 2024-07-29 20:10:03 -07:00
Ishaan Jaff
fb54c3e272 test - async ft jobs 2024-07-29 19:52:14 -07:00
Ishaan Jaff
c7f275e3e5 add list fine tune endpoints 2024-07-29 19:46:55 -07:00
Ishaan Jaff
46bf96c8da feat - add cancel_fine_tuning_job 2024-07-29 19:22:23 -07:00
Ishaan Jaff
ccbdc188f0 add acreate_fine_tuning_job 2024-07-29 18:59:29 -07:00
Krrish Dholakia
637654fb79 fix(factory.py): handle special keys for mistral chat template 2024-07-29 17:47:44 -07:00
Ishaan Jaff
b26d1704ee fix linting error - cohere_chat 2024-07-29 17:19:28 -07:00
Ishaan Jaff
decad8ca31 Merge pull request #4949 from pat-cohere/patch-1
Fix bug in cohere_chat.py
2024-07-29 17:01:40 -07:00
pat-cohere
d958a95371 Update cohere_chat.py 2024-07-29 17:26:07 -04:00
pat-cohere
3ee5d3d0b9 Update cohere_chat.py
Add chat history to cohere chat call that was previously being dropped.
2024-07-29 17:23:04 -04:00
Ishaan Jaff
316fb928ad feat - support guardrailConfig 2024-07-29 14:10:09 -07:00
Krish Dholakia
d19ef5cedb Merge pull request #4929 from BerriAI/litellm_vertex_mistral_cost_tracking
Support vertex mistral cost tracking
2024-07-27 22:38:33 -07:00
Krrish Dholakia
b22d216777 fix(factory.py): support mistral ai prefix:true in messages
Fixes https://github.com/BerriAI/litellm/issues/4882
2024-07-27 22:30:40 -07:00
Krrish Dholakia
a6b053f535 feat(databricks.py): support vertex mistral cost tracking 2024-07-27 20:22:35 -07:00
Krrish Dholakia
a13ed6bf83 fix(databricks.py): handle DONE chunk from databricks 2024-07-27 16:51:45 -07:00
Krrish Dholakia
56ba0c62f3 feat(utils.py): fix openai-like streaming 2024-07-27 15:32:57 -07:00
Krrish Dholakia
cfc061e38e fix(databricks.py): fix client used 2024-07-27 13:15:00 -07:00
Krrish Dholakia
ce7257ec5e feat(vertex_ai_partner.py): initial working commit for calling vertex ai mistral
Closes https://github.com/BerriAI/litellm/issues/4874
2024-07-27 12:54:14 -07:00
Krrish Dholakia
3a1eedfbf3 feat(ollama_chat.py): support ollama tool calling
Closes https://github.com/BerriAI/litellm/issues/4812
2024-07-26 21:51:54 -07:00
Krrish Dholakia
c66717cc35 feat(vertex_httpx.py): support logging citation metadata
Closes https://github.com/BerriAI/litellm/issues/3230
2024-07-26 20:54:59 -07:00
Krrish Dholakia
02b886d741 feat(vertex_httpx.py): support logging vertex ai safety results to langfuse
Closes https://github.com/BerriAI/litellm/issues/3230
2024-07-26 20:50:43 -07:00
Ishaan Jaff
eca6c0ccaa add verbose_logger.debug to retrieve batch 2024-07-26 18:26:39 -07:00
Krrish Dholakia
139ebcd10a fix(bedrock_httpx.py): fix streaming error message
Fixes https://github.com/BerriAI/litellm/issues/4900
2024-07-26 10:42:47 -07:00
Krrish Dholakia
6a4001c4f4 fix(vertex_ai_llama3.py): Fix llama3 streaming issue
Closes https://github.com/BerriAI/litellm/issues/4885
2024-07-25 22:30:55 -07:00
Krish Dholakia
a5cea7929d Merge branch 'main' into bedrock-llama3.1-405b 2024-07-25 19:29:10 -07:00
Ishaan Jaff
3eea3f0e2d Merge pull request #4884 from Manouchehri/add-mistral-large-2407-bedrock-1
Add mistral.mistral-large-2407-v1:0 on Amazon Bedrock
2024-07-25 19:22:46 -07:00
Krish Dholakia
ff6d153d58 Merge pull request #4879 from fracapuano/main
Add Single-Token predictions support for Replicate
2024-07-25 19:10:57 -07:00
Krish Dholakia
9a42d312b5 Merge pull request #4887 from BerriAI/litellm_custom_llm
feat(custom_llm.py): Support Custom LLM Handlers
2024-07-25 19:05:29 -07:00
Krrish Dholakia
a2de16582a fix(custom_llm.py): pass input params to custom llm 2024-07-25 19:03:52 -07:00
Ishaan Jaff
0b10d40674 feat support audio health checks for azure 2024-07-25 17:30:15 -07:00
Ishaan Jaff
591857082b feat - support health check audio_speech 2024-07-25 17:26:14 -07:00
Ishaan Jaff
56b55b6ab4 fix whisper health check with litellm 2024-07-25 17:22:57 -07:00
Krrish Dholakia
9b1c7066b7 feat(utils.py): support async streaming for custom llm provider 2024-07-25 17:11:57 -07:00
Krrish Dholakia
bf23aac11d feat(utils.py): support sync streaming for custom llm provider 2024-07-25 16:47:32 -07:00
Krrish Dholakia
fe503386ab fix(custom_llm.py): support async completion calls 2024-07-25 15:51:39 -07:00
Krrish Dholakia
54e1ca29b7 feat(custom_llm.py): initial working commit for writing your own custom LLM handler
Fixes https://github.com/BerriAI/litellm/issues/4675

 Also Addresses https://github.com/BerriAI/litellm/discussions/4677
2024-07-25 15:33:05 -07:00
David Manouchehri
213227a7e0 Support tool calling for Llama 3.1 on Amazon bedrock. 2024-07-25 20:36:25 +00:00
David Manouchehri
c7fd02faf3 Add mistral.mistral-large-2407-v1:0 on Amazon Bedrock. 2024-07-25 20:04:03 +00:00