phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 19:24:27 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
16781 commits 2490 branches 894 tags 548 MiB
Commit graph

1063 commits

Author SHA1 Message Date
Krrish Dholakia
bf23aac11d feat(utils.py): support sync streaming for custom llm provider 2024-07-25 16:47:32 -07:00
Krrish Dholakia
fe503386ab fix(custom_llm.py): support async completion calls 2024-07-25 15:51:39 -07:00
Krrish Dholakia
54e1ca29b7 feat(custom_llm.py): initial working commit for writing your own custom LLM handler 
Fixes https://github.com/BerriAI/litellm/issues/4675

 Also Addresses https://github.com/BerriAI/litellm/discussions/4677
 2024-07-25 15:33:05 -07:00
Krrish Dholakia
5945da4a66 fix(main.py): fix calling openai gpt-3.5-turbo-instruct via /completions 
Fixes https://github.com/BerriAI/litellm/issues/749
 2024-07-25 09:57:19 -07:00
Krrish Dholakia
778afcee31 feat(vertex_ai_llama.py): vertex ai llama3.1 api support 
Initial working commit for vertex ai llama 3.1 api support
 2024-07-23 17:07:30 -07:00
Ishaan Jaff
71c755d9a2 Merge pull request #3905 from giritatavarty-8451/litellm_triton_chatcompletion_support 
Litellm triton chatcompletion support - Resubmit of #3895
 2024-07-23 10:30:26 -07:00
Krrish Dholakia
dbaaf9f1a2 fix(main.py): check if anthropic api base ends with required url 
Fixes https://github.com/BerriAI/litellm/issues/4803
 2024-07-22 20:36:35 -07:00
Krrish Dholakia
a01a45230c fix(openai.py): support completion, streaming, async_streaming 2024-07-20 15:23:42 -07:00
Krrish Dholakia
a29be08397 fix(main.py): check for ANTHROPIC_BASE_URL in environment 
Fixes https://github.com/BerriAI/litellm/issues/4803
 2024-07-20 14:38:31 -07:00
Ishaan Jaff
82ceee32c4 fix health check 2024-07-19 15:56:35 -07:00
Sophia Loris
adae0777d6 resolve merge conflicts 2024-07-19 09:45:53 -05:00
Sophia Loris
91fa69c0c2 Add support for Triton streaming & triton async completions 2024-07-19 09:35:27 -05:00
Ishaan Jaff
17502de9ca Merge pull request #4789 from BerriAI/litellm_router_refactor 
[Feat-Router] - Tag based routing
 2024-07-18 22:19:18 -07:00
Ishaan Jaff
8d227680c7 fix use tags as a litellm param 2024-07-18 19:34:45 -07:00
Krrish Dholakia
aac912d3f8 feat(vertex_ai_anthropic.py): support response_schema for vertex ai anthropic calls 
allows passing response_schema for anthropic calls. supports schema validation.
 2024-07-18 16:57:38 -07:00
Ishaan Jaff
52370fee12 fix testing exception mapping 2024-07-13 11:10:13 -07:00
Krrish Dholakia
948fd6fc33 fix: fix linting errors 2024-07-11 13:36:55 -07:00
Krrish Dholakia
4bd7276732 fix(main.py): fix linting errors 2024-07-11 12:11:50 -07:00
Krrish Dholakia
48be4ce805 feat(proxy_server.py): working /v1/messages with config.yaml 
Adds async router support for adapter_completion call
 2024-07-10 18:53:54 -07:00
Krrish Dholakia
4ba30abb63 feat(proxy_server.py): working /v1/messages endpoint 
Works with claude engineer
 2024-07-10 18:15:38 -07:00
Krrish Dholakia
01a335b4c3 feat(anthropic_adapter.py): support for translating anthropic params to openai format 2024-07-10 00:32:28 -07:00
Krrish Dholakia
789d2dab15 fix(vertex_httpx.py): add sync vertex image gen support 
Fixes https://github.com/BerriAI/litellm/issues/4623
 2024-07-09 13:33:54 -07:00
Ishaan Jaff
24f718438e fix params on acompletion 2024-07-08 12:56:54 -07:00
Krrish Dholakia
d68ab2a8bc fix(whisper---handle-openai/azure-vtt-response-format): Fixes https://github.com/BerriAI/litellm/issues/4595 2024-07-08 09:10:40 -07:00
Krrish Dholakia
a00a1267bc fix(utils.py): support 'drop_params' for 'parallel_tool_calls' 
Closes https://github.com/BerriAI/litellm/issues/4584

 OpenAI-only param
 2024-07-08 07:36:41 -07:00
Simon S. Viloria
8eb78cbd98 Merge branch 'BerriAI:main' into main 2024-07-07 18:00:11 +02:00
Simon Sanchez Viloria
8d7c5049f8 (fix - watsonx) Fixed issues with watsonx embedding/async endpoints 2024-07-07 17:59:37 +02:00
Krish Dholakia
c6b6dbeb6b Merge branch 'main' into litellm_fix_httpx_transport 2024-07-06 19:12:06 -07:00
Krrish Dholakia
f89632f5ac fix(main.py): fix stream_chunk_builder usage calc 
Closes https://github.com/BerriAI/litellm/issues/4496
 2024-07-06 14:52:59 -07:00
Krrish Dholakia
d0862697b8 fix(vertex_httpx.py): fix supported vertex params 2024-07-04 21:17:52 -07:00
Ishaan Jaff
f5d9916147 add groq whisper large 2024-07-04 16:43:40 -07:00
Krrish Dholakia
23ebae39e2 fix(main.py): fix azure ai cohere tool calling 2024-07-04 11:46:14 -07:00
Krrish Dholakia
dca952f117 fix: linting fixes 2024-07-03 21:55:00 -07:00
Krish Dholakia
06c6c65d2a Merge branch 'main' into litellm_anthropic_tool_calling_streaming_fix 2024-07-03 20:43:51 -07:00
Krrish Dholakia
84044c08b6 fix(utils.py): stream_options working across all providers 2024-07-03 20:40:46 -07:00
Krrish Dholakia
4a6471e075 fix(utils.py): fix vertex anthropic streaming 2024-07-03 18:43:46 -07:00
Krish Dholakia
4e1b247c1d Revert "fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params " 2024-07-03 17:55:37 -07:00
Krrish Dholakia
46800ba20a fix(vertex_anthropic.py): Updates the vertex anthropic endpoint to do tool calling with the anthropic api params 2024-07-03 15:28:31 -07:00
Krish Dholakia
637369d2ac Merge branch 'main' into litellm_fix_httpx_transport 2024-07-02 17:17:43 -07:00
Ishaan Jaff
d8160e8459 Merge pull request #4519 from BerriAI/litellm_re_use_openai_azure_clients_whisper 
[Fix+Test] /audio/transcriptions - use initialized OpenAI / Azure OpenAI clients
 2024-07-02 16:42:22 -07:00
Ishaan Jaff
c7f278f686 fix use router level client for OpenAI / Azure transcription calls 2024-07-02 12:33:31 -07:00
Krrish Dholakia
39348317d2 fix(main.py): get the region name from boto3 client if dynamic var not set 2024-07-02 09:24:07 -07:00
Krrish Dholakia
459d294e21 fix(router.py): disable cooldowns 
allow admin to disable model cooldowns
 2024-07-01 15:03:10 -07:00
Krrish Dholakia
9400edaf33 fix(main.py): copy messages - prevent modifying user input 
Fixes https://github.com/BerriAI/litellm/discussions/4489
 2024-07-01 08:14:46 -07:00
Ishaan Jaff
695fb5118c fix bedrock claude test 2024-06-29 18:46:06 -07:00
Brian Schultheiss
195cab8e07 Resolve merge conflicts 2024-06-29 15:53:02 -07:00
Krrish Dholakia
ca22d2a106 fix(main.py): pass in openrouter as custom provider for openai client call 
Fixes https://github.com/BerriAI/litellm/issues/4414
 2024-06-28 21:26:42 -07:00
Krish Dholakia
134aa3cbd8 Merge pull request #4449 from BerriAI/litellm_azure_tts 
feat(azure.py): azure tts support
 2024-06-27 21:33:38 -07:00
Ishaan Jaff
7041e22aa5 azure - fix custom logger on post call 2024-06-27 17:37:02 -07:00
Krrish Dholakia
58244ba71f feat(azure.py): azure tts support 
Closes https://github.com/BerriAI/litellm/issues/4002
 2024-06-27 16:59:25 -07:00