phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 19:54:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
12726 commits 2497 branches 898 tags 550 MiB
Commit graph

1049 commits

Author SHA1 Message Date
Sha Ahammed Roze
b61b6fc94c Merge branch 'BerriAI:main' into main 2024-06-06 20:50:22 +05:30
Krrish Dholakia
3c1d4179c2 fix(vertex_ai.py): support video + pdf for vertex ai 2024-06-06 08:06:20 -07:00
Rajan Paneru
a050d98e51 Table format fix and Typo 
* Fixed marked down table formats because they were looking ugly in pycharm
* Typos Fixes.
 2024-06-06 22:29:59 +09:30
Sha Ahammed Roze
01e1a8e518 Merge branch 'BerriAI:main' into main 2024-06-05 21:56:41 +05:30
Krrish Dholakia
129745da90 fix(azure.py): support dynamic drop params 2024-06-05 09:03:10 -07:00
Krrish Dholakia
8b4b783772 fix(azure.py): fix logprobs naming error 
fixing string value
 2024-06-05 08:54:53 -07:00
sha-ahammed
93e7b9346c feat: Add Ollama as a provider in the proxy UI 2024-06-05 16:48:38 +05:30
Krish Dholakia
7127e6bcd8 Merge pull request #4012 from BerriAI/litellm_assistants_streaming 
feat(assistants/main.py): add assistants api streaming support
 2024-06-04 20:58:02 -07:00
Krrish Dholakia
9bd5c20803 fix(predibase.py): add better error message 2024-06-04 19:55:15 -07:00
Krish Dholakia
43c77a7589 Merge pull request #3989 from pharindoko/main 
fix(bedrock): raise nested error response
 2024-06-04 17:35:42 -07:00
Krrish Dholakia
7728fe185b feat(assistants/main.py): support arun_thread_stream 2024-06-04 16:47:51 -07:00
Krrish Dholakia
20cb525a5c feat(assistants/main.py): add assistants api streaming support 2024-06-04 16:30:35 -07:00
Krrish Dholakia
661b67e71c fix(main.py): fix typing for image gen response 2024-06-04 08:29:30 -07:00
Krish Dholakia
127d1457de Merge pull request #3996 from BerriAI/litellm_azure_assistants_api_support 
feat(assistants/main.py): Azure Assistants API support
 2024-06-03 21:05:03 -07:00
Krrish Dholakia
5b1e113c94 fix(main.py): cast to string only if var is not None 2024-06-03 19:25:59 -07:00
Krrish Dholakia
a2ba63955a feat(assistants/main.py): Closes https://github.com/BerriAI/litellm/issues/3993 2024-06-03 18:47:05 -07:00
uid10804
7858999941 fix(bedrock): raise internal error response 2024-06-03 22:02:10 +02:00
Krrish Dholakia
8b1b0f6f70 fix(anthropic.py): fix anthropic async streaming 
pass the 'stream' param to the httpx call

Addresses https://github.com/BerriAI/litellm/issues/3728#issuecomment-2143985104
 2024-06-02 16:01:44 -07:00
Krrish Dholakia
594daef07a fix(utils.py): correctly instrument passing through api version in optional param check 2024-06-01 19:31:52 -07:00
Krrish Dholakia
23087295e1 fix(azure.py): support dropping 'tool_choice=required' for older azure API versions 
Closes https://github.com/BerriAI/litellm/issues/3876
 2024-06-01 18:44:50 -07:00
Krrish Dholakia
5d3a0ace4b fix(openai.py): fix client caching logic 2024-06-01 16:45:56 -07:00
Krrish Dholakia
69244aabf3 fix(http_handler.py): allow setting ca bundle path 2024-06-01 14:48:53 -07:00
Krrish Dholakia
b6843756d7 fix(http_handler.py): add bool check for os.getenv verif ssl value 2024-06-01 14:07:41 -07:00
Krrish Dholakia
500741ed08 fix(http_handler.py): support verify_ssl=False when using httpx client 2024-06-01 13:56:45 -07:00
Ishaan Jaff
3badb9ede8 Merge pull request #3956 from BerriAI/litellm_cache_openai_clients 
[FEAT] Perf improvements - litellm.completion / litellm.acompletion - Cache OpenAI client
 2024-06-01 09:46:42 -07:00
Ishaan Jaff
1a69682282 fix used hashed api key 2024-06-01 09:24:16 -07:00
Ishaan Jaff
a89a6f2ee9 fix - in memory client cache 2024-06-01 08:58:22 -07:00
Krish Dholakia
f2ca86b0e7 Merge pull request #3944 from BerriAI/litellm_fix_parallel_streaming 
fix: fix streaming with httpx client
 2024-05-31 21:42:37 -07:00
Ishaan Jaff
d2efc8c63b fix cache openai client for embeddings, text, speech 2024-05-31 21:35:03 -07:00
Ishaan Jaff
9ff540870c fix - linting error 2024-05-31 21:24:14 -07:00
Ishaan Jaff
506251ecdf feat - cache openai clients 2024-05-31 21:22:06 -07:00
Krish Dholakia
addf8751a2 Merge pull request #3939 from pharindoko/main 
fix(bedrock): convert botocore credentials when role is assumed
 2024-05-31 18:46:15 -07:00
Krish Dholakia
f4dc681dd9 Merge pull request #3935 from BerriAI/litellm_cache_vertex_clients 
[Fix] Cache Vertex AI clients - Perf improvement
 2024-05-31 18:44:10 -07:00
Krish Dholakia
c049b6b4af Merge pull request #3936 from BerriAI/litellm_assistants_api_proxy 
feat(proxy_server.py): add assistants api endpoints to proxy server
 2024-05-31 18:43:22 -07:00
Krrish Dholakia
3896e3e88f fix: fix streaming with httpx client 
prevent overwriting streams in parallel streaming calls
 2024-05-31 10:55:18 -07:00
uid10804
559e825e2f refactor(bedrock_httpx): change botocore reference 2024-05-31 16:57:28 +02:00
David Manouchehri
13fed93dd1 fix(bedrock_httpx.py): Fix OIDC support. 2024-05-31 12:44:52 +00:00
David Manouchehri
4e57637669 feat (bedrock_httpx.py): Add OIDC support for Amazon Bedrock with httpx. 2024-05-31 12:44:50 +00:00
uid10804
df8043bac9 fix: add botocore credentials extraction and conversion 
The code changes in `bedrock_httpx.py` add functionality to extract and convert AWS STS credentials to session credentials using botocore. This fixes later error in add_auth request when token needs to be assigned.
 2024-05-31 12:02:34 +02:00
Krrish Dholakia
2fdf4a7bb4 feat(proxy_server.py): add assistants api endpoints to proxy server 2024-05-30 22:44:43 -07:00
Ishaan Jaff
d4d9b098b1 fix - vertex ai cache clients 2024-05-30 21:22:32 -07:00
Krish Dholakia
73e3dba2f6 Merge pull request #3928 from BerriAI/litellm_audio_speech_endpoint 
feat(main.py): support openai tts endpoint
 2024-05-30 17:30:42 -07:00
Krrish Dholakia
eb159b64e1 fix(openai.py): fix openai response for /audio/speech endpoint 2024-05-30 16:41:06 -07:00
Krrish Dholakia
1e89a1f56e feat(main.py): support openai tts endpoint 
Closes https://github.com/BerriAI/litellm/issues/3094
 2024-05-30 14:28:28 -07:00
KX
ddb998fac1 fix: add missing seed parameter to ollama input 
Current ollama interfacing does not allow for seed, which is supported in https://github.com/ollama/ollama/blob/main/docs/api.md#parameters and https://github.com/ollama/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values

This resolves that by adding in handling of seed parameter.
 2024-05-31 01:47:56 +08:00
Krrish Dholakia
5f01dce284 fix(main.py): pass api key and api base to openai.py for audio transcription call 2024-05-29 21:29:01 -07:00
Krrish Dholakia
915e599772 fix(openai.py): only allow 'user' as optional param if openai model 2024-05-29 15:15:02 -07:00
Ishaan Jaff
93bf4c2dc4 Revert "Added support for Triton chat completion using trtlllm generate endpo…" 2024-05-29 13:42:49 -07:00
Ishaan Jaff
64d050cadd Merge pull request #3895 from giritatavarty-8451/litellm_triton_chatcompletion_support 
Added support for Triton chat completion using trtlllm generate endpo…
 2024-05-29 12:50:31 -07:00
Ishaan Jaff
d8245cbccb Merge pull request #3888 from BerriAI/litellm_add_files_proxy 
[Feat] LiteLLM Proxy Add `POST /v1/files` and `GET /v1/files`
 2024-05-28 22:36:33 -07:00