phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-27 11:43:54 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
9053 commits 2497 branches 897 tags 550 MiB
Commit graph

2158 commits

Author SHA1 Message Date
Krrish Dholakia
eda65a25e3 test(test_caching.py): fix test_redis_cache_acompletion_stream 2024-03-25 21:36:47 -07:00
Krrish Dholakia
be055f31ee test(test_azure_astreaming_and_function_calling): fix test to handle caching 2024-03-25 19:33:57 -07:00
Krrish Dholakia
e9096ee922 fix(test_amazing_vertex_completion.py): fix test to check if content is none 2024-03-25 19:11:39 -07:00
Krrish Dholakia
c5bd4d4233 fix(utils.py): log success event for streaming 2024-03-25 19:03:10 -07:00
Krrish Dholakia
fed6ee1f35 test(test_custom_logger.py): cleanup test 2024-03-25 18:32:12 -07:00
Krrish Dholakia
cbf4c95e5f fix(utils.py): persist response id across chunks 2024-03-25 18:20:43 -07:00
Krrish Dholakia
ecc0cf5d9c fix(utils.py): fix text completion streaming 2024-03-25 16:47:17 -07:00
Krrish Dholakia
26dbb76d53 fix(utils.py): ensure last chunk is always empty delta w/ finish reason 
makes sure we're openai-compatible with our streaming. Adds stricter tests for this as well
 2024-03-25 16:33:41 -07:00
Krrish Dholakia
fec92767bb fix(caching.py): support default ttl for caching 2024-03-25 13:40:17 -07:00
Krrish Dholakia
10ecf31827 test(test_jwt.py): add unit tests for jwt auth integration 2024-03-25 13:24:39 -07:00
Krrish Dholakia
38bdf31652 fix(handle_jwt.py): allow setting proxy admin role string for jwt auth 2024-03-25 12:20:14 -07:00
Krrish Dholakia
8821b3d243 feat(main.py): support router.chat.completions.create 
allows using router with instructor

https://github.com/BerriAI/litellm/issues/2673
 2024-03-25 08:26:28 -07:00
Krrish Dholakia
8c6402b02d docs(routing.md): add pre-call checks to docs 2024-03-23 19:10:34 -07:00
Krrish Dholakia
292cdd81e4 fix(router.py): fix pre call check logic 2024-03-23 18:56:08 -07:00
Krrish Dholakia
4e70a3e09a feat(router.py): enable pre-call checks 
filter models outside of context window limits of a given message for a model group

 https://github.com/BerriAI/litellm/issues/872
 2024-03-23 18:03:30 -07:00
Krrish Dholakia
47b2b0df17 fix(bedrock.py): fix supported openai params for bedrock claude 3 2024-03-23 16:02:15 -07:00
Krrish Dholakia
4e61fbf7d7 test(test_completion.py): make default claude 3 test message multi-turn 2024-03-23 14:34:42 -07:00
Krrish Dholakia
3d9a883190 build(test_python_38.py): add testing for litellm cli import 2024-03-23 10:42:19 -07:00
Krrish Dholakia
2e88a22d63 test(test_completion.py): fix claude multi-turn conversation test 2024-03-23 00:56:41 -07:00
Krrish Dholakia
16368fec98 fix(anthropic.py): support async claude 3 tool calling + streaming 
https://github.com/BerriAI/litellm/issues/2644
 2024-03-22 19:57:01 -07:00
Krrish Dholakia
b872644496 fix(prompt_injection_detection.py): fix type check 2024-03-21 08:56:13 -07:00
Krrish Dholakia
7f6a2691bd test(test_llm_guard.py): fix llm guard integration 2024-03-21 08:31:11 -07:00
Krrish Dholakia
e9cc6b4cc9 feat(proxy_server.py): enable llm api based prompt injection checks 
run user calls through an llm api to check for prompt injection attacks. This happens in parallel to th
e actual llm call using `async_moderation_hook`
 2024-03-20 22:43:42 -07:00
Krrish Dholakia
e9ff51aa70 fix(prompt_injection_detection.py): ensure combinations are actual phrases, not just 1-2 words 
reduces misflagging

https://github.com/BerriAI/litellm/issues/2601
 2024-03-20 19:09:38 -07:00
Krish Dholakia
09269005db Merge pull request #2142 from vilmar-hillow/azure_embedding_ad_token 
Fixed azure ad token not being processed properly in embedding models
 2024-03-19 11:51:28 -07:00
Krrish Dholakia
697758e188 test(test_streaming.py): fix test 2024-03-18 22:06:29 -07:00
Krish Dholakia
f522a5236b Merge pull request #2561 from BerriAI/litellm_batch_writing_db 
fix(proxy/utils.py): move to batch writing db updates
 2024-03-18 21:50:47 -07:00
Ishaan Jaff
789d263dce (test) usage based routing test 2024-03-18 21:39:59 -07:00
Krrish Dholakia
751568826b test: handle vertex ai rate limit errors 2024-03-18 21:33:08 -07:00
Ishaan Jaff
cae1c24227 (ci/cd) run again 2024-03-18 21:24:24 -07:00
Ishaan Jaff
3648bd67b5 (fix) test load config proxy with redis 2024-03-18 20:42:41 -07:00
Krrish Dholakia
76fa334e8e test(test_update_spend.py): fix test 2024-03-18 20:38:21 -07:00
Krish Dholakia
3e32a245ea Merge pull request #2577 from BerriAI/litellm_vertex_ai_streaming_func_call 
feat(vertex_ai.py): support gemini (vertex ai) function calling when streaming
 2024-03-18 20:10:00 -07:00
Ishaan Jaff
201d2296bf Merge pull request #2578 from BerriAI/litellm_datadog_int 
[FEAT] DataDog Logging Provider
 2024-03-18 17:10:59 -07:00
Ishaan Jaff
c1800354e9 (test) dd test 2024-03-18 16:22:59 -07:00
Krrish Dholakia
ee0e3be092 test: fix test 2024-03-18 13:43:14 -07:00
Krrish Dholakia
f4443e21e0 feat(vertex_ai.py): support gemini (vertex ai) function calling when streaming 2024-03-18 11:47:27 -07:00
Krrish Dholakia
dfcf16eb4d fix(caching.py): pass redis kwargs to connection pool init 2024-03-18 08:21:36 -07:00
Krrish Dholakia
1618751824 fix(proxy/utils.py): move to batch writing db updates 2024-03-16 22:32:00 -07:00
Krish Dholakia
293c32204e Merge pull request #2556 from BerriAI/litellm_aws_secret_manager_support 
fix(utils.py): initial commit for aws secret manager support
 2024-03-16 18:41:58 -07:00
Krrish Dholakia
bad2327b88 fix(utils.py): fix aws secret manager + support key_management_settings 
fixes the aws secret manager implementation and allows the user to set which keys they want to check thr
ough it
 2024-03-16 16:47:50 -07:00
Krrish Dholakia
928ea59fac fix(proxy_server.py): rename beta end user blocking endpoints 
separating end user management from user management
 2024-03-16 13:53:10 -07:00
Krish Dholakia
06cb2652ca Merge branch 'main' into support_anthropic_function_result 2024-03-16 09:58:08 -07:00
Krish Dholakia
8e6e7f880d Merge pull request #2542 from BerriAI/litellm_redis_perf_improvements 
89% Caching improvement - Async Redis completion calls + batch redis GET requests for a given key + call type
 2024-03-15 18:58:36 -07:00
Krrish Dholakia
71936b0739 test(test_custom_logger.py): fix async streaming test 2024-03-15 18:18:54 -07:00
Krrish Dholakia
45582d2fa5 test(test_caching.py): fix async tests 2024-03-15 18:09:25 -07:00
ishaan-jaff
37be2ba569 (fix) fix error message raised on passing invalid tokens 2024-03-15 14:50:34 -07:00
Zihao Li
a855bf79f3 Add tool result submission to claude 3 function call test and claude 3 multi-turn conversion to ensure alternating message roles 2024-03-16 01:40:36 +08:00
Krish Dholakia
b0d530d029 Merge pull request #2535 from BerriAI/litellm_fireworks_ai_support 
feat(utils.py): add native fireworks ai support
 2024-03-15 10:02:53 -07:00
Krrish Dholakia
235787ff67 fix(cohere.py): return usage as a pydantic object not dict 2024-03-15 10:00:22 -07:00