Commit graph

14814 commits

Author SHA1 Message Date
Ishaan Jaff
b2bf5ad3d0 lakera run on /embeddings 2024-07-17 18:27:05 -07:00
Ishaan Jaff
9753c3676a fix run moderation check on embedding 2024-07-17 17:59:20 -07:00
Ishaan Jaff
3110abc832 shorten predibase streaming test 2024-07-17 17:50:42 -07:00
Ishaan Jaff
b94ba48ccc ci/cd run again 2024-07-17 17:43:47 -07:00
Ishaan Jaff
613bbe306f fix triton embedding test 2024-07-17 17:29:22 -07:00
Ishaan Jaff
03f79f78db fix custom Logger is None 2024-07-17 17:27:46 -07:00
Krrish Dholakia
0a94953896 fix(router.py): check for request_timeout in acompletion
support 'request_timeout' param in router acompletion
2024-07-17 17:19:06 -07:00
Ishaan Jaff
5faa840eb1
Merge pull request #4751 from themrzmaster/main
add new groq tool models
2024-07-17 16:54:53 -07:00
Ishaan Jaff
ee53b9093b
Merge pull request #4758 from BerriAI/litellm_langsmith_async_support
[Feat] Use Async Httpx client for langsmith logging
2024-07-17 16:54:40 -07:00
Ishaan Jaff
a77536b202 test_langsmith_logging_with_streaming_and_metadata 2024-07-17 16:51:26 -07:00
Krish Dholakia
0faa3510a7
Merge pull request #4756 from BerriAI/litellm_fix_async_caching
fix(litellm_logging.py): don't run async caching for sync streaming calls
2024-07-17 16:44:48 -07:00
Ishaan Jaff
bf793598b5
Merge pull request #4757 from BerriAI/litellm_langsmith_log_user_id
[Feat] Proxy + Langsmith - Log user_api_key_user_id, user_api_key_team_alias
2024-07-17 16:40:42 -07:00
Ishaan Jaff
8cb228bf16
Merge pull request #4754 from BerriAI/litellm_fix_langsmith_api_key_logged
[Fix] Langsmith - Don't Log Provider API Keys
2024-07-17 16:40:32 -07:00
Ishaan Jaff
f462e6a46c langsmith logs 2024-07-17 16:37:24 -07:00
Ishaan Jaff
f945e7009b test streaming logs to langsmith 2024-07-17 16:25:32 -07:00
Ishaan Jaff
f21a92cadc test langsmith 2024-07-17 16:08:55 -07:00
Ishaan Jaff
5f04f7b7c1 fix langsmith logging for streaming 2024-07-17 16:04:45 -07:00
Krrish Dholakia
e587d32058 docs(scrub_data.md): add scrub logging data tutorial to docs 2024-07-17 15:39:31 -07:00
Ishaan Jaff
9c00fb64c4 use langsmith as a custom callback class 2024-07-17 15:35:13 -07:00
Ishaan Jaff
b2b180e254 langsmith use verbose logger 2024-07-17 15:23:20 -07:00
Ishaan Jaff
ed533bab34 fix testing langsmith logging 2024-07-17 15:14:57 -07:00
Krrish Dholakia
a176feeacc fix(utils.py): return optional params from groq 2024-07-17 12:09:08 -07:00
Ishaan Jaff
1334bca371 fix use AsyncHTTPHandler for logging langsmith requests 2024-07-17 11:49:48 -07:00
Ishaan Jaff
8955d783d1 test correct fields are logged on langsmith 2024-07-17 11:29:29 -07:00
Krrish Dholakia
73bfc299f7 fix(factory.py): check if empty text block passed in (anthropic_messages_pt) 2024-07-17 11:27:22 -07:00
Ishaan Jaff
2c720214fa fix langsmith log user api key, user_id etc 2024-07-17 11:19:08 -07:00
Krrish Dholakia
d2e64f21f3 fix(litellm_logging.py): fix async caching for sync streaming calls (don't do it)
Checks if call is async before running async caching for streaming call

Fixes https://github.com/BerriAI/litellm/issues/4511#issuecomment-2233211808
2024-07-17 11:15:30 -07:00
Ishaan Jaff
7211bbcfab
Merge pull request #4755 from BerriAI/ui_fix_login
ui-fix: clear token when user logging in
2024-07-17 11:03:43 -07:00
Ishaan Jaff
ea55c5c857 ui clear token when user logging in 2024-07-17 11:02:33 -07:00
Ishaan Jaff
df446c52e4 test api_key not logged on langsmith 2024-07-17 10:56:33 -07:00
Ishaan Jaff
0890299f65 test langmsith logging 2024-07-17 10:08:29 -07:00
Ishaan Jaff
0119ca1ce1 fix langsmith - don't log api_key 2024-07-17 10:04:36 -07:00
Krrish Dholakia
e7f8ee2aba fix(test_key_generate_prisma.py): pass user_api_key_dict to test call 2024-07-17 08:29:21 -07:00
lucca
d06456b16f
groq tools 2024-07-17 10:30:44 -03:00
Krish Dholakia
606466d5fc
Merge pull request #4746 from BerriAI/litellm_anthropic_translation
fix(factory.py): use stronger typing for anthropic translation
2024-07-16 22:15:51 -07:00
Krrish Dholakia
3630896fde fix(team_endpoints.py): fix check 2024-07-16 22:05:48 -07:00
Krrish Dholakia
bc9f5eb628 fix(factory.py): handle content not being set 2024-07-16 21:51:30 -07:00
Ishaan Jaff
ee33a80486 fix remove index from tool calls cohere error 2024-07-16 21:49:45 -07:00
Krish Dholakia
5e1e413de0
Merge pull request #4742 from BerriAI/litellm_logging_fix
fix(proxy/utils.py): fix failure logging for rejected requests
2024-07-16 21:45:06 -07:00
Krish Dholakia
96b46a4d49
Merge branch 'main' into litellm_logging_fix 2024-07-16 21:45:00 -07:00
Krrish Dholakia
94af72a857 fix(internal_user_endpoints.py): delete associated invitation links before deleting user in /user/delete
Fixes https://github.com/BerriAI/litellm/issues/4740
2024-07-16 21:43:17 -07:00
Ishaan Jaff
78c41f471f fix linting error 2024-07-16 21:43:17 -07:00
Ishaan Jaff
02c786a040 bump: version 1.41.23 → 1.41.24 2024-07-16 21:43:17 -07:00
Ishaan Jaff
3ef8d0c97e test - raise correct Auth exception for anthropic API 2024-07-16 21:43:17 -07:00
Ishaan Jaff
6d62fb71ee anthropic - raise Authentication error when no api key provided 2024-07-16 21:43:17 -07:00
davidschuler-8451
9293305895 feat: enables batch embedding support for triton 2024-07-16 21:43:17 -07:00
Ishaan Jaff
f52102e2e8 docs how to use custom header for litellm proxy 2024-07-16 21:43:17 -07:00
Ishaan Jaff
6c872fea1d test_custom_api_key_header_name 2024-07-16 21:43:17 -07:00
Ishaan Jaff
29050d7c06 fix check if user passed custom header 2024-07-16 21:43:17 -07:00
Ishaan Jaff
d6c5b2e02c add example on how to use litellm_key_header_name 2024-07-16 21:43:17 -07:00