Commit graph

9496 commits

Author SHA1 Message Date
Ishaan Jaff
f945e7009b test streaming logs to langsmith 2024-07-17 16:25:32 -07:00
Ishaan Jaff
f21a92cadc test langsmith 2024-07-17 16:08:55 -07:00
Ishaan Jaff
5f04f7b7c1 fix langsmith logging for streaming 2024-07-17 16:04:45 -07:00
Ishaan Jaff
9c00fb64c4 use langsmith as a custom callback class 2024-07-17 15:35:13 -07:00
skucherlapati
5297d33426 max_tokens for compatibility 2024-07-17 15:32:42 -07:00
skucherlapati
3425c5f506 rename input tokens key 2024-07-17 15:30:37 -07:00
Ishaan Jaff
b2b180e254 langsmith use verbose logger 2024-07-17 15:23:20 -07:00
Ishaan Jaff
ed533bab34 fix testing langsmith logging 2024-07-17 15:14:57 -07:00
skucherlapati
db3d6925c6 add medlm cost calc 2024-07-17 14:54:54 -07:00
Krrish Dholakia
a176feeacc fix(utils.py): return optional params from groq 2024-07-17 12:09:08 -07:00
Ishaan Jaff
1334bca371 fix use AsyncHTTPHandler for logging langsmith requests 2024-07-17 11:49:48 -07:00
Ishaan Jaff
8955d783d1 test correct fields are logged on langsmith 2024-07-17 11:29:29 -07:00
Krrish Dholakia
73bfc299f7 fix(factory.py): check if empty text block passed in (anthropic_messages_pt) 2024-07-17 11:27:22 -07:00
Ishaan Jaff
2c720214fa fix langsmith log user api key, user_id etc 2024-07-17 11:19:08 -07:00
Krrish Dholakia
d2e64f21f3 fix(litellm_logging.py): fix async caching for sync streaming calls (don't do it)
Checks if call is async before running async caching for streaming call

Fixes https://github.com/BerriAI/litellm/issues/4511#issuecomment-2233211808
2024-07-17 11:15:30 -07:00
Ishaan Jaff
df446c52e4 test api_key not logged on langsmith 2024-07-17 10:56:33 -07:00
Ishaan Jaff
0890299f65 test langmsith logging 2024-07-17 10:08:29 -07:00
Ishaan Jaff
0119ca1ce1 fix langsmith - don't log api_key 2024-07-17 10:04:36 -07:00
Krrish Dholakia
e7f8ee2aba fix(test_key_generate_prisma.py): pass user_api_key_dict to test call 2024-07-17 08:29:21 -07:00
lucca
d06456b16f
groq tools 2024-07-17 10:30:44 -03:00
Krish Dholakia
606466d5fc
Merge pull request #4746 from BerriAI/litellm_anthropic_translation
fix(factory.py): use stronger typing for anthropic translation
2024-07-16 22:15:51 -07:00
Krrish Dholakia
3630896fde fix(team_endpoints.py): fix check 2024-07-16 22:05:48 -07:00
Krrish Dholakia
bc9f5eb628 fix(factory.py): handle content not being set 2024-07-16 21:51:30 -07:00
Ishaan Jaff
ee33a80486 fix remove index from tool calls cohere error 2024-07-16 21:49:45 -07:00
Krish Dholakia
96b46a4d49
Merge branch 'main' into litellm_logging_fix 2024-07-16 21:45:00 -07:00
Krrish Dholakia
94af72a857 fix(internal_user_endpoints.py): delete associated invitation links before deleting user in /user/delete
Fixes https://github.com/BerriAI/litellm/issues/4740
2024-07-16 21:43:17 -07:00
Ishaan Jaff
78c41f471f fix linting error 2024-07-16 21:43:17 -07:00
Ishaan Jaff
3ef8d0c97e test - raise correct Auth exception for anthropic API 2024-07-16 21:43:17 -07:00
Ishaan Jaff
6d62fb71ee anthropic - raise Authentication error when no api key provided 2024-07-16 21:43:17 -07:00
davidschuler-8451
9293305895 feat: enables batch embedding support for triton 2024-07-16 21:43:17 -07:00
Ishaan Jaff
6c872fea1d test_custom_api_key_header_name 2024-07-16 21:43:17 -07:00
Ishaan Jaff
29050d7c06 fix check if user passed custom header 2024-07-16 21:43:17 -07:00
Ishaan Jaff
d6c5b2e02c add example on how to use litellm_key_header_name 2024-07-16 21:43:17 -07:00
Ishaan Jaff
7338ce3d1d feat - use custom api key name 2024-07-16 21:43:17 -07:00
Krrish Dholakia
92307c9224 fix(team_endpoints.py): check if key belongs to team before returning /team/info 2024-07-16 21:43:17 -07:00
Ishaan Jaff
3736152e7d fix calculate correct alerting threshold 2024-07-16 21:43:17 -07:00
Ishaan Jaff
6c918f2373 fix tracking hanging requests 2024-07-16 21:43:16 -07:00
Ishaan Jaff
36be9967d1 fix storing request status in mem 2024-07-16 21:43:16 -07:00
Ishaan Jaff
86b311eeca fix set default value for max_file_size_mb 2024-07-16 21:43:16 -07:00
Ishaan Jaff
bbeb0316b3 fix install on python 3.8 2024-07-16 21:43:16 -07:00
Ishaan Jaff
505b4f86d3 fix installing on python3.8 2024-07-16 21:43:16 -07:00
Krrish Dholakia
ddb7627c30 fix(internal_user_endpoints.py): delete associated invitation links before deleting user in /user/delete
Fixes https://github.com/BerriAI/litellm/issues/4740
2024-07-16 21:32:55 -07:00
Ishaan Jaff
b04d20d367 fix linting error 2024-07-16 21:21:50 -07:00
Ishaan Jaff
c2f73764cb
Merge pull request #4747 from BerriAI/litellm_fix_anthrpic_exception_format
[Fix + Test] anthropic raise litellm.AuthenticationError when no Anthropic API Key provided
2024-07-16 21:19:08 -07:00
Ishaan Jaff
012c8ab132
Merge pull request #4736 from davidschuler-8451/fix/triton-embedding-shape
fix: enables batch embedding support for triton
2024-07-16 21:17:35 -07:00
Ishaan Jaff
3a57fef448
Merge pull request #4739 from BerriAI/litellm_custom_header_master_key
feat - use custom api key header name when using litellm virtual keys
2024-07-16 21:17:17 -07:00
Krrish Dholakia
ccbc7cfb9f fix(team_endpoints.py): check if key belongs to team before returning /team/info 2024-07-16 21:17:05 -07:00
Krrish Dholakia
4cf293395b fix(utils.py): fix linting error 2024-07-16 20:57:34 -07:00
Ishaan Jaff
c1633c0f79
Merge pull request #4732 from BerriAI/litellm_fix_slack_alerting_issue
[Fix-Proxy] Slack Alerting Store Request Status in memory
2024-07-16 20:52:32 -07:00
Ishaan Jaff
dbca6bbb99 test - raise correct Auth exception for anthropic API 2024-07-16 20:44:40 -07:00