Commit graph

15087 commits

Author SHA1 Message Date
Ishaan Jaff
14f5cab09a fix medllm test 2024-07-17 20:19:37 -07:00
Ishaan Jaff
f9592b1c06 ci/cd run again 2024-07-17 19:57:47 -07:00
Ishaan Jaff
e7372954a4
Merge pull request #4765 from skucherlapati/bug_4757_add_medlm_to_cost_calc
Fix failing tests on PR-4760
2024-07-17 19:39:20 -07:00
Ishaan Jaff
91fe964dc0 fix langsmith logging test 2024-07-17 19:32:22 -07:00
skucherlapati
ce474ff008 fix failing tests on PR-4760 2024-07-17 19:32:17 -07:00
Ishaan Jaff
a6a9a186ad ci/cd run again 2024-07-17 18:40:35 -07:00
Ishaan Jaff
91cd3ab7f8 fix langsmith logging test 2024-07-17 18:34:49 -07:00
Ishaan Jaff
3dfeee03d0 fix pre call utils on embedding 2024-07-17 18:29:34 -07:00
Ishaan Jaff
01f36797ae test lakera ai on embeddings 2024-07-17 18:28:39 -07:00
Ishaan Jaff
b2bf5ad3d0 lakera run on /embeddings 2024-07-17 18:27:05 -07:00
Ishaan Jaff
db316dd097
Merge pull request #4760 from skucherlapati/bug_4757_add_medlm_to_cost_calc
Add Medlm cost calc
2024-07-17 18:01:03 -07:00
Ishaan Jaff
703ff8ca28
Merge pull request #4763 from maamalama/main
Helicone headers to metadata
2024-07-17 17:59:57 -07:00
Ishaan Jaff
9753c3676a fix run moderation check on embedding 2024-07-17 17:59:20 -07:00
Ishaan Jaff
3110abc832 shorten predibase streaming test 2024-07-17 17:50:42 -07:00
Ishaan Jaff
b94ba48ccc ci/cd run again 2024-07-17 17:43:47 -07:00
Ishaan Jaff
613bbe306f fix triton embedding test 2024-07-17 17:29:22 -07:00
Ishaan Jaff
03f79f78db fix custom Logger is None 2024-07-17 17:27:46 -07:00
Krrish Dholakia
0a94953896 fix(router.py): check for request_timeout in acompletion
support 'request_timeout' param in router acompletion
2024-07-17 17:19:06 -07:00
maamalama
9d157c50a4 Helicone headers to metadata 2024-07-17 17:06:42 -07:00
Ishaan Jaff
5faa840eb1
Merge pull request #4751 from themrzmaster/main
add new groq tool models
2024-07-17 16:54:53 -07:00
Ishaan Jaff
ee53b9093b
Merge pull request #4758 from BerriAI/litellm_langsmith_async_support
[Feat] Use Async Httpx client for langsmith logging
2024-07-17 16:54:40 -07:00
Ishaan Jaff
a77536b202 test_langsmith_logging_with_streaming_and_metadata 2024-07-17 16:51:26 -07:00
Krish Dholakia
0faa3510a7
Merge pull request #4756 from BerriAI/litellm_fix_async_caching
fix(litellm_logging.py): don't run async caching for sync streaming calls
2024-07-17 16:44:48 -07:00
Ishaan Jaff
bf793598b5
Merge pull request #4757 from BerriAI/litellm_langsmith_log_user_id
[Feat] Proxy + Langsmith - Log user_api_key_user_id, user_api_key_team_alias
2024-07-17 16:40:42 -07:00
Ishaan Jaff
8cb228bf16
Merge pull request #4754 from BerriAI/litellm_fix_langsmith_api_key_logged
[Fix] Langsmith - Don't Log Provider API Keys
2024-07-17 16:40:32 -07:00
Krrish Dholakia
07d90f6739 feat(aporio_ai.py): support aporio ai prompt injection for chat completion requests
Closes https://github.com/BerriAI/litellm/issues/2950
2024-07-17 16:38:47 -07:00
Ishaan Jaff
f462e6a46c langsmith logs 2024-07-17 16:37:24 -07:00
Ishaan Jaff
f945e7009b test streaming logs to langsmith 2024-07-17 16:25:32 -07:00
Ishaan Jaff
f21a92cadc test langsmith 2024-07-17 16:08:55 -07:00
Ishaan Jaff
5f04f7b7c1 fix langsmith logging for streaming 2024-07-17 16:04:45 -07:00
Krrish Dholakia
e587d32058 docs(scrub_data.md): add scrub logging data tutorial to docs 2024-07-17 15:39:31 -07:00
Ishaan Jaff
9c00fb64c4 use langsmith as a custom callback class 2024-07-17 15:35:13 -07:00
skucherlapati
5297d33426 max_tokens for compatibility 2024-07-17 15:32:42 -07:00
skucherlapati
3425c5f506 rename input tokens key 2024-07-17 15:30:37 -07:00
Ishaan Jaff
b2b180e254 langsmith use verbose logger 2024-07-17 15:23:20 -07:00
Ishaan Jaff
ed533bab34 fix testing langsmith logging 2024-07-17 15:14:57 -07:00
skucherlapati
db3d6925c6 add medlm cost calc 2024-07-17 14:54:54 -07:00
Krrish Dholakia
a176feeacc fix(utils.py): return optional params from groq 2024-07-17 12:09:08 -07:00
Ishaan Jaff
1334bca371 fix use AsyncHTTPHandler for logging langsmith requests 2024-07-17 11:49:48 -07:00
Ishaan Jaff
8955d783d1 test correct fields are logged on langsmith 2024-07-17 11:29:29 -07:00
Krrish Dholakia
73bfc299f7 fix(factory.py): check if empty text block passed in (anthropic_messages_pt) 2024-07-17 11:27:22 -07:00
Ishaan Jaff
2c720214fa fix langsmith log user api key, user_id etc 2024-07-17 11:19:08 -07:00
Krrish Dholakia
d2e64f21f3 fix(litellm_logging.py): fix async caching for sync streaming calls (don't do it)
Checks if call is async before running async caching for streaming call

Fixes https://github.com/BerriAI/litellm/issues/4511#issuecomment-2233211808
2024-07-17 11:15:30 -07:00
Ishaan Jaff
7211bbcfab
Merge pull request #4755 from BerriAI/ui_fix_login
ui-fix: clear token when user logging in
2024-07-17 11:03:43 -07:00
Ishaan Jaff
ea55c5c857 ui clear token when user logging in 2024-07-17 11:02:33 -07:00
Ishaan Jaff
df446c52e4 test api_key not logged on langsmith 2024-07-17 10:56:33 -07:00
Ishaan Jaff
0890299f65 test langmsith logging 2024-07-17 10:08:29 -07:00
Ishaan Jaff
0119ca1ce1 fix langsmith - don't log api_key 2024-07-17 10:04:36 -07:00
Krrish Dholakia
e7f8ee2aba fix(test_key_generate_prisma.py): pass user_api_key_dict to test call 2024-07-17 08:29:21 -07:00
lucca
d06456b16f
groq tools 2024-07-17 10:30:44 -03:00