Commit graph

3588 commits

Author SHA1 Message Date
Krrish Dholakia
96471c145e fix(bedrock_httpx.py): support jamba streaming 2024-07-18 19:36:50 -07:00
Ishaan Jaff
4d0fbfea83 router - refactor to tag based routing 2024-07-18 19:22:09 -07:00
Ishaan Jaff
81c77f33b8 fix test amazing vertex medlm 2024-07-18 18:16:00 -07:00
Ishaan Jaff
4b96cd46b2
Merge pull request #4786 from BerriAI/litellm_use_model_tier_keys
[Feat-Enterprise] Use free/paid tiers for Virtual Keys
2024-07-18 18:07:09 -07:00
Krrish Dholakia
30d6c1d171 fix(factory.py): handle escape characters in image url
prevents mimetype errors in vertex ai calls
2024-07-18 17:36:58 -07:00
Ishaan Jaff
f6efed06de test adding free / paid tier to metadata 2024-07-18 17:31:02 -07:00
Ishaan Jaff
64e38562d9 router - use free paid tier routing 2024-07-18 17:09:42 -07:00
Krrish Dholakia
4d963ab789 feat(vertex_ai_anthropic.py): support response_schema for vertex ai anthropic calls
allows passing response_schema for anthropic calls. supports schema validation.
2024-07-18 16:57:38 -07:00
Ishaan Jaff
eedacf5193
Merge branch 'main' into litellm_run_moderation_check_on_embedding 2024-07-18 12:44:30 -07:00
Krish Dholakia
57f6923ab6
Merge pull request #4729 from vingiarrusso/vgiarrusso/guardrails
Add enabled_roles to Guardrails configuration, Update Lakera guardrail moderation hook
2024-07-17 22:24:35 -07:00
skucherlapati
2ad342e7bf add medlm models to cost map 2024-07-17 21:17:58 -07:00
Ishaan Jaff
9440754e48 ci/cd run again 2024-07-17 20:37:10 -07:00
Ishaan Jaff
c16583464a ci/cd run again 2024-07-17 20:25:43 -07:00
Ishaan Jaff
14f5cab09a fix medllm test 2024-07-17 20:19:37 -07:00
Ishaan Jaff
f9592b1c06 ci/cd run again 2024-07-17 19:57:47 -07:00
Ishaan Jaff
e7372954a4
Merge pull request #4765 from skucherlapati/bug_4757_add_medlm_to_cost_calc
Fix failing tests on PR-4760
2024-07-17 19:39:20 -07:00
Ishaan Jaff
91fe964dc0 fix langsmith logging test 2024-07-17 19:32:22 -07:00
skucherlapati
ce474ff008 fix failing tests on PR-4760 2024-07-17 19:32:17 -07:00
Ishaan Jaff
a6a9a186ad ci/cd run again 2024-07-17 18:40:35 -07:00
Ishaan Jaff
91cd3ab7f8 fix langsmith logging test 2024-07-17 18:34:49 -07:00
Ishaan Jaff
01f36797ae test lakera ai on embeddings 2024-07-17 18:28:39 -07:00
Ishaan Jaff
db316dd097
Merge pull request #4760 from skucherlapati/bug_4757_add_medlm_to_cost_calc
Add Medlm cost calc
2024-07-17 18:01:03 -07:00
Ishaan Jaff
3110abc832 shorten predibase streaming test 2024-07-17 17:50:42 -07:00
Ishaan Jaff
b94ba48ccc ci/cd run again 2024-07-17 17:43:47 -07:00
Ishaan Jaff
613bbe306f fix triton embedding test 2024-07-17 17:29:22 -07:00
Ishaan Jaff
ee53b9093b
Merge pull request #4758 from BerriAI/litellm_langsmith_async_support
[Feat] Use Async Httpx client for langsmith logging
2024-07-17 16:54:40 -07:00
Ishaan Jaff
a77536b202 test_langsmith_logging_with_streaming_and_metadata 2024-07-17 16:51:26 -07:00
Krish Dholakia
0faa3510a7
Merge pull request #4756 from BerriAI/litellm_fix_async_caching
fix(litellm_logging.py): don't run async caching for sync streaming calls
2024-07-17 16:44:48 -07:00
Ishaan Jaff
bf793598b5
Merge pull request #4757 from BerriAI/litellm_langsmith_log_user_id
[Feat] Proxy + Langsmith - Log user_api_key_user_id, user_api_key_team_alias
2024-07-17 16:40:42 -07:00
Ishaan Jaff
8cb228bf16
Merge pull request #4754 from BerriAI/litellm_fix_langsmith_api_key_logged
[Fix] Langsmith - Don't Log Provider API Keys
2024-07-17 16:40:32 -07:00
Ishaan Jaff
f945e7009b test streaming logs to langsmith 2024-07-17 16:25:32 -07:00
Ishaan Jaff
f21a92cadc test langsmith 2024-07-17 16:08:55 -07:00
Ishaan Jaff
ed533bab34 fix testing langsmith logging 2024-07-17 15:14:57 -07:00
skucherlapati
db3d6925c6 add medlm cost calc 2024-07-17 14:54:54 -07:00
Ishaan Jaff
8955d783d1 test correct fields are logged on langsmith 2024-07-17 11:29:29 -07:00
Krrish Dholakia
d2e64f21f3 fix(litellm_logging.py): fix async caching for sync streaming calls (don't do it)
Checks if call is async before running async caching for streaming call

Fixes https://github.com/BerriAI/litellm/issues/4511#issuecomment-2233211808
2024-07-17 11:15:30 -07:00
Ishaan Jaff
df446c52e4 test api_key not logged on langsmith 2024-07-17 10:56:33 -07:00
Ishaan Jaff
0890299f65 test langmsith logging 2024-07-17 10:08:29 -07:00
Krrish Dholakia
e7f8ee2aba fix(test_key_generate_prisma.py): pass user_api_key_dict to test call 2024-07-17 08:29:21 -07:00
Krish Dholakia
606466d5fc
Merge pull request #4746 from BerriAI/litellm_anthropic_translation
fix(factory.py): use stronger typing for anthropic translation
2024-07-16 22:15:51 -07:00
Ishaan Jaff
3ef8d0c97e test - raise correct Auth exception for anthropic API 2024-07-16 21:43:17 -07:00
davidschuler-8451
9293305895 feat: enables batch embedding support for triton 2024-07-16 21:43:17 -07:00
Ishaan Jaff
6c872fea1d test_custom_api_key_header_name 2024-07-16 21:43:17 -07:00
Krrish Dholakia
9771edb302 fix(factory.py): use stronger typing for anthropic translation
Fixes https://github.com/BerriAI/litellm/issues/4738
2024-07-16 19:58:27 -07:00
Krrish Dholakia
ec03e675c9 fix(proxy/utils.py): fix failure logging for rejected requests. + unit tests 2024-07-16 17:15:20 -07:00
Vinnie Giarrusso
b83f47e941 refactor a bit 2024-07-16 12:19:31 -07:00
Krish Dholakia
0fb88e527c
Merge pull request #4716 from pamelafox/countfuncs
Add token counting for OpenAI tools/tool_choice
2024-07-16 07:21:31 -07:00
Vinnie Giarrusso
6ff863ee00 Add enabled_roles to Guardrails configuration, Update Lakera guardrail moderation hook 2024-07-16 01:52:08 -07:00
Ishaan Jaff
a99cb5deeb run ci/cd again 2024-07-15 22:09:17 -07:00
Krrish Dholakia
a4b0740c4a fix(test_custom_callback_input.py): fix unit test for embedding logging 2024-07-15 21:47:05 -07:00