Commit graph

14849 commits

Author SHA1 Message Date
Ishaan Jaff
eedacf5193
Merge branch 'main' into litellm_run_moderation_check_on_embedding 2024-07-18 12:44:30 -07:00
Ishaan Jaff
51b3ef87d3 docs litellm telemetry 2024-07-18 12:36:16 -07:00
Ishaan Jaff
e719986c81
Merge pull request #4776 from BerriAI/litellm_add_gpt-4o
[Feat] Add OpenAI GPT-4o mini
2024-07-18 10:44:20 -07:00
Ishaan Jaff
b2623ed8a3 add gpt-4o-mini-2024-07-18 to docs 2024-07-18 10:43:33 -07:00
Ishaan Jaff
c453519aa1 gpt-4o-mini-2024-07-18 2024-07-18 10:42:37 -07:00
Ishaan Jaff
c521736bb8 add gpt-4o 2024-07-18 10:41:08 -07:00
Krish Dholakia
d8ccd7ef79
Merge pull request #4772 from fgreinacher/feat/minimal-health
feat(proxy): support hiding health check details
2024-07-18 09:58:04 -07:00
Florian Greinacher
f8bec3a86c
feat(proxy): support hiding health check details 2024-07-18 17:21:12 +02:00
Krish Dholakia
57f6923ab6
Merge pull request #4729 from vingiarrusso/vgiarrusso/guardrails
Add enabled_roles to Guardrails configuration, Update Lakera guardrail moderation hook
2024-07-17 22:24:35 -07:00
Krish Dholakia
e2f2c3f02f
Merge pull request #4762 from BerriAI/litellm_aporio_integration
feat(aporio_ai.py): support aporio ai prompt injection for chat completion requests
2024-07-17 22:14:34 -07:00
Krish Dholakia
77656d9f11
Merge branch 'main' into litellm_aporio_integration 2024-07-17 22:14:29 -07:00
Krish Dholakia
f359335b5b
Merge pull request #4766 from skucherlapati/add_medlm_models_to_cost_map
Add medlm models to cost map
2024-07-17 22:07:17 -07:00
skucherlapati
2ad342e7bf add medlm models to cost map 2024-07-17 21:17:58 -07:00
skucherlapati
f1747adac6 adding medlm models 2024-07-17 21:13:35 -07:00
Ishaan Jaff
9440754e48 ci/cd run again 2024-07-17 20:37:10 -07:00
Ishaan Jaff
c16583464a ci/cd run again 2024-07-17 20:25:43 -07:00
Ishaan Jaff
14f5cab09a fix medllm test 2024-07-17 20:19:37 -07:00
Ishaan Jaff
f9592b1c06 ci/cd run again 2024-07-17 19:57:47 -07:00
Ishaan Jaff
e7372954a4
Merge pull request #4765 from skucherlapati/bug_4757_add_medlm_to_cost_calc
Fix failing tests on PR-4760
2024-07-17 19:39:20 -07:00
Ishaan Jaff
91fe964dc0 fix langsmith logging test 2024-07-17 19:32:22 -07:00
skucherlapati
ce474ff008 fix failing tests on PR-4760 2024-07-17 19:32:17 -07:00
Ishaan Jaff
a6a9a186ad ci/cd run again 2024-07-17 18:40:35 -07:00
Ishaan Jaff
91cd3ab7f8 fix langsmith logging test 2024-07-17 18:34:49 -07:00
Ishaan Jaff
3dfeee03d0 fix pre call utils on embedding 2024-07-17 18:29:34 -07:00
Ishaan Jaff
01f36797ae test lakera ai on embeddings 2024-07-17 18:28:39 -07:00
Ishaan Jaff
b2bf5ad3d0 lakera run on /embeddings 2024-07-17 18:27:05 -07:00
Ishaan Jaff
db316dd097
Merge pull request #4760 from skucherlapati/bug_4757_add_medlm_to_cost_calc
Add Medlm cost calc
2024-07-17 18:01:03 -07:00
Ishaan Jaff
703ff8ca28
Merge pull request #4763 from maamalama/main
Helicone headers to metadata
2024-07-17 17:59:57 -07:00
Ishaan Jaff
9753c3676a fix run moderation check on embedding 2024-07-17 17:59:20 -07:00
Ishaan Jaff
3110abc832 shorten predibase streaming test 2024-07-17 17:50:42 -07:00
Ishaan Jaff
b94ba48ccc ci/cd run again 2024-07-17 17:43:47 -07:00
Ishaan Jaff
613bbe306f fix triton embedding test 2024-07-17 17:29:22 -07:00
Ishaan Jaff
03f79f78db fix custom Logger is None 2024-07-17 17:27:46 -07:00
Krrish Dholakia
0a94953896 fix(router.py): check for request_timeout in acompletion
support 'request_timeout' param in router acompletion
2024-07-17 17:19:06 -07:00
maamalama
9d157c50a4 Helicone headers to metadata 2024-07-17 17:06:42 -07:00
Ishaan Jaff
5faa840eb1
Merge pull request #4751 from themrzmaster/main
add new groq tool models
2024-07-17 16:54:53 -07:00
Ishaan Jaff
ee53b9093b
Merge pull request #4758 from BerriAI/litellm_langsmith_async_support
[Feat] Use Async Httpx client for langsmith logging
2024-07-17 16:54:40 -07:00
Ishaan Jaff
a77536b202 test_langsmith_logging_with_streaming_and_metadata 2024-07-17 16:51:26 -07:00
Krish Dholakia
0faa3510a7
Merge pull request #4756 from BerriAI/litellm_fix_async_caching
fix(litellm_logging.py): don't run async caching for sync streaming calls
2024-07-17 16:44:48 -07:00
Ishaan Jaff
bf793598b5
Merge pull request #4757 from BerriAI/litellm_langsmith_log_user_id
[Feat] Proxy + Langsmith - Log user_api_key_user_id, user_api_key_team_alias
2024-07-17 16:40:42 -07:00
Ishaan Jaff
8cb228bf16
Merge pull request #4754 from BerriAI/litellm_fix_langsmith_api_key_logged
[Fix] Langsmith - Don't Log Provider API Keys
2024-07-17 16:40:32 -07:00
Krrish Dholakia
07d90f6739 feat(aporio_ai.py): support aporio ai prompt injection for chat completion requests
Closes https://github.com/BerriAI/litellm/issues/2950
2024-07-17 16:38:47 -07:00
Ishaan Jaff
f462e6a46c langsmith logs 2024-07-17 16:37:24 -07:00
Ishaan Jaff
f945e7009b test streaming logs to langsmith 2024-07-17 16:25:32 -07:00
Ishaan Jaff
f21a92cadc test langsmith 2024-07-17 16:08:55 -07:00
Ishaan Jaff
5f04f7b7c1 fix langsmith logging for streaming 2024-07-17 16:04:45 -07:00
Krrish Dholakia
e587d32058 docs(scrub_data.md): add scrub logging data tutorial to docs 2024-07-17 15:39:31 -07:00
Ishaan Jaff
9c00fb64c4 use langsmith as a custom callback class 2024-07-17 15:35:13 -07:00
skucherlapati
5297d33426 max_tokens for compatibility 2024-07-17 15:32:42 -07:00
skucherlapati
3425c5f506 rename input tokens key 2024-07-17 15:30:37 -07:00