Commit graph

9559 commits

Author SHA1 Message Date
Ishaan Jaff
f8bdfe7cc3 fix test amazing vertex medlm 2024-07-18 20:35:14 -07:00
Ishaan Jaff
946db012d4 docs free/paid tier 2024-07-18 20:35:14 -07:00
Ishaan Jaff
59d599d5fd test adding free / paid tier to metadata 2024-07-18 20:35:14 -07:00
Ishaan Jaff
de8c92b11d feat - enterprise 2024-07-18 20:35:14 -07:00
Ishaan Jaff
0e70b5df14 router - use free paid tier routing 2024-07-18 20:35:14 -07:00
Ishaan Jaff
229b7a6493 helper to get_deployments_for_tier 2024-07-18 20:35:14 -07:00
Ishaan Jaff
dfc674622b litellm router - use free / paid tier 2024-07-18 20:35:14 -07:00
Ishaan Jaff
f3e0a89597 check if using tag based routing 2024-07-18 20:10:45 -07:00
Ishaan Jaff
08adda7091 control using enable_tag_filtering 2024-07-18 19:39:04 -07:00
Krrish Dholakia
96471c145e fix(bedrock_httpx.py): support jamba streaming 2024-07-18 19:36:50 -07:00
Ishaan Jaff
071091fd8c fix use tags as a litellm param 2024-07-18 19:34:45 -07:00
Ishaan Jaff
b6e60d481e fix remove previous code on free/paid tier 2024-07-18 19:24:13 -07:00
Ishaan Jaff
4d0fbfea83 router - refactor to tag based routing 2024-07-18 19:22:09 -07:00
Krrish Dholakia
cece76c4ee feat(bedrock_httpx.py): add ai21 jamba instruct as converse model
initial commit for adding ai21 jamba instruct support through bedrock converse
2024-07-18 18:24:06 -07:00
Ishaan Jaff
51525254e8 fix ui make ui session last 24 hours 2024-07-18 18:22:40 -07:00
Ishaan Jaff
81c77f33b8 fix test amazing vertex medlm 2024-07-18 18:16:00 -07:00
Ishaan Jaff
4b96cd46b2
Merge pull request #4786 from BerriAI/litellm_use_model_tier_keys
[Feat-Enterprise] Use free/paid tiers for Virtual Keys
2024-07-18 18:07:09 -07:00
Krrish Dholakia
b23a633cf1 fix(utils.py): fix status code in exception mapping 2024-07-18 18:04:59 -07:00
Ishaan Jaff
22ef951e0b docs free/paid tier 2024-07-18 18:01:30 -07:00
Krrish Dholakia
e3ca2789df fix(bedrock_httpx.py): cache response stream shape
Fixes https://github.com/BerriAI/litellm/issues/4774
2024-07-18 17:41:31 -07:00
Krrish Dholakia
30d6c1d171 fix(factory.py): handle escape characters in image url
prevents mimetype errors in vertex ai calls
2024-07-18 17:36:58 -07:00
Ishaan Jaff
f6efed06de test adding free / paid tier to metadata 2024-07-18 17:31:02 -07:00
Ishaan Jaff
fda5578263 feat - enterprise 2024-07-18 17:15:47 -07:00
Ishaan Jaff
64e38562d9 router - use free paid tier routing 2024-07-18 17:09:42 -07:00
Ishaan Jaff
88cd641089 helper to get_deployments_for_tier 2024-07-18 17:06:06 -07:00
Krrish Dholakia
4d963ab789 feat(vertex_ai_anthropic.py): support response_schema for vertex ai anthropic calls
allows passing response_schema for anthropic calls. supports schema validation.
2024-07-18 16:57:38 -07:00
Ishaan Jaff
007b959460 litellm router - use free / paid tier 2024-07-18 16:55:50 -07:00
Ishaan Jaff
99ffc5d4c3 feat - add gemini-gemma-2-27b-it 2024-07-18 15:18:56 -07:00
Marc Abramowitz
7b1c72e3f4 Alias /health/liveliness as /health/liveness
The latter is the more common term in Kubernetes, so it's nice to support that.
2024-07-18 14:29:32 -07:00
Ishaan Jaff
75ca53fab5 fix linting errors on main 2024-07-18 13:32:48 -07:00
Ishaan Jaff
eedacf5193
Merge branch 'main' into litellm_run_moderation_check_on_embedding 2024-07-18 12:44:30 -07:00
Ishaan Jaff
c453519aa1 gpt-4o-mini-2024-07-18 2024-07-18 10:42:37 -07:00
Ishaan Jaff
c521736bb8 add gpt-4o 2024-07-18 10:41:08 -07:00
Titusz
fcef2c4580
Add missing num_gpu ollama configuration parameter 2024-07-18 17:51:56 +02:00
Florian Greinacher
f8bec3a86c
feat(proxy): support hiding health check details 2024-07-18 17:21:12 +02:00
Krish Dholakia
57f6923ab6
Merge pull request #4729 from vingiarrusso/vgiarrusso/guardrails
Add enabled_roles to Guardrails configuration, Update Lakera guardrail moderation hook
2024-07-17 22:24:35 -07:00
Krish Dholakia
77656d9f11
Merge branch 'main' into litellm_aporio_integration 2024-07-17 22:14:29 -07:00
skucherlapati
2ad342e7bf add medlm models to cost map 2024-07-17 21:17:58 -07:00
Ishaan Jaff
9440754e48 ci/cd run again 2024-07-17 20:37:10 -07:00
Ishaan Jaff
c16583464a ci/cd run again 2024-07-17 20:25:43 -07:00
Ishaan Jaff
14f5cab09a fix medllm test 2024-07-17 20:19:37 -07:00
Ishaan Jaff
f9592b1c06 ci/cd run again 2024-07-17 19:57:47 -07:00
Ishaan Jaff
e7372954a4
Merge pull request #4765 from skucherlapati/bug_4757_add_medlm_to_cost_calc
Fix failing tests on PR-4760
2024-07-17 19:39:20 -07:00
Ishaan Jaff
91fe964dc0 fix langsmith logging test 2024-07-17 19:32:22 -07:00
skucherlapati
ce474ff008 fix failing tests on PR-4760 2024-07-17 19:32:17 -07:00
Ishaan Jaff
a6a9a186ad ci/cd run again 2024-07-17 18:40:35 -07:00
Ishaan Jaff
91cd3ab7f8 fix langsmith logging test 2024-07-17 18:34:49 -07:00
Ishaan Jaff
3dfeee03d0 fix pre call utils on embedding 2024-07-17 18:29:34 -07:00
Ishaan Jaff
01f36797ae test lakera ai on embeddings 2024-07-17 18:28:39 -07:00
Ishaan Jaff
db316dd097
Merge pull request #4760 from skucherlapati/bug_4757_add_medlm_to_cost_calc
Add Medlm cost calc
2024-07-17 18:01:03 -07:00