Krrish Dholakia
|
bd914c714c
|
fix(files/main.py): fix linting error
|
2024-07-19 15:48:22 -07:00 |
|
Krrish Dholakia
|
757dedd4c8
|
fix(factory.py): refactor factory to use httpx client
|
2024-07-19 15:35:05 -07:00 |
|
Krrish Dholakia
|
4c4f032a75
|
fix(factory.py): refactor factory to use httpx client
|
2024-07-19 15:32:01 -07:00 |
|
Krish Dholakia
|
f973bd8109
|
Merge branch 'main' into litellm_ai21_jamba
|
2024-07-19 15:11:55 -07:00 |
|
Ishaan Jaff
|
1797021d53
|
ci/cd run again
|
2024-07-19 14:05:22 -07:00 |
|
Ishaan Jaff
|
af80e271c9
|
ui new build
|
2024-07-19 14:02:28 -07:00 |
|
Ishaan Jaff
|
df1ac92222
|
fix add fix to update spend logs
|
2024-07-19 12:49:23 -07:00 |
|
Ishaan Jaff
|
90824e2d21
|
ui new build
|
2024-07-19 11:00:13 -07:00 |
|
Ishaan Jaff
|
ae316d2d9a
|
fix ui - make default session 24 hours
|
2024-07-19 10:17:45 -07:00 |
|
Ishaan Jaff
|
defc341f39
|
docs fireworks ai
|
2024-07-19 10:08:48 -07:00 |
|
Ishaan Jaff
|
2e766a7b1f
|
ci/cd run again
|
2024-07-19 08:25:56 -07:00 |
|
Sophia Loris
|
d779253949
|
resolve merge conflicts
|
2024-07-19 09:45:53 -05:00 |
|
Sophia Loris
|
d5c65c6be2
|
Add support for Triton streaming & triton async completions
|
2024-07-19 09:35:27 -05:00 |
|
Krish Dholakia
|
2ad1c0455a
|
Merge pull request #4773 from titusz/patch-1
Add missing `num_gpu` ollama configuration parameter
|
2024-07-18 22:47:39 -07:00 |
|
Krrish Dholakia
|
c56456be64
|
fix(anthropic.py): revert client to requests library
|
2024-07-18 22:45:41 -07:00 |
|
Marc Abramowitz
|
780a6293dc
|
Alias /health/liveliness as /health/liveness
The latter is the more common term in Kubernetes, so it's nice to support that.
|
2024-07-18 22:40:51 -07:00 |
|
Ishaan Jaff
|
6f393be66b
|
docs - tag based routing
|
2024-07-18 22:40:51 -07:00 |
|
Ishaan Jaff
|
d9c051adff
|
add tags to metadata
|
2024-07-18 22:40:51 -07:00 |
|
Ishaan Jaff
|
fa26d3f96f
|
fix test
|
2024-07-18 22:40:51 -07:00 |
|
Ishaan Jaff
|
1ab5c1a227
|
check if using tag based routing
|
2024-07-18 22:40:51 -07:00 |
|
Ishaan Jaff
|
52d0f6a808
|
control using enable_tag_filtering
|
2024-07-18 22:40:51 -07:00 |
|
Ishaan Jaff
|
e298515034
|
fix use tags as a litellm param
|
2024-07-18 22:40:51 -07:00 |
|
Ishaan Jaff
|
79c5788ad9
|
fix remove previous code on free/paid tier
|
2024-07-18 22:40:51 -07:00 |
|
Ishaan Jaff
|
ad46e6a61f
|
router - refactor to tag based routing
|
2024-07-18 22:40:51 -07:00 |
|
Ishaan Jaff
|
38c50e674e
|
fix ui make ui session last 24 hours
|
2024-07-18 22:40:51 -07:00 |
|
Krrish Dholakia
|
db3063d3d3
|
test: fix test
|
2024-07-18 22:40:51 -07:00 |
|
Ishaan Jaff
|
d42963a0ae
|
router - use free paid tier routing
|
2024-07-18 22:40:51 -07:00 |
|
Ishaan Jaff
|
b0f0898f2f
|
helper to get_deployments_for_tier
|
2024-07-18 22:40:51 -07:00 |
|
Krrish Dholakia
|
f2401d6d5e
|
feat(vertex_ai_anthropic.py): support response_schema for vertex ai anthropic calls
allows passing response_schema for anthropic calls. supports schema validation.
|
2024-07-18 22:40:35 -07:00 |
|
Ishaan Jaff
|
154fa64d0a
|
Merge pull request #4781 from msabramo/liveness-alias-of-liveliness
Alias `/health/liveliness` as `/health/liveness`
|
2024-07-18 22:20:09 -07:00 |
|
Ishaan Jaff
|
f04397e19a
|
Merge pull request #4789 from BerriAI/litellm_router_refactor
[Feat-Router] - Tag based routing
|
2024-07-18 22:19:18 -07:00 |
|
Ishaan Jaff
|
4dff995932
|
Merge pull request #4787 from BerriAI/litellm_increase_default_session_time_ui
[Fix] Admin UI - make ui session last 12 hours
|
2024-07-18 22:19:09 -07:00 |
|
Ishaan Jaff
|
a4338bec11
|
docs - tag based routing
|
2024-07-18 22:18:10 -07:00 |
|
Krrish Dholakia
|
a0ac3e3c7d
|
test: fix test
|
2024-07-18 22:05:47 -07:00 |
|
Ishaan Jaff
|
502b739b33
|
add tags to metadata
|
2024-07-18 21:55:53 -07:00 |
|
Ishaan Jaff
|
331e2bbc17
|
fix test
|
2024-07-18 21:49:36 -07:00 |
|
Krish Dholakia
|
967964a51c
|
Merge branch 'main' into litellm_anthropic_response_schema_support
|
2024-07-18 20:40:16 -07:00 |
|
Ishaan Jaff
|
f8bdfe7cc3
|
fix test amazing vertex medlm
|
2024-07-18 20:35:14 -07:00 |
|
Ishaan Jaff
|
946db012d4
|
docs free/paid tier
|
2024-07-18 20:35:14 -07:00 |
|
Ishaan Jaff
|
59d599d5fd
|
test adding free / paid tier to metadata
|
2024-07-18 20:35:14 -07:00 |
|
Ishaan Jaff
|
de8c92b11d
|
feat - enterprise
|
2024-07-18 20:35:14 -07:00 |
|
Ishaan Jaff
|
0e70b5df14
|
router - use free paid tier routing
|
2024-07-18 20:35:14 -07:00 |
|
Ishaan Jaff
|
229b7a6493
|
helper to get_deployments_for_tier
|
2024-07-18 20:35:14 -07:00 |
|
Ishaan Jaff
|
dfc674622b
|
litellm router - use free / paid tier
|
2024-07-18 20:35:14 -07:00 |
|
Ishaan Jaff
|
f3e0a89597
|
check if using tag based routing
|
2024-07-18 20:10:45 -07:00 |
|
Ishaan Jaff
|
08adda7091
|
control using enable_tag_filtering
|
2024-07-18 19:39:04 -07:00 |
|
Krrish Dholakia
|
96471c145e
|
fix(bedrock_httpx.py): support jamba streaming
|
2024-07-18 19:36:50 -07:00 |
|
Ishaan Jaff
|
071091fd8c
|
fix use tags as a litellm param
|
2024-07-18 19:34:45 -07:00 |
|
Ishaan Jaff
|
b6e60d481e
|
fix remove previous code on free/paid tier
|
2024-07-18 19:24:13 -07:00 |
|
Ishaan Jaff
|
4d0fbfea83
|
router - refactor to tag based routing
|
2024-07-18 19:22:09 -07:00 |
|