Commit graph

5143 commits

Author SHA1 Message Date
Krish Dholakia
10b71b0ff1
Update README.md 2024-01-02 17:22:44 +05:30
ishaan-jaff
c27b1fc5f8 (feat) proxy swagger - make admin link clickable 2024-01-02 17:04:32 +05:30
ishaan-jaff
8186af64c7 (docs) xinference on proxy 2024-01-02 16:57:25 +05:30
ishaan-jaff
8f8ac03961 (docs) proxy - using xinference 2024-01-02 16:55:10 +05:30
ishaan-jaff
14738ec89d (test) xinference on litellm router 2024-01-02 16:51:08 +05:30
Ishaan Jaff
5bf44e8a64
Update README.md - add xinference [Xorbits Inference] 2024-01-02 16:38:35 +05:30
ishaan-jaff
bfbed2d93d (test) xinference embeddings 2024-01-02 15:41:51 +05:30
ishaan-jaff
fdd4e72503 (docs) xinference embedding 2024-01-02 15:39:25 +05:30
ishaan-jaff
790dcff5e0 (feat) add xinference as an embedding provider 2024-01-02 15:32:26 +05:30
ishaan-jaff
0d0ee9e108 (docs) passing user config 2024-01-02 14:43:02 +05:30
Krrish Dholakia
0fffcc1579 fix(utils.py): support token counting for gpt-4-vision models 2024-01-02 14:41:42 +05:30
ishaan-jaff
eda6ab8cdc bump: version 1.16.9 → 1.16.10 2024-01-02 14:39:12 +05:30
ishaan-jaff
1efd1cb30f (docs) passing user_config to completion 2024-01-02 14:19:44 +05:30
ishaan-jaff
bfae0fe935 (test) proxy - pass user_config 2024-01-02 14:15:03 +05:30
ishaan-jaff
075eb1a516 (types) routerConfig 2024-01-02 14:14:29 +05:30
ishaan-jaff
60164cd5e4 (docs) pass user config to proxy / router 2024-01-02 14:14:14 +05:30
ishaan-jaff
9afdc8b4ee (feat) add Router init Pydantic Type 2024-01-02 13:30:24 +05:30
Krrish Dholakia
a9f58ec100 build(model_prices_and_context_window.json): add azure gpt-4-turbo, gpt-4-turbo-vision, dall-e-2 and dall-e-3 pricing 2024-01-02 12:50:15 +05:30
ishaan-jaff
1f8fc6d2a7 (feat) litellm add types for completion, embedding request 2024-01-02 12:27:08 +05:30
ishaan-jaff
6d2b9fd470 (feat) use - user router for aembedding 2024-01-02 12:27:08 +05:30
Krrish Dholakia
2ab31bcaf8 fix(lowest_tpm_rpm.py): handle null case for text/message input 2024-01-02 12:24:29 +05:30
ishaan-jaff
11f92c0074 (docs) router- init params 2024-01-02 12:14:32 +05:30
ishaan-jaff
0acaaf8f8f (test) sustained load test proxy 2024-01-02 12:10:34 +05:30
ishaan-jaff
31a896908b (test) proxy - use, user provided model_list 2024-01-02 12:10:34 +05:30
ishaan-jaff
ddc31c4810 (feat) proxy - use user_config for /chat/compeltions 2024-01-02 12:10:34 +05:30
Krrish Dholakia
a37a18ca80 feat(router.py): add support for retry/fallbacks for async embedding calls 2024-01-02 11:54:28 +05:30
Krrish Dholakia
c12e3bd565 fix(router.py): fix model name passed through 2024-01-02 11:15:30 +05:30
Krrish Dholakia
dff4c172d0 refactor(test_router_caching.py): move tpm/rpm routing tests to separate file 2024-01-02 11:10:11 +05:30
ishaan-jaff
18ef244230 (test) bedrock-test passing boto3 client 2024-01-02 10:23:28 +05:30
ishaan-jaff
d1e8d13c4f (fix) init_bedrock_client 2024-01-01 22:48:56 +05:30
Ishaan Jaff
e0dfbdcd68
Rename Dockerfile_alpine to Dockerfile.alpine 2024-01-01 22:11:11 +05:30
ishaan-jaff
7a46699eca (feat) build-push alpine Dockerfile 2024-01-01 22:09:23 +05:30
Ishaan Jaff
743a6abe34
Create Dockerfile_alpine 2024-01-01 22:01:44 +05:30
Ishaan Jaff
9adcfedc04
(test) fix test_get_model_cost_map.py 2024-01-01 21:58:48 +05:30
Krrish Dholakia
6884428556 build(model_prices_and_context_window.json): add openai dall-e-2 and dall-e-3 pricing 2024-01-01 21:41:09 +05:30
Krrish Dholakia
a83e2e07cf fix(router.py): correctly raise no model available error
https://github.com/BerriAI/litellm/issues/1289
2024-01-01 21:22:42 +05:30
Krrish Dholakia
91e6b2e79a bump: version 1.16.8 → 1.16.9 2024-01-01 20:47:17 +05:30
Krrish Dholakia
95f850fecc docs(ui.md): add docs on self serve ui flow 2024-01-01 18:25:52 +05:30
Ishaan Jaff
9cb5a2bec0
Merge pull request #1290 from fcakyon/patch-1
fix typos & add missing names for azure models
2024-01-01 17:58:17 +05:30
Krrish Dholakia
61cd800b9f fix(ui/admin.py): handles trailing '/' case 2024-01-01 17:49:54 +05:30
Krrish Dholakia
e1e3721917 build(user.py): fix page param read issue 2024-01-01 17:25:52 +05:30
Krrish Dholakia
ff3f3844c7 build(ui/): Add dockerfile for ui 2024-01-01 17:18:44 +05:30
Krrish Dholakia
a41e56a730 fix(proxy_server.py): enabling user auth via ui
https://github.com/BerriAI/litellm/issues/1231
2024-01-01 17:14:24 +05:30
fatih
29ebd23228
Update model_prices_and_context_window.json 2024-01-01 14:13:00 +03:00
fatih
6566ebd815
update azure turbo namings 2024-01-01 13:03:08 +03:00
fatih
08d23aafc0
fix a typo 2024-01-01 11:57:48 +03:00
Krrish Dholakia
ca40a88987 fix(proxy_server.py): check if user email in user db 2024-01-01 14:19:59 +05:30
fatih
7f5b2bf290
fix typos & add missing names for azure models 2024-01-01 11:49:46 +03:00
ishaan-jaff
7623c1a846 (feat) proxy - only use print_verbose 2024-01-01 13:52:11 +05:30
ishaan-jaff
84cfa1c42a (test) ci/cd 2024-01-01 13:51:27 +05:30