Commit graph

5275 commits

Author SHA1 Message Date
ishaan-jaff
1f8fc6d2a7 (feat) litellm add types for completion, embedding request 2024-01-02 12:27:08 +05:30
ishaan-jaff
6d2b9fd470 (feat) use - user router for aembedding 2024-01-02 12:27:08 +05:30
Krrish Dholakia
2ab31bcaf8 fix(lowest_tpm_rpm.py): handle null case for text/message input 2024-01-02 12:24:29 +05:30
ishaan-jaff
11f92c0074 (docs) router- init params 2024-01-02 12:14:32 +05:30
ishaan-jaff
0acaaf8f8f (test) sustained load test proxy 2024-01-02 12:10:34 +05:30
ishaan-jaff
31a896908b (test) proxy - use, user provided model_list 2024-01-02 12:10:34 +05:30
ishaan-jaff
ddc31c4810 (feat) proxy - use user_config for /chat/compeltions 2024-01-02 12:10:34 +05:30
Krrish Dholakia
a37a18ca80 feat(router.py): add support for retry/fallbacks for async embedding calls 2024-01-02 11:54:28 +05:30
Krrish Dholakia
c12e3bd565 fix(router.py): fix model name passed through 2024-01-02 11:15:30 +05:30
Krrish Dholakia
dff4c172d0 refactor(test_router_caching.py): move tpm/rpm routing tests to separate file 2024-01-02 11:10:11 +05:30
ishaan-jaff
18ef244230 (test) bedrock-test passing boto3 client 2024-01-02 10:23:28 +05:30
ishaan-jaff
d1e8d13c4f (fix) init_bedrock_client 2024-01-01 22:48:56 +05:30
Ishaan Jaff
e0dfbdcd68
Rename Dockerfile_alpine to Dockerfile.alpine 2024-01-01 22:11:11 +05:30
ishaan-jaff
7a46699eca (feat) build-push alpine Dockerfile 2024-01-01 22:09:23 +05:30
Ishaan Jaff
743a6abe34
Create Dockerfile_alpine 2024-01-01 22:01:44 +05:30
Ishaan Jaff
9adcfedc04
(test) fix test_get_model_cost_map.py 2024-01-01 21:58:48 +05:30
Krrish Dholakia
6884428556 build(model_prices_and_context_window.json): add openai dall-e-2 and dall-e-3 pricing 2024-01-01 21:41:09 +05:30
Krrish Dholakia
a83e2e07cf fix(router.py): correctly raise no model available error
https://github.com/BerriAI/litellm/issues/1289
2024-01-01 21:22:42 +05:30
Krrish Dholakia
91e6b2e79a bump: version 1.16.8 → 1.16.9 2024-01-01 20:47:17 +05:30
Krrish Dholakia
95f850fecc docs(ui.md): add docs on self serve ui flow 2024-01-01 18:25:52 +05:30
Ishaan Jaff
9cb5a2bec0
Merge pull request #1290 from fcakyon/patch-1
fix typos & add missing names for azure models
2024-01-01 17:58:17 +05:30
Krrish Dholakia
61cd800b9f fix(ui/admin.py): handles trailing '/' case 2024-01-01 17:49:54 +05:30
Krrish Dholakia
e1e3721917 build(user.py): fix page param read issue 2024-01-01 17:25:52 +05:30
Krrish Dholakia
ff3f3844c7 build(ui/): Add dockerfile for ui 2024-01-01 17:18:44 +05:30
Krrish Dholakia
a41e56a730 fix(proxy_server.py): enabling user auth via ui
https://github.com/BerriAI/litellm/issues/1231
2024-01-01 17:14:24 +05:30
fatih
29ebd23228
Update model_prices_and_context_window.json 2024-01-01 14:13:00 +03:00
fatih
6566ebd815
update azure turbo namings 2024-01-01 13:03:08 +03:00
fatih
08d23aafc0
fix a typo 2024-01-01 11:57:48 +03:00
Krrish Dholakia
ca40a88987 fix(proxy_server.py): check if user email in user db 2024-01-01 14:19:59 +05:30
fatih
7f5b2bf290
fix typos & add missing names for azure models 2024-01-01 11:49:46 +03:00
ishaan-jaff
7623c1a846 (feat) proxy - only use print_verbose 2024-01-01 13:52:11 +05:30
ishaan-jaff
84cfa1c42a (test) ci/cd 2024-01-01 13:51:27 +05:30
ishaan-jaff
08d57a20a7 (feat) pre-commit check print on proxy_server.py 2024-01-01 13:51:27 +05:30
Krrish Dholakia
24e7dc359d feat(proxy_server.py): introduces new /user/auth endpoint for handling user email auth
decouples streamlit ui from proxy server. this then requires the proxy to handle user auth separately.
2024-01-01 13:44:47 +05:30
ishaan-jaff
52db2a6040 (feat) proxy - remove streamlit ui on startup 2024-01-01 12:54:23 +05:30
ishaan-jaff
20236c1c69 (docs) proxy 2024-01-01 12:40:12 +05:30
ishaan-jaff
a98d752f7b (docs) use embeddings with proxy 2024-01-01 12:31:24 +05:30
ishaan-jaff
cf902a53b4 (docs) using /embeddings with Proxy 2024-01-01 12:31:13 +05:30
ishaan-jaff
c8f8bd9e57 (test) proxy - log metadata to langfuse 2024-01-01 11:54:16 +05:30
ishaan-jaff
21cccd02e8 (docs) langfuse + langchain log metadata 2024-01-01 11:53:38 +05:30
ishaan-jaff
a549962f14 (docs) request/response format 2024-01-01 11:52:47 +05:30
ishaan-jaff
76f9c8cc8f (docs) request/response format proxy 2024-01-01 11:52:30 +05:30
ishaan-jaff
694956b44e (test) proxy - pass metadata to openai client 2024-01-01 11:12:57 +05:30
ishaan-jaff
8b29f9a48b (docs) pass metatadata to proxy + openai client 2024-01-01 11:12:31 +05:30
ishaan-jaff
5b9973136e (docs) langfuse + proxy - log metadata 2024-01-01 11:03:00 +05:30
ishaan-jaff
dacd86030b (fix) proxy - remove extra print statemet 2024-01-01 10:52:09 +05:30
ishaan-jaff
16fb83e007 (fix) proxy - remove errant print statement 2024-01-01 10:48:12 +05:30
ishaan-jaff
6c33fcbf6b (feat) proxy-ui a separate dep 2024-01-01 09:23:35 +05:30
Krrish Dholakia
d0d08b4dce docs(routing.md): adding latency-based routing to docs 2024-01-01 08:36:40 +05:30
ishaan-jaff
d71f89aac3 bump: version 1.16.7 → 1.16.8 2023-12-30 20:25:52 +05:30