phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
5106 commits 1603 branches 645 tags 320 MiB
Commit graph

5106 commits

This branch
This branch
All branches
Author SHA1 Message Date
Krrish Dholakia
95f850fecc docs(ui.md): add docs on self serve ui flow 2024-01-01 18:25:52 +05:30
Ishaan Jaff
9cb5a2bec0
Merge pull request #1290 from fcakyon/patch-1 
fix typos & add missing names for azure models
 2024-01-01 17:58:17 +05:30
Krrish Dholakia
61cd800b9f fix(ui/admin.py): handles trailing '/' case 2024-01-01 17:49:54 +05:30
Krrish Dholakia
e1e3721917 build(user.py): fix page param read issue 2024-01-01 17:25:52 +05:30
Krrish Dholakia
ff3f3844c7 build(ui/): Add dockerfile for ui 2024-01-01 17:18:44 +05:30
Krrish Dholakia
a41e56a730 fix(proxy_server.py): enabling user auth via ui 
https://github.com/BerriAI/litellm/issues/1231
 2024-01-01 17:14:24 +05:30
fatih
29ebd23228
Update model_prices_and_context_window.json 2024-01-01 14:13:00 +03:00
fatih
6566ebd815
update azure turbo namings 2024-01-01 13:03:08 +03:00
fatih
08d23aafc0
fix a typo 2024-01-01 11:57:48 +03:00
Krrish Dholakia
ca40a88987 fix(proxy_server.py): check if user email in user db 2024-01-01 14:19:59 +05:30
fatih
7f5b2bf290
fix typos & add missing names for azure models 2024-01-01 11:49:46 +03:00
ishaan-jaff
7623c1a846 (feat) proxy - only use print_verbose 2024-01-01 13:52:11 +05:30
ishaan-jaff
84cfa1c42a (test) ci/cd 2024-01-01 13:51:27 +05:30
ishaan-jaff
08d57a20a7 (feat) pre-commit check print on proxy_server.py 2024-01-01 13:51:27 +05:30
Krrish Dholakia
24e7dc359d feat(proxy_server.py): introduces new /user/auth endpoint for handling user email auth 
decouples streamlit ui from proxy server. this then requires the proxy to handle user auth separately.
 2024-01-01 13:44:47 +05:30
ishaan-jaff
52db2a6040 (feat) proxy - remove streamlit ui on startup 2024-01-01 12:54:23 +05:30
ishaan-jaff
20236c1c69 (docs) proxy 2024-01-01 12:40:12 +05:30
ishaan-jaff
a98d752f7b (docs) use embeddings with proxy 2024-01-01 12:31:24 +05:30
ishaan-jaff
cf902a53b4 (docs) using /embeddings with Proxy 2024-01-01 12:31:13 +05:30
ishaan-jaff
c8f8bd9e57 (test) proxy - log metadata to langfuse 2024-01-01 11:54:16 +05:30
ishaan-jaff
21cccd02e8 (docs) langfuse + langchain log metadata 2024-01-01 11:53:38 +05:30
ishaan-jaff
a549962f14 (docs) request/response format 2024-01-01 11:52:47 +05:30
ishaan-jaff
76f9c8cc8f (docs) request/response format proxy 2024-01-01 11:52:30 +05:30
ishaan-jaff
694956b44e (test) proxy - pass metadata to openai client 2024-01-01 11:12:57 +05:30
ishaan-jaff
8b29f9a48b (docs) pass metatadata to proxy + openai client 2024-01-01 11:12:31 +05:30
ishaan-jaff
5b9973136e (docs) langfuse + proxy - log metadata 2024-01-01 11:03:00 +05:30
ishaan-jaff
dacd86030b (fix) proxy - remove extra print statemet 2024-01-01 10:52:09 +05:30
ishaan-jaff
16fb83e007 (fix) proxy - remove errant print statement 2024-01-01 10:48:12 +05:30
ishaan-jaff
6c33fcbf6b (feat) proxy-ui a separate dep 2024-01-01 09:23:35 +05:30
Krrish Dholakia
d0d08b4dce docs(routing.md): adding latency-based routing to docs 2024-01-01 08:36:40 +05:30
ishaan-jaff
d71f89aac3 bump: version 1.16.7 → 1.16.8 2023-12-30 20:25:52 +05:30
ishaan-jaff
c269c65371 (docs) langfuse log trace id, trace user id 2023-12-30 20:25:23 +05:30
ishaan-jaff
84fbc903aa (test) langfuse - set custom trace_id 2023-12-30 20:19:22 +05:30
ishaan-jaff
8ae4554a8a (feat) langfuse - set custom trace_id, trace_user_id 2023-12-30 20:19:03 +05:30
ishaan-jaff
cc7b964433 (docs) add litellm.cache docstring 2023-12-30 20:04:08 +05:30
ishaan-jaff
70cdc16d6f (feat) cache context manager - update cache 2023-12-30 19:50:53 +05:30
ishaan-jaff
bf4a9f40e8 (docs) cache context manager 2023-12-30 19:50:22 +05:30
ishaan-jaff
1c93642951 (docs) caching use context manager 2023-12-30 19:43:26 +05:30
ishaan-jaff
e35f17ca3c (test) caching - context managers 2023-12-30 19:33:47 +05:30
ishaan-jaff
ddddfe6602 (feat) add cache context manager 2023-12-30 19:32:51 +05:30
ishaan-jaff
231148ed73 (docs) caching 2023-12-30 19:04:36 +05:30
Krrish Dholakia
8ff3bbcfee fix(proxy_server.py): router model group alias routing 
check model alias group routing before specific deployment routing, to deal with an alias being the same as a deployment name (e.g. gpt-3.5-turbo)

n
 2023-12-30 17:55:24 +05:30
Krrish Dholakia
027218c3f0 test(test_lowest_latency_routing.py): add more tests 2023-12-30 17:41:42 +05:30
Krrish Dholakia
f2d0d5584a fix(router.py): fix latency based routing 2023-12-30 17:25:40 +05:30
Krrish Dholakia
c41b1418d4 test(test_router_init.py): fix test router init 2023-12-30 16:51:39 +05:30
Krrish Dholakia
3cb7acceaa test(test_least_busy_routing.py): fix test 2023-12-30 16:12:52 +05:30
Krrish Dholakia
3935f99083 test(test_router.py): add retries 2023-12-30 15:54:46 +05:30
Krrish Dholakia
69935db239 fix(router.py): periodically re-initialize azure/openai clients to solve max conn issue 2023-12-30 15:48:34 +05:30
Krrish Dholakia
d089157925 build(model_prices_and_context_window.json): fix text unicorn mapping 2023-12-30 13:38:24 +05:30
Krrish Dholakia
b66cf0aa43 fix(lowest_tpm_rpm_routing.py): broaden scope of get deployment logic 2023-12-30 13:27:50 +05:30