Krrish Dholakia
8a32d8825c
fix(proxy_server.py): fix /team/update endpoint
...
this also removes the functionality for modifying membership via `/team/update`. This is not considered a breaking change, as we've been pointing to usage of `/team/member_add` and `/team/member_delete` for this. Previous behaviour for this endpoint was causing it to be non-functional. If you're impacted, please let us know.
2024-04-15 10:29:21 -07:00
Krrish Dholakia
43c37c31ea
fix(proxy_server.py): return none if no model list set in router
...
https://github.com/BerriAI/litellm/issues/2979
2024-04-15 09:02:18 -07:00
Krish Dholakia
b0b4c07e89
Merge pull request #3017 from BerriAI/litellm_prometheus_service_metrics
...
Litellm prometheus service metrics
2024-04-13 19:34:22 -07:00
Krrish Dholakia
4e81acf2c6
feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)
2024-04-13 18:15:02 -07:00
Ishaan Jaff
5d873e1541
ui - new build
2024-04-13 18:08:46 -07:00
zJ
04f6342589
Merge branch 'BerriAI:main' into model-id-as-key
2024-04-14 02:58:23 +02:00
zJ
aff8e6a97a
Merge branch 'BerriAI:main' into model-id-as-key
2024-04-14 02:47:15 +02:00
Ishaan Jaff
11d1a0fd95
test - slack alerting
2024-04-13 17:44:57 -07:00
Ishaan Jaff
f2c6f1d837
ui - edit slack alerting settings
2024-04-13 17:31:13 -07:00
Ishaan Jaff
451b1a5fe0
fix - instantly propogate langfuse callback shange
2024-04-13 17:17:07 -07:00
Ishaan Jaff
a6fa0e030e
ui - new build
2024-04-13 17:05:03 -07:00
Ishaan Jaff
4996ac7ed6
Merge pull request #3007 from BerriAI/litellm_test_langfuse_config
...
UI - test langfuse callbacks on Admin UI
2024-04-13 17:00:42 -07:00
Ishaan Jaff
9e35f09343
ui - new build
2024-04-13 16:59:20 -07:00
Ishaan Jaff
48069b4e23
fix - test langfuse callbacks
2024-04-13 16:28:46 -07:00
Ishaan Jaff
39ed7dfa5d
fix return service config to get/config/callbacks
2024-04-13 14:34:51 -07:00
Ishaan Jaff
885ae139b8
fix - testing lagfuse service
2024-04-13 13:44:17 -07:00
Ishaan Jaff
ffb1393b94
feat - test langfuse /health/service
2024-04-13 13:42:49 -07:00
Ishaan Jaff
28cc9a11c4
feat - load proxy models on proxy startup events
2024-04-13 13:28:58 -07:00
Ishaan Jaff
d849810445
ui - new build
2024-04-13 12:58:37 -07:00
zJ
a5153377a0
set model_id in db correctly on add
2024-04-13 19:23:14 +02:00
Ishaan Jaff
f0ebadbb6f
test - /health endpoints
2024-04-13 10:09:18 -07:00
Krish Dholakia
fd7760d3db
Merge pull request #2996 from BerriAI/litellm_semaphores
...
fix(router.py): initial commit for semaphores on router
2024-04-12 23:23:36 -07:00
Ishaan Jaff
081adf87e3
fix - proxy /health checks
2024-04-12 20:30:15 -07:00
Ishaan Jaff
91d89a7b9b
fix - use copy.deepcopy on /model/info endpoints
2024-04-12 20:17:11 -07:00
Krrish Dholakia
8179596ebc
fix(lowest_tpm_rpm_v2.py): don't fail calls if redis fails to connect
2024-04-12 19:36:59 -07:00
Krrish Dholakia
a4e415b23c
fix(router.py): initial commit for semaphores on router
2024-04-12 17:59:05 -07:00
Krrish Dholakia
74aa230eac
fix(main.py): automatically infer mode for text completion models
2024-04-12 14:16:21 -07:00
Krrish Dholakia
e407ff7ee7
build(ui): allow deleting models from UI + show correct provider in model list
2024-04-12 12:53:22 -07:00
Krrish Dholakia
dc2f57e060
build(ui): allow multi select models when adding them to a model group
2024-04-12 11:48:07 -07:00
Krrish Dholakia
7ee17c97e7
build(ui): dropdown for known provider models
2024-04-12 11:17:09 -07:00
Krrish Dholakia
bdb32a0f42
build(ui): allow setting openai org id when creating new models
2024-04-12 09:34:09 -07:00
Krrish Dholakia
f4c7f4f901
fix(proxy_server.py): support tracking org spend
...
currently works when org set for jwt auth
2024-04-11 23:01:21 -07:00
Krish Dholakia
d89644d46c
Merge pull request #2970 from BerriAI/litellm_keys
...
fix(handle_jwt.py): User cost tracking via JWT Auth
2024-04-11 21:44:15 -07:00
Krrish Dholakia
77097f8e7d
test(test_jwt.py): add testing to make sure user api key auth returns the expected values
2024-04-11 20:18:55 -07:00
Krrish Dholakia
67b5634417
fix(auth_checks.py): raise error if user doesn't exist in db
2024-04-11 19:55:04 -07:00
Krrish Dholakia
36ff593c02
feat(proxy_server.py): support cost tracking on user id via JWT-Auth
...
allows admin to track cost for LiteLLM_UserTable via JWT
2024-04-11 18:47:46 -07:00
Krrish Dholakia
e413191493
fix(handle_jwt.py): support firebase public key format
...
adds support for when the public keys are a json instead of nested inside a json
2024-04-11 18:07:13 -07:00
Ishaan Jaff
beabec620e
fix - delete updated keys from cache
2024-04-11 17:21:44 -07:00
Ishaan Jaff
68e0c93246
fix - better debugging for adding new models
2024-04-11 14:49:00 -07:00
Ishaan Jaff
fc832f2196
fix - issue when loading models through ui
2024-04-11 13:06:10 -07:00
Ishaan Jaff
5f95260cf5
ui - show fallback login
2024-04-11 11:48:40 -07:00
Ishaan Jaff
7cb40d3b35
UI - add /fallback/login route
2024-04-11 11:20:41 -07:00
Krrish Dholakia
84d43484c6
fix(router.py): make sure pre call rpm check runs even when model not in model cost map
2024-04-11 09:27:46 -07:00
Ishaan Jaff
96cd038a73
security fix - disable demo accounts
2024-04-11 07:40:34 -07:00
Krish Dholakia
6749306239
Merge pull request #2945 from ushuz/hotfix
...
Fix image generation pre call hook call type
2024-04-10 21:53:00 -07:00
Krrish Dholakia
f4d34673d0
fix: update gitignore
2024-04-10 20:56:39 -07:00
Krish Dholakia
83e7ed94ce
Merge pull request #2942 from BerriAI/litellm_fix_router_loading
...
Router Async Improvements
2024-04-10 20:16:53 -07:00
Ishaan Jaff
e90645bd5d
fix - setting env vars on proxy
2024-04-10 17:50:28 -07:00
John HU
c9b05828ff
Fix image generation pre call hook call type
2024-04-11 00:18:35 +00:00
Ishaan Jaff
8bc02b34c2
test -base64 cache hits
2024-04-10 16:46:56 -07:00