Krrish Dholakia
dc4b0f9536
build(ui): allow admin to move key to another team
2024-04-15 16:40:19 -07:00
Krrish Dholakia
e4bcc51e44
build(ui): add vertex ai models via ui
2024-04-15 15:59:36 -07:00
Krish Dholakia
a4a21aff41
Merge pull request #3034 from BerriAI/litellm_team_table_fix
...
fix(proxy_server.py): fix /team/update endpoint
2024-04-15 14:40:12 -07:00
Krish Dholakia
45d0873e04
Merge pull request #3043 from BerriAI/litellm_dynamic_vertex_credentials
...
fix(vertex_ai_anthropic.py): Add vertex ai models via `/model/new`
2024-04-15 14:38:29 -07:00
Ishaan Jaff
adae555fb1
Merge branch 'main' into litellm_fix_using_wildcard_openai_models_proxy
2024-04-15 14:35:06 -07:00
Krrish Dholakia
1ec7118e1f
fix(vertex_ai_anthropic.py): set vertex_credentials for vertex ai anthropic calls
...
allows setting vertex credentials as a json string for vertex ai anthropic calls
2024-04-15 14:16:28 -07:00
Ishaan Jaff
6df5337e65
test - wildcard openai models on proxy
2024-04-15 14:05:26 -07:00
Ishaan Jaff
020fb54ea7
fix using wildcard models on proxy
2024-04-15 14:04:37 -07:00
Ishaan Jaff
4c5bf508fc
Merge pull request #3041 from BerriAI/docs_add_team_based_langfuse
...
Docs - add team based logging langfuse on langfuse proxy docs
2024-04-15 14:01:09 -07:00
Ishaan Jaff
ecc6aa060f
test - team based logging on proxy
2024-04-15 13:26:55 -07:00
Krrish Dholakia
8a32d8825c
fix(proxy_server.py): fix /team/update endpoint
...
this also removes the functionality for modifying membership via `/team/update`. This is not considered a breaking change, as we've been pointing to usage of `/team/member_add` and `/team/member_delete` for this. Previous behaviour for this endpoint was causing it to be non-functional. If you're impacted, please let us know.
2024-04-15 10:29:21 -07:00
Krrish Dholakia
43c37c31ea
fix(proxy_server.py): return none if no model list set in router
...
https://github.com/BerriAI/litellm/issues/2979
2024-04-15 09:02:18 -07:00
Krish Dholakia
b0b4c07e89
Merge pull request #3017 from BerriAI/litellm_prometheus_service_metrics
...
Litellm prometheus service metrics
2024-04-13 19:34:22 -07:00
Krrish Dholakia
4e81acf2c6
feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)
2024-04-13 18:15:02 -07:00
Ishaan Jaff
5d873e1541
ui - new build
2024-04-13 18:08:46 -07:00
Ishaan Jaff
11d1a0fd95
test - slack alerting
2024-04-13 17:44:57 -07:00
Ishaan Jaff
f2c6f1d837
ui - edit slack alerting settings
2024-04-13 17:31:13 -07:00
Ishaan Jaff
451b1a5fe0
fix - instantly propogate langfuse callback shange
2024-04-13 17:17:07 -07:00
Ishaan Jaff
a6fa0e030e
ui - new build
2024-04-13 17:05:03 -07:00
Ishaan Jaff
4996ac7ed6
Merge pull request #3007 from BerriAI/litellm_test_langfuse_config
...
UI - test langfuse callbacks on Admin UI
2024-04-13 17:00:42 -07:00
Ishaan Jaff
9e35f09343
ui - new build
2024-04-13 16:59:20 -07:00
Ishaan Jaff
48069b4e23
fix - test langfuse callbacks
2024-04-13 16:28:46 -07:00
Ishaan Jaff
39ed7dfa5d
fix return service config to get/config/callbacks
2024-04-13 14:34:51 -07:00
Ishaan Jaff
885ae139b8
fix - testing lagfuse service
2024-04-13 13:44:17 -07:00
Ishaan Jaff
ffb1393b94
feat - test langfuse /health/service
2024-04-13 13:42:49 -07:00
Ishaan Jaff
28cc9a11c4
feat - load proxy models on proxy startup events
2024-04-13 13:28:58 -07:00
Ishaan Jaff
d849810445
ui - new build
2024-04-13 12:58:37 -07:00
Ishaan Jaff
f0ebadbb6f
test - /health endpoints
2024-04-13 10:09:18 -07:00
Krish Dholakia
fd7760d3db
Merge pull request #2996 from BerriAI/litellm_semaphores
...
fix(router.py): initial commit for semaphores on router
2024-04-12 23:23:36 -07:00
Ishaan Jaff
081adf87e3
fix - proxy /health checks
2024-04-12 20:30:15 -07:00
Ishaan Jaff
91d89a7b9b
fix - use copy.deepcopy on /model/info endpoints
2024-04-12 20:17:11 -07:00
Krrish Dholakia
8179596ebc
fix(lowest_tpm_rpm_v2.py): don't fail calls if redis fails to connect
2024-04-12 19:36:59 -07:00
Krrish Dholakia
a4e415b23c
fix(router.py): initial commit for semaphores on router
2024-04-12 17:59:05 -07:00
Krrish Dholakia
74aa230eac
fix(main.py): automatically infer mode for text completion models
2024-04-12 14:16:21 -07:00
Krrish Dholakia
e407ff7ee7
build(ui): allow deleting models from UI + show correct provider in model list
2024-04-12 12:53:22 -07:00
Krrish Dholakia
dc2f57e060
build(ui): allow multi select models when adding them to a model group
2024-04-12 11:48:07 -07:00
Krrish Dholakia
7ee17c97e7
build(ui): dropdown for known provider models
2024-04-12 11:17:09 -07:00
Krrish Dholakia
bdb32a0f42
build(ui): allow setting openai org id when creating new models
2024-04-12 09:34:09 -07:00
Krrish Dholakia
f4c7f4f901
fix(proxy_server.py): support tracking org spend
...
currently works when org set for jwt auth
2024-04-11 23:01:21 -07:00
Krish Dholakia
d89644d46c
Merge pull request #2970 from BerriAI/litellm_keys
...
fix(handle_jwt.py): User cost tracking via JWT Auth
2024-04-11 21:44:15 -07:00
Krrish Dholakia
77097f8e7d
test(test_jwt.py): add testing to make sure user api key auth returns the expected values
2024-04-11 20:18:55 -07:00
Krrish Dholakia
67b5634417
fix(auth_checks.py): raise error if user doesn't exist in db
2024-04-11 19:55:04 -07:00
Krrish Dholakia
36ff593c02
feat(proxy_server.py): support cost tracking on user id via JWT-Auth
...
allows admin to track cost for LiteLLM_UserTable via JWT
2024-04-11 18:47:46 -07:00
Krrish Dholakia
e413191493
fix(handle_jwt.py): support firebase public key format
...
adds support for when the public keys are a json instead of nested inside a json
2024-04-11 18:07:13 -07:00
Ishaan Jaff
beabec620e
fix - delete updated keys from cache
2024-04-11 17:21:44 -07:00
Ishaan Jaff
68e0c93246
fix - better debugging for adding new models
2024-04-11 14:49:00 -07:00
Ishaan Jaff
fc832f2196
fix - issue when loading models through ui
2024-04-11 13:06:10 -07:00
Ishaan Jaff
5f95260cf5
ui - show fallback login
2024-04-11 11:48:40 -07:00
Ishaan Jaff
7cb40d3b35
UI - add /fallback/login route
2024-04-11 11:20:41 -07:00
Krrish Dholakia
84d43484c6
fix(router.py): make sure pre call rpm check runs even when model not in model cost map
2024-04-11 09:27:46 -07:00
