Commit graph

1391 commits

Author SHA1 Message Date
Krrish Dholakia
0cf056f493 fix(proxy_server.py): use argon2 for faster api key checking
0.04s latency boost on load test
2024-03-07 21:48:18 -08:00
Ishaan Jaff
90d7b61ec2
Merge pull request #2393 from BerriAI/litellm_router_debug_get_dep
[Feat] Load Balancing - View Metrics about selected deployments in server logs
2024-03-07 20:44:18 -08:00
ishaan-jaff
6f0faca85b (feat) print debug info per deployment 2024-03-07 18:33:09 -08:00
ishaan-jaff
8c3ec15856 (fix) improve improve prisma alerting/debug 2024-03-07 15:44:03 -08:00
ishaan-jaff
5217e800c4 (fix) better prisma debug logs 2024-03-07 14:04:02 -08:00
ishaan-jaff
b64e4c3e6f (feat) better debugging when reading prisma 2024-03-07 13:42:54 -08:00
Krrish Dholakia
dd78a1956a fix(proxy_server.py): fix model alias map + add back testing 2024-03-07 07:56:51 -08:00
Krrish Dholakia
a8bc10170a fix(proxy_server.py): support cost tracking if general_settings is none
works if database_url is in env
2024-03-06 21:27:41 -08:00
Krish Dholakia
38612ddd34
Merge pull request #2377 from BerriAI/litellm_team_level_model_groups
feat(proxy_server.py): team based model aliases
2024-03-06 21:03:53 -08:00
Krrish Dholakia
d1d8adfb11 fix(proxy_server.py): fix sql query 2024-03-06 19:41:12 -08:00
Krish Dholakia
cb8b30970b
Merge pull request #2347 from BerriAI/litellm_retry_rate_limited_requests
feat(proxy_server.py): retry if virtual key is rate limited
2024-03-06 19:23:11 -08:00
Krrish Dholakia
fc16b6650e build(schema.prisma): add support for team-based model aliases 2024-03-06 18:55:44 -08:00
Krrish Dholakia
ca97ea8acd feat(proxy_server.py): team based model aliases
allow setting model aliases at a team level (e.g. route all 'gpt-3.5-turbo' requests from team-1 to model-deployment-group-2)
2024-03-06 17:42:08 -08:00
ishaan-jaff
6aadfb3472 (fix) remove unuse endpoint 2024-03-06 15:40:22 -08:00
ishaan-jaff
ac5137f442 (fix) admin UI swagger 2024-03-06 14:01:39 -08:00
ishaan-jaff
ee468a4e05 (feat) circular ref error on prisa 2024-03-06 12:08:22 -08:00
ishaan-jaff
c17789f170 (fix) circular ref error h 2024-03-06 12:02:44 -08:00
ishaan-jaff
2313f5f90a (feat) handle litellm circular ref error 2024-03-06 10:21:25 -08:00
Ishaan Jaff
2679e2baf3
Merge pull request #2345 from BerriAI/litellm_fix_update_team_db
(fix) Update Team DB
2024-03-05 20:37:58 -08:00
Ishaan Jaff
a3ece3fd71
Merge pull request #2341 from BerriAI/litellm_fixes_proxy_db
[Fix] Better debugging with alerts
2024-03-05 20:37:16 -08:00
ishaan-jaff
c4e7c45c3a (fix) update team_id 2024-03-05 19:09:19 -08:00
ishaan-jaff
92753f558c (fix) _update_team_db 2024-03-05 19:03:27 -08:00
Krrish Dholakia
ad55f4dbb5 feat(proxy_server.py): retry if virtual key is rate limited
currently for chat completions
2024-03-05 19:00:03 -08:00
ishaan-jaff
52e59e050c (fix) use str(e) 2024-03-05 18:57:26 -08:00
ishaan-jaff
00666566c2 (fix) chore 2024-03-05 18:54:04 -08:00
Ishaan Jaff
03fa322b38
Merge branch 'main' into litellm_fixes_proxy_db 2024-03-05 18:51:55 -08:00
ishaan-jaff
a7094b0a3c (v0) fix pydantic warnings 2024-03-05 18:29:09 -08:00
ishaan-jaff
735728c4dd (feat) add better debugging when DB read/write fails 2024-03-05 18:16:59 -08:00
Ishaan Jaff
e8c475b925
Merge pull request #2340 from BerriAI/litellm_fix_batch_update_users
[Fix] Fix Batch Updating User DB
2024-03-05 18:06:08 -08:00
ishaan-jaff
3df618bf04 (fix) cleanup 2024-03-05 17:05:01 -08:00
ishaan-jaff
d0953a1349 (fix) chore 2024-03-05 17:04:25 -08:00
ishaan-jaff
3f7bf5c6b1 (fix) fix batch update user db 2024-03-05 16:46:58 -08:00
Krrish Dholakia
387864662e fix(main.py): trigger new build 2024-03-05 15:50:40 -08:00
ishaan-jaff
b706598415 (v0) fixes 2024-03-05 15:27:06 -08:00
Krish Dholakia
5b3459d759
Merge branch 'main' into litellm_claude_3_bedrock_access 2024-03-05 07:10:45 -08:00
Krrish Dholakia
3303236305 test(test_proxy_server.py): add back bedrock embedding tests 2024-03-04 18:28:05 -08:00
ishaan-jaff
257c9cadaf (build) new ui build 2024-03-04 16:28:45 -08:00
ishaan-jaff
3a61df9995 (feat) show /model/metrics on Admin UI 2024-03-04 16:25:35 -08:00
ishaan-jaff
2479712807 (feat) show model metrics on admin panel 2024-03-04 13:44:13 -08:00
Krrish Dholakia
873ddde924 fix(huggingface_restapi.py): fix huggingface streaming error raising 2024-03-04 09:32:41 -08:00
Krrish Dholakia
db0489d603 fix(proxy/utils.py): add linting fix 2024-03-02 21:11:25 -08:00
Krrish Dholakia
ff2e002a92 fix(proxy/utils.py): fix pydantic model dump logic 2024-03-02 21:10:37 -08:00
Krrish Dholakia
a4b4489832 fix(proxy/utils.py): fix model dump pydantic versioning issue 2024-03-02 21:01:36 -08:00
Krrish Dholakia
37ad5efc61 fix(proxy/utils.py): fix resetting budget logic 2024-03-02 20:52:54 -08:00
Krrish Dholakia
f5f12d204e fix(proxy_server.py): fix track cost callback 2024-03-02 19:52:45 -08:00
Krish Dholakia
530b454ff4
Merge branch 'main' into litellm_slack_budget_alerting 2024-03-02 19:13:57 -08:00
Krrish Dholakia
679c47d196 fix(proxy_server.py): fix budget creation 2024-03-02 19:11:37 -08:00
Krish Dholakia
ce84bce8e6
Merge pull request #2300 from BerriAI/litellm_organization_table
feat(proxy_server.py): enable `/organizations/new`, `/organization/info` and `/budget/info` endpoints
2024-03-02 18:37:36 -08:00
Krrish Dholakia
ac085a4643 fix(proxy_server.py): actual implementation of slack soft budget alerting 2024-03-02 18:34:18 -08:00
ishaan-jaff
aa565dc990 (feat) improve test slack alert 2024-03-02 17:33:31 -08:00