Commit graph

4973 commits

Author SHA1 Message Date
ishaan-jaff
db002315e3 (feat) print debug info per deployment 2024-03-07 18:33:09 -08:00
Krrish Dholakia
807bf854c3 test: reintegrate s3 testing 2024-03-07 08:56:59 -08:00
Krrish Dholakia
6f7d3080af test(test_router_caching.py): add more verbose logs 2024-03-07 08:37:00 -08:00
Krrish Dholakia
3c414c6357 fix(proxy_server.py): fix model alias map + add back testing 2024-03-07 07:56:51 -08:00
Krrish Dholakia
4185a262ed test: increase time before checking budget reset - avoid deadlocking 2024-03-06 22:16:59 -08:00
Krrish Dholakia
fd5f0ed27c fix(lowest_tpm_rpm.py): handle async scenarios 2024-03-06 21:38:30 -08:00
Krrish Dholakia
badd8cf7ef fix(utils.py): fix google ai studio timeout error raising 2024-03-06 21:12:04 -08:00
Krish Dholakia
ede9647e49 Merge pull request #2377 from BerriAI/litellm_team_level_model_groups
feat(proxy_server.py): team based model aliases
2024-03-06 21:03:53 -08:00
Krrish Dholakia
995c31db84 fix(utils.py): fix get optional param embeddings 2024-03-06 20:47:05 -08:00
ishaan-jaff
e1e9c6dbd2 (test) ci/cd run again 2024-03-06 20:40:27 -08:00
ishaan-jaff
60b2e3c7e6 (fix) vertex_ai test_vertex_projects optional params embedding 2024-03-06 20:33:25 -08:00
Krrish Dholakia
9acdae4349 test(test_completion.py): fix test 2024-03-06 20:13:09 -08:00
Krrish Dholakia
df0eb170e6 fix(proxy_server.py): fix sql query 2024-03-06 19:41:12 -08:00
Krish Dholakia
d0dec7fc71 Merge pull request #2379 from BerriAI/litellm_s3_bucket_folder_path
fix(caching.py): add s3 path as a top-level param
2024-03-06 19:35:46 -08:00
Krish Dholakia
050a056e09 Merge pull request #2347 from BerriAI/litellm_retry_rate_limited_requests
feat(proxy_server.py): retry if virtual key is rate limited
2024-03-06 19:23:11 -08:00
Krrish Dholakia
6346839574 test(test_parallel_request_limiter.py): add more verbose logging 2024-03-06 19:21:57 -08:00
Krrish Dholakia
6029be00d1 test(test_completion.py): temporary patch for wikipedia get image issue 2024-03-06 19:07:38 -08:00
Krrish Dholakia
ff279ec77b test(test_completion.py): handle gemini timeout error 2024-03-06 19:05:39 -08:00
Krrish Dholakia
82b8a227ed build(schema.prisma): add support for team-based model aliases 2024-03-06 18:55:44 -08:00
Krrish Dholakia
66a8dc850f fix(factory.py): retry failed get request 2024-03-06 18:53:30 -08:00
ishaan-jaff
45d03f1901 (test) fix replicate test 2024-03-06 18:12:24 -08:00
Krrish Dholakia
12d663d693 fix(caching.py): add s3 path as a top-level param 2024-03-06 18:07:28 -08:00
ishaan-jaff
47174c106c (fix) dict changed size during iteration 2024-03-06 17:53:01 -08:00
Krrish Dholakia
7bfadc258e feat(proxy_server.py): team based model aliases
allow setting model aliases at a team level (e.g. route all 'gpt-3.5-turbo' requests from team-1 to model-deployment-group-2)
2024-03-06 17:42:08 -08:00
Ishaan Jaff
bc0cef53c5 Merge pull request #2371 from BerriAI/litellm_fix_user_new_swagger
(fix) admin UI swagger
2024-03-06 15:41:34 -08:00
ishaan-jaff
b6f3eb1434 (fix) remove unuse endpoint 2024-03-06 15:40:22 -08:00
ishaan-jaff
b0575bdcf0 (fix) admin UI swagger 2024-03-06 14:01:39 -08:00
Krrish Dholakia
7f4dd734c1 fix(vertex_ai.py): correctly parse optional params and pass vertex ai project 2024-03-06 14:00:50 -08:00
Ishaan Jaff
b721ef9152 Merge pull request #2363 from BerriAI/litellm_handle_circular_ref
(Fix) High Traffic Fix - handle litellm circular ref error
2024-03-06 12:38:01 -08:00
ishaan-jaff
0ea0566f20 (fix) high traffic langfuse, s3 2024-03-06 12:22:52 -08:00
ishaan-jaff
ffd23ef161 (fix) high traffic langfuse logging 2024-03-06 12:17:59 -08:00
ishaan-jaff
48f6189760 (feat) circular ref error on prisa 2024-03-06 12:08:22 -08:00
ishaan-jaff
8a75c4c3a3 (fix) circular ref error h 2024-03-06 12:02:44 -08:00
Krrish Dholakia
411f21e1f5 fix(factory.py): support image url requests for anthropic 2024-03-06 11:09:50 -08:00
ishaan-jaff
596f415f6b (feat) handle litellm circular ref error 2024-03-06 10:21:25 -08:00
Krrish Dholakia
43c0d31ea6 fix(utils.py): set status code for api error 2024-03-05 21:37:59 -08:00
Krrish Dholakia
ee2fc1e5e8 test(test_caching.py): fix test to check on id 2024-03-05 21:12:50 -08:00
Krrish Dholakia
affcfdf561 fix(utils.py): fix mistral api exception mapping 2024-03-05 20:45:16 -08:00
Ishaan Jaff
905e82dd63 Merge pull request #2345 from BerriAI/litellm_fix_update_team_db
(fix) Update Team DB
2024-03-05 20:37:58 -08:00
Ishaan Jaff
cca5329423 Merge pull request #2341 from BerriAI/litellm_fixes_proxy_db
[Fix] Better debugging with alerts
2024-03-05 20:37:16 -08:00
Ishaan Jaff
3e77f36f68 Merge pull request #2344 from BerriAI/litellm_fix_cant_import_litellm
(fix) bug importing litellm on python 3.8
2024-03-05 20:36:08 -08:00
ishaan-jaff
086de85625 (fix) update team_id 2024-03-05 19:09:19 -08:00
Krrish Dholakia
61db2d775e fix(replicate.py): handle model endpoint 2024-03-05 19:06:24 -08:00
ishaan-jaff
3ca856fe39 (fix) _update_team_db 2024-03-05 19:03:27 -08:00
Krrish Dholakia
95eef82aab test(test_completion.py): handle anthropic internal server error 2024-03-05 19:01:55 -08:00
Krrish Dholakia
c963e2761b feat(proxy_server.py): retry if virtual key is rate limited
currently for chat completions
2024-03-05 19:00:03 -08:00
ishaan-jaff
d0a4862871 (fix) use str(e) 2024-03-05 18:57:26 -08:00
ishaan-jaff
5d76081d89 (fix) chore 2024-03-05 18:54:04 -08:00
Ishaan Jaff
563f4e6a16 Merge branch 'main' into litellm_fixes_proxy_db 2024-03-05 18:51:55 -08:00
ishaan-jaff
e8f89001d3 (fix) using litellm on python 3.8 2024-03-05 18:45:47 -08:00