Commit graph

8681 commits

Author SHA1 Message Date
ishaan-jaff
3baa55210a (docs) setting load balancing config 2024-03-07 12:22:39 -08:00
Daniel Chico
3b86375782 feat: add realease details to discord notification message 2024-03-07 12:26:03 -05:00
Krish Dholakia
bd568d33b0
Merge pull request #2386 from BerriAI/litellm_reintegrate_s3_testing
test: reintegrate s3 testing
2024-03-07 09:16:02 -08:00
Krrish Dholakia
4885bff9e3 test: reintegrate s3 testing 2024-03-07 08:56:59 -08:00
Krrish Dholakia
a89d0db625 test(test_router_caching.py): add more verbose logs 2024-03-07 08:37:00 -08:00
Krrish Dholakia
4508b4ede0 docs(team_based_routing.md): add docs on team based routing 2024-03-07 08:14:46 -08:00
Krrish Dholakia
0d8bed0acf bump: version 1.30.0 → 1.30.1 2024-03-07 07:57:13 -08:00
Krrish Dholakia
dd78a1956a fix(proxy_server.py): fix model alias map + add back testing 2024-03-07 07:56:51 -08:00
Krrish Dholakia
b9854a99d2 test: increase time before checking budget reset - avoid deadlocking 2024-03-06 22:16:59 -08:00
Krrish Dholakia
0273410310 fix(lowest_tpm_rpm.py): handle async scenarios 2024-03-06 21:38:30 -08:00
Krrish Dholakia
a8bc10170a fix(proxy_server.py): support cost tracking if general_settings is none
works if database_url is in env
2024-03-06 21:27:41 -08:00
Krrish Dholakia
ec79482612 fix(utils.py): fix google ai studio timeout error raising 2024-03-06 21:12:04 -08:00
Krrish Dholakia
f79ce63f05 bump: version 1.29.7 → 1.30.0 2024-03-06 21:04:46 -08:00
Krish Dholakia
38612ddd34
Merge pull request #2377 from BerriAI/litellm_team_level_model_groups
feat(proxy_server.py): team based model aliases
2024-03-06 21:03:53 -08:00
Krrish Dholakia
c0c3117dec fix(utils.py): fix get optional param embeddings 2024-03-06 20:47:05 -08:00
ishaan-jaff
2e130fb662 (test) ci/cd run again 2024-03-06 20:40:27 -08:00
ishaan-jaff
0ee02e1ab9 (fix) vertex_ai test_vertex_projects optional params embedding 2024-03-06 20:33:25 -08:00
Krrish Dholakia
be6674f5e0 test(test_completion.py): fix test 2024-03-06 20:13:09 -08:00
Krrish Dholakia
d1d8adfb11 fix(proxy_server.py): fix sql query 2024-03-06 19:41:12 -08:00
Krish Dholakia
06bde2b8c0
Merge pull request #2379 from BerriAI/litellm_s3_bucket_folder_path
fix(caching.py): add s3 path as a top-level param
2024-03-06 19:35:46 -08:00
Krish Dholakia
cb8b30970b
Merge pull request #2347 from BerriAI/litellm_retry_rate_limited_requests
feat(proxy_server.py): retry if virtual key is rate limited
2024-03-06 19:23:11 -08:00
Krrish Dholakia
2163e43b9a test(test_parallel_request_limiter.py): add more verbose logging 2024-03-06 19:21:57 -08:00
Krrish Dholakia
f1aa400d91 test(test_completion.py): temporary patch for wikipedia get image issue 2024-03-06 19:07:38 -08:00
Krrish Dholakia
7e3734d037 test(test_completion.py): handle gemini timeout error 2024-03-06 19:05:39 -08:00
Krrish Dholakia
fc16b6650e build(schema.prisma): add support for team-based model aliases 2024-03-06 18:55:44 -08:00
Krrish Dholakia
c3c0727366 fix(factory.py): retry failed get request 2024-03-06 18:53:30 -08:00
ishaan-jaff
6123e349f2 (test) fix replicate test 2024-03-06 18:12:24 -08:00
Krrish Dholakia
726dad5756 fix(caching.py): add s3 path as a top-level param 2024-03-06 18:07:28 -08:00
Ishaan Jaff
96a3c03a1f
Merge pull request #2375 from BerriAI/litellm_default_docker
[Fix] Switch off detailed_debug in default docker
2024-03-06 18:00:38 -08:00
Ishaan Jaff
8981f60396
Merge pull request #2378 from BerriAI/litellm_fix_dict_changed_size_during_iteration
[FIX]  🐛 embedding - "Dictionary changed size during iteration" Debug Log
2024-03-06 17:58:51 -08:00
ishaan-jaff
d3818713ad (fix) dict changed size during iteration 2024-03-06 17:53:01 -08:00
Krrish Dholakia
ca97ea8acd feat(proxy_server.py): team based model aliases
allow setting model aliases at a team level (e.g. route all 'gpt-3.5-turbo' requests from team-1 to model-deployment-group-2)
2024-03-06 17:42:08 -08:00
ishaan-jaff
547f0a023d (docs) best practices for high traffic 2024-03-06 16:36:35 -08:00
ishaan-jaff
c50b0e315a (feat) don't use --detailed_debug on all default litellm images 2024-03-06 16:31:32 -08:00
ishaan-jaff
32adb4e80d bump: version 1.29.6 → 1.29.7 2024-03-06 15:42:16 -08:00
ishaan-jaff
8a3941ad27 bump: version 1.29.5 → 1.29.6 2024-03-06 15:42:16 -08:00
Ishaan Jaff
f644da4afa
Merge pull request #2371 from BerriAI/litellm_fix_user_new_swagger
(fix) admin UI swagger
2024-03-06 15:41:34 -08:00
ishaan-jaff
6aadfb3472 (fix) remove unuse endpoint 2024-03-06 15:40:22 -08:00
ishaan-jaff
ac5137f442 (fix) admin UI swagger 2024-03-06 14:01:39 -08:00
Krrish Dholakia
cdb960eb34 fix(vertex_ai.py): correctly parse optional params and pass vertex ai project 2024-03-06 14:00:50 -08:00
Ishaan Jaff
4e395bf244
Merge pull request #2367 from BerriAI/litellm_admin_ui_fixes
(feat) admin UI show model avg latency, num requests
2024-03-06 13:30:59 -08:00
ishaan-jaff
929489111d (feat) admin UI show model avg latency, num requests 2024-03-06 12:59:09 -08:00
Ishaan Jaff
6c79bea177
Merge pull request #2363 from BerriAI/litellm_handle_circular_ref
(Fix) High Traffic Fix - handle litellm circular ref error
2024-03-06 12:38:01 -08:00
ishaan-jaff
c4079b2548 (fix) high traffic langfuse, s3 2024-03-06 12:22:52 -08:00
ishaan-jaff
74e50d9d35 (fix) high traffic langfuse logging 2024-03-06 12:17:59 -08:00
ishaan-jaff
ee468a4e05 (feat) circular ref error on prisa 2024-03-06 12:08:22 -08:00
ishaan-jaff
c17789f170 (fix) circular ref error h 2024-03-06 12:02:44 -08:00
Krrish Dholakia
81b92f3434 fix(factory.py): support image url requests for anthropic 2024-03-06 11:09:50 -08:00
ishaan-jaff
2313f5f90a (feat) handle litellm circular ref error 2024-03-06 10:21:25 -08:00
Krrish Dholakia
7d824225a5 fix(utils.py): set status code for api error 2024-03-05 21:37:59 -08:00