Commit graph

1851 commits

Author SHA1 Message Date
Krrish Dholakia
7a0bccf4d0 test(test_key_generate_dynamodb.py): fix test 2024-02-05 21:44:50 -08:00
Krrish Dholakia
a9a4f4cf0f test(test_key_generate_dynamodb.py): fix test 2024-02-05 21:43:17 -08:00
ishaan-jaff
81f8ac00b2 (test) semantic caching 2024-02-05 18:22:50 -08:00
ishaan-jaff
cf4bd1cf4e (test) semantic cache 2024-02-05 17:58:32 -08:00
ishaan-jaff
2b588a8786 (test) litellm-dashboard never allowed to /chat/completions 2024-02-05 16:11:33 -08:00
ishaan-jaff
d4a799a3ca (feat )add semantic cache 2024-02-05 12:28:21 -08:00
Krish Dholakia
640572647a
Merge pull request #1805 from BerriAI/litellm_cost_tracking_image_gen
feat(utils.py): support cost tracking for openai/azure image gen models
2024-02-03 22:23:22 -08:00
Krrish Dholakia
49b2dc4180 test(test_completion_cost.py): fix test 2024-02-03 22:00:49 -08:00
Krrish Dholakia
66565f96b1 test(test_completion.py): fix test 2024-02-03 21:44:57 -08:00
Krrish Dholakia
d2d57ecf1c test(test_parallel_request_limiter.py): fix test 2024-02-03 21:31:29 -08:00
Krrish Dholakia
3a19c8b600 test(test_completion.py): fix test 2024-02-03 21:30:45 -08:00
Krish Dholakia
28df60b609
Merge pull request #1809 from BerriAI/litellm_embedding_caching_updates
Support caching individual items in embedding list (Async embedding only)
2024-02-03 21:04:23 -08:00
ishaan-jaff
c353161456 (fix) test_parallel limiter fix 2024-02-03 21:03:15 -08:00
Krrish Dholakia
3e35041758 test(test_parallel_request_limiter.py): fix test to handle minute changes 2024-02-03 20:39:31 -08:00
ishaan-jaff
1155025e6a (ci/cd) run again 2024-02-03 20:36:35 -08:00
Krrish Dholakia
b47b2837eb test(test_parallel_request_limiter.py): fix test 2024-02-03 20:34:05 -08:00
ishaan-jaff
774cbbde52 (test) tgai is unstable 2024-02-03 20:00:40 -08:00
Krrish Dholakia
efb6123d28 fix(utils.py): support get_secret("TOGETHER_AI_TOKEN") 2024-02-03 19:35:09 -08:00
Krrish Dholakia
c49c88c8e5 fix(utils.py): route together ai calls to openai client
together ai is now openai-compatible

n
2024-02-03 19:22:48 -08:00
Krish Dholakia
9ab59045a3
Merge branch 'main' into litellm_embedding_caching_updates 2024-02-03 18:08:47 -08:00
Krish Dholakia
1d241b4001
Merge pull request #1802 from BerriAI/litellm_vertex_ai_high_traffic_fix
fix(vertex_ai.py): treat vertex ai high-traffic error as a rate limit error - allows user-controlled backoff logic to work here
2024-02-03 15:37:05 -08:00
Krish Dholakia
6408af11b6
Merge pull request #1799 from BerriAI/litellm_bedrock_stable_diffusion_support
feat(bedrock.py): add stable diffusion image generation support
2024-02-03 12:59:00 -08:00
Krrish Dholakia
e617ef981d fix(vertex_ai.py): treat vertex ai high-traffic error as a rate limit error - allows backoff logic to work here 2024-02-03 12:58:16 -08:00
Krish Dholakia
1c05d479e2
Merge pull request #1797 from BerriAI/litellm_vertex_ai_async_embedding_support
fix(vertex_ai.py): add async embedding support for vertex ai
2024-02-03 12:11:21 -08:00
Krrish Dholakia
36416360c4 feat(bedrock.py): add stable diffusion image generation support 2024-02-03 12:08:38 -08:00
Ishaan Jaff
aadc352cf0
Merge pull request #1795 from BerriAI/litellm_allow_setting_user_roles
[Feat] Allow setting user roles for UserTable
2024-02-03 11:13:09 -08:00
ishaan-jaff
8455aa4bd4 (test) setting user_role 2024-02-03 11:06:51 -08:00
Krrish Dholakia
0ffdf57dec fix(vertex_ai.py): add async embedding support for vertex ai 2024-02-03 10:35:17 -08:00
Krish Dholakia
5bf51a6058
Merge pull request #1794 from BerriAI/litellm_vertex_ai_gecko_support
Litellm vertex ai gecko support
2024-02-03 10:17:37 -08:00
Krrish Dholakia
1ba6882f76 fix(test_embedding.py): fix test 2024-02-03 09:49:23 -08:00
Krrish Dholakia
d9ba8668f4 feat(vertex_ai.py): vertex ai gecko text embedding support 2024-02-03 09:48:29 -08:00
Ishaan Jaff
6950f99804
Merge pull request #1788 from BerriAI/litellm_fix_delete_key
[Fix] /key/delete + add delete cache keys
2024-02-02 20:22:26 -08:00
ishaan-jaff
ae95e4c3f9 (test) user_api_key_auth_cache 2024-02-02 19:57:55 -08:00
Krish Dholakia
38a299a1bc
Merge pull request #1786 from BerriAI/litellm_cost_tracking_caching_fixes
Litellm cost tracking caching fixes (should be 0.0)
2024-02-02 19:23:07 -08:00
Krrish Dholakia
3aab719521 test(test_completion.py): skip flaky test 2024-02-02 19:03:47 -08:00
Krrish Dholakia
1f0598a277 fix(proxy_server.py): load default team config straight from config file 2024-02-02 19:03:47 -08:00
Krrish Dholakia
142e7cf1ce test(test_image_generation.py): ignore content violation errors for image gen test 2024-02-02 19:03:47 -08:00
Krrish Dholakia
c0699b08e5 test(test_caching.py): fix test to check id 2024-02-02 19:03:47 -08:00
Krrish Dholakia
c997d4b0ce fix(test_key_generate_prisma.py): add longer delay to allow logs to update 2024-02-02 19:03:47 -08:00
Krrish Dholakia
ddf3e51545 fix(main.py): for health checks, don't use cached responses 2024-02-02 19:03:47 -08:00
ishaan-jaff
3899361aa4 (test) state of litellm cache after create, delete 2024-02-02 18:49:20 -08:00
Krrish Dholakia
2d59331148 test(test_completion.py): skip flaky test 2024-02-02 18:44:17 -08:00
Krrish Dholakia
5631b3357b fix(proxy_server.py): load default team config straight from config file 2024-02-02 18:35:30 -08:00
Krrish Dholakia
f3dd0c0563 test(test_image_generation.py): ignore content violation errors for image gen test 2024-02-02 18:05:39 -08:00
Krrish Dholakia
92b0a4cf50 test(test_key_generate_prisma.py): add longer sleep time 2024-02-02 18:03:07 -08:00
Krrish Dholakia
93e8a9ff91 test(test_caching.py): fix test to check id 2024-02-02 18:01:43 -08:00
Krrish Dholakia
a79f92533f fix(test_key_generate_prisma.py): add longer delay to allow logs to update 2024-02-02 17:51:15 -08:00
Krrish Dholakia
1ed6842009 fix(utils.py): fix cost tracking for cache hits (should be 0) 2024-02-02 17:33:39 -08:00
Krrish Dholakia
62ad6f19b7 fix(main.py): for health checks, don't use cached responses 2024-02-02 16:51:42 -08:00
ishaan-jaff
46a76852c7 (fix) s3 logging test 2024-02-02 14:10:24 -08:00