Commit graph

4168 commits

Author SHA1 Message Date
Krrish Dholakia
49b2dc4180 test(test_completion_cost.py): fix test 2024-02-03 22:00:49 -08:00
Krrish Dholakia
66565f96b1 test(test_completion.py): fix test 2024-02-03 21:44:57 -08:00
Krrish Dholakia
d2d57ecf1c test(test_parallel_request_limiter.py): fix test 2024-02-03 21:31:29 -08:00
Krrish Dholakia
3a19c8b600 test(test_completion.py): fix test 2024-02-03 21:30:45 -08:00
Krish Dholakia
28df60b609
Merge pull request #1809 from BerriAI/litellm_embedding_caching_updates
Support caching individual items in embedding list (Async embedding only)
2024-02-03 21:04:23 -08:00
ishaan-jaff
c353161456 (fix) test_parallel limiter fix 2024-02-03 21:03:15 -08:00
Krrish Dholakia
3e35041758 test(test_parallel_request_limiter.py): fix test to handle minute changes 2024-02-03 20:39:31 -08:00
ishaan-jaff
1155025e6a (ci/cd) run again 2024-02-03 20:36:35 -08:00
Krrish Dholakia
b47b2837eb test(test_parallel_request_limiter.py): fix test 2024-02-03 20:34:05 -08:00
Krrish Dholakia
312c7462c8 refactor(ollama.py): trigger rebuild 2024-02-03 20:23:43 -08:00
Krrish Dholakia
01cef1fe9e fix(ollama.py): fix api connection error
https://github.com/BerriAI/litellm/issues/1735
2024-02-03 20:22:33 -08:00
ishaan-jaff
774cbbde52 (test) tgai is unstable 2024-02-03 20:00:40 -08:00
Krrish Dholakia
25a0e15727 fix(utils.py): support time based pricing for openai-compatible together ai 2024-02-03 19:59:32 -08:00
Krrish Dholakia
efb6123d28 fix(utils.py): support get_secret("TOGETHER_AI_TOKEN") 2024-02-03 19:35:09 -08:00
Krrish Dholakia
c49c88c8e5 fix(utils.py): route together ai calls to openai client
together ai is now openai-compatible

n
2024-02-03 19:22:48 -08:00
Krrish Dholakia
c2f674ebe0 fix(utils.py): fix conditional check 2024-02-03 18:58:58 -08:00
ishaan-jaff
c6aadcbd34 (feat) new ui build 2024-02-03 18:53:05 -08:00
Krish Dholakia
9ab59045a3
Merge branch 'main' into litellm_embedding_caching_updates 2024-02-03 18:08:47 -08:00
Ishaan Jaff
61d1a9a0be
Merge pull request #1807 from BerriAI/litellm_view_key_spend
[UI] View Key Spend Reports 🤠
2024-02-03 17:42:38 -08:00
ishaan-jaff
1fa85c03b8 (feat) allow users to view their spend/logs 2024-02-03 17:33:19 -08:00
Krrish Dholakia
ef0171e063 feat(utils.py): support cost tracking for openai/azure image gen models 2024-02-03 17:09:54 -08:00
Krish Dholakia
1d241b4001
Merge pull request #1802 from BerriAI/litellm_vertex_ai_high_traffic_fix
fix(vertex_ai.py): treat vertex ai high-traffic error as a rate limit error - allows user-controlled backoff logic to work here
2024-02-03 15:37:05 -08:00
ishaan-jaff
44b6c73351 (feat) only allow master key to update users 2024-02-03 14:16:14 -08:00
ishaan-jaff
16364d3879 (feat) update max_budget in /user/update 2024-02-03 14:12:18 -08:00
Krish Dholakia
6408af11b6
Merge pull request #1799 from BerriAI/litellm_bedrock_stable_diffusion_support
feat(bedrock.py): add stable diffusion image generation support
2024-02-03 12:59:00 -08:00
Krrish Dholakia
e617ef981d fix(vertex_ai.py): treat vertex ai high-traffic error as a rate limit error - allows backoff logic to work here 2024-02-03 12:58:16 -08:00
Krish Dholakia
1c05d479e2
Merge pull request #1797 from BerriAI/litellm_vertex_ai_async_embedding_support
fix(vertex_ai.py): add async embedding support for vertex ai
2024-02-03 12:11:21 -08:00
Krrish Dholakia
36416360c4 feat(bedrock.py): add stable diffusion image generation support 2024-02-03 12:08:38 -08:00
Ishaan Jaff
aadc352cf0
Merge pull request #1795 from BerriAI/litellm_allow_setting_user_roles
[Feat] Allow setting user roles for UserTable
2024-02-03 11:13:09 -08:00
ishaan-jaff
8455aa4bd4 (test) setting user_role 2024-02-03 11:06:51 -08:00
ishaan-jaff
3f2f864cc8 (docs) /user/new 2024-02-03 10:59:06 -08:00
ishaan-jaff
c9958eb329 (feat) raise error when user_role not in known roles 2024-02-03 10:40:59 -08:00
Krrish Dholakia
0ffdf57dec fix(vertex_ai.py): add async embedding support for vertex ai 2024-02-03 10:35:17 -08:00
ishaan-jaff
29885bbdc1 (feat) set user_role for Users 2024-02-03 10:23:50 -08:00
Krish Dholakia
5bf51a6058
Merge pull request #1794 from BerriAI/litellm_vertex_ai_gecko_support
Litellm vertex ai gecko support
2024-02-03 10:17:37 -08:00
ishaan-jaff
93c7e1d457 (feat) add user_role to _types 2024-02-03 10:15:03 -08:00
ishaan-jaff
d41f1b4997 (feat) set user_role for Users on proxy 2024-02-03 10:11:42 -08:00
ishaan-jaff
aee477f4aa (feat) add user_rol to schema.prisma 2024-02-03 10:09:27 -08:00
Krrish Dholakia
1ba6882f76 fix(test_embedding.py): fix test 2024-02-03 09:49:23 -08:00
Krrish Dholakia
d9ba8668f4 feat(vertex_ai.py): vertex ai gecko text embedding support 2024-02-03 09:48:29 -08:00
Ishaan Jaff
6950f99804
Merge pull request #1788 from BerriAI/litellm_fix_delete_key
[Fix] /key/delete + add delete cache keys
2024-02-02 20:22:26 -08:00
ishaan-jaff
ebb221f743 (fix) ui - don't fail when no DB connected 2024-02-02 20:17:26 -08:00
ishaan-jaff
ed048fb822 (ui) update ui build 2024-02-02 20:08:49 -08:00
ishaan-jaff
cfec3c611e (fix) improve proxy api_key caching 2024-02-02 19:59:13 -08:00
ishaan-jaff
ae95e4c3f9 (test) user_api_key_auth_cache 2024-02-02 19:57:55 -08:00
Krish Dholakia
38a299a1bc
Merge pull request #1786 from BerriAI/litellm_cost_tracking_caching_fixes
Litellm cost tracking caching fixes (should be 0.0)
2024-02-02 19:23:07 -08:00
ishaan-jaff
42fcce4645 (fix) /key/info test 2024-02-02 19:22:55 -08:00
Krrish Dholakia
bfe2faa454 test(test_keys.py): separate streaming key info test from normal completion key info test 2024-02-02 19:03:47 -08:00
Krrish Dholakia
3aab719521 test(test_completion.py): skip flaky test 2024-02-02 19:03:47 -08:00
Krrish Dholakia
1f0598a277 fix(proxy_server.py): load default team config straight from config file 2024-02-02 19:03:47 -08:00