Commit graph

4457 commits

Author SHA1 Message Date
Krrish Dholakia
efb6123d28 fix(utils.py): support get_secret("TOGETHER_AI_TOKEN") 2024-02-03 19:35:09 -08:00
Krrish Dholakia
c49c88c8e5 fix(utils.py): route together ai calls to openai client
together ai is now openai-compatible

n
2024-02-03 19:22:48 -08:00
Krrish Dholakia
c2f674ebe0 fix(utils.py): fix conditional check 2024-02-03 18:58:58 -08:00
ishaan-jaff
c6aadcbd34 (feat) new ui build 2024-02-03 18:53:05 -08:00
Krish Dholakia
9ab59045a3
Merge branch 'main' into litellm_embedding_caching_updates 2024-02-03 18:08:47 -08:00
Ishaan Jaff
61d1a9a0be
Merge pull request #1807 from BerriAI/litellm_view_key_spend
[UI] View Key Spend Reports 🤠
2024-02-03 17:42:38 -08:00
ishaan-jaff
1fa85c03b8 (feat) allow users to view their spend/logs 2024-02-03 17:33:19 -08:00
Krrish Dholakia
ef0171e063 feat(utils.py): support cost tracking for openai/azure image gen models 2024-02-03 17:09:54 -08:00
Krish Dholakia
1d241b4001
Merge pull request #1802 from BerriAI/litellm_vertex_ai_high_traffic_fix
fix(vertex_ai.py): treat vertex ai high-traffic error as a rate limit error - allows user-controlled backoff logic to work here
2024-02-03 15:37:05 -08:00
ishaan-jaff
44b6c73351 (feat) only allow master key to update users 2024-02-03 14:16:14 -08:00
ishaan-jaff
16364d3879 (feat) update max_budget in /user/update 2024-02-03 14:12:18 -08:00
Krish Dholakia
6408af11b6
Merge pull request #1799 from BerriAI/litellm_bedrock_stable_diffusion_support
feat(bedrock.py): add stable diffusion image generation support
2024-02-03 12:59:00 -08:00
Krrish Dholakia
e617ef981d fix(vertex_ai.py): treat vertex ai high-traffic error as a rate limit error - allows backoff logic to work here 2024-02-03 12:58:16 -08:00
Krish Dholakia
1c05d479e2
Merge pull request #1797 from BerriAI/litellm_vertex_ai_async_embedding_support
fix(vertex_ai.py): add async embedding support for vertex ai
2024-02-03 12:11:21 -08:00
Krrish Dholakia
36416360c4 feat(bedrock.py): add stable diffusion image generation support 2024-02-03 12:08:38 -08:00
Ishaan Jaff
aadc352cf0
Merge pull request #1795 from BerriAI/litellm_allow_setting_user_roles
[Feat] Allow setting user roles for UserTable
2024-02-03 11:13:09 -08:00
ishaan-jaff
8455aa4bd4 (test) setting user_role 2024-02-03 11:06:51 -08:00
ishaan-jaff
3f2f864cc8 (docs) /user/new 2024-02-03 10:59:06 -08:00
ishaan-jaff
c9958eb329 (feat) raise error when user_role not in known roles 2024-02-03 10:40:59 -08:00
Krrish Dholakia
0ffdf57dec fix(vertex_ai.py): add async embedding support for vertex ai 2024-02-03 10:35:17 -08:00
ishaan-jaff
29885bbdc1 (feat) set user_role for Users 2024-02-03 10:23:50 -08:00
Krish Dholakia
5bf51a6058
Merge pull request #1794 from BerriAI/litellm_vertex_ai_gecko_support
Litellm vertex ai gecko support
2024-02-03 10:17:37 -08:00
ishaan-jaff
93c7e1d457 (feat) add user_role to _types 2024-02-03 10:15:03 -08:00
ishaan-jaff
d41f1b4997 (feat) set user_role for Users on proxy 2024-02-03 10:11:42 -08:00
ishaan-jaff
aee477f4aa (feat) add user_rol to schema.prisma 2024-02-03 10:09:27 -08:00
Krrish Dholakia
1ba6882f76 fix(test_embedding.py): fix test 2024-02-03 09:49:23 -08:00
Krrish Dholakia
d9ba8668f4 feat(vertex_ai.py): vertex ai gecko text embedding support 2024-02-03 09:48:29 -08:00
Ishaan Jaff
6950f99804
Merge pull request #1788 from BerriAI/litellm_fix_delete_key
[Fix] /key/delete + add delete cache keys
2024-02-02 20:22:26 -08:00
ishaan-jaff
ebb221f743 (fix) ui - don't fail when no DB connected 2024-02-02 20:17:26 -08:00
ishaan-jaff
ed048fb822 (ui) update ui build 2024-02-02 20:08:49 -08:00
ishaan-jaff
cfec3c611e (fix) improve proxy api_key caching 2024-02-02 19:59:13 -08:00
ishaan-jaff
ae95e4c3f9 (test) user_api_key_auth_cache 2024-02-02 19:57:55 -08:00
Krish Dholakia
38a299a1bc
Merge pull request #1786 from BerriAI/litellm_cost_tracking_caching_fixes
Litellm cost tracking caching fixes (should be 0.0)
2024-02-02 19:23:07 -08:00
ishaan-jaff
42fcce4645 (fix) /key/info test 2024-02-02 19:22:55 -08:00
Krrish Dholakia
bfe2faa454 test(test_keys.py): separate streaming key info test from normal completion key info test 2024-02-02 19:03:47 -08:00
Krrish Dholakia
3aab719521 test(test_completion.py): skip flaky test 2024-02-02 19:03:47 -08:00
Krrish Dholakia
1f0598a277 fix(proxy_server.py): load default team config straight from config file 2024-02-02 19:03:47 -08:00
Krrish Dholakia
142e7cf1ce test(test_image_generation.py): ignore content violation errors for image gen test 2024-02-02 19:03:47 -08:00
Krrish Dholakia
c0699b08e5 test(test_caching.py): fix test to check id 2024-02-02 19:03:47 -08:00
Krrish Dholakia
c997d4b0ce fix(test_key_generate_prisma.py): add longer delay to allow logs to update 2024-02-02 19:03:47 -08:00
Krrish Dholakia
ddf3e51545 fix(main.py): for health checks, don't use cached responses 2024-02-02 19:03:47 -08:00
Krrish Dholakia
688193bea3 fix(proxy_server.py): don't silently fail load_team_config 2024-02-02 19:03:47 -08:00
Krrish Dholakia
8988353176 test(test_keys.py): separate streaming key info test from normal completion key info test 2024-02-02 18:57:19 -08:00
ishaan-jaff
3899361aa4 (test) state of litellm cache after create, delete 2024-02-02 18:49:20 -08:00
Krrish Dholakia
2d59331148 test(test_completion.py): skip flaky test 2024-02-02 18:44:17 -08:00
ishaan-jaff
9852462d1f (fix) proxy - clear cache after /key/delete 2024-02-02 18:40:18 -08:00
ishaan-jaff
4d6ffe4400 (feat) - cache - add delete cache 2024-02-02 18:36:51 -08:00
Krrish Dholakia
5631b3357b fix(proxy_server.py): load default team config straight from config file 2024-02-02 18:35:30 -08:00
Krrish Dholakia
f3dd0c0563 test(test_image_generation.py): ignore content violation errors for image gen test 2024-02-02 18:05:39 -08:00
Krrish Dholakia
92b0a4cf50 test(test_key_generate_prisma.py): add longer sleep time 2024-02-02 18:03:07 -08:00