Commit graph

4484 commits

Author SHA1 Message Date
Krrish Dholakia
3b9ada07e0 fix(main.py): raise better error message for health check models without mode 2024-02-05 16:26:25 -08:00
ishaan-jaff
1f7c8e86a7 (fix) make sure route is str 2024-02-05 16:22:36 -08:00
Krrish Dholakia
a1bbb16ab2 fix(langfuse.py): support logging failed llm api calls to langfuse 2024-02-05 16:16:15 -08:00
ishaan-jaff
2b588a8786 (test) litellm-dashboard never allowed to /chat/completions 2024-02-05 16:11:33 -08:00
ishaan-jaff
8d7698f24d (fix) litellm-ui keys can never access /chat/completions 2024-02-05 16:10:49 -08:00
Krrish Dholakia
77fe71ee08 fix(utils.py): support together ai function calling 2024-02-05 15:30:44 -08:00
ishaan-jaff
7557a2535a (fix) model_prices 2024-02-05 15:04:39 -08:00
ishaan-jaff
70f36073dc (fix) pre commit hook to sync backup context_window mapping 2024-02-05 15:03:04 -08:00
ishaan-jaff
9cbc412c78 (fix) fix backup.json 2024-02-05 14:36:07 -08:00
ishaan-jaff
d4a799a3ca (feat )add semantic cache 2024-02-05 12:28:21 -08:00
David Manouchehri
26e68c3f67
(feat) Add sessionId for Langfuse. 2024-02-05 15:13:21 -05:00
Krrish Dholakia
1bdb332454 fix(utils.py): handle count response tokens false case token counting 2024-02-05 08:47:10 -08:00
Ishaan Jaff
14c9e239a1
Merge pull request #1750 from vanpelt/patch-2
Re-raise exception in async ollama streaming
2024-02-05 08:12:17 -08:00
Krish Dholakia
640572647a
Merge pull request #1805 from BerriAI/litellm_cost_tracking_image_gen
feat(utils.py): support cost tracking for openai/azure image gen models
2024-02-03 22:23:22 -08:00
Krrish Dholakia
49b2dc4180 test(test_completion_cost.py): fix test 2024-02-03 22:00:49 -08:00
Krrish Dholakia
66565f96b1 test(test_completion.py): fix test 2024-02-03 21:44:57 -08:00
Krrish Dholakia
d2d57ecf1c test(test_parallel_request_limiter.py): fix test 2024-02-03 21:31:29 -08:00
Krrish Dholakia
3a19c8b600 test(test_completion.py): fix test 2024-02-03 21:30:45 -08:00
Krish Dholakia
28df60b609
Merge pull request #1809 from BerriAI/litellm_embedding_caching_updates
Support caching individual items in embedding list (Async embedding only)
2024-02-03 21:04:23 -08:00
ishaan-jaff
c353161456 (fix) test_parallel limiter fix 2024-02-03 21:03:15 -08:00
Krrish Dholakia
3e35041758 test(test_parallel_request_limiter.py): fix test to handle minute changes 2024-02-03 20:39:31 -08:00
ishaan-jaff
1155025e6a (ci/cd) run again 2024-02-03 20:36:35 -08:00
Krrish Dholakia
b47b2837eb test(test_parallel_request_limiter.py): fix test 2024-02-03 20:34:05 -08:00
Krrish Dholakia
312c7462c8 refactor(ollama.py): trigger rebuild 2024-02-03 20:23:43 -08:00
Krrish Dholakia
01cef1fe9e fix(ollama.py): fix api connection error
https://github.com/BerriAI/litellm/issues/1735
2024-02-03 20:22:33 -08:00
ishaan-jaff
774cbbde52 (test) tgai is unstable 2024-02-03 20:00:40 -08:00
Krrish Dholakia
25a0e15727 fix(utils.py): support time based pricing for openai-compatible together ai 2024-02-03 19:59:32 -08:00
Krrish Dholakia
efb6123d28 fix(utils.py): support get_secret("TOGETHER_AI_TOKEN") 2024-02-03 19:35:09 -08:00
Krrish Dholakia
c49c88c8e5 fix(utils.py): route together ai calls to openai client
together ai is now openai-compatible

n
2024-02-03 19:22:48 -08:00
Krrish Dholakia
c2f674ebe0 fix(utils.py): fix conditional check 2024-02-03 18:58:58 -08:00
ishaan-jaff
c6aadcbd34 (feat) new ui build 2024-02-03 18:53:05 -08:00
Krish Dholakia
9ab59045a3
Merge branch 'main' into litellm_embedding_caching_updates 2024-02-03 18:08:47 -08:00
Ishaan Jaff
61d1a9a0be
Merge pull request #1807 from BerriAI/litellm_view_key_spend
[UI] View Key Spend Reports 🤠
2024-02-03 17:42:38 -08:00
ishaan-jaff
1fa85c03b8 (feat) allow users to view their spend/logs 2024-02-03 17:33:19 -08:00
Krrish Dholakia
ef0171e063 feat(utils.py): support cost tracking for openai/azure image gen models 2024-02-03 17:09:54 -08:00
Krish Dholakia
1d241b4001
Merge pull request #1802 from BerriAI/litellm_vertex_ai_high_traffic_fix
fix(vertex_ai.py): treat vertex ai high-traffic error as a rate limit error - allows user-controlled backoff logic to work here
2024-02-03 15:37:05 -08:00
ishaan-jaff
44b6c73351 (feat) only allow master key to update users 2024-02-03 14:16:14 -08:00
ishaan-jaff
16364d3879 (feat) update max_budget in /user/update 2024-02-03 14:12:18 -08:00
Krish Dholakia
6408af11b6
Merge pull request #1799 from BerriAI/litellm_bedrock_stable_diffusion_support
feat(bedrock.py): add stable diffusion image generation support
2024-02-03 12:59:00 -08:00
Krrish Dholakia
e617ef981d fix(vertex_ai.py): treat vertex ai high-traffic error as a rate limit error - allows backoff logic to work here 2024-02-03 12:58:16 -08:00
Krish Dholakia
1c05d479e2
Merge pull request #1797 from BerriAI/litellm_vertex_ai_async_embedding_support
fix(vertex_ai.py): add async embedding support for vertex ai
2024-02-03 12:11:21 -08:00
Krrish Dholakia
36416360c4 feat(bedrock.py): add stable diffusion image generation support 2024-02-03 12:08:38 -08:00
Ishaan Jaff
aadc352cf0
Merge pull request #1795 from BerriAI/litellm_allow_setting_user_roles
[Feat] Allow setting user roles for UserTable
2024-02-03 11:13:09 -08:00
ishaan-jaff
8455aa4bd4 (test) setting user_role 2024-02-03 11:06:51 -08:00
ishaan-jaff
3f2f864cc8 (docs) /user/new 2024-02-03 10:59:06 -08:00
ishaan-jaff
c9958eb329 (feat) raise error when user_role not in known roles 2024-02-03 10:40:59 -08:00
Krrish Dholakia
0ffdf57dec fix(vertex_ai.py): add async embedding support for vertex ai 2024-02-03 10:35:17 -08:00
ishaan-jaff
29885bbdc1 (feat) set user_role for Users 2024-02-03 10:23:50 -08:00
Krish Dholakia
5bf51a6058
Merge pull request #1794 from BerriAI/litellm_vertex_ai_gecko_support
Litellm vertex ai gecko support
2024-02-03 10:17:37 -08:00
ishaan-jaff
93c7e1d457 (feat) add user_role to _types 2024-02-03 10:15:03 -08:00