Commit graph

4415 commits

Author SHA1 Message Date
ishaan-jaff
901a1a3655 (fix) litellm bug in 2024-02-17 18:41:37 -08:00
Krish Dholakia
ad81e19282
Merge pull request #2013 from afbarbaro/litellm_gemini_safety_settings
Add safety_settings parameter to gemini generate_content calls
2024-02-17 16:47:29 -08:00
ishaan-jaff
44202aa25b (fix) dynamo db test - new model_spend params 2024-02-17 16:00:08 -08:00
Ishaan Jaff
35af2d666b
Merge pull request #2022 from BerriAI/litellm_budgets_per_llm
[FEAT] Track spend per model (for Key, User and Team)
2024-02-17 15:35:31 -08:00
ishaan-jaff
c069403b05 (fix) ui build 2024-02-17 14:06:52 -08:00
ishaan-jaff
844df2412e (feat) set fast api root path 2024-02-17 13:03:24 -08:00
Krrish Dholakia
3565f74338 docs(enterprise.md): add llama guard tutorial to enterprise docs 2024-02-17 09:25:49 -08:00
Krrish Dholakia
05b2a3c146 refactor(main.py): trigger new build 2024-02-17 08:25:58 -08:00
Krish Dholakia
9ce29295af
Merge pull request #2017 from sorokine/main 2024-02-17 07:07:56 -08:00
Krrish Dholakia
2a4a6995ac feat(llama_guard.py): add llama guard support for content moderation + new async_moderation_hook endpoint 2024-02-16 18:45:25 -08:00
ishaan-jaff
62d0c54cfb (fix) issue with storing model max budget 2024-02-16 18:18:35 -08:00
ishaan-jaff
e76a3c5ce5 (fix) _types for model_max_budget 2024-02-16 17:47:22 -08:00
Krish Dholakia
5e7dda4f88
Merge pull request #2025 from BerriAI/litellm_langfuse_image_gen_logging
fix(utils.py): support image gen logging to langfuse
2024-02-16 17:08:07 -08:00
ishaan-jaff
e8dcf8fa13 (fix) setting model_max_budget 2024-02-16 17:00:23 -08:00
ishaan-jaff
d65c6d3869 (feat) track spend key-model, user-model, team-model 2024-02-16 16:32:17 -08:00
Krrish Dholakia
9cbdbda8e4 test(test_custom_callback_input.py): fix image gen callback test 2024-02-16 16:29:26 -08:00
ishaan-jaff
2c9d142e42 (feat) track key spend per model 2024-02-16 16:15:24 -08:00
Krrish Dholakia
f57483ea70 fix(utils.py): support image gen logging to langfuse 2024-02-16 16:12:52 -08:00
ishaan-jaff
a2f1d2ee52 (feat) set key-model budgets 2024-02-16 15:44:34 -08:00
Ishaan Jaff
4d4653b619
Merge branch 'main' into litellm_fix_generic_sso 2024-02-16 14:51:46 -08:00
Ishaan Jaff
e6b9e5b46f
Merge pull request #2020 from Lunik/feat/generic-sso-scopes
 Allow to configure scopes in generic SSO
2024-02-16 14:45:09 -08:00
ishaan-jaff
5857b02bfc (feat) generic sso, set generic_user_id_attribute_name 2024-02-16 14:40:27 -08:00
Lunik
af4537e421
Allow to configure scopes in generic SSO
Signed-off-by: Lunik <lunik@tiwabbit.fr>
2024-02-16 23:24:58 +01:00
Krrish Dholakia
5f9e141d1e fix(huggingface_restapi.py): return streamed response correctly 2024-02-16 13:25:13 -08:00
Krrish Dholakia
86886de9d8 test(test_completion.py): handle azure gpt-4 vision internal error 2024-02-16 13:16:46 -08:00
Alexandre Sorokine
3c919cbbe7 fix for importllib compatibility issue for python 3.8
was tested for python versions 3.8, 3.9, 3.10, 3.11, 3.12
2024-02-16 15:52:39 -05:00
Krrish Dholakia
0d54887149 test(test_amazing_vertex_completion.py): handle rate limit errors 2024-02-16 11:54:12 -08:00
Krrish Dholakia
01077b20b9 fix(proxy_server.py): restrict model access for /v1/completions endpoint 2024-02-16 11:54:12 -08:00
ishaan-jaff
936e460a30 (chore) fix spend tracking request tags 2024-02-16 11:54:12 -08:00
Krrish Dholakia
b3d48da640 fix(main.py): map list input to ollama prompt input format 2024-02-16 11:54:12 -08:00
Krrish Dholakia
e9b27d9811 fix(proxy_server.py): re-add /team/info endpoint (fixing merge issue) 2024-02-16 11:54:12 -08:00
Krrish Dholakia
8f55e86527 test(test_amazing_vertex_completion.py): handle rate limit errors 2024-02-16 11:51:41 -08:00
Krrish Dholakia
d97369dcbe fix(proxy_server.py): restrict model access for /v1/completions endpoint 2024-02-16 11:50:07 -08:00
Ishaan Jaff
691542ddf0
Merge pull request #2004 from BerriAI/litellm_track_spend_per_tag
[FEAT] Track spend per tag
2024-02-16 10:55:02 -08:00
ishaan-jaff
55bd08847c (chore) fix spend tracking request tags 2024-02-16 10:53:33 -08:00
Andres Barbaro
1f054203bf Add safety_settings parameter to gemini generate_content calls 2024-02-16 12:22:18 -06:00
ishaan-jaff
138f5ceb1e (feat) view spend per tag 2024-02-16 10:16:48 -08:00
Krrish Dholakia
944afcb5d1 fix(main.py): map list input to ollama prompt input format 2024-02-16 09:57:51 -08:00
ishaan-jaff
23589a398a (feat) log request_tags in SpendLogs 2024-02-16 09:52:25 -08:00
ishaan-jaff
097b46d948 (feat) view spend per tag 2024-02-16 08:51:23 -08:00
Krrish Dholakia
8640989a80 fix(proxy_server.py): re-add /team/info endpoint (fixing merge issue) 2024-02-16 08:49:37 -08:00
Krish Dholakia
70146c1d37
Merge pull request #1995 from BerriAI/litellm_langfuse_prompts
feat(langfuse.py): support langfuse prompt management
2024-02-15 23:57:00 -08:00
Krish Dholakia
999fab82f7
Merge branch 'main' into litellm_moderations_improvements 2024-02-15 23:08:25 -08:00
Krish Dholakia
9b60ef9a3c
Merge pull request #1916 from RenaLu/main
Add support for Vertex AI custom models deployed on private endpoint
2024-02-15 22:47:36 -08:00
Ishaan Jaff
3615094939
Merge pull request #1996 from BerriAI/litellm_track_spend_per_team
[FEAT] Track spend per team
2024-02-15 22:43:36 -08:00
ishaan-jaff
c4eae818ef (fix) chat ui bug 2024-02-15 22:40:42 -08:00
ishaan-jaff
9bcf9ad531 (feat) schema.prisma 2024-02-15 22:10:45 -08:00
Krrish Dholakia
79efa64560 refactor(main.py): trigger rebuild 2024-02-15 21:53:09 -08:00
Krrish Dholakia
122d644e10 fix(test_async_fn.py): fix test 2024-02-15 21:51:06 -08:00
Ishaan Jaff
de6b4967a7
Merge pull request #1993 from BerriAI/litellm_track_team_id_langfuse_tags_metadata
[FEAT] Track team_id in langfuse tags, callback metadata
2024-02-15 21:42:12 -08:00