Commit graph

859 commits

Author SHA1 Message Date
Krrish Dholakia
a1aeb7b404 fix(main.py): map list input to ollama prompt input format 2024-02-16 09:57:51 -08:00
Krrish Dholakia
b2fdf264ad refactor(main.py): trigger rebuild 2024-02-15 21:53:09 -08:00
Krrish Dholakia
bd960cc4ce refactor(main.py): trigger rebuild 2024-02-14 21:57:08 -08:00
Krish Dholakia
a801728037 Merge pull request #1952 from BerriAI/litellm_aioboto3_sagemaker
Implements aioboto3 for sagemaker
2024-02-14 21:47:22 -08:00
Krish Dholakia
eda9fa300e Merge branch 'main' into litellm_aioboto3_sagemaker 2024-02-14 21:46:58 -08:00
Krish Dholakia
8fea7b45df Merge branch 'main' into litellm_team_settings 2024-02-14 21:45:59 -08:00
Krrish Dholakia
0a37700026 refactor(main.py): trigger rebuild 2024-02-14 21:04:39 -08:00
Ishaan Jaff
c9f1f31901 Merge pull request #1974 from BerriAI/litellm_proxy_add_moderations_endpoint
[FEAT] Proxy Add /moderations endpoint
2024-02-14 13:07:34 -08:00
Krrish Dholakia
f2cbb52521 refactor(main.py): trigger rebuild 2024-02-14 11:55:54 -08:00
ishaan-jaff
afff73e38e (fix) fix moderation test 2024-02-14 11:40:58 -08:00
ishaan-jaff
6c1c2e8c7d (feat) add moderation on router 2024-02-14 11:00:09 -08:00
Krrish Dholakia
a3212a83cb refactor(main.py): trigger rebuild 2024-02-12 22:32:36 -08:00
Krrish Dholakia
e25590acfc refactor(main.py): trigger rebuild 2024-02-12 22:26:57 -08:00
Krrish Dholakia
5de569fcb1 feat(sagemaker.py): aioboto3 streaming support 2024-02-12 21:18:34 -08:00
Krrish Dholakia
23c410a548 feat(sagemaker.py): initial commit of working sagemaker with aioboto3 2024-02-12 17:25:57 -08:00
Krrish Dholakia
3ac1e0a78f refactor(main.py): trigger new build 2024-02-09 21:01:12 -08:00
ishaan-jaff
83e7ebd157 (feat) support bedrock timeout 2024-02-09 14:36:43 -08:00
Krrish Dholakia
6aab36af47 fix(main.py): trigger new build 2024-02-08 23:03:03 -08:00
Krrish Dholakia
07aa05bf17 fix(test_parallel_request_limiter.py): use mock responses for streaming 2024-02-08 21:45:38 -08:00
Krrish Dholakia
350e9dcf64 refactor(main.py): trigger rebuild 2024-02-06 23:39:28 -08:00
Krrish Dholakia
2381e025ad refactor(main.py): trigger deploy
n
2024-02-06 13:55:51 -08:00
TanaroSch
97d27e53db change max_tokens float to int 2024-02-06 11:19:28 +01:00
Krrish Dholakia
1364874d77 fix(main.py): raise better error message for health check models without mode 2024-02-05 16:26:25 -08:00
Krrish Dholakia
2e3c7088d1 fix(utils.py): support together ai function calling 2024-02-05 15:30:44 -08:00
Krrish Dholakia
85a3515d83 fix(utils.py): route together ai calls to openai client
together ai is now openai-compatible

n
2024-02-03 19:22:48 -08:00
Krish Dholakia
45cbb3cf3d Merge branch 'main' into litellm_embedding_caching_updates 2024-02-03 18:08:47 -08:00
Krish Dholakia
dbaad8ae56 Merge pull request #1799 from BerriAI/litellm_bedrock_stable_diffusion_support
feat(bedrock.py): add stable diffusion image generation support
2024-02-03 12:59:00 -08:00
Krrish Dholakia
5994c1e7ef feat(bedrock.py): add stable diffusion image generation support 2024-02-03 12:08:38 -08:00
Krrish Dholakia
7e2c7259e6 fix(vertex_ai.py): add async embedding support for vertex ai 2024-02-03 10:35:17 -08:00
Krrish Dholakia
3f23b18dad feat(vertex_ai.py): vertex ai gecko text embedding support 2024-02-03 09:48:29 -08:00
Krrish Dholakia
df815042de fix(main.py): for health checks, don't use cached responses 2024-02-02 16:51:42 -08:00
Krrish Dholakia
d813f8cdce refactor(main.py): trigger rebuild 2024-02-02 13:18:51 -08:00
Krrish Dholakia
fa03e1c0ae refactor(main.py): trigger rebuild 2024-02-02 13:17:25 -08:00
Krrish Dholakia
44098c4b41 refactor: fix spacing 2024-02-01 21:42:13 -08:00
Krrish Dholakia
3975b40695 refactor(main.py): trigger rebuild 2024-02-01 09:56:45 -08:00
Krrish Dholakia
a0fae908ed refactor(main.py): trigger rebuild 2024-01-31 13:06:12 -08:00
Krrish Dholakia
7a01ef93c1 refactor(main.py): trigger rebuild 2024-01-31 09:39:28 -08:00
Krish Dholakia
35e9cc4600 Merge pull request #1690 from BerriAI/litellm_custom_pricing_fix
fix(main.py): register both model name and model name with provider
2024-01-30 13:56:38 -08:00
Krrish Dholakia
7c8a3acc53 fix(main.py): register both model name and model name with provider 2024-01-30 12:47:46 -08:00
ishaan-jaff
2806a2e99f (fix) use OpenAI organization in ahealth_check 2024-01-30 11:45:22 -08:00
ishaan-jaff
4c37befe81 (feat) set organization on litellm.completion 2024-01-30 10:56:36 -08:00
Krrish Dholakia
a406bd5d33 feat(main.py): support auto-infering mode if not set 2024-01-27 19:50:26 -08:00
Krrish Dholakia
50cb36e8ab refactor(main.py): trigger version bump 2024-01-26 22:48:21 -08:00
Krish Dholakia
e73e3be842 Merge pull request #1646 from BerriAI/litellm_image_gen_cost_tracking_proxy
Litellm image gen cost tracking proxy
2024-01-26 22:30:14 -08:00
Krrish Dholakia
d9fdddc301 fix(utils.py): enable cost tracking for image gen models on proxy 2024-01-26 20:51:13 -08:00
Krish Dholakia
a9a9969d6d Merge pull request #1641 from BerriAI/litellm_bedrock_region_based_pricing
feat(utils.py): support region based pricing for bedrock + use bedrock's token counts if given
2024-01-26 20:28:16 -08:00
Krrish Dholakia
e1beaf0945 feat(utils.py): support region based pricing for bedrock + use bedrock's token counts if given 2024-01-26 14:53:58 -08:00
ishaan-jaff
bc66c0e366 (feat) add support for dimensions param 2024-01-26 10:54:34 -08:00
Krrish Dholakia
cc6a58d2e0 test(main.py): adding more logging 2024-01-25 18:15:24 -08:00
Krrish Dholakia
7591aba27e fix(main.py): allow vertex ai project and location to be set in completion() call 2024-01-25 16:40:23 -08:00