Commit graph

800 commits

Author SHA1 Message Date
Ishaan Jaff
ed8f507536
Merge pull request #1974 from BerriAI/litellm_proxy_add_moderations_endpoint
[FEAT] Proxy Add /moderations endpoint
2024-02-14 13:07:34 -08:00
Krrish Dholakia
2d9ecff85b refactor(main.py): trigger rebuild 2024-02-14 11:55:54 -08:00
ishaan-jaff
a575efb4ee (fix) fix moderation test 2024-02-14 11:40:58 -08:00
ishaan-jaff
693efc8e84 (feat) add moderation on router 2024-02-14 11:00:09 -08:00
Krrish Dholakia
3b1cef3e96 refactor(main.py): trigger rebuild 2024-02-12 22:32:36 -08:00
Krrish Dholakia
81bbabdbcf refactor(main.py): trigger rebuild 2024-02-12 22:26:57 -08:00
Krrish Dholakia
b1bc30ee16 feat(sagemaker.py): aioboto3 streaming support 2024-02-12 21:18:34 -08:00
Krrish Dholakia
460b48914e feat(sagemaker.py): initial commit of working sagemaker with aioboto3 2024-02-12 17:25:57 -08:00
Krrish Dholakia
163d1d0e99 refactor(main.py): trigger new build 2024-02-09 21:01:12 -08:00
ishaan-jaff
896fd393db (feat) support bedrock timeout 2024-02-09 14:36:43 -08:00
Krrish Dholakia
2a7e346144 fix(main.py): trigger new build 2024-02-08 23:03:03 -08:00
Krrish Dholakia
b9393fb769 fix(test_parallel_request_limiter.py): use mock responses for streaming 2024-02-08 21:45:38 -08:00
Krrish Dholakia
46dd08c207 refactor(main.py): trigger rebuild 2024-02-06 23:39:28 -08:00
Krrish Dholakia
d1549cb2f3 refactor(main.py): trigger deploy
n
2024-02-06 13:55:51 -08:00
Krrish Dholakia
3b9ada07e0 fix(main.py): raise better error message for health check models without mode 2024-02-05 16:26:25 -08:00
Krrish Dholakia
77fe71ee08 fix(utils.py): support together ai function calling 2024-02-05 15:30:44 -08:00
Krrish Dholakia
c49c88c8e5 fix(utils.py): route together ai calls to openai client
together ai is now openai-compatible

n
2024-02-03 19:22:48 -08:00
Krish Dholakia
9ab59045a3
Merge branch 'main' into litellm_embedding_caching_updates 2024-02-03 18:08:47 -08:00
Krish Dholakia
6408af11b6
Merge pull request #1799 from BerriAI/litellm_bedrock_stable_diffusion_support
feat(bedrock.py): add stable diffusion image generation support
2024-02-03 12:59:00 -08:00
Krrish Dholakia
36416360c4 feat(bedrock.py): add stable diffusion image generation support 2024-02-03 12:08:38 -08:00
Krrish Dholakia
0ffdf57dec fix(vertex_ai.py): add async embedding support for vertex ai 2024-02-03 10:35:17 -08:00
Krrish Dholakia
d9ba8668f4 feat(vertex_ai.py): vertex ai gecko text embedding support 2024-02-03 09:48:29 -08:00
Krrish Dholakia
62ad6f19b7 fix(main.py): for health checks, don't use cached responses 2024-02-02 16:51:42 -08:00
Krrish Dholakia
0111c17981 refactor(main.py): trigger rebuild 2024-02-02 13:18:51 -08:00
Krrish Dholakia
937731fe48 refactor(main.py): trigger rebuild 2024-02-02 13:17:25 -08:00
Krrish Dholakia
9dadbb4b38 refactor: fix spacing 2024-02-01 21:42:13 -08:00
Krrish Dholakia
b8027aea33 refactor(main.py): trigger rebuild 2024-02-01 09:56:45 -08:00
Krrish Dholakia
e71d3f8df4 refactor(main.py): trigger rebuild 2024-01-31 13:06:12 -08:00
Krrish Dholakia
eb9eca6f37 refactor(main.py): trigger rebuild 2024-01-31 09:39:28 -08:00
Krish Dholakia
8ef7e9ad20
Merge pull request #1690 from BerriAI/litellm_custom_pricing_fix
fix(main.py): register both model name and model name with provider
2024-01-30 13:56:38 -08:00
Krrish Dholakia
aa0de83083 fix(main.py): register both model name and model name with provider 2024-01-30 12:47:46 -08:00
ishaan-jaff
e011c4a989 (fix) use OpenAI organization in ahealth_check 2024-01-30 11:45:22 -08:00
ishaan-jaff
cf4b1afa52 (feat) set organization on litellm.completion 2024-01-30 10:56:36 -08:00
Krrish Dholakia
bcad7c58a8 feat(main.py): support auto-infering mode if not set 2024-01-27 19:50:26 -08:00
Krrish Dholakia
8b16059bdf refactor(main.py): trigger version bump 2024-01-26 22:48:21 -08:00
Krish Dholakia
ba4089824d
Merge pull request #1646 from BerriAI/litellm_image_gen_cost_tracking_proxy
Litellm image gen cost tracking proxy
2024-01-26 22:30:14 -08:00
Krrish Dholakia
a299ac2328 fix(utils.py): enable cost tracking for image gen models on proxy 2024-01-26 20:51:13 -08:00
Krish Dholakia
b36f628fc8
Merge pull request #1641 from BerriAI/litellm_bedrock_region_based_pricing
feat(utils.py): support region based pricing for bedrock + use bedrock's token counts if given
2024-01-26 20:28:16 -08:00
Krrish Dholakia
f5da95685a feat(utils.py): support region based pricing for bedrock + use bedrock's token counts if given 2024-01-26 14:53:58 -08:00
ishaan-jaff
479add6b96 (feat) add support for dimensions param 2024-01-26 10:54:34 -08:00
Krrish Dholakia
39aec43b86 test(main.py): adding more logging 2024-01-25 18:15:24 -08:00
Krrish Dholakia
014f83c847 fix(main.py): allow vertex ai project and location to be set in completion() call 2024-01-25 16:40:23 -08:00
Krrish Dholakia
72275ad8cb fix(main.py): fix logging event loop for async logging but sync streaming 2024-01-25 15:59:53 -08:00
Krrish Dholakia
bbe6a92eb9 fix(main.py): fix order of assembly for streaming chunks 2024-01-25 14:51:08 -08:00
Krrish Dholakia
09ec6d6458 fix(utils.py): fix sagemaker async logging for sync streaming
https://github.com/BerriAI/litellm/issues/1592
2024-01-25 12:49:45 -08:00
Ishaan Jaff
6d105754d7
Merge pull request #1561 from BerriAI/litellm_sagemaker_streaming
[Feat] Add REAL Sagemaker streaming
2024-01-22 22:10:20 -08:00
ishaan-jaff
f29de0024a (v0) sagemaker streaming 2024-01-22 21:50:40 -08:00
Krrish Dholakia
3e8c8ef507 fix(openai.py): fix linting issue 2024-01-22 18:20:15 -08:00
Krrish Dholakia
074ea17325 fix: support streaming custom cost completion tracking 2024-01-22 15:15:34 -08:00
Krrish Dholakia
2ce4258cc0 fix(main.py): support custom pricing for embedding calls 2024-01-22 15:15:34 -08:00