Commit graph

626 commits

Author SHA1 Message Date
Krish Dholakia
dbaad8ae56 Merge pull request #1799 from BerriAI/litellm_bedrock_stable_diffusion_support
feat(bedrock.py): add stable diffusion image generation support
2024-02-03 12:59:00 -08:00
Krrish Dholakia
5994c1e7ef feat(bedrock.py): add stable diffusion image generation support 2024-02-03 12:08:38 -08:00
Krrish Dholakia
7e2c7259e6 fix(vertex_ai.py): add async embedding support for vertex ai 2024-02-03 10:35:17 -08:00
Krrish Dholakia
3f23b18dad feat(vertex_ai.py): vertex ai gecko text embedding support 2024-02-03 09:48:29 -08:00
Krrish Dholakia
df815042de fix(main.py): for health checks, don't use cached responses 2024-02-02 16:51:42 -08:00
Krrish Dholakia
d813f8cdce refactor(main.py): trigger rebuild 2024-02-02 13:18:51 -08:00
Krrish Dholakia
fa03e1c0ae refactor(main.py): trigger rebuild 2024-02-02 13:17:25 -08:00
Krrish Dholakia
44098c4b41 refactor: fix spacing 2024-02-01 21:42:13 -08:00
Krrish Dholakia
3975b40695 refactor(main.py): trigger rebuild 2024-02-01 09:56:45 -08:00
Krrish Dholakia
a0fae908ed refactor(main.py): trigger rebuild 2024-01-31 13:06:12 -08:00
Krrish Dholakia
7a01ef93c1 refactor(main.py): trigger rebuild 2024-01-31 09:39:28 -08:00
Krish Dholakia
35e9cc4600 Merge pull request #1690 from BerriAI/litellm_custom_pricing_fix
fix(main.py): register both model name and model name with provider
2024-01-30 13:56:38 -08:00
Krrish Dholakia
7c8a3acc53 fix(main.py): register both model name and model name with provider 2024-01-30 12:47:46 -08:00
ishaan-jaff
2806a2e99f (fix) use OpenAI organization in ahealth_check 2024-01-30 11:45:22 -08:00
ishaan-jaff
4c37befe81 (feat) set organization on litellm.completion 2024-01-30 10:56:36 -08:00
Krrish Dholakia
a406bd5d33 feat(main.py): support auto-infering mode if not set 2024-01-27 19:50:26 -08:00
Krrish Dholakia
50cb36e8ab refactor(main.py): trigger version bump 2024-01-26 22:48:21 -08:00
Krish Dholakia
e73e3be842 Merge pull request #1646 from BerriAI/litellm_image_gen_cost_tracking_proxy
Litellm image gen cost tracking proxy
2024-01-26 22:30:14 -08:00
Krrish Dholakia
d9fdddc301 fix(utils.py): enable cost tracking for image gen models on proxy 2024-01-26 20:51:13 -08:00
Krish Dholakia
a9a9969d6d Merge pull request #1641 from BerriAI/litellm_bedrock_region_based_pricing
feat(utils.py): support region based pricing for bedrock + use bedrock's token counts if given
2024-01-26 20:28:16 -08:00
Krrish Dholakia
e1beaf0945 feat(utils.py): support region based pricing for bedrock + use bedrock's token counts if given 2024-01-26 14:53:58 -08:00
ishaan-jaff
bc66c0e366 (feat) add support for dimensions param 2024-01-26 10:54:34 -08:00
Krrish Dholakia
cc6a58d2e0 test(main.py): adding more logging 2024-01-25 18:15:24 -08:00
Krrish Dholakia
7591aba27e fix(main.py): allow vertex ai project and location to be set in completion() call 2024-01-25 16:40:23 -08:00
Krrish Dholakia
d88e190304 fix(main.py): fix logging event loop for async logging but sync streaming 2024-01-25 15:59:53 -08:00
Krrish Dholakia
806eef02dd fix(main.py): fix order of assembly for streaming chunks 2024-01-25 14:51:08 -08:00
Krrish Dholakia
402235dc5d fix(utils.py): fix sagemaker async logging for sync streaming
https://github.com/BerriAI/litellm/issues/1592
2024-01-25 12:49:45 -08:00
Ishaan Jaff
97dd61a6cb Merge pull request #1561 from BerriAI/litellm_sagemaker_streaming
[Feat] Add REAL Sagemaker streaming
2024-01-22 22:10:20 -08:00
ishaan-jaff
eb9b3987fb (v0) sagemaker streaming 2024-01-22 21:50:40 -08:00
Krrish Dholakia
db2b7bfd4e fix(openai.py): fix linting issue 2024-01-22 18:20:15 -08:00
Krrish Dholakia
e423aeff85 fix: support streaming custom cost completion tracking 2024-01-22 15:15:34 -08:00
Krrish Dholakia
85b9ad7def fix(main.py): support custom pricing for embedding calls 2024-01-22 15:15:34 -08:00
Krrish Dholakia
480c3d3991 feat(utils.py): support custom cost tracking per second
https://github.com/BerriAI/litellm/issues/1374
2024-01-22 15:15:34 -08:00
ishaan-jaff
033de31ec9 (feat) mock_response set custom_llm_provider in hidden param 2024-01-22 14:22:16 -08:00
Krrish Dholakia
2ecc2f12cd fix(gemini.py): support streaming 2024-01-19 20:21:34 -08:00
Ishaan Jaff
268f9e3c7e Merge pull request #1513 from costly-ai/main
Allow overriding headers for anthropic
2024-01-19 15:21:45 -08:00
ishaan-jaff
cf2bf1fe60 (fix) return usage in mock_completion 2024-01-19 11:25:47 -08:00
Keegan McCallum
48948805a8 Allow overriding headers for anthropic 2024-01-18 20:12:59 -08:00
Krrish Dholakia
aa01ed0f38 fix(main.py): read azure ad token from optional params extra body 2024-01-18 17:14:03 -08:00
Krrish Dholakia
cc89aa7456 fix(bedrock.py): add support for sts based boto3 initialization
https://github.com/BerriAI/litellm/issues/1476
2024-01-17 12:08:59 -08:00
ishaan-jaff
cd2828e93a (feat) set custom_llm_provider in stream chunk builder 2024-01-13 11:09:22 -08:00
ishaan-jaff
f7bdee69fb (fix) always check if response has hidden_param attr 2024-01-12 17:51:34 -08:00
ishaan-jaff
e83c70ea55 (feat) set custom_llm_provider for embedding hidden params 2024-01-12 17:35:08 -08:00
ishaan-jaff
f9271b59b4 (v0) 2024-01-12 17:05:51 -08:00
Krrish Dholakia
becdabe837 fix(main.py): support text completion routing 2024-01-12 11:24:31 +05:30
Krrish Dholakia
cbb021c9af refactor(main.py): trigger new release 2024-01-12 00:14:12 +05:30
Krrish Dholakia
0e1ea4325c fix(azure.py): support health checks to text completion endpoints 2024-01-12 00:13:01 +05:30
Krrish Dholakia
36068b707a fix(proxy_cli.py): read db url from config, not just environment 2024-01-11 19:19:29 +05:30
ishaan-jaff
c41b47dc8b (fix) acompletion kwargs type hints 2024-01-11 14:22:37 +05:30
ishaan-jaff
29393fb512 (fix) acompletion typehints - pass kwargs 2024-01-11 11:49:55 +05:30