Commit graph

3262 commits

Author SHA1 Message Date
ishaan-jaff
719b051b3d (test) provisioned throughput model 2024-01-13 15:56:24 -08:00
ishaan-jaff
0307ba7def (test) bedrock provisioned througput 2024-01-13 15:40:30 -08:00
ishaan-jaff
5e03c9c637 (feat) bedrock support provisioned throughput 2024-01-13 15:39:54 -08:00
ishaan-jaff
fffb077cf6 (test) get optional_params Azure 2024-01-13 14:32:41 -08:00
ishaan-jaff
79ad63009e (feat) support extra body for Azure, OpenAI 2024-01-13 14:32:11 -08:00
ishaan-jaff
6bae534968 (fix) check if custom_llm_provider is not None 2024-01-13 12:54:03 -08:00
ishaan-jaff
f62dbd0e08 (test) litellm.completion_cost mistral, anyscale 2024-01-13 12:35:09 -08:00
ishaan-jaff
53fd62b0cd (feat) use custom_llm_provider in completion_cost 2024-01-13 12:29:51 -08:00
ishaan-jaff
70426cad76 (fix) run prisma_setup on startup event 2024-01-13 12:06:23 -08:00
ishaan-jaff
4b3e9c6b38 (ci/cd) run testing again 2024-01-13 11:50:43 -08:00
ishaan-jaff
8d3ca785ae (fix) proxy only import dynamo_db when it's being used 2024-01-13 11:43:50 -08:00
ishaan-jaff
b931841e60 (fix) dynamoDB import issues 2024-01-13 11:38:42 -08:00
Ishaan Jaff
7fc8ccf854
Merge pull request #1432 from BerriAI/litellm_set_hiden_params_custom_llm_provider
Set custom_llm_provider in ModelResponse hidden params
2024-01-14 01:00:49 +05:30
ishaan-jaff
61dff3decb (fix) gunicorn - show request logs like uvicorn 2024-01-13 11:22:16 -08:00
ishaan-jaff
f3d25d2c27 (test) hidden params in stream_chunk builder 2024-01-13 11:10:23 -08:00
ishaan-jaff
485f469518 (feat) set custom_llm_provider in stream chunk builder 2024-01-13 11:09:22 -08:00
Krrish Dholakia
3d7c169a58 fix(proxy_cli.py): only run prisma db push if prisma in environment 2024-01-13 19:44:12 +05:30
Krrish Dholakia
8a7a745549 Merge branch 'litellm_dynamo_db_keys' 2024-01-13 18:38:43 +05:30
Krrish Dholakia
be1ebe36a1 fix(dynamo_db.py): allow user to specify table names 2024-01-13 18:35:19 +05:30
ishaan-jaff
99dcce1e0f (test) aembedding includes custom_llm_provider 2024-01-12 17:52:14 -08:00
ishaan-jaff
39f724d9f3 (fix) always check if response has hidden_param attr 2024-01-12 17:51:34 -08:00
ishaan-jaff
c1686b264f (test) embedding hidden params 2024-01-12 17:35:33 -08:00
ishaan-jaff
7f37d7e44f (feat) set custom_llm_provider for embedding hidden params 2024-01-12 17:35:08 -08:00
ishaan-jaff
f85b64b85c (test) custom_llm_provider in streaming response 2024-01-12 17:15:15 -08:00
ishaan-jaff
6b2a4714a6 (feat) return custom_llm_provider in streaming response 2024-01-12 17:14:43 -08:00
ishaan-jaff
70899521ae (test) custom_llm_provider in hidden params 2024-01-12 17:09:59 -08:00
ishaan-jaff
fd9bddc71a (v0) 2024-01-12 17:05:51 -08:00
Krrish Dholakia
cd639a7f4b fix(proxy_server.py): have /user/info return user info + related user keys 2024-01-12 22:52:13 +05:30
Krish Dholakia
d29a9029ac
Merge pull request #1425 from kaonick/main
#1424:gunicorn can't run in windows
2024-01-12 22:16:38 +05:30
Krish Dholakia
554080804f
Merge pull request #1429 from dleen/data
[bug] unbound variable in bedrock
2024-01-12 22:16:11 +05:30
David Leen
a674de8f36 improve bedrock exception granularity 2024-01-12 16:38:55 +01:00
David Leen
8b021fc4cd [bug] unbound variable in bedrock
note: the code was written as `json.dumps({})` even though it is more verbose in order to facilitate easier refactoring in the future

fixes #1428
2024-01-12 12:33:00 +01:00
XD3000/高瑞雲
574d042655 #1424:gunicorn can't run in windows 2024-01-12 14:30:23 +08:00
Krrish Dholakia
352f943dcf fix(dynamo_db.py): don't auto-create tables, allow database_type == 'dynamodb' 2024-01-12 11:33:40 +05:30
Krrish Dholakia
51110bfb62 fix(main.py): support text completion routing 2024-01-12 11:24:31 +05:30
Krrish Dholakia
d895979065 test(test_health_check.py): fix test 2024-01-12 00:21:11 +05:30
Krrish Dholakia
0cbdec563b refactor(main.py): trigger new release 2024-01-12 00:14:12 +05:30
Krrish Dholakia
a7f182b8ec fix(azure.py): support health checks to text completion endpoints 2024-01-12 00:13:01 +05:30
Krrish Dholakia
f94a37a836 fix(dynamo_db.py): add cost tracking support for key + user 2024-01-11 23:56:41 +05:30
ishaan-jaff
b7567865de (test) caching for bedrock/embedding str inputs 2024-01-11 23:12:57 +05:30
ishaan-jaff
276d11946e (test) bedrock - embedding with strings 2024-01-11 23:04:41 +05:30
ishaan-jaff
a9d812eb8d (fix) bedrock - embedding - support str input 2024-01-11 23:02:12 +05:30
Krrish Dholakia
9b3d78c4f3 fix(dynamo_db.py): if table create fails, tell user what the table + hash key needs to be 2024-01-11 23:01:28 +05:30
ishaan-jaff
a876748bf5 v0 2024-01-11 22:56:18 +05:30
Ishaan Jaff
d181bd22a7
Merge pull request #1422 from dleen/httpx
(fix) create httpx.Request instead of httpx.request
2024-01-11 22:31:55 +05:30
David Leen
6b87c13b9d (fix) create httpx.Request instead of httpx.request
fixes #1420
2024-01-11 16:22:26 +01:00
Krrish Dholakia
43533812a7 fix(proxy_cli.py): read db url from config, not just environment 2024-01-11 19:19:29 +05:30
ishaan-jaff
1fb3547e48 (feat) improve litellm verbose logs 2024-01-11 18:13:08 +05:30
ishaan-jaff
f297a4d174 (feat) show args passed to litellm.completion, acompletion on call 2024-01-11 17:56:27 +05:30
ishaan-jaff
bb8eac0597 (test) improve s3 logging test 2024-01-11 16:57:51 +05:30