Commit graph

3353 commits

Author SHA1 Message Date
ishaan-jaff
4b3e9c6b38 (ci/cd) run testing again 2024-01-13 11:50:43 -08:00
ishaan-jaff
8d3ca785ae (fix) proxy only import dynamo_db when it's being used 2024-01-13 11:43:50 -08:00
ishaan-jaff
b931841e60 (fix) dynamoDB import issues 2024-01-13 11:38:42 -08:00
Ishaan Jaff
7fc8ccf854
Merge pull request #1432 from BerriAI/litellm_set_hiden_params_custom_llm_provider
Set custom_llm_provider in ModelResponse hidden params
2024-01-14 01:00:49 +05:30
ishaan-jaff
61dff3decb (fix) gunicorn - show request logs like uvicorn 2024-01-13 11:22:16 -08:00
ishaan-jaff
f3d25d2c27 (test) hidden params in stream_chunk builder 2024-01-13 11:10:23 -08:00
ishaan-jaff
485f469518 (feat) set custom_llm_provider in stream chunk builder 2024-01-13 11:09:22 -08:00
Krrish Dholakia
3d7c169a58 fix(proxy_cli.py): only run prisma db push if prisma in environment 2024-01-13 19:44:12 +05:30
Krrish Dholakia
8a7a745549 Merge branch 'litellm_dynamo_db_keys' 2024-01-13 18:38:43 +05:30
Krrish Dholakia
be1ebe36a1 fix(dynamo_db.py): allow user to specify table names 2024-01-13 18:35:19 +05:30
ishaan-jaff
99dcce1e0f (test) aembedding includes custom_llm_provider 2024-01-12 17:52:14 -08:00
ishaan-jaff
39f724d9f3 (fix) always check if response has hidden_param attr 2024-01-12 17:51:34 -08:00
ishaan-jaff
c1686b264f (test) embedding hidden params 2024-01-12 17:35:33 -08:00
ishaan-jaff
7f37d7e44f (feat) set custom_llm_provider for embedding hidden params 2024-01-12 17:35:08 -08:00
ishaan-jaff
f85b64b85c (test) custom_llm_provider in streaming response 2024-01-12 17:15:15 -08:00
ishaan-jaff
6b2a4714a6 (feat) return custom_llm_provider in streaming response 2024-01-12 17:14:43 -08:00
ishaan-jaff
70899521ae (test) custom_llm_provider in hidden params 2024-01-12 17:09:59 -08:00
ishaan-jaff
fd9bddc71a (v0) 2024-01-12 17:05:51 -08:00
Krrish Dholakia
cd639a7f4b fix(proxy_server.py): have /user/info return user info + related user keys 2024-01-12 22:52:13 +05:30
Krish Dholakia
d29a9029ac
Merge pull request #1425 from kaonick/main
#1424:gunicorn can't run in windows
2024-01-12 22:16:38 +05:30
Krish Dholakia
554080804f
Merge pull request #1429 from dleen/data
[bug] unbound variable in bedrock
2024-01-12 22:16:11 +05:30
David Leen
a674de8f36 improve bedrock exception granularity 2024-01-12 16:38:55 +01:00
David Leen
8b021fc4cd [bug] unbound variable in bedrock
note: the code was written as `json.dumps({})` even though it is more verbose in order to facilitate easier refactoring in the future

fixes #1428
2024-01-12 12:33:00 +01:00
XD3000/高瑞雲
574d042655 #1424:gunicorn can't run in windows 2024-01-12 14:30:23 +08:00
Krrish Dholakia
352f943dcf fix(dynamo_db.py): don't auto-create tables, allow database_type == 'dynamodb' 2024-01-12 11:33:40 +05:30
Krrish Dholakia
51110bfb62 fix(main.py): support text completion routing 2024-01-12 11:24:31 +05:30
Krrish Dholakia
d895979065 test(test_health_check.py): fix test 2024-01-12 00:21:11 +05:30
Krrish Dholakia
0cbdec563b refactor(main.py): trigger new release 2024-01-12 00:14:12 +05:30
Krrish Dholakia
a7f182b8ec fix(azure.py): support health checks to text completion endpoints 2024-01-12 00:13:01 +05:30
Krrish Dholakia
f94a37a836 fix(dynamo_db.py): add cost tracking support for key + user 2024-01-11 23:56:41 +05:30
ishaan-jaff
b7567865de (test) caching for bedrock/embedding str inputs 2024-01-11 23:12:57 +05:30
ishaan-jaff
276d11946e (test) bedrock - embedding with strings 2024-01-11 23:04:41 +05:30
ishaan-jaff
a9d812eb8d (fix) bedrock - embedding - support str input 2024-01-11 23:02:12 +05:30
Krrish Dholakia
9b3d78c4f3 fix(dynamo_db.py): if table create fails, tell user what the table + hash key needs to be 2024-01-11 23:01:28 +05:30
ishaan-jaff
a876748bf5 v0 2024-01-11 22:56:18 +05:30
Ishaan Jaff
d181bd22a7
Merge pull request #1422 from dleen/httpx
(fix) create httpx.Request instead of httpx.request
2024-01-11 22:31:55 +05:30
David Leen
6b87c13b9d (fix) create httpx.Request instead of httpx.request
fixes #1420
2024-01-11 16:22:26 +01:00
Krrish Dholakia
43533812a7 fix(proxy_cli.py): read db url from config, not just environment 2024-01-11 19:19:29 +05:30
ishaan-jaff
1fb3547e48 (feat) improve litellm verbose logs 2024-01-11 18:13:08 +05:30
ishaan-jaff
f297a4d174 (feat) show args passed to litellm.completion, acompletion on call 2024-01-11 17:56:27 +05:30
ishaan-jaff
bb8eac0597 (test) improve s3 logging test 2024-01-11 16:57:51 +05:30
Ishaan Jaff
e5b491b39f
Merge pull request #1413 from BerriAI/litellm_log_cache_hits
[Feat] Proxy - Log Cache Hits on success callbacks + Testing
2024-01-11 16:39:22 +05:30
ishaan-jaff
1d9dad4af4 (feat) s3 logging - log cache hits 2024-01-11 15:57:54 +05:30
ishaan-jaff
4a1541c485 (fix) retry gemini-pro-vision 3 times 2024-01-11 14:39:08 +05:30
ishaan-jaff
f89385eed8 (fix) acompletion kwargs type hints 2024-01-11 14:22:37 +05:30
Krish Dholakia
40054f89b5
Merge pull request #1415 from BerriAI/litellm_bump_httpx_pool_limits
fix(router.py): bump httpx pool limits
2024-01-11 13:46:31 +05:30
Krrish Dholakia
40c7400894 fix(router.py): bump httpx pool limits 2024-01-11 12:51:29 +05:30
ishaan-jaff
bd5a14daf6 (fix) acompletion typehints - pass kwargs 2024-01-11 11:49:55 +05:30
ishaan-jaff
cc78e003bf (test) s3 log cache hits 2024-01-11 11:44:48 +05:30
ishaan-jaff
ce426f8b07 (fix) s3 log cache hits 2024-01-11 11:44:20 +05:30