Commit graph

3232 commits

Author SHA1 Message Date
ishaan-jaff
60586fc37f (test) proxy rules 2024-01-15 21:11:50 -08:00
ishaan-jaff
2873f587fd (docs) add example post call rules to proxy 2024-01-15 20:58:50 -08:00
ishaan-jaff
fcc1e23a05 (fix) post_call rules 2024-01-15 20:56:25 -08:00
ishaan-jaff
a8f2550c25 (ci/cd) openrouter unstable - use other model 2024-01-15 17:43:56 -08:00
ishaan-jaff
c50d8afc86 (test) test_post_call_rule 2024-01-15 17:17:43 -08:00
ishaan-jaff
e864c78d15 (feat) post call rules - fail with error message 2024-01-15 17:13:13 -08:00
ishaan-jaff
4e6a238820 (test) hf currently loading error 2024-01-15 17:07:49 -08:00
ishaan-jaff
58a0b4c03b Revert "Revert "(fix) proxy only import dynamo_db when it's being used""
This reverts commit 8cce2f28ca.
2024-01-15 16:57:36 -08:00
ishaan-jaff
340cca5ac3 Revert "Revert "(fix) dynamoDB import issues""
This reverts commit 6181b95ab3.
2024-01-15 16:48:10 -08:00
ishaan-jaff
8cce2f28ca Revert "(fix) proxy only import dynamo_db when it's being used"
This reverts commit 8d3ca785ae.
2024-01-15 14:20:29 -08:00
ishaan-jaff
6181b95ab3 Revert "(fix) dynamoDB import issues"
This reverts commit b931841e60.
2024-01-15 12:04:13 -08:00
ishaan-jaff
1f62637197 (fix) proxy + dynamo - add some debugging 2024-01-15 12:03:10 -08:00
ishaan-jaff
b43cf53473 (feat) proxy use ProxyException clas 2024-01-15 10:45:39 -08:00
ishaan-jaff
63e80056e5 (test) proxy exception mapping 2024-01-15 10:43:54 -08:00
ishaan-jaff
f0d001658a (test) proxy exception mapping - exactly like OpenAI 2024-01-15 10:43:26 -08:00
ishaan-jaff
44a7e4157c (test) proxy - add openai exception mapping error 2024-01-15 09:56:20 -08:00
ishaan-jaff
746213f5d1 (test) proxy - add JS OpenAI test 2024-01-15 09:53:57 -08:00
ishaan-jaff
9716108c80 (feat) proxy - introduce OpenAIException class 2024-01-15 09:52:23 -08:00
Ishaan Jaff
ad06b08a5e
Merge pull request #1442 from BerriAI/litellm_bedrock_provisioned_throughput
[Feat] Support Bedrock provisioned throughput LLMs
2024-01-14 10:51:28 +05:30
ishaan-jaff
069d060ec9 (feat) provisioned throughput - bedrock embedding models 2024-01-13 21:07:38 -08:00
ishaan-jaff
719b051b3d (test) provisioned throughput model 2024-01-13 15:56:24 -08:00
ishaan-jaff
0307ba7def (test) bedrock provisioned througput 2024-01-13 15:40:30 -08:00
ishaan-jaff
5e03c9c637 (feat) bedrock support provisioned throughput 2024-01-13 15:39:54 -08:00
ishaan-jaff
fffb077cf6 (test) get optional_params Azure 2024-01-13 14:32:41 -08:00
ishaan-jaff
79ad63009e (feat) support extra body for Azure, OpenAI 2024-01-13 14:32:11 -08:00
ishaan-jaff
6bae534968 (fix) check if custom_llm_provider is not None 2024-01-13 12:54:03 -08:00
ishaan-jaff
f62dbd0e08 (test) litellm.completion_cost mistral, anyscale 2024-01-13 12:35:09 -08:00
ishaan-jaff
53fd62b0cd (feat) use custom_llm_provider in completion_cost 2024-01-13 12:29:51 -08:00
ishaan-jaff
70426cad76 (fix) run prisma_setup on startup event 2024-01-13 12:06:23 -08:00
ishaan-jaff
4b3e9c6b38 (ci/cd) run testing again 2024-01-13 11:50:43 -08:00
ishaan-jaff
8d3ca785ae (fix) proxy only import dynamo_db when it's being used 2024-01-13 11:43:50 -08:00
ishaan-jaff
b931841e60 (fix) dynamoDB import issues 2024-01-13 11:38:42 -08:00
Ishaan Jaff
7fc8ccf854
Merge pull request #1432 from BerriAI/litellm_set_hiden_params_custom_llm_provider
Set custom_llm_provider in ModelResponse hidden params
2024-01-14 01:00:49 +05:30
ishaan-jaff
61dff3decb (fix) gunicorn - show request logs like uvicorn 2024-01-13 11:22:16 -08:00
ishaan-jaff
f3d25d2c27 (test) hidden params in stream_chunk builder 2024-01-13 11:10:23 -08:00
ishaan-jaff
485f469518 (feat) set custom_llm_provider in stream chunk builder 2024-01-13 11:09:22 -08:00
Krrish Dholakia
3d7c169a58 fix(proxy_cli.py): only run prisma db push if prisma in environment 2024-01-13 19:44:12 +05:30
Krrish Dholakia
8a7a745549 Merge branch 'litellm_dynamo_db_keys' 2024-01-13 18:38:43 +05:30
Krrish Dholakia
be1ebe36a1 fix(dynamo_db.py): allow user to specify table names 2024-01-13 18:35:19 +05:30
ishaan-jaff
99dcce1e0f (test) aembedding includes custom_llm_provider 2024-01-12 17:52:14 -08:00
ishaan-jaff
39f724d9f3 (fix) always check if response has hidden_param attr 2024-01-12 17:51:34 -08:00
ishaan-jaff
c1686b264f (test) embedding hidden params 2024-01-12 17:35:33 -08:00
ishaan-jaff
7f37d7e44f (feat) set custom_llm_provider for embedding hidden params 2024-01-12 17:35:08 -08:00
ishaan-jaff
f85b64b85c (test) custom_llm_provider in streaming response 2024-01-12 17:15:15 -08:00
ishaan-jaff
6b2a4714a6 (feat) return custom_llm_provider in streaming response 2024-01-12 17:14:43 -08:00
ishaan-jaff
70899521ae (test) custom_llm_provider in hidden params 2024-01-12 17:09:59 -08:00
ishaan-jaff
fd9bddc71a (v0) 2024-01-12 17:05:51 -08:00
Krrish Dholakia
cd639a7f4b fix(proxy_server.py): have /user/info return user info + related user keys 2024-01-12 22:52:13 +05:30
Krish Dholakia
d29a9029ac
Merge pull request #1425 from kaonick/main
#1424:gunicorn can't run in windows
2024-01-12 22:16:38 +05:30
Krish Dholakia
554080804f
Merge pull request #1429 from dleen/data
[bug] unbound variable in bedrock
2024-01-12 22:16:11 +05:30