Commit graph

3262 commits

Author SHA1 Message Date
ishaan-jaff
121266b05b (test) /key/gen fails when crossing budget 2024-01-16 19:35:34 -08:00
ishaan-jaff
d8a11b7ee6 (test) cleanup 2024-01-16 17:42:47 -08:00
ishaan-jaff
2c79b8fc1b (test) invalid key auth 2024-01-16 17:40:32 -08:00
ishaan-jaff
adc921f0be (test) /key/gen 2024-01-16 17:36:33 -08:00
ishaan-jaff
466fff4aaf (fix) when budget, spend is None comparison 2024-01-16 17:35:39 -08:00
ishaan-jaff
086f827af8 (v0) add test for basic key gen with dynamo 2024-01-16 17:21:50 -08:00
ishaan-jaff
d566421bc2 (test) test 8 key/gen, user_auth scenarios 2024-01-16 16:47:31 -08:00
ishaan-jaff
5b201bbb4d (test) add new key gen tests 2024-01-16 16:20:29 -08:00
ishaan-jaff
d59ac23e82 (fix) proxy, dynamo - allow users to set ssl_verify False 2024-01-16 16:13:55 -08:00
Ishaan Jaff
023c07b607
Merge pull request #1464 from BerriAI/litellm_fixes_key_gen
[Fix] Fixes for /key/gen, /user/new
2024-01-16 16:05:53 -08:00
ishaan-jaff
e4ba779d6a (ci/cd) fixes 2024-01-16 16:03:42 -08:00
ishaan-jaff
90c8698b64 (temp) undo ssl_verify=False change 2024-01-16 15:56:21 -08:00
ishaan-jaff
ee3c584b0d (ci/cd) fixes for ollama test 2024-01-16 15:46:19 -08:00
ishaan-jaff
87ff4ca55c (fix) proxy check expires time 2024-01-16 15:38:58 -08:00
ishaan-jaff
92093dd45a (ci/cd) ollama test 2024-01-16 15:22:33 -08:00
ishaan-jaff
4085c465f5 (ci/cd) skip streaming + hosted ollama flaky test 2024-01-16 15:01:56 -08:00
ishaan-jaff
de456678cd (fix) reject Auth if user crosses budget 2024-01-16 14:58:00 -08:00
ishaan-jaff
a045bb90d4 (fix) check if budget crossed for api_key 2024-01-16 14:20:19 -08:00
ishaan-jaff
e16fa16442 (fix) improve unauthorized error message 2024-01-16 14:04:26 -08:00
ishaan-jaff
c15adf4fe4 (fix) proxy - improve invalid models exception msg 2024-01-16 14:01:01 -08:00
ishaan-jaff
7d9c953dee (feat) proxy - auth - raise Value Error when master key is None 2024-01-16 13:27:50 -08:00
ishaan-jaff
d6f0cb8756 (ci/cd) fix olama hosted testing 2024-01-16 12:27:16 -08:00
ishaan-jaff
6c6c62f032 (temp) ssl_verify=False for dynamo 2024-01-16 12:24:40 -08:00
ishaan-jaff
893627cab4 (feat) use env variables to set host, port, num_workers 2024-01-16 08:36:29 -08:00
ishaan-jaff
6a09fcfa06 (feat) print num_workers when starting prox 2024-01-16 08:21:37 -08:00
ishaan-jaff
7b1c8471c5 v0 num_workers 2024-01-16 08:15:12 -08:00
ishaan-jaff
be1bbb2dcd (test) test exceptions 2024-01-15 22:01:33 -08:00
ishaan-jaff
0e26ef858b (feat) sagemaker - map status code and message 2024-01-15 21:43:16 -08:00
ishaan-jaff
00ac18e8b7 (feat) improve bedrock, sagemaker exception mapping 2024-01-15 21:22:22 -08:00
ishaan-jaff
893a2c3c7b (fix) proxy:sagemaker, bedrock fix - num_retries=0 2024-01-15 21:18:49 -08:00
ishaan-jaff
60586fc37f (test) proxy rules 2024-01-15 21:11:50 -08:00
ishaan-jaff
2873f587fd (docs) add example post call rules to proxy 2024-01-15 20:58:50 -08:00
ishaan-jaff
fcc1e23a05 (fix) post_call rules 2024-01-15 20:56:25 -08:00
ishaan-jaff
a8f2550c25 (ci/cd) openrouter unstable - use other model 2024-01-15 17:43:56 -08:00
ishaan-jaff
c50d8afc86 (test) test_post_call_rule 2024-01-15 17:17:43 -08:00
ishaan-jaff
e864c78d15 (feat) post call rules - fail with error message 2024-01-15 17:13:13 -08:00
ishaan-jaff
4e6a238820 (test) hf currently loading error 2024-01-15 17:07:49 -08:00
ishaan-jaff
58a0b4c03b Revert "Revert "(fix) proxy only import dynamo_db when it's being used""
This reverts commit 8cce2f28ca.
2024-01-15 16:57:36 -08:00
ishaan-jaff
340cca5ac3 Revert "Revert "(fix) dynamoDB import issues""
This reverts commit 6181b95ab3.
2024-01-15 16:48:10 -08:00
ishaan-jaff
8cce2f28ca Revert "(fix) proxy only import dynamo_db when it's being used"
This reverts commit 8d3ca785ae.
2024-01-15 14:20:29 -08:00
ishaan-jaff
6181b95ab3 Revert "(fix) dynamoDB import issues"
This reverts commit b931841e60.
2024-01-15 12:04:13 -08:00
ishaan-jaff
1f62637197 (fix) proxy + dynamo - add some debugging 2024-01-15 12:03:10 -08:00
ishaan-jaff
b43cf53473 (feat) proxy use ProxyException clas 2024-01-15 10:45:39 -08:00
ishaan-jaff
63e80056e5 (test) proxy exception mapping 2024-01-15 10:43:54 -08:00
ishaan-jaff
f0d001658a (test) proxy exception mapping - exactly like OpenAI 2024-01-15 10:43:26 -08:00
ishaan-jaff
44a7e4157c (test) proxy - add openai exception mapping error 2024-01-15 09:56:20 -08:00
ishaan-jaff
746213f5d1 (test) proxy - add JS OpenAI test 2024-01-15 09:53:57 -08:00
ishaan-jaff
9716108c80 (feat) proxy - introduce OpenAIException class 2024-01-15 09:52:23 -08:00
Ishaan Jaff
ad06b08a5e
Merge pull request #1442 from BerriAI/litellm_bedrock_provisioned_throughput
[Feat] Support Bedrock provisioned throughput LLMs
2024-01-14 10:51:28 +05:30
ishaan-jaff
069d060ec9 (feat) provisioned throughput - bedrock embedding models 2024-01-13 21:07:38 -08:00