ishaan-jaff
|
92093dd45a
|
(ci/cd) ollama test
|
2024-01-16 15:22:33 -08:00 |
|
ishaan-jaff
|
4085c465f5
|
(ci/cd) skip streaming + hosted ollama flaky test
|
2024-01-16 15:01:56 -08:00 |
|
ishaan-jaff
|
de456678cd
|
(fix) reject Auth if user crosses budget
|
2024-01-16 14:58:00 -08:00 |
|
ishaan-jaff
|
a045bb90d4
|
(fix) check if budget crossed for api_key
|
2024-01-16 14:20:19 -08:00 |
|
ishaan-jaff
|
e16fa16442
|
(fix) improve unauthorized error message
|
2024-01-16 14:04:26 -08:00 |
|
ishaan-jaff
|
c15adf4fe4
|
(fix) proxy - improve invalid models exception msg
|
2024-01-16 14:01:01 -08:00 |
|
ishaan-jaff
|
7d9c953dee
|
(feat) proxy - auth - raise Value Error when master key is None
|
2024-01-16 13:27:50 -08:00 |
|
ishaan-jaff
|
d6f0cb8756
|
(ci/cd) fix olama hosted testing
|
2024-01-16 12:27:16 -08:00 |
|
ishaan-jaff
|
6c6c62f032
|
(temp) ssl_verify=False for dynamo
|
2024-01-16 12:24:40 -08:00 |
|
ishaan-jaff
|
893627cab4
|
(feat) use env variables to set host, port, num_workers
|
2024-01-16 08:36:29 -08:00 |
|
ishaan-jaff
|
6a09fcfa06
|
(feat) print num_workers when starting prox
|
2024-01-16 08:21:37 -08:00 |
|
ishaan-jaff
|
7b1c8471c5
|
v0 num_workers
|
2024-01-16 08:15:12 -08:00 |
|
ishaan-jaff
|
be1bbb2dcd
|
(test) test exceptions
|
2024-01-15 22:01:33 -08:00 |
|
ishaan-jaff
|
0e26ef858b
|
(feat) sagemaker - map status code and message
|
2024-01-15 21:43:16 -08:00 |
|
ishaan-jaff
|
00ac18e8b7
|
(feat) improve bedrock, sagemaker exception mapping
|
2024-01-15 21:22:22 -08:00 |
|
ishaan-jaff
|
893a2c3c7b
|
(fix) proxy:sagemaker, bedrock fix - num_retries=0
|
2024-01-15 21:18:49 -08:00 |
|
ishaan-jaff
|
60586fc37f
|
(test) proxy rules
|
2024-01-15 21:11:50 -08:00 |
|
ishaan-jaff
|
2873f587fd
|
(docs) add example post call rules to proxy
|
2024-01-15 20:58:50 -08:00 |
|
ishaan-jaff
|
fcc1e23a05
|
(fix) post_call rules
|
2024-01-15 20:56:25 -08:00 |
|
ishaan-jaff
|
a8f2550c25
|
(ci/cd) openrouter unstable - use other model
|
2024-01-15 17:43:56 -08:00 |
|
ishaan-jaff
|
c50d8afc86
|
(test) test_post_call_rule
|
2024-01-15 17:17:43 -08:00 |
|
ishaan-jaff
|
e864c78d15
|
(feat) post call rules - fail with error message
|
2024-01-15 17:13:13 -08:00 |
|
ishaan-jaff
|
4e6a238820
|
(test) hf currently loading error
|
2024-01-15 17:07:49 -08:00 |
|
ishaan-jaff
|
58a0b4c03b
|
Revert "Revert "(fix) proxy only import dynamo_db when it's being used""
This reverts commit 8cce2f28ca .
|
2024-01-15 16:57:36 -08:00 |
|
ishaan-jaff
|
340cca5ac3
|
Revert "Revert "(fix) dynamoDB import issues""
This reverts commit 6181b95ab3 .
|
2024-01-15 16:48:10 -08:00 |
|
ishaan-jaff
|
8cce2f28ca
|
Revert "(fix) proxy only import dynamo_db when it's being used"
This reverts commit 8d3ca785ae .
|
2024-01-15 14:20:29 -08:00 |
|
ishaan-jaff
|
6181b95ab3
|
Revert "(fix) dynamoDB import issues"
This reverts commit b931841e60 .
|
2024-01-15 12:04:13 -08:00 |
|
ishaan-jaff
|
1f62637197
|
(fix) proxy + dynamo - add some debugging
|
2024-01-15 12:03:10 -08:00 |
|
ishaan-jaff
|
b43cf53473
|
(feat) proxy use ProxyException clas
|
2024-01-15 10:45:39 -08:00 |
|
ishaan-jaff
|
63e80056e5
|
(test) proxy exception mapping
|
2024-01-15 10:43:54 -08:00 |
|
ishaan-jaff
|
f0d001658a
|
(test) proxy exception mapping - exactly like OpenAI
|
2024-01-15 10:43:26 -08:00 |
|
ishaan-jaff
|
44a7e4157c
|
(test) proxy - add openai exception mapping error
|
2024-01-15 09:56:20 -08:00 |
|
ishaan-jaff
|
746213f5d1
|
(test) proxy - add JS OpenAI test
|
2024-01-15 09:53:57 -08:00 |
|
ishaan-jaff
|
9716108c80
|
(feat) proxy - introduce OpenAIException class
|
2024-01-15 09:52:23 -08:00 |
|
Ishaan Jaff
|
ad06b08a5e
|
Merge pull request #1442 from BerriAI/litellm_bedrock_provisioned_throughput
[Feat] Support Bedrock provisioned throughput LLMs
|
2024-01-14 10:51:28 +05:30 |
|
ishaan-jaff
|
069d060ec9
|
(feat) provisioned throughput - bedrock embedding models
|
2024-01-13 21:07:38 -08:00 |
|
ishaan-jaff
|
719b051b3d
|
(test) provisioned throughput model
|
2024-01-13 15:56:24 -08:00 |
|
ishaan-jaff
|
0307ba7def
|
(test) bedrock provisioned througput
|
2024-01-13 15:40:30 -08:00 |
|
ishaan-jaff
|
5e03c9c637
|
(feat) bedrock support provisioned throughput
|
2024-01-13 15:39:54 -08:00 |
|
ishaan-jaff
|
fffb077cf6
|
(test) get optional_params Azure
|
2024-01-13 14:32:41 -08:00 |
|
ishaan-jaff
|
79ad63009e
|
(feat) support extra body for Azure, OpenAI
|
2024-01-13 14:32:11 -08:00 |
|
ishaan-jaff
|
6bae534968
|
(fix) check if custom_llm_provider is not None
|
2024-01-13 12:54:03 -08:00 |
|
ishaan-jaff
|
f62dbd0e08
|
(test) litellm.completion_cost mistral, anyscale
|
2024-01-13 12:35:09 -08:00 |
|
ishaan-jaff
|
53fd62b0cd
|
(feat) use custom_llm_provider in completion_cost
|
2024-01-13 12:29:51 -08:00 |
|
ishaan-jaff
|
70426cad76
|
(fix) run prisma_setup on startup event
|
2024-01-13 12:06:23 -08:00 |
|
ishaan-jaff
|
4b3e9c6b38
|
(ci/cd) run testing again
|
2024-01-13 11:50:43 -08:00 |
|
ishaan-jaff
|
8d3ca785ae
|
(fix) proxy only import dynamo_db when it's being used
|
2024-01-13 11:43:50 -08:00 |
|
ishaan-jaff
|
b931841e60
|
(fix) dynamoDB import issues
|
2024-01-13 11:38:42 -08:00 |
|
Ishaan Jaff
|
7fc8ccf854
|
Merge pull request #1432 from BerriAI/litellm_set_hiden_params_custom_llm_provider
Set custom_llm_provider in ModelResponse hidden params
|
2024-01-14 01:00:49 +05:30 |
|
ishaan-jaff
|
61dff3decb
|
(fix) gunicorn - show request logs like uvicorn
|
2024-01-13 11:22:16 -08:00 |
|