Krrish Dholakia
|
7a0bccf4d0
|
test(test_key_generate_dynamodb.py): fix test
|
2024-02-05 21:44:50 -08:00 |
|
Krrish Dholakia
|
a9a4f4cf0f
|
test(test_key_generate_dynamodb.py): fix test
|
2024-02-05 21:43:17 -08:00 |
|
ishaan-jaff
|
81f8ac00b2
|
(test) semantic caching
|
2024-02-05 18:22:50 -08:00 |
|
ishaan-jaff
|
cf4bd1cf4e
|
(test) semantic cache
|
2024-02-05 17:58:32 -08:00 |
|
ishaan-jaff
|
2b588a8786
|
(test) litellm-dashboard never allowed to /chat/completions
|
2024-02-05 16:11:33 -08:00 |
|
ishaan-jaff
|
d4a799a3ca
|
(feat )add semantic cache
|
2024-02-05 12:28:21 -08:00 |
|
Krish Dholakia
|
640572647a
|
Merge pull request #1805 from BerriAI/litellm_cost_tracking_image_gen
feat(utils.py): support cost tracking for openai/azure image gen models
|
2024-02-03 22:23:22 -08:00 |
|
Krrish Dholakia
|
49b2dc4180
|
test(test_completion_cost.py): fix test
|
2024-02-03 22:00:49 -08:00 |
|
Krrish Dholakia
|
66565f96b1
|
test(test_completion.py): fix test
|
2024-02-03 21:44:57 -08:00 |
|
Krrish Dholakia
|
d2d57ecf1c
|
test(test_parallel_request_limiter.py): fix test
|
2024-02-03 21:31:29 -08:00 |
|
Krrish Dholakia
|
3a19c8b600
|
test(test_completion.py): fix test
|
2024-02-03 21:30:45 -08:00 |
|
Krish Dholakia
|
28df60b609
|
Merge pull request #1809 from BerriAI/litellm_embedding_caching_updates
Support caching individual items in embedding list (Async embedding only)
|
2024-02-03 21:04:23 -08:00 |
|
ishaan-jaff
|
c353161456
|
(fix) test_parallel limiter fix
|
2024-02-03 21:03:15 -08:00 |
|
Krrish Dholakia
|
3e35041758
|
test(test_parallel_request_limiter.py): fix test to handle minute changes
|
2024-02-03 20:39:31 -08:00 |
|
ishaan-jaff
|
1155025e6a
|
(ci/cd) run again
|
2024-02-03 20:36:35 -08:00 |
|
Krrish Dholakia
|
b47b2837eb
|
test(test_parallel_request_limiter.py): fix test
|
2024-02-03 20:34:05 -08:00 |
|
ishaan-jaff
|
774cbbde52
|
(test) tgai is unstable
|
2024-02-03 20:00:40 -08:00 |
|
Krrish Dholakia
|
efb6123d28
|
fix(utils.py): support get_secret("TOGETHER_AI_TOKEN")
|
2024-02-03 19:35:09 -08:00 |
|
Krrish Dholakia
|
c49c88c8e5
|
fix(utils.py): route together ai calls to openai client
together ai is now openai-compatible
n
|
2024-02-03 19:22:48 -08:00 |
|
Krish Dholakia
|
9ab59045a3
|
Merge branch 'main' into litellm_embedding_caching_updates
|
2024-02-03 18:08:47 -08:00 |
|
Krish Dholakia
|
1d241b4001
|
Merge pull request #1802 from BerriAI/litellm_vertex_ai_high_traffic_fix
fix(vertex_ai.py): treat vertex ai high-traffic error as a rate limit error - allows user-controlled backoff logic to work here
|
2024-02-03 15:37:05 -08:00 |
|
Krish Dholakia
|
6408af11b6
|
Merge pull request #1799 from BerriAI/litellm_bedrock_stable_diffusion_support
feat(bedrock.py): add stable diffusion image generation support
|
2024-02-03 12:59:00 -08:00 |
|
Krrish Dholakia
|
e617ef981d
|
fix(vertex_ai.py): treat vertex ai high-traffic error as a rate limit error - allows backoff logic to work here
|
2024-02-03 12:58:16 -08:00 |
|
Krish Dholakia
|
1c05d479e2
|
Merge pull request #1797 from BerriAI/litellm_vertex_ai_async_embedding_support
fix(vertex_ai.py): add async embedding support for vertex ai
|
2024-02-03 12:11:21 -08:00 |
|
Krrish Dholakia
|
36416360c4
|
feat(bedrock.py): add stable diffusion image generation support
|
2024-02-03 12:08:38 -08:00 |
|
Ishaan Jaff
|
aadc352cf0
|
Merge pull request #1795 from BerriAI/litellm_allow_setting_user_roles
[Feat] Allow setting user roles for UserTable
|
2024-02-03 11:13:09 -08:00 |
|
ishaan-jaff
|
8455aa4bd4
|
(test) setting user_role
|
2024-02-03 11:06:51 -08:00 |
|
Krrish Dholakia
|
0ffdf57dec
|
fix(vertex_ai.py): add async embedding support for vertex ai
|
2024-02-03 10:35:17 -08:00 |
|
Krish Dholakia
|
5bf51a6058
|
Merge pull request #1794 from BerriAI/litellm_vertex_ai_gecko_support
Litellm vertex ai gecko support
|
2024-02-03 10:17:37 -08:00 |
|
Krrish Dholakia
|
1ba6882f76
|
fix(test_embedding.py): fix test
|
2024-02-03 09:49:23 -08:00 |
|
Krrish Dholakia
|
d9ba8668f4
|
feat(vertex_ai.py): vertex ai gecko text embedding support
|
2024-02-03 09:48:29 -08:00 |
|
Ishaan Jaff
|
6950f99804
|
Merge pull request #1788 from BerriAI/litellm_fix_delete_key
[Fix] /key/delete + add delete cache keys
|
2024-02-02 20:22:26 -08:00 |
|
ishaan-jaff
|
ae95e4c3f9
|
(test) user_api_key_auth_cache
|
2024-02-02 19:57:55 -08:00 |
|
Krish Dholakia
|
38a299a1bc
|
Merge pull request #1786 from BerriAI/litellm_cost_tracking_caching_fixes
Litellm cost tracking caching fixes (should be 0.0)
|
2024-02-02 19:23:07 -08:00 |
|
Krrish Dholakia
|
3aab719521
|
test(test_completion.py): skip flaky test
|
2024-02-02 19:03:47 -08:00 |
|
Krrish Dholakia
|
1f0598a277
|
fix(proxy_server.py): load default team config straight from config file
|
2024-02-02 19:03:47 -08:00 |
|
Krrish Dholakia
|
142e7cf1ce
|
test(test_image_generation.py): ignore content violation errors for image gen test
|
2024-02-02 19:03:47 -08:00 |
|
Krrish Dholakia
|
c0699b08e5
|
test(test_caching.py): fix test to check id
|
2024-02-02 19:03:47 -08:00 |
|
Krrish Dholakia
|
c997d4b0ce
|
fix(test_key_generate_prisma.py): add longer delay to allow logs to update
|
2024-02-02 19:03:47 -08:00 |
|
Krrish Dholakia
|
ddf3e51545
|
fix(main.py): for health checks, don't use cached responses
|
2024-02-02 19:03:47 -08:00 |
|
ishaan-jaff
|
3899361aa4
|
(test) state of litellm cache after create, delete
|
2024-02-02 18:49:20 -08:00 |
|
Krrish Dholakia
|
2d59331148
|
test(test_completion.py): skip flaky test
|
2024-02-02 18:44:17 -08:00 |
|
Krrish Dholakia
|
5631b3357b
|
fix(proxy_server.py): load default team config straight from config file
|
2024-02-02 18:35:30 -08:00 |
|
Krrish Dholakia
|
f3dd0c0563
|
test(test_image_generation.py): ignore content violation errors for image gen test
|
2024-02-02 18:05:39 -08:00 |
|
Krrish Dholakia
|
92b0a4cf50
|
test(test_key_generate_prisma.py): add longer sleep time
|
2024-02-02 18:03:07 -08:00 |
|
Krrish Dholakia
|
93e8a9ff91
|
test(test_caching.py): fix test to check id
|
2024-02-02 18:01:43 -08:00 |
|
Krrish Dholakia
|
a79f92533f
|
fix(test_key_generate_prisma.py): add longer delay to allow logs to update
|
2024-02-02 17:51:15 -08:00 |
|
Krrish Dholakia
|
1ed6842009
|
fix(utils.py): fix cost tracking for cache hits (should be 0)
|
2024-02-02 17:33:39 -08:00 |
|
Krrish Dholakia
|
62ad6f19b7
|
fix(main.py): for health checks, don't use cached responses
|
2024-02-02 16:51:42 -08:00 |
|
ishaan-jaff
|
46a76852c7
|
(fix) s3 logging test
|
2024-02-02 14:10:24 -08:00 |
|