Commit graph

1591 commits

Author SHA1 Message Date
ishaan-jaff
ccfcc39681 (test) custom key/generate 2024-01-20 10:13:32 -08:00
ishaan-jaff
480f237fb5 (test) add custom_key_generate test 2024-01-20 09:59:04 -08:00
Ishaan Jaff
435d4b9279
Merge pull request #1534 from BerriAI/litellm_custom_cooldown_times
[Feat] Litellm.Router set custom cooldown times
2024-01-19 20:49:17 -08:00
ishaan-jaff
ccbc47122c (fix) test caching 2024-01-19 20:45:10 -08:00
ishaan-jaff
84684c50fa (fix) router - timeout exception mapping 2024-01-19 20:30:41 -08:00
Krrish Dholakia
b07677c6be fix(gemini.py): support streaming 2024-01-19 20:21:34 -08:00
ishaan-jaff
0fa9d8af82 (test) custom cooldown times - router 2024-01-19 19:41:52 -08:00
Krrish Dholakia
1be4f7d2d1 fix(test_key_generate_prisma.py): fix testing
n
2024-01-19 16:53:46 -08:00
ishaan-jaff
6bc7cc46b4 (docs) router debugging 2024-01-19 15:18:00 -08:00
Ishaan Jaff
73684bc93f
Merge pull request #1525 from BerriAI/litellm_router_improvements
[Feat] Router improvements
2024-01-19 15:02:05 -08:00
ishaan-jaff
8a4f2c198b (test) test_usage_based_routing 2024-01-19 14:59:56 -08:00
Krrish Dholakia
f5ced089d6 test(tests/): add unit testing for proxy server endpoints 2024-01-19 14:54:29 -08:00
ishaan-jaff
f408162449 (test) debug logs test - router 2024-01-19 14:22:18 -08:00
ishaan-jaff
0196ac6376 (test) router-fallbacks 2024-01-19 14:12:09 -08:00
ishaan-jaff
57a20100e4 (test) usage based routing 2024-01-19 13:58:08 -08:00
ishaan-jaff
912e2de364 (test) usage based router + fallbacks 2024-01-19 12:34:08 -08:00
ishaan-jaff
8cf8da1378 (test) langfuse_latency_test_user 2024-01-19 11:38:44 -08:00
ishaan-jaff
2f429f37b7 (test) test latency added with langfuse call 2024-01-19 11:28:10 -08:00
ishaan-jaff
cd08a02764 (test) add blocking callback test 2024-01-19 08:51:52 -08:00
Krrish Dholakia
f7694bc193 Merge branch 'main' into litellm_tpm_rpm_rate_limits 2024-01-18 19:10:07 -08:00
Krrish Dholakia
94ce524c63 test(test_completion.py): handle together ai timeout 2024-01-18 17:54:16 -08:00
Krrish Dholakia
e0aaa94f28 fix(main.py): read azure ad token from optional params extra body 2024-01-18 17:14:03 -08:00
Ishaan Jaff
a8ba5df90e
Merge pull request #1500 from BerriAI/litellm_create_keys_with_team_id
[Feat] /key/generate - create keys with`team_id`
2024-01-18 16:35:14 -08:00
Krrish Dholakia
22c3321208 test(test_parallel_request_limiter.py): unit testing for tpm/rpm rate limits 2024-01-18 15:25:29 -08:00
ishaan-jaff
5beef6dbcd (test) setting team_id 2024-01-18 14:33:13 -08:00
Ishaan Jaff
a26267851f
Merge pull request #1498 from BerriAI/litellm_spend_tracking_logs
[Feat] Proxy - Add Spend tracking logs
2024-01-18 14:21:51 -08:00
Krrish Dholakia
aef59c554f feat(parallel_request_limiter.py): add support for tpm/rpm limits 2024-01-18 13:52:15 -08:00
ishaan-jaff
4294657b99 (fix) use get_logging_payload 2024-01-18 13:40:48 -08:00
Krrish Dholakia
1ea3833ef7 fix(parallel_request_limiter.py): decrement count for failed llm calls
https://github.com/BerriAI/litellm/issues/1477
2024-01-18 12:42:14 -08:00
ishaan-jaff
08ee65f894 (test) /key/update, /key/info 2024-01-18 09:35:02 -08:00
ishaan-jaff
85b5395692 (test) use os.environ/ for azure vision enhance 2024-01-17 21:26:47 -08:00
Ishaan Jaff
15ae9182db
Merge pull request #1484 from BerriAI/litellm_access_key_metadata_in_callbacks
[Feat] Proxy - Access Key metadata in callbacks
2024-01-17 18:08:08 -08:00
Krrish Dholakia
08b409bae8 fix(utils.py): fix if check 2024-01-17 17:17:58 -08:00
ishaan-jaff
46f84bec69 (test) api_key metadata available in callback 2024-01-17 16:48:02 -08:00
Krrish Dholakia
7ed4d9b4d1 fix(utils.py): allow dynamically setting boto3 init and switching between bedrock and openai 2024-01-17 15:56:30 -08:00
ishaan-jaff
9b3d24bbe0 (test) key/delete 2024-01-17 14:55:54 -08:00
Ishaan Jaff
cbb4484bce
Merge pull request #1478 from BerriAI/litellm_unit_test_proxy_key_gen
[Test] Proxy -  Unit Test proxy key gen
2024-01-17 13:38:38 -08:00
ishaan-jaff
a0eec51ee6 (test) expired key prisma 2024-01-17 13:24:15 -08:00
ishaan-jaff
5f7a89d2e7 (test) prisma - non expiring keys 2024-01-17 13:05:23 -08:00
ishaan-jaff
f1ae6957ca (test) use fixture for prisma 2024-01-17 12:44:06 -08:00
ishaan-jaff
62963146fe (test) prisma /key/gen 2024-01-17 12:23:45 -08:00
ishaan-jaff
2273f8055c (test) add test fixture for dynamodb testing 2024-01-17 12:23:04 -08:00
Krrish Dholakia
8e9dc09955 fix(bedrock.py): add support for sts based boto3 initialization
https://github.com/BerriAI/litellm/issues/1476
2024-01-17 12:08:59 -08:00
ishaan-jaff
4036c64bdf (test) prisma key gen 2024-01-17 11:58:14 -08:00
ishaan-jaff
acbbccdef7 v0 testing 2024-01-17 11:28:59 -08:00
ishaan-jaff
67db73ab1a (test) init proxy router with gpt-vision enhancements 2024-01-17 10:54:37 -08:00
ishaan-jaff
5a8a5fa0fd (fix) using base_url Azure 2024-01-17 10:12:55 -08:00
ishaan-jaff
b95d6ec207 (v0) fixes for Azure GPT Vision enhancements 2024-01-17 09:57:16 -08:00
ishaan-jaff
9c214d67b0 (test) /key/gen and budgets 2024-01-16 20:56:01 -08:00
ishaan-jaff
d1897ca156 (ci/cd) undo change from PR 1464 2024-01-16 20:44:00 -08:00