405 commits

Author	SHA1	Message	Date
Krrish Dholakia	d6844f43c8	test(test_keys.py): use correct model name for token counting	2024-01-23 17:46:14 -08:00
Krrish Dholakia	f47db44b4f	test(test_keys.py): fix streaming test	2024-01-23 16:27:45 -08:00
Krrish Dholakia	f8870fb48e	fix(utils.py): fix proxy streaming spend tracking	2024-01-23 15:59:03 -08:00
Krrish Dholakia	f5ced089d6	test(tests/): add unit testing for proxy server endpoints	2024-01-19 14:54:29 -08:00
Krrish Dholakia	1a29272b47	fix(parallel_request_limiter.py): handle tpm/rpm limits being null	2024-01-19 10:22:27 -08:00