7 commits

Author	SHA1	Message	Date
Krrish Dholakia	3ffccf8804	test(test_token_counter.py): include testing for function calls	2023-11-30 18:24:21 -08:00
ishaan-jaff	f8918e3836	(chore) fix testing	2023-11-29 20:05:13 -08:00
Krrish Dholakia	a05722571b	fix(replicate.py): fix custom prompt formatting	2023-11-29 19:44:09 -08:00
ishaan-jaff	77284cb80d	(test) add rpm to load test profiling	2023-11-29 17:14:34 -08:00
Krrish Dholakia	60d6b6bc37	fix(router.py): fix exponential backoff to use retry-after if present in headers	2023-11-28 17:25:03 -08:00
Krrish Dholakia	624ef83455	build: adding debug logs to gitignore	2023-11-27 22:05:07 -08:00
Krrish Dholakia	e564f643f5	fix(router.py): speed improvements to the router	2023-11-27 17:35:26 -08:00