9 commits

Author	SHA1	Message	Date
Krrish Dholakia	f0aec09c8a	docs(load_test.md): add litellm load test script to docs	2023-12-29 13:41:44 +05:30
Krrish Dholakia	79978c44ba	refactor: add black formatting	2023-12-25 14:11:20 +05:30
Krrish Dholakia	81764ca4f6	test: load test router	2023-11-17 08:23:44 -08:00
Krrish Dholakia	a6e9f147d3	fix(openai.py): handling extra headers	2023-11-16 12:48:21 -08:00
Krrish Dholakia	95642df0a4	test(loadtest_router.py): commenting out of ci/cd	2023-11-16 12:17:25 -08:00
Krrish Dholakia	e54056f0ed	fix(azure.py): use openai client sdk for handling sync+async calling	2023-11-16 12:08:12 -08:00
Krrish Dholakia	0f6713993d	fix(router.py): enabling retrying with expo backoff (without tenacity) for router	2023-11-14 20:57:51 -08:00
Krrish Dholakia	5d58bb9cd0	fix(main.py): misrouting ollama models to nlp cloud	2023-11-14 18:55:08 -08:00
Krrish Dholakia	9b582b2c85	fix(main.py): keep client consistent across calls + exponential backoff retry on ratelimit errors	2023-11-14 16:26:05 -08:00