11 commits

Author	SHA1	Message	Date
Krrish Dholakia	7f5bcf38b7	feat(prometheus_services.py): emit proxy latency for successful llm api requests ... uses prometheus histogram for this	2024-04-18 16:04:35 -07:00
Krrish Dholakia	c6ad02b167	fix(proxy_server.py): ensure id used in delete deployment matches id used in litellm Router	2024-04-16 15:17:18 -07:00
Krrish Dholakia	866259f95f	feat(prometheus_services.py): monitor health of proxy adjacent services (redis / postgres / etc.)	2024-04-13 18:15:02 -07:00
Krrish Dholakia	c177407f7b	test(test_openai_endpoints.py): add concurrency testing for user defined rate limits on proxy	2024-04-12 18:56:13 -07:00
Krrish Dholakia	f5206d592a	fix(router.py): generate consistent model id's ... having the same id for a deployment, lets redis usage caching work across multiple instances	2024-04-10 15:23:57 -07:00
unclecode	3a75c144dc	Continue fixing the issue #2832: Add protected_namespaces to another to Config class within the router.py	2024-04-08 12:49:40 +08:00
unclecode	311e801ab4	Fix issue #2832: Add protected_namespaces to Config class within utils.py, router.py and completion.py to avoid the warning message.	2024-04-08 12:43:17 +08:00
Krrish Dholakia	fd67dc7556	fix(utils.py): fix import	2024-04-06 18:37:38 -07:00
ishaan-jaff	2adcf8c762	(types) routerConfig	2024-01-02 14:14:29 +05:30
ishaan-jaff	2cbbfa72f1	(feat) add Router init Pydantic Type	2024-01-02 13:30:24 +05:30
ishaan-jaff	f7fc4da850	(feat) litellm add types for completion, embedding request	2024-01-02 12:27:08 +05:30