4345 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Krish Dholakia	7ed68da149	Updated config.yml	2023-12-09 11:09:18 -08:00
Krrish Dholakia	9433c3c11b	test: trigger ci/cd build	2023-12-09 11:03:19 -08:00
Krish Dholakia	4d0615391b	Updated config.yml	2023-12-09 11:00:40 -08:00
ishaan-jaff	875b7d1c7f	(test) custom logger	2023-12-09 10:42:50 -08:00
Krrish Dholakia	c482c399ff	fix(proxy_server.py): add logging around /key/generate	2023-12-09 10:26:12 -08:00
Krish Dholakia	c8eca35015	Updated config.yml	2023-12-09 10:23:36 -08:00
ishaan-jaff	4643a9ac18	(test) custom logger + stream + sync compl()	2023-12-09 10:22:45 -08:00
Krish Dholakia	341382cb97	Updated config.yml	2023-12-09 10:20:46 -08:00
ishaan-jaff	c8b699c0aa	(feat) custom logger: async stream,assemble chunks	2023-12-09 10:10:48 -08:00
ishaan-jaff	5d65550732	(test) custom logger print success handler	2023-12-09 10:04:10 -08:00
ishaan-jaff	8b144451e6	(test) model_info calback	2023-12-08 22:00:36 -08:00
Krrish Dholakia	4bf875d3ed	fix(router.py): fix least-busy routing	2023-12-08 20:29:49 -08:00
ishaan-jaff	d9b115b8fb	(ci/cd) run again	2023-12-08 19:26:55 -08:00
ishaan-jaff	9e9781d193	(Docs) Proxy,remove traceloop api key req	2023-12-08 19:26:05 -08:00
ishaan-jaff	db51a95a42	(test) init success_callback = [] for ci/cd	2023-12-08 19:16:12 -08:00
ishaan-jaff	04ec363788	(test) redis cache	2023-12-08 19:14:46 -08:00
ishaan-jaff	d7265a84c9	(test) caching reset success_callback	2023-12-08 19:10:35 -08:00
ishaan-jaff	4cdada62c5	(ci/cd) run another test	2023-12-08 19:04:45 -08:00
ishaan-jaff	fcc9f3c504	(ci/cd) q up another test	2023-12-08 18:55:18 -08:00
ishaan-jaff	dface6a36f	(docs) traceloop	2023-12-08 18:47:18 -08:00
ishaan-jaff	c7eebf75a8	(ci/cd) test proxy custom logger	2023-12-08 18:46:19 -08:00
ishaan-jaff	0dc7d538b5	(docs) proxy - OTEL + traceloop	2023-12-08 18:39:52 -08:00
ishaan-jaff	13731f4bd8	(test) fix	2023-12-08 18:25:11 -08:00
ishaan-jaff	1ca50c5fa2	(ci/cd) run again	2023-12-08 18:11:01 -08:00
ishaan-jaff	b84f6670ea	(docs) custom callbacks proxy	2023-12-08 18:00:58 -08:00
ishaan-jaff	ccee0cefe4	(ci/cd) run tests	2023-12-08 17:50:14 -08:00
ishaan-jaff	39ea2e0909	(ci/cd) add langfuse	2023-12-08 17:49:43 -08:00
Krish Dholakia	f2bba58a24	Updated config.yml	2023-12-08 17:49:42 -08:00
ishaan-jaff	5efe336968	(fix) linting	2023-12-08 17:26:14 -08:00
ishaan-jaff	8c628b64e0	(test) proxy - custom logger	2023-12-08 17:25:05 -08:00
ishaan-jaff	88c1d6649f	(fix) asyc callback + stream-stop dbl cnt chunk	2023-12-08 17:25:05 -08:00
ishaan-jaff	e237361891	(test) async logger + streaming	2023-12-08 17:25:05 -08:00
ishaan-jaff	b50faed5ab	(test) callback - strict test - async callback resp	2023-12-08 17:25:05 -08:00
ishaan-jaff	34428a8e67	(docs) fix	2023-12-08 17:25:05 -08:00
ishaan-jaff	4e8e3ff33a	(fix) async custom logger - trigger when stream completed	2023-12-08 17:25:05 -08:00
Krrish Dholakia	5fa2b6e5ad	fix(proxy_server.py): enable pre+post-call hooks and max parallel request limits	2023-12-08 17:11:30 -08:00
ishaan-jaff	977bfaaab9	(docs) proxy - get model_info,server_request	2023-12-08 14:57:29 -08:00
ishaan-jaff	76d0c50523	(ci/cd) comment beta test	2023-12-08 14:27:53 -08:00
ishaan-jaff	73984504e9	(test) proxy: access model_info and request_obj	2023-12-08 14:26:18 -08:00
ishaan-jaff	14d57ec7de	(feat) proxy: log model_info + proxy_server request	2023-12-08 14:26:18 -08:00
ishaan-jaff	93b1df1c79	(feat) embedding - pass model_info, proxy_server request	2023-12-08 14:26:18 -08:00
ishaan-jaff	9805269bd7	(feat) proxy: pass model_info as kwargs	2023-12-08 14:26:18 -08:00
ishaan-jaff	be94a8c478	(feat) pass model_info, proxy_server_request to callback	2023-12-08 14:26:18 -08:00
ishaan-jaff	72cca2e5a7	(feat) pass model_info, proxy_server_request callback	2023-12-08 14:26:18 -08:00
Krrish Dholakia	bab958561e	fix(proxy/utils.py): correctly raise exceptions on db call fail	2023-12-08 13:35:42 -08:00
Krrish Dholakia	9f0b83248a	fix(proxy/utils.py): add backoff/retry logic to db read/writes	2023-12-08 13:34:31 -08:00
ishaan-jaff	b8e9e1edc9	(fix) test caching	2023-12-08 13:15:00 -08:00
Krrish Dholakia	f06c3e0f08	fix(proxy_server.py): initializing sentry in proxy logging before db init	2023-12-08 11:58:16 -08:00
ishaan-jaff	fa8ba9dd4e	(test) cache + streaming	2023-12-08 11:50:37 -08:00
ishaan-jaff	6e8ad10991	(feat) caching - streaming caching support	2023-12-08 11:50:37 -08:00