517 commits

Author	SHA1	Message	Date
ishaan-jaff	4a2dee83a3	(docs) proxy config with azure, openai embedding models	2023-12-06 10:45:07 -08:00
ishaan-jaff	edb3f82629	(fix) proxy - move new health check import	2023-12-06 10:13:06 -08:00
Ishaan Jaff	f3d8825290	Merge pull request #1023 from PSU3D0/speedup_health_endpoint ... (feat) Speedup health endpoint	2023-12-06 09:52:13 -08:00
Krrish Dholakia	1546b85bc7	feat(proxy_server.py): adding /model/delete endpoint	2023-12-05 22:38:38 -08:00
ishaan-jaff	905f366f43	(fix) router - allow users to call a specific_model explicit	2023-12-05 21:57:00 -08:00
Frank Colson	497602606f	Speedup health endpoint	2023-12-05 22:09:01 -07:00
ishaan-jaff	1365a536f3	(fix) proxy: better debugging when -debug is on	2023-12-05 18:19:15 -08:00
ishaan-jaff	70a4fbcfeb	(fix) proxy - clean up print statement	2023-12-05 18:14:01 -08:00
ishaan-jaff	aded35d3c8	(feat) proxy cli, better description of config yaml param	2023-12-05 18:11:29 -08:00
ishaan-jaff	9693e5ede6	(fix) prox cli: remove deprecated param	2023-12-05 18:04:08 -08:00
ishaan-jaff	457c47b0c9	(fix) proxy: make yaml load print_verbose	2023-12-05 18:00:00 -08:00
ishaan-jaff	bc6a97495e	(feat) proxy /embedding check 1 deploy call	2023-12-05 17:22:07 -08:00
ishaan-jaff	0c4190bec7	(fix) proxy: /chat/cmp - check 1 deployment	2023-12-05 17:19:48 -08:00
ishaan-jaff	862d4bdef1	(fix) proxy debugging display Init API key	2023-12-05 16:08:17 -08:00
Krrish Dholakia	4328a66a3a	fix(proxy_server.py): don't override exceptions if they're of type httpexception	2023-12-05 14:33:28 -08:00
ishaan-jaff	ca2cce2c56	(chore) linting fix	2023-12-05 13:23:35 -08:00
Krrish Dholakia	c2acdfce09	test: remove local test	2023-12-05 12:45:52 -08:00
ishaan-jaff	7ba22141ed	(docs) proxy + langchain	2023-12-05 12:20:42 -08:00
Krrish Dholakia	94abb14b99	fix(_redis.py): support additional params for redis	2023-12-05 12:16:51 -08:00
ishaan-jaff	67272e1d8e	(test) proxy: langchain compatible	2023-12-05 11:45:35 -08:00
Krrish Dholakia	a858a2752d	refactor(proxy_server.py): clean up print statements in proxy server	2023-12-05 11:14:16 -08:00
Krrish Dholakia	9318a29fb1	fix: fix proxy testing	2023-12-05 11:13:09 -08:00
Krrish Dholakia	545ee2e16f	test: fix linting errors	2023-12-04 18:43:01 -08:00
Krrish Dholakia	4848b41abe	feat(proxy_server.py): allow user to override api key auth	2023-12-04 18:32:58 -08:00
ishaan-jaff	fc68e98198	(docs) add example config.yaml	2023-12-04 18:08:57 -08:00
Krrish Dholakia	d1a525b6c9	feat(utils.py): add async success callbacks for custom functions	2023-12-04 16:42:40 -08:00
ishaan-jaff	b3be960885	(chore) rm old config examples	2023-12-04 13:26:55 -08:00
ishaan-jaff	2790d12b53	(test) test_reading proxy	2023-12-04 13:24:41 -08:00
ishaan-jaff	6f73a3e682	(test) proxy: reading config.yaml	2023-12-04 13:16:19 -08:00
Krrish Dholakia	f337b6569e	test: fix linting errors	2023-12-04 12:45:15 -08:00
ishaan-jaff	add6de25c6	(docs) default config proxy	2023-12-04 11:30:53 -08:00
ishaan-jaff	080dfe2bd5	(fix) proxy: custom callbacks	2023-12-04 11:29:26 -08:00
ishaan-jaff	831e586282	(docs) custom callbacks proxy	2023-12-04 11:20:27 -08:00
ishaan-jaff	7a83691e46	(feat) proxy: set custom headers in metadata	2023-12-04 10:49:01 -08:00
ishaan-jaff	73135bbab1	(chore) rename proxy: custom_callbacks	2023-12-04 10:49:01 -08:00
ishaan-jaff	62139978b2	(chore) rename: proxy-custom logger	2023-12-04 10:49:01 -08:00
Krrish Dholakia	813bb15a00	fix(proxy_server.py): fix /key/generate post endpoint	2023-12-04 10:44:13 -08:00
ishaan-jaff	89972239a6	(fix) proxy	2023-12-04 10:23:55 -08:00
ishaan-jaff	d06864cc59	(fix) proxy: don't overwrite user	2023-12-04 10:17:56 -08:00
ishaan-jaff	f0b292375b	(fix) access user in custom logger	2023-12-04 09:50:36 -08:00
ishaan-jaff	92df0418e7	(feat) proxy:custom_logger	2023-12-04 09:23:55 -08:00
ishaan-jaff	5cddee3382	(feat) proxy: custom callbacks	2023-12-04 09:10:12 -08:00
ishaan-jaff	e525f4367f	(feat) proxy-read litellm custom callback class	2023-12-04 09:09:54 -08:00
ishaan-jaff	e9eeaca2b5	(feat) proxy: custom_logger for I/O logging	2023-12-04 08:44:20 -08:00
ishaan-jaff	20b59c2b19	(feat) proxy: use custom_logger	2023-12-04 08:26:06 -08:00
Krrish Dholakia	5839b2dbec	fix(proxy_server.py): support model info augmenting for azure models	2023-12-02 21:33:54 -08:00
ishaan-jaff	362c3a7d9a	(fix) proxy: pydantic error / warning message	2023-12-02 21:30:35 -08:00
Krrish Dholakia	d14d1ccc4c	fix(proxy_server.py): add litellm model cost map info to /model/info	2023-12-02 21:24:28 -08:00
Krrish Dholakia	2346ce0bfd	fix(proxy_server.py): fix user param name sent to litellm.completion	2023-12-02 19:56:22 -08:00
Krrish Dholakia	bfb2c8815b	fix(proxy_server.py): Passing user IDs to OpenAI to identify abusive virtual keys	2023-12-02 19:55:11 -08:00