1830 commits

Author	SHA1	Message	Date
Krrish Dholakia	1546b85bc7	feat(proxy_server.py): adding /model/delete endpoint	2023-12-05 22:38:38 -08:00
ishaan-jaff	905f366f43	(fix) router - allow users to call a specific_model explicit	2023-12-05 21:57:00 -08:00
Frank Colson	497602606f	Speedup health endpoint	2023-12-05 22:09:01 -07:00
ishaan-jaff	1365a536f3	(fix) proxy: better debugging when -debug is on	2023-12-05 18:19:15 -08:00
ishaan-jaff	70a4fbcfeb	(fix) proxy - clean up print statement	2023-12-05 18:14:01 -08:00
ishaan-jaff	457c47b0c9	(fix) proxy: make yaml load print_verbose	2023-12-05 18:00:00 -08:00
ishaan-jaff	bc6a97495e	(feat) proxy /embedding check 1 deploy call	2023-12-05 17:22:07 -08:00
ishaan-jaff	0c4190bec7	(fix) proxy: /chat/cmp - check 1 deployment	2023-12-05 17:19:48 -08:00
ishaan-jaff	862d4bdef1	(fix) proxy debugging display Init API key	2023-12-05 16:08:17 -08:00
Krrish Dholakia	4328a66a3a	fix(proxy_server.py): don't override exceptions if they're of type httpexception	2023-12-05 14:33:28 -08:00
Krrish Dholakia	94abb14b99	fix(_redis.py): support additional params for redis	2023-12-05 12:16:51 -08:00
Krrish Dholakia	a858a2752d	refactor(proxy_server.py): clean up print statements in proxy server	2023-12-05 11:14:16 -08:00
Krrish Dholakia	9318a29fb1	fix: fix proxy testing	2023-12-05 11:13:09 -08:00
Krrish Dholakia	4848b41abe	feat(proxy_server.py): allow user to override api key auth	2023-12-04 18:32:58 -08:00
Krrish Dholakia	d1a525b6c9	feat(utils.py): add async success callbacks for custom functions	2023-12-04 16:42:40 -08:00
ishaan-jaff	080dfe2bd5	(fix) proxy: custom callbacks	2023-12-04 11:29:26 -08:00
ishaan-jaff	7a83691e46	(feat) proxy: set custom headers in metadata	2023-12-04 10:49:01 -08:00
Krrish Dholakia	813bb15a00	fix(proxy_server.py): fix /key/generate post endpoint	2023-12-04 10:44:13 -08:00
ishaan-jaff	89972239a6	(fix) proxy	2023-12-04 10:23:55 -08:00
ishaan-jaff	d06864cc59	(fix) proxy: don't overwrite user	2023-12-04 10:17:56 -08:00
ishaan-jaff	e525f4367f	(feat) proxy-read litellm custom callback class	2023-12-04 09:09:54 -08:00
ishaan-jaff	e9eeaca2b5	(feat) proxy: custom_logger for I/O logging	2023-12-04 08:44:20 -08:00
Krrish Dholakia	5839b2dbec	fix(proxy_server.py): support model info augmenting for azure models	2023-12-02 21:33:54 -08:00
ishaan-jaff	362c3a7d9a	(fix) proxy: pydantic error / warning message	2023-12-02 21:30:35 -08:00
Krrish Dholakia	d14d1ccc4c	fix(proxy_server.py): add litellm model cost map info to /model/info	2023-12-02 21:24:28 -08:00
Krrish Dholakia	2346ce0bfd	fix(proxy_server.py): fix user param name sent to litellm.completion	2023-12-02 19:56:22 -08:00
Krrish Dholakia	bfb2c8815b	fix(proxy_server.py): Passing user IDs to OpenAI to identify abusive virtual keys	2023-12-02 19:55:11 -08:00
Krrish Dholakia	3560c9356e	fix: fix linting issues	2023-12-02 19:30:03 -08:00
Krrish Dholakia	6015bff80b	fix(proxy_server.py): hash keys	2023-12-02 19:30:03 -08:00
Krrish Dholakia	c85da2dfaa	fix(proxy_server.py): update db with master key if set, and fix tracking cost for azure models	2023-12-02 15:58:08 -08:00
Krrish Dholakia	1af2435636	fix(proxy_server.py): add testing for model info being added to /model/new	2023-12-02 14:15:45 -08:00
ishaan-jaff	5c4fb9453d	(docs) proxy: OTEL	2023-12-02 11:56:02 -08:00
ishaan-jaff	9c0437cecf	(fix) proxy: config reading error	2023-12-02 11:09:38 -08:00
ishaan-jaff	34971ddcce	(fix) otel - make it optional	2023-12-02 11:02:03 -08:00
ishaan-jaff	2e6fff71cc	(feat) proxy: embedding add OTEL collector	2023-12-02 09:41:29 -08:00
ishaan-jaff	879e62b929	(fix) linting error	2023-12-02 09:39:26 -08:00
ishaan-jaff	0c1e038ae2	(feat) allow users to set OTEL_ENDPOINT as env	2023-12-01 21:29:26 -08:00
ishaan-jaff	cd52117463	(feat) proxy: name OTEL logger	2023-12-01 21:08:25 -08:00
ishaan-jaff	ef33406671	(feat) proxy: add OTEL logging input/output	2023-12-01 21:04:07 -08:00
Krrish Dholakia	59dd7945f5	fix(proxy_server.py): expose model_info as part of pydantic model params object	2023-12-01 20:55:26 -08:00
Krrish Dholakia	c6518b8d0f	fix(proxy_server.py): redact api keys from proxy load	2023-12-01 20:47:13 -08:00
Krrish Dholakia	3db1c79651	fix(proxy_server.py): fix linting errors	2023-12-01 20:40:49 -08:00
Krrish Dholakia	ba76929303	feat(proxy_server.py): dynamic reloading config.yaml with new models	2023-12-01 20:32:24 -08:00
Krrish Dholakia	fbdcde1a54	fix(proxy_server.py): fix linting errors	2023-12-01 19:45:09 -08:00
Krrish Dholakia	284fb64f4d	feat: support for azure key vault	2023-12-01 19:36:06 -08:00
Krrish Dholakia	e8efde5a83	fix(proxy_server.py): check if bearer token passed in	2023-12-01 17:06:29 -08:00
ishaan-jaff	c42d7e104c	(proxy) fix types	2023-12-01 16:05:29 -08:00
ishaan-jaff	ff8adeb991	(feat) proxy: use dict	2023-12-01 16:00:00 -08:00
Krrish Dholakia	923f90aed2	fix(proxy_server.py): accept max tokens as int	2023-12-01 15:19:34 -08:00
Krrish Dholakia	3d7fab6c0c	fix: linting errors	2023-12-01 15:02:22 -08:00