Commit graph

353 commits

Author SHA1 Message Date
Krrish Dholakia
4328a66a3a fix(proxy_server.py): don't override exceptions if they're of type httpexception 2023-12-05 14:33:28 -08:00
ishaan-jaff
ca2cce2c56 (chore) linting fix 2023-12-05 13:23:35 -08:00
Krrish Dholakia
c2acdfce09 test: remove local test 2023-12-05 12:45:52 -08:00
ishaan-jaff
7ba22141ed (docs) proxy + langchain 2023-12-05 12:20:42 -08:00
Krrish Dholakia
94abb14b99 fix(_redis.py): support additional params for redis 2023-12-05 12:16:51 -08:00
ishaan-jaff
67272e1d8e (test) proxy: langchain compatible 2023-12-05 11:45:35 -08:00
Krrish Dholakia
a858a2752d refactor(proxy_server.py): clean up print statements in proxy server 2023-12-05 11:14:16 -08:00
Krrish Dholakia
9318a29fb1 fix: fix proxy testing 2023-12-05 11:13:09 -08:00
Krrish Dholakia
545ee2e16f test: fix linting errors 2023-12-04 18:43:01 -08:00
Krrish Dholakia
4848b41abe feat(proxy_server.py): allow user to override api key auth 2023-12-04 18:32:58 -08:00
ishaan-jaff
fc68e98198 (docs) add example config.yaml 2023-12-04 18:08:57 -08:00
Krrish Dholakia
d1a525b6c9 feat(utils.py): add async success callbacks for custom functions 2023-12-04 16:42:40 -08:00
ishaan-jaff
b3be960885 (chore) rm old config examples 2023-12-04 13:26:55 -08:00
ishaan-jaff
2790d12b53 (test) test_reading proxy 2023-12-04 13:24:41 -08:00
ishaan-jaff
6f73a3e682 (test) proxy: reading config.yaml 2023-12-04 13:16:19 -08:00
Krrish Dholakia
f337b6569e test: fix linting errors 2023-12-04 12:45:15 -08:00
ishaan-jaff
add6de25c6 (docs) default config proxy 2023-12-04 11:30:53 -08:00
ishaan-jaff
080dfe2bd5 (fix) proxy: custom callbacks 2023-12-04 11:29:26 -08:00
ishaan-jaff
831e586282 (docs) custom callbacks proxy 2023-12-04 11:20:27 -08:00
ishaan-jaff
7a83691e46 (feat) proxy: set custom headers in metadata 2023-12-04 10:49:01 -08:00
ishaan-jaff
73135bbab1 (chore) rename proxy: custom_callbacks 2023-12-04 10:49:01 -08:00
ishaan-jaff
62139978b2 (chore) rename: proxy-custom logger 2023-12-04 10:49:01 -08:00
Krrish Dholakia
813bb15a00 fix(proxy_server.py): fix /key/generate post endpoint 2023-12-04 10:44:13 -08:00
ishaan-jaff
89972239a6 (fix) proxy 2023-12-04 10:23:55 -08:00
ishaan-jaff
d06864cc59 (fix) proxy: don't overwrite user 2023-12-04 10:17:56 -08:00
ishaan-jaff
f0b292375b (fix) access user in custom logger 2023-12-04 09:50:36 -08:00
ishaan-jaff
92df0418e7 (feat) proxy:custom_logger 2023-12-04 09:23:55 -08:00
ishaan-jaff
5cddee3382 (feat) proxy: custom callbacks 2023-12-04 09:10:12 -08:00
ishaan-jaff
e525f4367f (feat) proxy-read litellm custom callback class 2023-12-04 09:09:54 -08:00
ishaan-jaff
e9eeaca2b5 (feat) proxy: custom_logger for I/O logging 2023-12-04 08:44:20 -08:00
ishaan-jaff
20b59c2b19 (feat) proxy: use custom_logger 2023-12-04 08:26:06 -08:00
Krrish Dholakia
5839b2dbec fix(proxy_server.py): support model info augmenting for azure models 2023-12-02 21:33:54 -08:00
ishaan-jaff
362c3a7d9a (fix) proxy: pydantic error / warning message 2023-12-02 21:30:35 -08:00
Krrish Dholakia
d14d1ccc4c fix(proxy_server.py): add litellm model cost map info to /model/info 2023-12-02 21:24:28 -08:00
Krrish Dholakia
2346ce0bfd fix(proxy_server.py): fix user param name sent to litellm.completion 2023-12-02 19:56:22 -08:00
Krrish Dholakia
bfb2c8815b fix(proxy_server.py): Passing user IDs to OpenAI to identify abusive virtual keys 2023-12-02 19:55:11 -08:00
Krrish Dholakia
3560c9356e fix: fix linting issues 2023-12-02 19:30:03 -08:00
Krrish Dholakia
6015bff80b fix(proxy_server.py): hash keys 2023-12-02 19:30:03 -08:00
Krrish Dholakia
c85da2dfaa fix(proxy_server.py): update db with master key if set, and fix tracking cost for azure models 2023-12-02 15:58:08 -08:00
Krrish Dholakia
1af2435636 fix(proxy_server.py): add testing for model info being added to /model/new 2023-12-02 14:15:45 -08:00
ishaan-jaff
5c4fb9453d (docs) proxy: OTEL 2023-12-02 11:56:02 -08:00
ishaan-jaff
02a88d4945 (fix) general proxy config yaml 2023-12-02 11:32:29 -08:00
ishaan-jaff
0a2645d676 (docs) proxy: add example OTEL config yaml 2023-12-02 11:22:40 -08:00
ishaan-jaff
ef1ffad626 (docs) proxy: add example config.yaml 2023-12-02 11:11:39 -08:00
ishaan-jaff
9c0437cecf (fix) proxy: config reading error 2023-12-02 11:09:38 -08:00
ishaan-jaff
34971ddcce (fix) otel - make it optional 2023-12-02 11:02:03 -08:00
ishaan-jaff
2e6fff71cc (feat) proxy: embedding add OTEL collector 2023-12-02 09:41:29 -08:00
ishaan-jaff
879e62b929 (fix) linting error 2023-12-02 09:39:26 -08:00
ishaan-jaff
0c1e038ae2 (feat) allow users to set OTEL_ENDPOINT as env 2023-12-01 21:29:26 -08:00
ishaan-jaff
cd52117463 (feat) proxy: name OTEL logger 2023-12-01 21:08:25 -08:00