Commit graph

4653 commits

Author SHA1 Message Date
Krrish Dholakia
4d7ff1b33b fix(proxy_server.py): don't override exceptions if they're of type httpexception 2023-12-05 14:33:28 -08:00
ishaan-jaff
4e3040b357 (chore) linting fix 2023-12-05 13:23:35 -08:00
Krrish Dholakia
397eefabe1 test: remove local test 2023-12-05 12:45:52 -08:00
ishaan-jaff
d5f67a0a25 (docs) proxy + langchain 2023-12-05 12:20:42 -08:00
Krrish Dholakia
88c95ca259 fix(_redis.py): support additional params for redis 2023-12-05 12:16:51 -08:00
ishaan-jaff
a0f8bf23ab (test) proxy: langchain compatible 2023-12-05 11:45:35 -08:00
Krrish Dholakia
ddea62fdb1 refactor(proxy_server.py): clean up print statements in proxy server 2023-12-05 11:14:16 -08:00
Krrish Dholakia
b46c73a46e fix: fix proxy testing 2023-12-05 11:13:09 -08:00
Krrish Dholakia
31f3187670 test: fix linting errors 2023-12-04 18:43:01 -08:00
Krrish Dholakia
030bd22078 feat(proxy_server.py): allow user to override api key auth 2023-12-04 18:32:58 -08:00
ishaan-jaff
ac486a3c4a (docs) add example config.yaml 2023-12-04 18:08:57 -08:00
Krrish Dholakia
e0ccb281d8 feat(utils.py): add async success callbacks for custom functions 2023-12-04 16:42:40 -08:00
ishaan-jaff
07a2035651 (chore) rm old config examples 2023-12-04 13:26:55 -08:00
ishaan-jaff
50284771b7 (test) test_reading proxy 2023-12-04 13:24:41 -08:00
ishaan-jaff
de4a7b719d (test) proxy: reading config.yaml 2023-12-04 13:16:19 -08:00
Krrish Dholakia
f20bdc9b79 test: fix linting errors 2023-12-04 12:45:15 -08:00
ishaan-jaff
15f54c3072 (docs) default config proxy 2023-12-04 11:30:53 -08:00
ishaan-jaff
4ef0378e6e (fix) proxy: custom callbacks 2023-12-04 11:29:26 -08:00
ishaan-jaff
c5b92837c2 (docs) custom callbacks proxy 2023-12-04 11:20:27 -08:00
ishaan-jaff
e96a608938 (feat) proxy: set custom headers in metadata 2023-12-04 10:49:01 -08:00
ishaan-jaff
ec579d4821 (chore) rename proxy: custom_callbacks 2023-12-04 10:49:01 -08:00
ishaan-jaff
9b1e02cdf1 (chore) rename: proxy-custom logger 2023-12-04 10:49:01 -08:00
Krrish Dholakia
63e55f1865 fix(proxy_server.py): fix /key/generate post endpoint 2023-12-04 10:44:13 -08:00
ishaan-jaff
d7d8c5f6e6 (fix) proxy 2023-12-04 10:23:55 -08:00
ishaan-jaff
88cec3b9ab (fix) proxy: don't overwrite user 2023-12-04 10:17:56 -08:00
ishaan-jaff
f3b939e603 (fix) access user in custom logger 2023-12-04 09:50:36 -08:00
ishaan-jaff
0d44f5e441 (feat) proxy:custom_logger 2023-12-04 09:23:55 -08:00
ishaan-jaff
6599263a85 (feat) proxy: custom callbacks 2023-12-04 09:10:12 -08:00
ishaan-jaff
65e00b438e (feat) proxy-read litellm custom callback class 2023-12-04 09:09:54 -08:00
ishaan-jaff
ed8c666922 (feat) proxy: custom_logger for I/O logging 2023-12-04 08:44:20 -08:00
ishaan-jaff
b1bd799be8 (feat) proxy: use custom_logger 2023-12-04 08:26:06 -08:00
Krrish Dholakia
add4dfc528 fix(proxy_server.py): support model info augmenting for azure models 2023-12-02 21:33:54 -08:00
ishaan-jaff
ecddb852a2 (fix) proxy: pydantic error / warning message 2023-12-02 21:30:35 -08:00
Krrish Dholakia
47c1aa27c7 fix(proxy_server.py): add litellm model cost map info to /model/info 2023-12-02 21:24:28 -08:00
Krrish Dholakia
f0d8a87c48 fix(proxy_server.py): fix user param name sent to litellm.completion 2023-12-02 19:56:22 -08:00
Krrish Dholakia
5200818af1 fix(proxy_server.py): Passing user IDs to OpenAI to identify abusive virtual keys 2023-12-02 19:55:11 -08:00
Krrish Dholakia
492c9043f6 fix: fix linting issues 2023-12-02 19:30:03 -08:00
Krrish Dholakia
6b1b1b82cf fix(proxy_server.py): hash keys 2023-12-02 19:30:03 -08:00
Krrish Dholakia
722c325503 fix(proxy_server.py): update db with master key if set, and fix tracking cost for azure models 2023-12-02 15:58:08 -08:00
Krrish Dholakia
5a4c054eef fix(proxy_server.py): add testing for model info being added to /model/new 2023-12-02 14:15:45 -08:00
ishaan-jaff
da78fd617c (docs) proxy: OTEL 2023-12-02 11:56:02 -08:00
ishaan-jaff
b9e1c66ebe (fix) general proxy config yaml 2023-12-02 11:32:29 -08:00
ishaan-jaff
89cd54094c (docs) proxy: add example OTEL config yaml 2023-12-02 11:22:40 -08:00
ishaan-jaff
067e4e7057 (docs) proxy: add example config.yaml 2023-12-02 11:11:39 -08:00
ishaan-jaff
6866895a27 (fix) proxy: config reading error 2023-12-02 11:09:38 -08:00
ishaan-jaff
54c5736f81 (fix) otel - make it optional 2023-12-02 11:02:03 -08:00
ishaan-jaff
5edb529891 (feat) proxy: embedding add OTEL collector 2023-12-02 09:41:29 -08:00
ishaan-jaff
4830aa08ee (fix) linting error 2023-12-02 09:39:26 -08:00
ishaan-jaff
dd8c1b0458 (feat) allow users to set OTEL_ENDPOINT as env 2023-12-01 21:29:26 -08:00
ishaan-jaff
2a25d9c15d (feat) proxy: name OTEL logger 2023-12-01 21:08:25 -08:00