Commit graph

3972 commits

Author SHA1 Message Date
Krrish Dholakia
5a4c054eef fix(proxy_server.py): add testing for model info being added to /model/new 2023-12-02 14:15:45 -08:00
ishaan-jaff
278ef6bd83 (docs) refactor litellm proxy docs to use a hierarchy 2023-12-02 14:09:39 -08:00
Krish Dholakia
132218e0ed
Merge pull request #977 from Manouchehri/patch-2
Mention Neon as a database option in docs
2023-12-02 13:26:10 -08:00
David Manouchehri
7c974bdc57
(docs) Mention Neon as a database option. 2023-12-02 15:15:54 -05:00
ishaan-jaff
da78fd617c (docs) proxy: OTEL 2023-12-02 11:56:02 -08:00
ishaan-jaff
b9e1c66ebe (fix) general proxy config yaml 2023-12-02 11:32:29 -08:00
ishaan-jaff
59b36a6f9c (feat) proxy: add proxy_otel deps 2023-12-02 11:32:15 -08:00
ishaan-jaff
89cd54094c (docs) proxy: add example OTEL config yaml 2023-12-02 11:22:40 -08:00
ishaan-jaff
067e4e7057 (docs) proxy: add example config.yaml 2023-12-02 11:11:39 -08:00
ishaan-jaff
30e34e62d0 (docs) proxy otel 2023-12-02 11:11:16 -08:00
ishaan-jaff
6866895a27 (fix) proxy: config reading error 2023-12-02 11:09:38 -08:00
ishaan-jaff
54c5736f81 (fix) otel - make it optional 2023-12-02 11:02:03 -08:00
ishaan-jaff
f897d5e849 (ci/cd) HF embedding 2023-12-02 10:57:33 -08:00
ishaan-jaff
7f28333ad8 (docs) simple proxy 2023-12-02 10:42:12 -08:00
ishaan-jaff
5edb529891 (feat) proxy: embedding add OTEL collector 2023-12-02 09:41:29 -08:00
ishaan-jaff
4830aa08ee (fix) linting error 2023-12-02 09:39:26 -08:00
ishaan-jaff
6a0ebc1bb3 (chore) cleanup proxy 2023-12-02 09:37:14 -08:00
ishaan-jaff
278ab7dcab (docs) otel collector 2023-12-01 21:46:37 -08:00
ishaan-jaff
dd8c1b0458 (feat) allow users to set OTEL_ENDPOINT as env 2023-12-01 21:29:26 -08:00
ishaan-jaff
8b6c4918fd (docs) OTEL simple proxy 2023-12-01 21:28:46 -08:00
ishaan-jaff
2a25d9c15d (feat) proxy: name OTEL logger 2023-12-01 21:08:25 -08:00
ishaan-jaff
c431bf8daa (feat) proxy: otel logging 2023-12-01 21:04:08 -08:00
ishaan-jaff
3e62f90b43 (feat) proxy: add OTEL logging input/output 2023-12-01 21:04:07 -08:00
ishaan-jaff
848acdf28e (feat) proxy: add otel config 2023-12-01 21:04:07 -08:00
Krrish Dholakia
60af976aac fix(proxy_server.py): expose model_info as part of pydantic model params object 2023-12-01 20:55:26 -08:00
Krrish Dholakia
41afe48bf8 bump: version 1.9.5 → 1.10.0 2023-12-01 20:47:40 -08:00
Krrish Dholakia
bb687cb96f fix(proxy_server.py): redact api keys from proxy load 2023-12-01 20:47:13 -08:00
Krrish Dholakia
47730da262 fix(proxy_server.py): fix linting errors 2023-12-01 20:40:49 -08:00
Krrish Dholakia
72381c3cc2 feat(proxy_server.py): dynamic reloading config.yaml with new models 2023-12-01 20:32:24 -08:00
Krrish Dholakia
eae5b3ce50 fix(__init__.py): fix linting error 2023-12-01 20:08:08 -08:00
Krrish Dholakia
ccd10b07a8 docs(secret.md): add azure key vault support to docs 2023-12-01 20:07:20 -08:00
Krrish Dholakia
328113a28e fix(proxy_server.py): fix linting errors 2023-12-01 19:45:09 -08:00
Krrish Dholakia
368fee224e feat: support for azure key vault 2023-12-01 19:36:06 -08:00
Krrish Dholakia
cac7ecf840 fix(proxy_server.py): check if bearer token passed in 2023-12-01 17:06:29 -08:00
ishaan-jaff
a971d78d6c bump: version 1.9.4 → 1.9.5 2023-12-01 16:47:14 -08:00
ishaan-jaff
6c6add2a3c (fix) ci/cd 2023-12-01 16:06:22 -08:00
ishaan-jaff
61f902347f (proxy) fix types 2023-12-01 16:05:29 -08:00
ishaan-jaff
80e2ffbfa6 (feat) proxy: use dict 2023-12-01 16:00:00 -08:00
Krrish Dholakia
2c1103247d test: fix flaky test 2023-12-01 15:46:39 -08:00
Krrish Dholakia
4da20ac0b9 fix(proxy_server.py): accept max tokens as int 2023-12-01 15:19:34 -08:00
Krrish Dholakia
ac4429c35f test(test_completion.py): commenting out flaky test 2023-12-01 15:06:54 -08:00
Krrish Dholakia
8c1439e910 fix: linting errors 2023-12-01 15:02:22 -08:00
ishaan-jaff
fc40e83783 (fix) linting 2023-12-01 14:51:44 -08:00
ishaan-jaff
455c915b70 (linting) fix 2023-12-01 14:34:15 -08:00
ishaan-jaff
73eb5a7718 (fix) linting 2023-12-01 14:08:19 -08:00
ishaan-jaff
24386c05aa (fix) proxy: pydantic 2023-12-01 13:58:28 -08:00
ishaan-jaff
e8ae347681 (feat) proxy-pydantic,swagger for chat/completion 2023-12-01 13:50:51 -08:00
ishaan-jaff
e77b7e5a50 (docs) proxy: add tags=chat/completions + add response type 2023-12-01 10:00:48 -08:00
ishaan-jaff
2977d04f56 (fix) proxy: raise exceptions 2023-12-01 09:21:06 -08:00
ishaan-jaff
1e9aa69268 (fix) proxy: use orjson.loads() 2023-11-30 20:24:31 -08:00