Commit graph

24 commits

Author SHA1 Message Date
ishaan-jaff
d59ac23e82 (fix) proxy, dynamo - allow users to set ssl_verify False 2024-01-16 16:13:55 -08:00
ishaan-jaff
6c6c62f032 (temp) ssl_verify=False for dynamo 2024-01-16 12:24:40 -08:00
ishaan-jaff
2873f587fd (docs) add example post call rules to proxy 2024-01-15 20:58:50 -08:00
ishaan-jaff
5136d5980f (fix) use gunicorn to start proxt 2024-01-10 17:09:03 +05:30
ishaan-jaff
119ff2fe05 (docs) show fallbacks on proxy_config 2024-01-08 08:54:10 +05:30
ishaan-jaff
8e10a1eb81 (docs) config with cloudflare exampel 2024-01-04 10:25:35 +05:30
Krrish Dholakia
071283c102 fix(router.py): init deployment_latency_map even if model_list is empty 2023-12-18 17:50:26 -08:00
ishaan-jaff
43b0da3ebc (docs) - proxy_config.yaml 2023-12-11 09:06:27 -08:00
ishaan-jaff
900b8d66f3 (feat) proxy use model_group_alias_map 2023-12-06 20:23:24 -08:00
ishaan-jaff
44bf51601a (feat) proxy - custom on failure callback 2023-12-06 14:43:47 -08:00
ishaan-jaff
368934d160 (feat) proxy: use async_callback function 2023-12-06 13:51:24 -08:00
ishaan-jaff
f3c3a9860a (feat) /v1/model/info 2023-12-06 13:03:29 -08:00
ishaan-jaff
29fb97f88a (feat) proxy - define model info 2023-12-06 12:06:30 -08:00
ishaan-jaff
de58dcc016 (feat) proxy - allow setting cost, context window 2023-12-06 11:42:56 -08:00
ishaan-jaff
aefa4f36f9 (docs) update yaml with chat/embedding/completion mode 2023-12-06 11:36:16 -08:00
ishaan-jaff
fd86876164 (feat) proxy: add mode in model info 2023-12-06 11:29:59 -08:00
ishaan-jaff
7c77cc3cfa (feat) add mode for config.yaml health checks 2023-12-06 11:16:29 -08:00
ishaan-jaff
1e2a8869a9 (docs) proxy config with azure, openai embedding models 2023-12-06 10:45:07 -08:00
ishaan-jaff
15f54c3072 (docs) default config proxy 2023-12-04 11:30:53 -08:00
ishaan-jaff
ec579d4821 (chore) rename proxy: custom_callbacks 2023-12-04 10:49:01 -08:00
ishaan-jaff
6599263a85 (feat) proxy: custom callbacks 2023-12-04 09:10:12 -08:00
ishaan-jaff
b1bd799be8 (feat) proxy: use custom_logger 2023-12-04 08:26:06 -08:00
ishaan-jaff
b9e1c66ebe (fix) general proxy config yaml 2023-12-02 11:32:29 -08:00
ishaan-jaff
067e4e7057 (docs) proxy: add example config.yaml 2023-12-02 11:11:39 -08:00