Commit graph

1128 commits

Author SHA1 Message Date
Krrish Dholakia
a5bac8ae15 fix(caching.py): support s-maxage param for cache controls 2024-01-04 11:41:23 +05:30
Krrish Dholakia
586d2f8e58 docs(docs/index.md): add proxy details to docs 2024-01-04 11:20:43 +05:30
Krrish Dholakia
62ea95c25b fix(proxy/rules.md): add docs on setting post-call rules on the proxy 2024-01-04 11:16:50 +05:30
ishaan-jaff
343f6a2806 (docs) proxy - caching 2024-01-03 18:02:14 +05:30
ishaan-jaff
7a11f5dbba (docs) use s3 Cache on litellm proxy 2024-01-03 17:56:44 +05:30
ishaan-jaff
0f07999ffe (docs) proxy - cachig 2024-01-03 17:56:44 +05:30
ishaan-jaff
3d2f7834b2 (docs) simplify caching docs 2024-01-03 16:21:23 +05:30
ishaan-jaff
1022a7785e (docs) simplify caching docs 2024-01-03 16:20:19 +05:30
ishaan-jaff
5eabb70ad6 (docs) s3 cache 2024-01-03 16:16:18 +05:30
ishaan-jaff
d439d0e858 (docs) s3 Cache 2024-01-03 15:42:23 +05:30
Krrish Dholakia
6a0f31e260 docs(caching.md): fix typo 2024-01-03 12:47:16 +05:30
Krrish Dholakia
176af67aac fix(caching.py): support ttl, s-max-age, and no-cache cache controls
https://github.com/BerriAI/litellm/issues/1306
2024-01-03 12:42:43 +05:30
Krrish Dholakia
a34254223e docs(alerting.md): add alerting thresholds to docs 2024-01-03 11:21:56 +05:30
Krrish Dholakia
7ef15787a7 docs(alerting.md): add slack alerting to docs 2024-01-02 22:47:01 +05:30
Krrish Dholakia
3c93bb37b2 docs(ui.md): update ui docs to for smtp server hosting 2024-01-02 22:30:17 +05:30
ishaan-jaff
c33a625b48 (docs) xinference on proxy 2024-01-02 16:57:25 +05:30
ishaan-jaff
3a555657d4 (docs) proxy - using xinference 2024-01-02 16:55:10 +05:30
ishaan-jaff
c395c82cef (docs) xinference embedding 2024-01-02 15:39:25 +05:30
ishaan-jaff
122cfdb177 (docs) passing user config 2024-01-02 14:43:02 +05:30
ishaan-jaff
942bff6fd2 (docs) passing user_config to completion 2024-01-02 14:19:44 +05:30
ishaan-jaff
81b30fa394 (docs) pass user config to proxy / router 2024-01-02 14:14:14 +05:30
ishaan-jaff
4ef7c028ab (docs) router- init params 2024-01-02 12:14:32 +05:30
Krrish Dholakia
940e04f552 docs(ui.md): add docs on self serve ui flow 2024-01-01 18:25:52 +05:30
Krrish Dholakia
4a9477d4bc fix(ui/admin.py): handles trailing '/' case 2024-01-01 17:49:54 +05:30
ishaan-jaff
a4169ad536 (docs) proxy 2024-01-01 12:40:12 +05:30
ishaan-jaff
b486aeb587 (docs) use embeddings with proxy 2024-01-01 12:31:24 +05:30
ishaan-jaff
8198ac3b2b (docs) using /embeddings with Proxy 2024-01-01 12:31:13 +05:30
ishaan-jaff
080b61a91d (docs) langfuse + langchain log metadata 2024-01-01 11:53:38 +05:30
ishaan-jaff
1836ac2534 (docs) request/response format 2024-01-01 11:52:47 +05:30
ishaan-jaff
90d5b59748 (docs) request/response format proxy 2024-01-01 11:52:30 +05:30
ishaan-jaff
369660fcf8 (docs) pass metatadata to proxy + openai client 2024-01-01 11:12:31 +05:30
ishaan-jaff
31f3e3b919 (docs) langfuse + proxy - log metadata 2024-01-01 11:03:00 +05:30
Krrish Dholakia
6aff92a16b docs(routing.md): adding latency-based routing to docs 2024-01-01 08:36:40 +05:30
ishaan-jaff
b9908d6dbb (docs) langfuse log trace id, trace user id 2023-12-30 20:25:23 +05:30
ishaan-jaff
9583feb1f3 (docs) cache context manager 2023-12-30 19:50:22 +05:30
ishaan-jaff
2eecf9efe3 (docs) caching use context manager 2023-12-30 19:43:26 +05:30
ishaan-jaff
fedf976f58 (docs) caching 2023-12-30 19:04:36 +05:30
ishaan-jaff
1fefd5c5cc (docs) proxy - timeout per request 2023-12-30 11:18:03 +05:30
ishaan-jaff
342641eb58 (docs) proxy - set timeout per request 2023-12-30 11:17:31 +05:30
Krrish Dholakia
bf1cd099ca docs(routing.md): add retry_after to docs 2023-12-29 15:22:12 +05:30
Krrish Dholakia
3c50177314 fix(caching.py): hash the cache key to prevent key too long errors 2023-12-29 15:03:33 +05:30
Krrish Dholakia
f0aec09c8a docs(load_test.md): add litellm load test script to docs 2023-12-29 13:41:44 +05:30
ishaan-jaff
dc5ac9c096 (docs) cloudflare 2023-12-29 12:10:32 +05:30
Krrish Dholakia
93971c77c2 docs(users.md): add user rate limits to docs 2023-12-28 19:28:32 +05:30
ishaan-jaff
10688abf13 (docs) voyage ai embeddings 2023-12-28 17:15:16 +05:30
ishaan-jaff
2cdea502fc (docs) add voyage ai 2023-12-28 17:12:58 +05:30
ishaan-jaff
9d82458524 (docs) add mistral embeddings 2023-12-28 16:54:26 +05:30
ishaan-jaff
ddafa7590f (docs) add mistral-embed 2023-12-28 16:50:52 +05:30
ishaan-jaff
d964a0fe6b (docs) deploy on railway 2023-12-28 16:35:18 +05:30
Krrish Dholakia
9af02a8c93 docs(streaming_logging.md): custom streaming logging tutorial 2023-12-28 13:49:41 +05:30