Commit graph

11 commits

Author SHA1 Message Date
Krrish Dholakia
d8a8cd2961 feat(ui): add ability to enable traceloop + langsmith via ui 2024-07-31 21:40:29 -07:00
Krrish Dholakia
d914aa558d feat(ui): add braintrust logging to ui 2024-07-31 21:15:19 -07:00
Ishaan Jaff
154fa64d0a
Merge pull request #4781 from msabramo/liveness-alias-of-liveliness
Alias  `/health/liveliness` as `/health/liveness`
2024-07-18 22:20:09 -07:00
Marc Abramowitz
7b1c72e3f4 Alias /health/liveliness as /health/liveness
The latter is the more common term in Kubernetes, so it's nice to support that.
2024-07-18 14:29:32 -07:00
Florian Greinacher
f8bec3a86c
feat(proxy): support hiding health check details 2024-07-18 17:21:12 +02:00
Marc Abramowitz
3d86c4f515 Shorter success callbacks from /health/readiness
Before:

```shell
$ curl -sSL http://0.0.0.0:4000/health/readiness | jq '.success_callbacks'
[
  "langfuse",
  "<function _PROXY_track_cost_callback at 0x12fc14b80>",
  "<bound method SlackAlerting.response_taking_too_long_callback of <litellm.integrations.slack_alerting.SlackAlerting object at 0x12cedb740>>",
  "<litellm.proxy.hooks.parallel_request_limiter._PROXY_MaxParallelRequestsHandler object at 0x12cedb8f0>",
  "<litellm.proxy.hooks.max_budget_limiter._PROXY_MaxBudgetLimiter object at 0x12cedb830>",
  "<litellm.proxy.hooks.cache_control_check._PROXY_CacheControlCheck object at 0x12ca101d0>",
  "<litellm._service_logger.ServiceLogging object at 0x13a6d8c50>"
]
```

After:

```shell
$ curl -sSL http://0.0.0.0:4000/health/readiness | jq '.success_callbacks'
[
  "langfuse",
  "_PROXY_track_cost_callback",
  "response_taking_too_long_callback",
  "_PROXY_MaxParallelRequestsHandler",
  "_PROXY_MaxBudgetLimiter",
  "_PROXY_CacheControlCheck",
  "ServiceLogging"
]
```
2024-07-10 18:45:42 -07:00
Ishaan Jaff
5c0d4a4162 use ProxyErrorTypes, 2024-07-08 12:47:53 -07:00
Ishaan Jaff
19f0f66dbc add options for /health/readiness and liveliness 2024-06-19 12:13:35 -07:00
Ishaan Jaff
4007c6c6e8 add health/readiness OPTIONS 2024-06-19 12:00:48 -07:00
Ishaan Jaff
8aa1387170 feat - support OPTIONS for health endpoints 2024-06-19 09:55:38 -07:00
Ishaan Jaff
0f8237e263 fix - refactor key endpoints 2024-06-15 14:13:32 -07:00
Renamed from litellm/proxy/health_endpoints/health_endpoints.py (Browse further)