litellm-mirror/docs/my-website/docs/proxy
Krish Dholakia 71f13c8c12 feat(proxy_cli.py): add new 'log_config' cli param (#6352)
* feat(proxy_cli.py): add new 'log_config' cli param

Allows passing logging.conf to uvicorn on startup

* docs(cli.md): add logging conf to uvicorn cli docs

* fix(get_llm_provider_logic.py): fix default api base for litellm_proxy

Fixes https://github.com/BerriAI/litellm/issues/6332

* feat(openai_like/embedding): Add support for jina ai embeddings

Closes https://github.com/BerriAI/litellm/issues/6337

* docs(deploy.md): update entrypoint.sh filepath post-refactor

Fixes outdated docs

* feat(prometheus.py): emit time_to_first_token metric on prometheus

Closes https://github.com/BerriAI/litellm/issues/6334

* fix(prometheus.py): only emit time to first token metric if stream is True

enables more accurate ttft usage

* test: handle vertex api instability

* fix(get_llm_provider_logic.py): fix import

* fix(openai.py): fix deepinfra default api base

* fix(anthropic/transformation.py): remove anthropic beta header (#6361)
2024-10-21 21:25:58 -07:00
..
guardrails LiteLLM Minor Fixes & Improvements (10/15/2024) (#6242) 2024-10-16 07:32:06 -07:00
access_control.md doc onboarding orgs 2024-10-09 19:11:36 +05:30
alerting.md (feat proxy slack alerting) - allow opting in to getting key / internal user alerts (#5990) 2024-10-01 10:49:22 -07:00
architecture.md docs clarify how virtual key is read from cache / db 2024-09-18 09:39:54 -07:00
billing.md Update lago.py to accomodate API change (#5495) (#5543) 2024-09-05 17:27:40 -07:00
bucket.md docs update what gets logged on gcs buckets 2024-09-18 10:18:57 -07:00
caching.md doc fix Turn on / off caching per Key. (#6297) 2024-10-18 15:43:04 +05:30
call_hooks.md [Feat] Add proxy level prometheus metrics (#5789) 2024-09-19 17:13:07 -07:00
cli.md feat(proxy_cli.py): add new 'log_config' cli param (#6352) 2024-10-21 21:25:58 -07:00
configs.md LiteLLM Minor Fixes & Improvements (10/17/2024) (#6293) 2024-10-17 22:09:11 -07:00
cost_tracking.md docs(virtual_keys.md): add enable/disable virtual keys to docs + refactor sidebar 2024-09-21 22:20:39 -07:00
custom_pricing.md ui cleanup 2024-09-07 11:20:07 -07:00
custom_sso.md [Feat-Proxy] Allow using custom sso handler (#5809) 2024-09-20 19:14:33 -07:00
customer_routing.md LiteLLM Minor Fixes & Improvements (10/15/2024) (#6242) 2024-10-16 07:32:06 -07:00
customers.md ui - fix typo on referencing base url 2024-07-18 13:36:05 -07:00
debugging.md docs(debugging.md): cleanup docs 2024-07-27 09:28:53 -07:00
demo.md docs(virtual_keys.md): add enable/disable virtual keys to docs + refactor sidebar 2024-09-21 22:20:39 -07:00
deploy.md feat(proxy_cli.py): add new 'log_config' cli param (#6352) 2024-10-21 21:25:58 -07:00
docker_quick_start.md docs(docker_quick_start.md): update quick start with azure connection error 2024-09-16 07:31:32 -07:00
email.md docs clean up emojis 2024-08-17 13:30:11 -07:00
embedding.md (docs) use port 4000 2024-03-08 21:59:00 -08:00
enterprise.md fix links due to broken list (#6103) 2024-10-07 15:47:29 -04:00
guardrails.md docs move lakera to free 2024-08-20 16:38:37 -07:00
health.md fix grammar on health check docs (#5984) 2024-09-30 09:21:42 -07:00
ip_address.md [Feat-Router] Allow setting which environment to use a model on (#5892) 2024-09-25 10:12:06 -07:00
load_balancing.md LiteLLM Minor Fixes and Improvements (09/13/2024) (#5689) 2024-09-14 10:02:55 -07:00
logging.md docs fix 2024-10-11 19:32:59 +05:30
metrics.md (docs) show /daily_metrics 2024-02-27 19:34:47 -08:00
model_management.md docs(model_management.md): add section on adding additional model information to proxy config 2024-08-14 14:39:48 -07:00
multiple_admins.md docs clean up emojis 2024-08-17 13:30:11 -07:00
oauth2.md docs oauh 2.0 enterprise feature 2024-08-16 14:00:24 -07:00
pass_through.md docs(pass_through.md): add doc on using langfuse client sdk w/ litellm proxy 2024-08-14 21:43:31 -07:00
perf.md docs - fix build time issues 2024-06-15 16:12:37 -07:00
pii_masking.md docs new presidio language controls 2024-09-04 13:04:19 -07:00
prod.md (docs) add 1k rps load test doc (#6059) 2024-10-04 16:56:34 +05:30
prometheus.md feat(proxy_cli.py): add new 'log_config' cli param (#6352) 2024-10-21 21:25:58 -07:00
quick_start.md Improving the proxy docs for configuring with vllm 2024-08-13 16:07:41 -07:00
reliability.md docs(response_headers.md): add response headers to docs 2024-09-28 23:33:50 -07:00
response_headers.md docs(response_headers.md): add response headers to docs 2024-09-28 23:33:50 -07:00
rules.md (docs) use port 4000 2024-03-08 21:59:00 -08:00
self_serve.md feat(custom_logger.py): expose new async_dataset_hook for modifying… (#6331) 2024-10-20 09:00:04 -07:00
service_accounts.md docs service accounts (#5900) 2024-09-25 15:46:13 -07:00
streaming_logging.md ui cleanup 2024-09-07 11:20:07 -07:00
tag_routing.md add "default" tag 2024-09-09 14:41:22 -07:00
team_based_routing.md docs(team_logging.md): cleanup docs 2024-08-12 19:53:05 -07:00
team_budgets.md docs(users.md): add doc on setting max budget for internal users 2024-08-21 16:21:40 -07:00
team_logging.md (docs) key based callbacks (#6107) 2024-10-08 07:12:01 +05:30
token_auth.md [Feat-Router] Allow setting which environment to use a model on (#5892) 2024-09-25 10:12:06 -07:00
ui.md [Feat] SSO - add provider in the OpenID field for custom sso (#5849) 2024-09-23 16:34:30 -07:00
user_keys.md docs(user_keys.md): add regex doc for clientside auth params 2024-10-17 22:42:29 -07:00
users.md docs(users.md): add doc on setting max budget for internal users 2024-08-21 16:22:41 -07:00
virtual_keys.md docs(virtual_keys.md): add enable/disable virtual keys to docs + refactor sidebar 2024-09-21 22:20:39 -07:00