litellm/docs/my-website/docs
Krish Dholakia 7e9d8b58f6
LiteLLM Minor Fixes & Improvements (11/23/2024) (#6870)
* feat(pass_through_endpoints/): support logging anthropic/gemini pass through calls to langfuse/s3/etc.

* fix(utils.py): allow disabling end user cost tracking with new param

Allows proxy admin to disable cost tracking for end user - keeps prometheus metrics small

* docs(configs.md): add disable_end_user_cost_tracking reference to docs

* feat(key_management_endpoints.py): add support for restricting access to `/key/generate` by team/proxy level role

Enables admin to restrict key creation, and assign team admins to handle distributing keys

* test(test_key_management.py): add unit testing for personal / team key restriction checks

* docs: add docs on restricting key creation

* docs(finetuned_models.md): add new guide on calling finetuned models

* docs(input.md): cleanup anthropic supported params

Closes https://github.com/BerriAI/litellm/issues/6856

* test(test_embedding.py): add test for passing extra headers via embedding

* feat(cohere/embed): pass client to async embedding

* feat(rerank.py): add `/v1/rerank` if missing for cohere base url

Closes https://github.com/BerriAI/litellm/issues/6844

* fix(main.py): pass extra_headers param to openai

Fixes https://github.com/BerriAI/litellm/issues/6836

* fix(litellm_logging.py): don't disable global callbacks when dynamic callbacks are set

Fixes issue where global callbacks - e.g. prometheus were overriden when langfuse was set dynamically

* fix(handler.py): fix linting error

* fix: fix typing

* build: add conftest to proxy_admin_ui_tests/

* test: fix test

* fix: fix linting errors

* test: fix test

* fix: fix pass through testing
2024-11-23 15:17:40 +05:30
..
caching (refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208) 2024-10-14 16:34:01 +05:30
completion LiteLLM Minor Fixes & Improvements (11/23/2024) (#6870) 2024-11-23 15:17:40 +05:30
debugging docs - fix doc build time errors 2024-06-15 14:58:02 -07:00
embedding Litellm dev 11 21 2024 (#6837) 2024-11-22 01:53:52 +05:30
extras docs(code_quality.md): add doc on litellm code qa 2024-10-02 11:20:15 -04:00
guides LiteLLM Minor Fixes & Improvements (11/23/2024) (#6870) 2024-11-23 15:17:40 +05:30
langchain update langchain documentation to reflect refactor 2024-05-07 17:01:55 +05:30
observability Litellm dev 11 20 2024 (#6838) 2024-11-21 05:20:37 +05:30
pass_through (feat) use @google-cloud/vertexai js sdk with litellm (#6873) 2024-11-22 16:50:10 -08:00
projects add dbally project 2024-08-22 23:21:40 +02:00
providers Litellm dev 11 21 2024 (#6837) 2024-11-22 01:53:52 +05:30
proxy LiteLLM Minor Fixes & Improvements (11/23/2024) (#6870) 2024-11-23 15:17:40 +05:30
tutorials docs: fix dead links 2024-08-26 13:28:25 -07:00
assistants.md [Feat-Proxy] Add Azure Assistants API - Create Assistant, Delete Assistant Support (#5777) 2024-09-18 16:27:33 -07:00
audio_transcription.md docs(image_generation.md): add proxy image gen example to docs 2024-07-09 11:56:21 -07:00
batches.md [Feat-Proxy] Add Azure Assistants API - Create Assistant, Delete Assistant Support (#5777) 2024-09-18 16:27:33 -07:00
benchmarks.md (docs) add benchmarks on 1K RPS (#6704) 2024-11-11 19:25:53 -08:00
budget_manager.md docs - use consistent name for LiteLLM proxy server 2024-08-03 12:54:07 -07:00
contact.md updating docs 2023-08-12 11:30:32 -07:00
contributing.md docs(contributing.md): add docs for contributing to litellm ui 2024-02-23 13:01:34 -08:00
data_security.md docs(data_security.md): cleanup docs 2024-10-01 15:33:10 -04:00
default_code_snippet.md update docs 2023-08-25 17:02:43 -07:00
enterprise.md Merge branch 'main' into litellm_allow_setting_route_controls 2024-09-03 17:00:22 -07:00
exception_mapping.md Litellm dev 10 26 2024 (#6472) 2024-10-28 15:05:43 -07:00
fine_tuning.md docs native vertex ft endpoint 2024-08-03 11:56:43 -07:00
getting_started.md Add Helicone 2024-07-08 15:41:35 -07:00
hosted.md docs gdpr regions cloud 2024-07-10 18:00:16 -07:00
image_generation.md Litellm dev 11 21 2024 (#6837) 2024-11-22 01:53:52 +05:30
index.md docs docker quick start 2024-09-19 15:10:59 -07:00
load_test.md (docs) add 1k rps load test doc (#6059) 2024-10-04 16:56:34 +05:30
load_test_advanced.md update load test doc 2024-10-04 18:47:26 +05:30
load_test_rpm.md (docs) add 1k rps load test doc (#6059) 2024-10-04 16:56:34 +05:30
load_test_sdk.md (docs) add 1k rps load test doc (#6059) 2024-10-04 16:56:34 +05:30
migration.md (docs) update migration 2023-11-21 11:22:54 -08:00
migration_policy.md docs migration policy 2024-08-09 18:06:37 -07:00
oidc.md (oidc): Improve docs for unofficial provider. 2024-08-16 20:30:41 +00:00
old_guardrails.md docs move lakera to free 2024-08-20 16:38:37 -07:00
projects.md docs 2023-09-08 20:55:04 -07:00
prompt_injection.md docs(sidebars.js): refactor docs 2024-08-22 18:22:50 -07:00
proxy_api.md updates 2023-09-29 11:33:58 -07:00
proxy_server.md docs - use consistent name for LiteLLM proxy server 2024-08-03 12:54:07 -07:00
realtime.md Litellm dev 10 22 2024 (#6384) 2024-10-22 21:18:54 -07:00
rerank.md docs: add docs on jina ai rerank support 2024-11-15 01:45:57 +05:30
routing.md Update routing references (#6758) 2024-11-16 08:28:44 -08:00
rules.md docs(rules.md): adding rules to docs 2023-11-20 19:14:07 -08:00
scheduler.md docs(scheduler.md): cleanup docs to use /chat/completion endpoint 2024-08-07 21:49:06 -07:00
sdk_custom_pricing.md organize docs 2024-08-03 12:54:07 -07:00
secret.md (feat) Use litellm/ prefix when storing virtual keys in AWS secret manager (#6765) 2024-11-15 18:07:43 -08:00
set_keys.md feat(utils.py): unify common auth params across azure/vertex_ai/bedrock/watsonx 2024-04-27 11:06:18 -07:00
simple_proxy_old_doc.md (docs + testing) Correctly document the timeout value used by litellm proxy is 6000 seconds + add to best practices for prod (#6339) 2024-10-23 14:09:35 +05:30
text_to_speech.md docs tts 2024-08-23 18:29:36 -07:00
troubleshoot.md docs(troubleshoot.md): cleanup docs 2024-05-27 09:51:35 -07:00