phoenix/litellm
1
0
Fork 0
forked from phoenix/litellm-mirror
Code Pull requests Activity
litellm/docs/my-website/docs
History
Ishaan Jaff c73ce95c01
(feat) - provider budget improvements - ensure provider budgets work with multiple proxy instances + improve latency to ~90ms (#6886) 
* use 1 file for duration_in_seconds

* add to readme.md

* re use duration_in_seconds

* fix importing _extract_from_regex, get_last_day_of_month

* fix import

* update provider budget routing

* fix - remove dup test

* add support for using in multi instance environments

* test_in_memory_redis_sync_e2e

* test_in_memory_redis_sync_e2e

* fix test_in_memory_redis_sync_e2e

* fix code quality check

* fix test provider budgets

* working provider budget tests

* add fixture for provider budget routing

* fix router testing for provider budgets

* add comments on provider budget routing

* use RedisPipelineIncrementOperation

* add redis async_increment_pipeline

* use redis async_increment_pipeline

* use lower value for testing

* use redis async_increment_pipeline

* use consistent key name for increment op

* add handling for budget windows

* fix typing async_increment_pipeline

* fix set attr

* add clear doc strings

* unit testing for provider budgets

* test_redis_increment_pipeline
2024-11-24 16:36:19 -08:00
..
caching (refactor) caching use LLMCachingHandler for async_get_cache and set_cache (#6208) 2024-10-14 16:34:01 +05:30
completion LiteLLM Minor Fixes & Improvements (11/23/2024) (#6870) 2024-11-23 15:17:40 +05:30
debugging docs - fix doc build time errors 2024-06-15 14:58:02 -07:00
embedding Litellm dev 11 21 2024 (#6837) 2024-11-22 01:53:52 +05:30
extras docs(code_quality.md): add doc on litellm code qa 2024-10-02 11:20:15 -04:00
guides LiteLLM Minor Fixes & Improvements (11/23/2024) (#6870) 2024-11-23 15:17:40 +05:30
langchain update langchain documentation to reflect refactor 2024-05-07 17:01:55 +05:30
observability Litellm dev 11 20 2024 (#6838) 2024-11-21 05:20:37 +05:30
pass_through (feat) use @google-cloud/vertexai js sdk with litellm (#6873) 2024-11-22 16:50:10 -08:00
projects add dbally project 2024-08-22 23:21:40 +02:00
providers Litellm dev 11 21 2024 (#6837) 2024-11-22 01:53:52 +05:30
proxy (feat) - provider budget improvements - ensure provider budgets work with multiple proxy instances + improve latency to ~90ms (#6886) 2024-11-24 16:36:19 -08:00
tutorials docs: fix dead links 2024-08-26 13:28:25 -07:00
assistants.md [Feat-Proxy] Add Azure Assistants API - Create Assistant, Delete Assistant Support (#5777) 2024-09-18 16:27:33 -07:00
audio_transcription.md docs(image_generation.md): add proxy image gen example to docs 2024-07-09 11:56:21 -07:00
batches.md [Feat-Proxy] Add Azure Assistants API - Create Assistant, Delete Assistant Support (#5777) 2024-09-18 16:27:33 -07:00
benchmarks.md (docs) add benchmarks on 1K RPS (#6704) 2024-11-11 19:25:53 -08:00
budget_manager.md docs - use consistent name for LiteLLM proxy server 2024-08-03 12:54:07 -07:00
contact.md updating docs 2023-08-12 11:30:32 -07:00
contributing.md docs(contributing.md): add docs for contributing to litellm ui 2024-02-23 13:01:34 -08:00
data_security.md docs(data_security.md): cleanup docs 2024-10-01 15:33:10 -04:00
default_code_snippet.md update docs 2023-08-25 17:02:43 -07:00
enterprise.md Merge branch 'main' into litellm_allow_setting_route_controls 2024-09-03 17:00:22 -07:00
exception_mapping.md Litellm dev 10 26 2024 (#6472) 2024-10-28 15:05:43 -07:00
fine_tuning.md docs native vertex ft endpoint 2024-08-03 11:56:43 -07:00
getting_started.md Add Helicone 2024-07-08 15:41:35 -07:00
hosted.md docs gdpr regions cloud 2024-07-10 18:00:16 -07:00
image_generation.md Litellm dev 11 21 2024 (#6837) 2024-11-22 01:53:52 +05:30
index.md docs docker quick start 2024-09-19 15:10:59 -07:00
load_test.md (docs) add 1k rps load test doc (#6059) 2024-10-04 16:56:34 +05:30
load_test_advanced.md update load test doc 2024-10-04 18:47:26 +05:30
load_test_rpm.md (docs) add 1k rps load test doc (#6059) 2024-10-04 16:56:34 +05:30
load_test_sdk.md (docs) add 1k rps load test doc (#6059) 2024-10-04 16:56:34 +05:30
migration.md (docs) update migration 2023-11-21 11:22:54 -08:00
migration_policy.md docs migration policy 2024-08-09 18:06:37 -07:00
oidc.md (oidc): Improve docs for unofficial provider. 2024-08-16 20:30:41 +00:00
old_guardrails.md docs move lakera to free 2024-08-20 16:38:37 -07:00
projects.md docs 2023-09-08 20:55:04 -07:00
prompt_injection.md docs(sidebars.js): refactor docs 2024-08-22 18:22:50 -07:00
proxy_api.md updates 2023-09-29 11:33:58 -07:00
proxy_server.md docs - use consistent name for LiteLLM proxy server 2024-08-03 12:54:07 -07:00
realtime.md Litellm dev 10 22 2024 (#6384) 2024-10-22 21:18:54 -07:00
rerank.md docs: add docs on jina ai rerank support 2024-11-15 01:45:57 +05:30
routing.md Update routing references (#6758) 2024-11-16 08:28:44 -08:00
rules.md docs(rules.md): adding rules to docs 2023-11-20 19:14:07 -08:00
scheduler.md docs(scheduler.md): cleanup docs to use /chat/completion endpoint 2024-08-07 21:49:06 -07:00
sdk_custom_pricing.md organize docs 2024-08-03 12:54:07 -07:00
secret.md (feat) Use litellm/ prefix when storing virtual keys in AWS secret manager (#6765) 2024-11-15 18:07:43 -08:00
set_keys.md feat(utils.py): unify common auth params across azure/vertex_ai/bedrock/watsonx 2024-04-27 11:06:18 -07:00
simple_proxy_old_doc.md (docs + testing) Correctly document the timeout value used by litellm proxy is 6000 seconds + add to best practices for prod (#6339) 2024-10-23 14:09:35 +05:30
text_to_speech.md docs tts 2024-08-23 18:29:36 -07:00
troubleshoot.md docs(troubleshoot.md): cleanup docs 2024-05-27 09:51:35 -07:00