litellm-mirror/litellm/integrations
Krish Dholakia 2acb0c0675
Litellm Minor Fixes & Improvements (10/12/2024) (#6179)
* build(model_prices_and_context_window.json): add bedrock llama3.2 pricing

* build(model_prices_and_context_window.json): add bedrock cross region inference pricing

* Revert "(perf) move s3 logging to Batch logging + async [94% faster perf under 100 RPS on 1 litellm instance] (#6165)"

This reverts commit 2a5624af47.

* add azure/gpt-4o-2024-05-13 (#6174)

* LiteLLM Minor Fixes & Improvements (10/10/2024)  (#6158)

* refactor(vertex_ai_partner_models/anthropic): refactor anthropic to use partner model logic

* fix(vertex_ai/): support passing custom api base to partner models

Fixes https://github.com/BerriAI/litellm/issues/4317

* fix(proxy_server.py): Fix prometheus premium user check logic

* docs(prometheus.md): update quick start docs

* fix(custom_llm.py): support passing dynamic api key + api base

* fix(realtime_api/main.py): Add request/response logging for realtime api endpoints

Closes https://github.com/BerriAI/litellm/issues/6081

* feat(openai/realtime): add openai realtime api logging

Closes https://github.com/BerriAI/litellm/issues/6081

* fix(realtime_streaming.py): fix linting errors

* fix(realtime_streaming.py): fix linting errors

* fix: fix linting errors

* fix pattern match router

* Add literalai in the sidebar observability category (#6163)

* fix: add literalai in the sidebar

* fix: typo

* update (#6160)

* Feat: Add Langtrace integration (#5341)

* Feat: Add Langtrace integration

* add langtrace service name

* fix timestamps for traces

* add tests

* Discard Callback + use existing otel logger

* cleanup

* remove print statments

* remove callback

* add docs

* docs

* add logging docs

* format logging

* remove emoji and add litellm proxy example

* format logging

* format `logging.md`

* add langtrace docs to logging.md

* sync conflict

* docs fix

* (perf) move s3 logging to Batch logging + async [94% faster perf under 100 RPS on 1 litellm instance] (#6165)

* fix move s3 to use customLogger

* add basic s3 logging test

* add s3 to custom logger compatible

* use batch logger for s3

* s3 set flush interval and batch size

* fix s3 logging

* add notes on s3 logging

* fix s3 logging

* add basic s3 logging test

* fix s3 type errors

* add test for sync logging on s3

* fix: fix to debug log

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Willy Douhard <willy.douhard@gmail.com>
Co-authored-by: yujonglee <yujonglee.dev@gmail.com>
Co-authored-by: Ali Waleed <ali@scale3labs.com>

* docs(custom_llm_server.md): update doc on passing custom params

* fix(pass_through_endpoints.py): don't require headers

Fixes https://github.com/BerriAI/litellm/issues/6128

* feat(utils.py): add support for caching rerank endpoints

Closes https://github.com/BerriAI/litellm/issues/6144

* feat(litellm_logging.py'): add response headers for failed requests

Closes https://github.com/BerriAI/litellm/issues/6159

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Willy Douhard <willy.douhard@gmail.com>
Co-authored-by: yujonglee <yujonglee.dev@gmail.com>
Co-authored-by: Ali Waleed <ali@scale3labs.com>
2024-10-12 11:48:34 -07:00
..
_types feat - arize ai open inference types 2024-07-22 11:07:48 -07:00
datadog Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
email_templates fix - move email templates 2024-05-31 10:37:56 -07:00
gcs_bucket (code clean up) use a folder for gcs bucket logging + add readme in folder (#6080) 2024-10-05 16:58:10 +05:30
opik fix typing on opik.py 2024-10-10 18:46:07 +05:30
prometheus_helpers feat(prometheus_api.py): support querying prometheus metrics for all-up + key-level spend on UI (#5782) 2024-09-18 22:39:15 -07:00
SlackAlerting Add pyright to ci/cd + Fix remaining type-checking errors (#6082) 2024-10-05 17:04:00 -04:00
__init__.py add linting 2023-08-18 11:05:05 -07:00
aispend.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
arize_ai.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
athina.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
berrispend.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
braintrust_logging.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
clickhouse.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
custom_batch_logger.py LiteLLM Minor Fixes & Improvements (10/10/2024) (#6158) 2024-10-11 23:04:36 -07:00
custom_guardrail.py LiteLLM Minor Fixes & Improvements (09/17/2024) (#5742) 2024-09-17 23:00:04 -07:00
custom_logger.py Add pyright to ci/cd + Fix remaining type-checking errors (#6082) 2024-10-05 17:04:00 -04:00
dynamodb.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
email_alerting.py Add pyright to ci/cd + Fix remaining type-checking errors (#6082) 2024-10-05 17:04:00 -04:00
galileo.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
greenscale.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
helicone.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
lago.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
langfuse.py Litellm Minor Fixes & Improvements (10/12/2024) (#6179) 2024-10-12 11:48:34 -07:00
langsmith.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
langtrace.py Feat: Add Langtrace integration (#5341) 2024-10-11 19:19:53 +05:30
litedebugger.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
literal_ai.py fix literal ai typing errors 2024-10-09 15:23:39 +05:30
logfire_logger.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
lunary.py Add pyright to ci/cd + Fix remaining type-checking errors (#6082) 2024-10-05 17:04:00 -04:00
openmeter.py Add pyright to ci/cd + Fix remaining type-checking errors (#6082) 2024-10-05 17:04:00 -04:00
opentelemetry.py Feat: Add Langtrace integration (#5341) 2024-10-11 19:19:53 +05:30
prometheus.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
prometheus_services.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
prompt_layer.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
s3.py LiteLLM Minor Fixes & Improvements (10/10/2024) (#6158) 2024-10-11 23:04:36 -07:00
supabase.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00
test_httpx.py fix(utils.py): improved predibase exception mapping 2024-06-08 14:32:43 -07:00
traceloop.py Add pyright to ci/cd + Fix remaining type-checking errors (#6082) 2024-10-05 17:04:00 -04:00
weights_biases.py Litellm ruff linting enforcement (#5992) 2024-10-01 19:44:20 -04:00