Krish Dholakia
|
11f9df923a
|
LiteLLM Minor Fixes & Improvements (10/10/2024) (#6158)
* refactor(vertex_ai_partner_models/anthropic): refactor anthropic to use partner model logic
* fix(vertex_ai/): support passing custom api base to partner models
Fixes https://github.com/BerriAI/litellm/issues/4317
* fix(proxy_server.py): Fix prometheus premium user check logic
* docs(prometheus.md): update quick start docs
* fix(custom_llm.py): support passing dynamic api key + api base
* fix(realtime_api/main.py): Add request/response logging for realtime api endpoints
Closes https://github.com/BerriAI/litellm/issues/6081
* feat(openai/realtime): add openai realtime api logging
Closes https://github.com/BerriAI/litellm/issues/6081
* fix(realtime_streaming.py): fix linting errors
* fix(realtime_streaming.py): fix linting errors
* fix: fix linting errors
* fix pattern match router
* Add literalai in the sidebar observability category (#6163)
* fix: add literalai in the sidebar
* fix: typo
* update (#6160)
* Feat: Add Langtrace integration (#5341)
* Feat: Add Langtrace integration
* add langtrace service name
* fix timestamps for traces
* add tests
* Discard Callback + use existing otel logger
* cleanup
* remove print statments
* remove callback
* add docs
* docs
* add logging docs
* format logging
* remove emoji and add litellm proxy example
* format logging
* format `logging.md`
* add langtrace docs to logging.md
* sync conflict
* docs fix
* (perf) move s3 logging to Batch logging + async [94% faster perf under 100 RPS on 1 litellm instance] (#6165)
* fix move s3 to use customLogger
* add basic s3 logging test
* add s3 to custom logger compatible
* use batch logger for s3
* s3 set flush interval and batch size
* fix s3 logging
* add notes on s3 logging
* fix s3 logging
* add basic s3 logging test
* fix s3 type errors
* add test for sync logging on s3
* fix: fix to debug log
---------
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
Co-authored-by: Willy Douhard <willy.douhard@gmail.com>
Co-authored-by: yujonglee <yujonglee.dev@gmail.com>
Co-authored-by: Ali Waleed <ali@scale3labs.com>
|
2024-10-11 23:04:36 -07:00 |
|
Krish Dholakia
|
d57be47b0f
|
Litellm ruff linting enforcement (#5992)
* ci(config.yml): add a 'check_code_quality' step
Addresses https://github.com/BerriAI/litellm/issues/5991
* ci(config.yml): check why circle ci doesn't pick up this test
* ci(config.yml): fix to run 'check_code_quality' tests
* fix(__init__.py): fix unprotected import
* fix(__init__.py): don't remove unused imports
* build(ruff.toml): update ruff.toml to ignore unused imports
* fix: fix: ruff + pyright - fix linting + type-checking errors
* fix: fix linting errors
* fix(lago.py): fix module init error
* fix: fix linting errors
* ci(config.yml): cd into correct dir for checks
* fix(proxy_server.py): fix linting error
* fix(utils.py): fix bare except
causes ruff linting errors
* fix: ruff - fix remaining linting errors
* fix(clickhouse.py): use standard logging object
* fix(__init__.py): fix unprotected import
* fix: ruff - fix linting errors
* fix: fix linting errors
* ci(config.yml): cleanup code qa step (formatting handled in local_testing)
* fix(_health_endpoints.py): fix ruff linting errors
* ci(config.yml): just use ruff in check_code_quality pipeline for now
* build(custom_guardrail.py): include missing file
* style(embedding_handler.py): fix ruff check
|
2024-10-01 19:44:20 -04:00 |
|
Ishaan Jaff
|
b60361fca1
|
fix otel test
|
2024-09-09 16:20:47 -07:00 |
|
Ishaan Jaff
|
7c9591881c
|
use callback_settings when intializing otel
|
2024-09-09 16:05:48 -07:00 |
|
Ishaan Jaff
|
e253c100f4
|
support using "callbacks" for prometheus
|
2024-09-09 08:26:03 -07:00 |
|
Ishaan Jaff
|
d6493b0e7f
|
docs semantic caching qdrant
|
2024-08-21 13:03:41 -07:00 |
|
Ishaan Jaff
|
1fdebfb0b7
|
working lakera ai during call hook
|
2024-08-20 14:39:04 -07:00 |
|
Ishaan Jaff
|
cad0352f76
|
rename lakera ai
|
2024-08-20 13:44:39 -07:00 |
|
Ishaan Jaff
|
042350bd74
|
rename Aporia Guardrail
|
2024-08-20 13:42:55 -07:00 |
|
Ishaan Jaff
|
6f12f6dcf8
|
fix importing _ENTERPRISE_Aporia
|
2024-08-19 20:39:24 -07:00 |
|
Ishaan Jaff
|
ca9c81470b
|
fix aporia typo
|
2024-08-19 18:34:45 -07:00 |
|
Ishaan Jaff
|
613bd1babd
|
feat - return applied guardrails in response headers
|
2024-08-19 11:56:20 -07:00 |
|
Ishaan Jaff
|
eff874bf05
|
fix proxy all models test
|
2024-08-17 15:54:51 -07:00 |
|
Ishaan Jaff
|
ee0f772b5c
|
feat return rmng tokens for model for api key
|
2024-08-17 12:35:10 -07:00 |
|
Ishaan Jaff
|
5985c7e933
|
feat - use commong helper for getting model group
|
2024-08-17 10:46:04 -07:00 |
|