Commit graph

946 commits

Author SHA1 Message Date
Krish Dholakia
5ad341d0ff
Merge pull request #4607 from maamalama/helicone-cohere
Helicone Headers & Cohere support
2024-07-11 22:01:44 -07:00
Krrish Dholakia
9d918d2ac7 fix(presidio_pii_masking.py): support logging_only pii masking 2024-07-11 18:04:12 -07:00
Krrish Dholakia
9deb9b4e3f feat(guardrails): Flag for PII Masking on Logging
Fixes https://github.com/BerriAI/litellm/issues/4580
2024-07-11 16:09:34 -07:00
Marc Abramowitz
fe27182e8e Add missing space in "Failed Tracking Cost" msg
Fixes stuff like this:

```
Message: Failed Tracking Cost forerror in tracking cost callback - Traceback (most recent call last):
                              ^^^^^^^^
```
2024-07-11 13:26:59 -07:00
Krrish Dholakia
2163434ff3 fix(llm_cost_calc/google.py): fix google embedding cost calculation
Fixes https://github.com/BerriAI/litellm/issues/4630
2024-07-11 11:55:48 -07:00
Ishaan Jaff
e3470d8e91
Merge pull request #4658 from BerriAI/litellm_check_otel_spans
[Test-Proxy] Otel Traces
2024-07-11 10:41:51 -07:00
Ishaan Jaff
02ab3cb73d test- otel span recording 2024-07-11 08:47:16 -07:00
Krish Dholakia
dacce3d78b
Merge pull request #4635 from BerriAI/litellm_anthropic_adapter
Anthropic `/v1/messages` endpoint support
2024-07-10 22:41:53 -07:00
Krrish Dholakia
2f8dbbeb97 feat(proxy_server.py): working /v1/messages endpoint
Works with claude engineer
2024-07-10 18:15:38 -07:00
Ishaan Jaff
d0a7983a41 fix try / except langfuse deep copy 2024-07-10 17:22:14 -07:00
Ishaan Jaff
e20b540dac add validation on slack 2024-07-10 10:10:32 -07:00
Krrish Dholakia
5d6e172d5c feat(anthropic_adapter.py): support for translating anthropic params to openai format 2024-07-10 00:32:28 -07:00
maamalama
3367c78113 fix 2024-07-08 14:37:47 -07:00
maamalama
75d7755d34 some fixes 2024-07-08 12:34:35 -07:00
Krrish Dholakia
1193ee8803 fix(presidio_pii_masking.py): fix presidio unset url check + add same check for langfuse 2024-07-06 17:50:55 -07:00
Ishaan Jaff
c2631ce860
Merge pull request #4422 from BerriAI/litellm_otel_env_name
[Feat] OTEL allow setting deployment environment
2024-07-06 15:23:07 -07:00
Ishaan Jaff
c91b254e25 fix OTEL TracerProvider 2024-07-06 15:15:49 -07:00
Ishaan Jaff
285cb50821 fix init for async http handler 2024-07-05 20:29:47 -07:00
Ishaan Jaff
e444b465a2 fix import galileo issue 2024-07-05 20:26:02 -07:00
maamalama
2c9560239a headers and custom gateway 2024-07-05 20:17:38 -07:00
Ishaan Jaff
7bab381029 feat - galileo logging 2024-07-05 16:25:08 -07:00
Ishaan Jaff
dc1d69f2a0 add galileo response pydantic obj 2024-07-05 16:21:00 -07:00
Krrish Dholakia
7618ec43b3 fix(proxy_server.py): support langfuse logging for rejected requests on /v1/chat/completions 2024-07-05 13:07:09 -07:00
Ishaan Jaff
85ecc13458 feat - show key alias on prometheus metrics 2024-07-04 09:57:00 -07:00
Krrish Dholakia
66c6992f8a fix(slack_alerting.py): use in-memory cache for checking request status 2024-07-02 13:01:59 -07:00
Ishaan Jaff
402799c8db
Merge pull request #4503 from BerriAI/litellm_log_remaining_rate_limit_prometheus
[Feat-Enterprise]  log `"x-ratelimit-remaining-tokens"` and `"x-ratelimit-remaining-requests"` on prometheus
2024-07-01 21:11:42 -07:00
Ishaan Jaff
c37d45d556 feat - prometheus log remaining headers 2024-07-01 20:00:47 -07:00
Krrish Dholakia
b761ce9dd1 fix(s3.py): fix s3 path logging on proxy 2024-07-01 17:22:31 -07:00
Krish Dholakia
5f942e7fcf
Merge pull request #4413 from BerriAI/litellm_clean_metadata_langfuse
fix(langfuse.py): use clean metadata instead of deepcopy
2024-06-29 19:28:31 -07:00
Ishaan Jaff
174d6eaf13 OTEL allow setting deployment environment 2024-06-26 11:50:16 -07:00
Krrish Dholakia
b4c8af771d fix(langfuse.py): use clean metadata instead of deepcopy 2024-06-25 18:20:39 -07:00
Krrish Dholakia
d98e00d1e0 fix(router.py): set cooldown_time: per model 2024-06-25 16:51:55 -07:00
Krrish Dholakia
f8b390d421 fix(langfuse.py): cleanup 2024-06-24 21:43:40 -07:00
Krrish Dholakia
a4bea47a2d fix(router.py): log rejected router requests to langfuse
Fixes issue where rejected requests weren't being logged
2024-06-24 17:52:01 -07:00
7HR4IZ3
515dc9acc7
fix: Lunary integration
Fixes the bug of litellm not logging system messages to lunary
2024-06-24 14:09:40 +01:00
Krish Dholakia
961e7ac95d
Merge branch 'main' into litellm_dynamic_tpm_limits 2024-06-22 19:14:59 -07:00
Krrish Dholakia
a028600932 feat(dynamic_rate_limiter.py): update cache with active project 2024-06-21 20:25:40 -07:00
Krrish Dholakia
2584120012 refactor(litellm_logging.py): refactors how slack_alerting generates langfuse trace url
gets the url from logging object
2024-06-21 16:12:25 -07:00
Krrish Dholakia
941574a921 fix(proxy/utils.py): fix add langfuse trace id to alert
Fixing the import after refactor
2024-06-21 14:55:09 -07:00
Krrish Dholakia
682ec33aa0 fix(litellm_logging.py): initialize global variables
Fixes https://github.com/BerriAI/litellm/issues/4281
2024-06-19 18:39:45 -07:00
Ishaan Jaff
e1b646c304
Merge pull request #4275 from BerriAI/litellm_fix_langfuse_log_prompts
[Fix] Use Langfuse prompt Object with LiteLLM Proxy
2024-06-18 20:09:13 -07:00
Ishaan Jaff
04038a0bef feat - _add_prompt_to_generation_params for langfuse 2024-06-18 19:55:16 -07:00
Nejc Habjan
2ecd614a73
fix: add more type hints to init methods 2024-06-18 12:09:39 +02:00
Ishaan Jaff
253b504199 fix - otel fixes 2024-06-17 19:15:14 -07:00
Krish Dholakia
0cf99c47d4
Merge pull request #4141 from lunary-ai/main
fix: lunary callback tags
2024-06-17 16:13:01 -07:00
Krrish Dholakia
2623bb260f fix(litellm_logging.py): fix lago callback logic 2024-06-17 09:10:19 -07:00
Hugues Chocart
722e89b6a2
Merge branch 'BerriAI:main' into main 2024-06-17 11:15:23 -03:00
Hannes Burrichter
1b644fa0fc
Merge branch 'BerriAI:main' into main 2024-06-16 15:15:00 +02:00
Hannes Burrichter
d338a94a57 Set Langfuse output to null for embedding responses 2024-06-16 15:14:34 +02:00
Ishaan Jaff
2f9aa308f1 fix - remove deprecated clickhouse utils 2024-06-15 15:33:26 -07:00