Commit graph

550 commits

Author SHA1 Message Date
Krrish Dholakia
1d6643df22 feat(pass_through_endpoint.py): support enforcing key rpm limits on pass through endpoints
Closes https://github.com/BerriAI/litellm/issues/4698
2024-07-13 13:29:44 -07:00
Krrish Dholakia
d2a0977af7 feat(opentelemetry.py): support logging call metadata to otel 2024-07-12 15:41:34 -07:00
Andrea Ponti
b9ffd0682c Rollback to metadata deepcopy 2024-07-12 11:25:23 +02:00
Krish Dholakia
35a17b7d99 Merge pull request #4669 from BerriAI/litellm_logging_only_masking
Flag for PII masking on Logging only
2024-07-11 22:03:37 -07:00
Krish Dholakia
ea21f6ef26 Merge pull request #4607 from maamalama/helicone-cohere
Helicone Headers & Cohere support
2024-07-11 22:01:44 -07:00
Krrish Dholakia
1a57e49e46 fix(presidio_pii_masking.py): support logging_only pii masking 2024-07-11 18:04:12 -07:00
Krrish Dholakia
abd682323c feat(guardrails): Flag for PII Masking on Logging
Fixes https://github.com/BerriAI/litellm/issues/4580
2024-07-11 16:09:34 -07:00
Marc Abramowitz
3b1459056b Add missing space in "Failed Tracking Cost" msg
Fixes stuff like this:

```
Message: Failed Tracking Cost forerror in tracking cost callback - Traceback (most recent call last):
                              ^^^^^^^^
```
2024-07-11 13:26:59 -07:00
Krrish Dholakia
3f965df68b fix(llm_cost_calc/google.py): fix google embedding cost calculation
Fixes https://github.com/BerriAI/litellm/issues/4630
2024-07-11 11:55:48 -07:00
Ishaan Jaff
db7d417727 Merge pull request #4658 from BerriAI/litellm_check_otel_spans
[Test-Proxy] Otel Traces
2024-07-11 10:41:51 -07:00
Ishaan Jaff
97da1252f1 test- otel span recording 2024-07-11 08:47:16 -07:00
Krish Dholakia
f4d140efec Merge pull request #4635 from BerriAI/litellm_anthropic_adapter
Anthropic `/v1/messages` endpoint support
2024-07-10 22:41:53 -07:00
Krrish Dholakia
4ba30abb63 feat(proxy_server.py): working /v1/messages endpoint
Works with claude engineer
2024-07-10 18:15:38 -07:00
Ishaan Jaff
f7d239f528 fix try / except langfuse deep copy 2024-07-10 17:22:14 -07:00
Ishaan Jaff
7849e97847 add validation on slack 2024-07-10 10:10:32 -07:00
Krrish Dholakia
01a335b4c3 feat(anthropic_adapter.py): support for translating anthropic params to openai format 2024-07-10 00:32:28 -07:00
maamalama
d7cb6a1fad fix 2024-07-08 14:37:47 -07:00
maamalama
305a01fbd6 some fixes 2024-07-08 12:34:35 -07:00
Krrish Dholakia
bcd7358daf fix(presidio_pii_masking.py): fix presidio unset url check + add same check for langfuse 2024-07-06 17:50:55 -07:00
Ishaan Jaff
35d4adb147 Merge pull request #4422 from BerriAI/litellm_otel_env_name
[Feat] OTEL allow setting deployment environment
2024-07-06 15:23:07 -07:00
Ishaan Jaff
9738aaebf6 fix OTEL TracerProvider 2024-07-06 15:15:49 -07:00
Ishaan Jaff
7ae18691f4 fix init for async http handler 2024-07-05 20:29:47 -07:00
Ishaan Jaff
21c9de8ef5 fix import galileo issue 2024-07-05 20:26:02 -07:00
maamalama
f7f084c171 headers and custom gateway 2024-07-05 20:17:38 -07:00
Ishaan Jaff
cb7d34c080 feat - galileo logging 2024-07-05 16:25:08 -07:00
Ishaan Jaff
0eeea98f82 add galileo response pydantic obj 2024-07-05 16:21:00 -07:00
Krrish Dholakia
56410cfcd0 fix(proxy_server.py): support langfuse logging for rejected requests on /v1/chat/completions 2024-07-05 13:07:09 -07:00
Ishaan Jaff
09e22d8e33 feat - show key alias on prometheus metrics 2024-07-04 09:57:00 -07:00
Krrish Dholakia
d09a78d7fd fix(slack_alerting.py): use in-memory cache for checking request status 2024-07-02 13:01:59 -07:00
Ishaan Jaff
0596749b9f Merge pull request #4503 from BerriAI/litellm_log_remaining_rate_limit_prometheus
[Feat-Enterprise]  log `"x-ratelimit-remaining-tokens"` and `"x-ratelimit-remaining-requests"` on prometheus
2024-07-01 21:11:42 -07:00
Ishaan Jaff
86e3cae596 feat - prometheus log remaining headers 2024-07-01 20:00:47 -07:00
Krrish Dholakia
b6f509a745 fix(s3.py): fix s3 path logging on proxy 2024-07-01 17:22:31 -07:00
Krish Dholakia
f28f4edbb2 Merge pull request #4413 from BerriAI/litellm_clean_metadata_langfuse
fix(langfuse.py): use clean metadata instead of deepcopy
2024-06-29 19:28:31 -07:00
Ishaan Jaff
4f409e647f OTEL allow setting deployment environment 2024-06-26 11:50:16 -07:00
Krrish Dholakia
f55a0fec15 fix(langfuse.py): use clean metadata instead of deepcopy 2024-06-25 18:20:39 -07:00
Krrish Dholakia
c70d4ffafb fix(router.py): set cooldown_time: per model 2024-06-25 16:51:55 -07:00
Krrish Dholakia
589a83c82d fix(langfuse.py): cleanup 2024-06-24 21:43:40 -07:00
Krrish Dholakia
94830ec281 fix(router.py): log rejected router requests to langfuse
Fixes issue where rejected requests weren't being logged
2024-06-24 17:52:01 -07:00
7HR4IZ3
15fc99a3ff fix: Lunary integration
Fixes the bug of litellm not logging system messages to lunary
2024-06-24 14:09:40 +01:00
Krish Dholakia
63d0defa6d Merge branch 'main' into litellm_dynamic_tpm_limits 2024-06-22 19:14:59 -07:00
Krrish Dholakia
0430807178 feat(dynamic_rate_limiter.py): update cache with active project 2024-06-21 20:25:40 -07:00
Krrish Dholakia
c7b06c42b7 refactor(litellm_logging.py): refactors how slack_alerting generates langfuse trace url
gets the url from logging object
2024-06-21 16:12:25 -07:00
Krrish Dholakia
174b345766 fix(proxy/utils.py): fix add langfuse trace id to alert
Fixing the import after refactor
2024-06-21 14:55:09 -07:00
Krrish Dholakia
84043f4fd4 fix(litellm_logging.py): initialize global variables
Fixes https://github.com/BerriAI/litellm/issues/4281
2024-06-19 18:39:45 -07:00
Ishaan Jaff
e799ef02f0 Merge pull request #4275 from BerriAI/litellm_fix_langfuse_log_prompts
[Fix] Use Langfuse prompt Object with LiteLLM Proxy
2024-06-18 20:09:13 -07:00
Ishaan Jaff
373f232cdb feat - _add_prompt_to_generation_params for langfuse 2024-06-18 19:55:16 -07:00
Nejc Habjan
da343c7aca fix: add more type hints to init methods 2024-06-18 12:09:39 +02:00
Ishaan Jaff
b343911d59 fix - otel fixes 2024-06-17 19:15:14 -07:00
Krish Dholakia
daf0e477bb Merge pull request #4141 from lunary-ai/main
fix: lunary callback tags
2024-06-17 16:13:01 -07:00
Krrish Dholakia
fa6ddcde3c fix(litellm_logging.py): fix lago callback logic 2024-06-17 09:10:19 -07:00