Commit graph

569 commits

Author SHA1 Message Date
Ishaan Jaff
ec66e7520e fix logfire - don't load_dotenv 2024-07-25 19:22:26 -07:00
Ishaan Jaff
f00b34eeb1 langsmith - support logging tags 2024-07-24 07:08:40 -07:00
Krish Dholakia
7cf9620b12 Merge branch 'main' into litellm_braintrust_integration 2024-07-22 22:40:39 -07:00
Krrish Dholakia
8c005d8134 feat(redact_messages.py): allow remove sensitive key information before passing to logging integration 2024-07-22 20:58:02 -07:00
Krrish Dholakia
0f8ab1f4c5 test(test_braintrust.py): add testing for braintrust integration 2024-07-22 18:05:11 -07:00
Krrish Dholakia
d4c72f913c feat(braintrust_logging.py): working braintrust logging for successful calls 2024-07-22 17:04:55 -07:00
Krrish Dholakia
8061c29e70 feat(braintrust.py): initial commit for braintrust integration 2024-07-22 15:06:15 -07:00
Ishaan Jaff
d85deaf7cb feat - arize ai log llm i/o 2024-07-22 13:47:58 -07:00
Ishaan Jaff
464a4edfb2 otel - log to arize ai 2024-07-22 13:40:42 -07:00
Ishaan Jaff
c6aec9d436 add arize.py 2024-07-22 11:27:51 -07:00
Ishaan Jaff
3c1699986e feat - arize ai open inference types 2024-07-22 11:07:48 -07:00
Ishaan Jaff
e49001c5f2 fix langsmith logging test 2024-07-17 18:34:49 -07:00
Ishaan Jaff
f90b7ae0b0 test streaming logs to langsmith 2024-07-17 16:25:32 -07:00
Ishaan Jaff
1abd66db1b fix langsmith logging for streaming 2024-07-17 16:04:45 -07:00
Ishaan Jaff
c9b29d8c34 langsmith use verbose logger 2024-07-17 15:23:20 -07:00
Ishaan Jaff
0e170c75de fix use AsyncHTTPHandler for logging langsmith requests 2024-07-17 11:49:48 -07:00
Ishaan Jaff
b34eea9c28 fix langsmith log user api key, user_id etc 2024-07-17 11:19:08 -07:00
Ishaan Jaff
27f0a148d9 test api_key not logged on langsmith 2024-07-17 10:56:33 -07:00
Ishaan Jaff
2751ad3526 fix langsmith - don't log api_key 2024-07-17 10:04:36 -07:00
Krrish Dholakia
1d6643df22 feat(pass_through_endpoint.py): support enforcing key rpm limits on pass through endpoints
Closes https://github.com/BerriAI/litellm/issues/4698
2024-07-13 13:29:44 -07:00
Krrish Dholakia
d2a0977af7 feat(opentelemetry.py): support logging call metadata to otel 2024-07-12 15:41:34 -07:00
Andrea Ponti
b9ffd0682c Rollback to metadata deepcopy 2024-07-12 11:25:23 +02:00
Krish Dholakia
35a17b7d99 Merge pull request #4669 from BerriAI/litellm_logging_only_masking
Flag for PII masking on Logging only
2024-07-11 22:03:37 -07:00
Krish Dholakia
ea21f6ef26 Merge pull request #4607 from maamalama/helicone-cohere
Helicone Headers & Cohere support
2024-07-11 22:01:44 -07:00
Krrish Dholakia
1a57e49e46 fix(presidio_pii_masking.py): support logging_only pii masking 2024-07-11 18:04:12 -07:00
Krrish Dholakia
abd682323c feat(guardrails): Flag for PII Masking on Logging
Fixes https://github.com/BerriAI/litellm/issues/4580
2024-07-11 16:09:34 -07:00
Marc Abramowitz
3b1459056b Add missing space in "Failed Tracking Cost" msg
Fixes stuff like this:

```
Message: Failed Tracking Cost forerror in tracking cost callback - Traceback (most recent call last):
                              ^^^^^^^^
```
2024-07-11 13:26:59 -07:00
Krrish Dholakia
3f965df68b fix(llm_cost_calc/google.py): fix google embedding cost calculation
Fixes https://github.com/BerriAI/litellm/issues/4630
2024-07-11 11:55:48 -07:00
Ishaan Jaff
db7d417727 Merge pull request #4658 from BerriAI/litellm_check_otel_spans
[Test-Proxy] Otel Traces
2024-07-11 10:41:51 -07:00
Ishaan Jaff
97da1252f1 test- otel span recording 2024-07-11 08:47:16 -07:00
Krish Dholakia
f4d140efec Merge pull request #4635 from BerriAI/litellm_anthropic_adapter
Anthropic `/v1/messages` endpoint support
2024-07-10 22:41:53 -07:00
Krrish Dholakia
4ba30abb63 feat(proxy_server.py): working /v1/messages endpoint
Works with claude engineer
2024-07-10 18:15:38 -07:00
Ishaan Jaff
f7d239f528 fix try / except langfuse deep copy 2024-07-10 17:22:14 -07:00
Ishaan Jaff
7849e97847 add validation on slack 2024-07-10 10:10:32 -07:00
Krrish Dholakia
01a335b4c3 feat(anthropic_adapter.py): support for translating anthropic params to openai format 2024-07-10 00:32:28 -07:00
maamalama
d7cb6a1fad fix 2024-07-08 14:37:47 -07:00
maamalama
305a01fbd6 some fixes 2024-07-08 12:34:35 -07:00
Krrish Dholakia
bcd7358daf fix(presidio_pii_masking.py): fix presidio unset url check + add same check for langfuse 2024-07-06 17:50:55 -07:00
Ishaan Jaff
35d4adb147 Merge pull request #4422 from BerriAI/litellm_otel_env_name
[Feat] OTEL allow setting deployment environment
2024-07-06 15:23:07 -07:00
Ishaan Jaff
9738aaebf6 fix OTEL TracerProvider 2024-07-06 15:15:49 -07:00
Ishaan Jaff
7ae18691f4 fix init for async http handler 2024-07-05 20:29:47 -07:00
Ishaan Jaff
21c9de8ef5 fix import galileo issue 2024-07-05 20:26:02 -07:00
maamalama
f7f084c171 headers and custom gateway 2024-07-05 20:17:38 -07:00
Ishaan Jaff
cb7d34c080 feat - galileo logging 2024-07-05 16:25:08 -07:00
Ishaan Jaff
0eeea98f82 add galileo response pydantic obj 2024-07-05 16:21:00 -07:00
Krrish Dholakia
56410cfcd0 fix(proxy_server.py): support langfuse logging for rejected requests on /v1/chat/completions 2024-07-05 13:07:09 -07:00
Ishaan Jaff
09e22d8e33 feat - show key alias on prometheus metrics 2024-07-04 09:57:00 -07:00
Krrish Dholakia
d09a78d7fd fix(slack_alerting.py): use in-memory cache for checking request status 2024-07-02 13:01:59 -07:00
Ishaan Jaff
0596749b9f Merge pull request #4503 from BerriAI/litellm_log_remaining_rate_limit_prometheus
[Feat-Enterprise]  log `"x-ratelimit-remaining-tokens"` and `"x-ratelimit-remaining-requests"` on prometheus
2024-07-01 21:11:42 -07:00
Ishaan Jaff
86e3cae596 feat - prometheus log remaining headers 2024-07-01 20:00:47 -07:00