Commit graph

582 commits

Author SHA1 Message Date
Ishaan Jaff
f9e4e75160 log output from /audio on langfuse 2024-07-29 08:21:22 -07:00
Ishaan Jaff
4c427a3793 fix default input/output values for /audio/trancription logging 2024-07-29 08:03:08 -07:00
Ishaan Jaff
aade38760d use common helpers for writing to otel 2024-07-27 11:40:39 -07:00
Ishaan Jaff
40f9e67be4 move _get_parent_otel_span_from_kwargs to otel.py 2024-07-27 11:12:13 -07:00
Idris Mokhtarzada
b292f03b95 Fix Datadog JSON serialization
Nested dicts were not being serialized properly
2024-07-27 02:16:36 -04:00
Krrish Dholakia
1562cba823 fix(utils.py): fix cache hits for streaming
Fixes https://github.com/BerriAI/litellm/issues/4109
2024-07-26 19:04:08 -07:00
Idris Mokhtarzada
66c1b54ea2 Better JSON serialization for Datadog logs
Dicts are now properly serialized to JSON so that Datadog can parse the child attributes.  Also, numbers and nulls are sent as numbers and nulls instead of strings.
2024-07-26 17:02:05 -04:00
Idris Mokhtarzada
b8f7edfa0a Use milliseconds for response_time in Datadog logs
milliseconds is more commonly used and more standard than seconds
2024-07-26 16:43:21 -04:00
Idris Mokhtarzada
59cd7a4925 Use underscores
Datadog does not play nice with special characters (as in "(seconds)").  Also just makes sense to standardize on either underscores or camelCase, but not mix-and-match.
2024-07-26 16:38:54 -04:00
Krish Dholakia
3e083ce215 Merge pull request #4869 from maamalama/anthropic-tools
Fixed tool_call for Helicone integration
2024-07-26 10:42:10 -07:00
Ishaan Jaff
ec66e7520e fix logfire - don't load_dotenv 2024-07-25 19:22:26 -07:00
maamalama
2f49114d08 anthropic gateway fixes 2024-07-25 11:37:29 -07:00
maamalama
33f5e079bc tab 2024-07-24 17:42:07 -07:00
maamalama
4e82d0e592 tools_call to Helicone 2024-07-24 17:40:20 -07:00
Ishaan Jaff
f00b34eeb1 langsmith - support logging tags 2024-07-24 07:08:40 -07:00
Krish Dholakia
7cf9620b12 Merge branch 'main' into litellm_braintrust_integration 2024-07-22 22:40:39 -07:00
Krrish Dholakia
8c005d8134 feat(redact_messages.py): allow remove sensitive key information before passing to logging integration 2024-07-22 20:58:02 -07:00
Krrish Dholakia
0f8ab1f4c5 test(test_braintrust.py): add testing for braintrust integration 2024-07-22 18:05:11 -07:00
Krrish Dholakia
d4c72f913c feat(braintrust_logging.py): working braintrust logging for successful calls 2024-07-22 17:04:55 -07:00
Krrish Dholakia
8061c29e70 feat(braintrust.py): initial commit for braintrust integration 2024-07-22 15:06:15 -07:00
Ishaan Jaff
d85deaf7cb feat - arize ai log llm i/o 2024-07-22 13:47:58 -07:00
Ishaan Jaff
464a4edfb2 otel - log to arize ai 2024-07-22 13:40:42 -07:00
Ishaan Jaff
c6aec9d436 add arize.py 2024-07-22 11:27:51 -07:00
Ishaan Jaff
3c1699986e feat - arize ai open inference types 2024-07-22 11:07:48 -07:00
Ishaan Jaff
e49001c5f2 fix langsmith logging test 2024-07-17 18:34:49 -07:00
Ishaan Jaff
f90b7ae0b0 test streaming logs to langsmith 2024-07-17 16:25:32 -07:00
Ishaan Jaff
1abd66db1b fix langsmith logging for streaming 2024-07-17 16:04:45 -07:00
Ishaan Jaff
c9b29d8c34 langsmith use verbose logger 2024-07-17 15:23:20 -07:00
Ishaan Jaff
0e170c75de fix use AsyncHTTPHandler for logging langsmith requests 2024-07-17 11:49:48 -07:00
Ishaan Jaff
b34eea9c28 fix langsmith log user api key, user_id etc 2024-07-17 11:19:08 -07:00
Ishaan Jaff
27f0a148d9 test api_key not logged on langsmith 2024-07-17 10:56:33 -07:00
Ishaan Jaff
2751ad3526 fix langsmith - don't log api_key 2024-07-17 10:04:36 -07:00
Krrish Dholakia
1d6643df22 feat(pass_through_endpoint.py): support enforcing key rpm limits on pass through endpoints
Closes https://github.com/BerriAI/litellm/issues/4698
2024-07-13 13:29:44 -07:00
Krrish Dholakia
d2a0977af7 feat(opentelemetry.py): support logging call metadata to otel 2024-07-12 15:41:34 -07:00
Andrea Ponti
b9ffd0682c Rollback to metadata deepcopy 2024-07-12 11:25:23 +02:00
Krish Dholakia
35a17b7d99 Merge pull request #4669 from BerriAI/litellm_logging_only_masking
Flag for PII masking on Logging only
2024-07-11 22:03:37 -07:00
Krish Dholakia
ea21f6ef26 Merge pull request #4607 from maamalama/helicone-cohere
Helicone Headers & Cohere support
2024-07-11 22:01:44 -07:00
Krrish Dholakia
1a57e49e46 fix(presidio_pii_masking.py): support logging_only pii masking 2024-07-11 18:04:12 -07:00
Krrish Dholakia
abd682323c feat(guardrails): Flag for PII Masking on Logging
Fixes https://github.com/BerriAI/litellm/issues/4580
2024-07-11 16:09:34 -07:00
Marc Abramowitz
3b1459056b Add missing space in "Failed Tracking Cost" msg
Fixes stuff like this:

```
Message: Failed Tracking Cost forerror in tracking cost callback - Traceback (most recent call last):
                              ^^^^^^^^
```
2024-07-11 13:26:59 -07:00
Krrish Dholakia
3f965df68b fix(llm_cost_calc/google.py): fix google embedding cost calculation
Fixes https://github.com/BerriAI/litellm/issues/4630
2024-07-11 11:55:48 -07:00
Ishaan Jaff
db7d417727 Merge pull request #4658 from BerriAI/litellm_check_otel_spans
[Test-Proxy] Otel Traces
2024-07-11 10:41:51 -07:00
Ishaan Jaff
97da1252f1 test- otel span recording 2024-07-11 08:47:16 -07:00
Krish Dholakia
f4d140efec Merge pull request #4635 from BerriAI/litellm_anthropic_adapter
Anthropic `/v1/messages` endpoint support
2024-07-10 22:41:53 -07:00
Krrish Dholakia
4ba30abb63 feat(proxy_server.py): working /v1/messages endpoint
Works with claude engineer
2024-07-10 18:15:38 -07:00
Ishaan Jaff
f7d239f528 fix try / except langfuse deep copy 2024-07-10 17:22:14 -07:00
Ishaan Jaff
7849e97847 add validation on slack 2024-07-10 10:10:32 -07:00
Krrish Dholakia
01a335b4c3 feat(anthropic_adapter.py): support for translating anthropic params to openai format 2024-07-10 00:32:28 -07:00
maamalama
d7cb6a1fad fix 2024-07-08 14:37:47 -07:00
maamalama
305a01fbd6 some fixes 2024-07-08 12:34:35 -07:00