Commit graph

567 commits

Author SHA1 Message Date
Krish Dholakia
e770ac48a2
Merge branch 'main' into litellm_braintrust_integration 2024-07-22 22:40:39 -07:00
Krrish Dholakia
548e4f53f8 feat(redact_messages.py): allow remove sensitive key information before passing to logging integration 2024-07-22 20:58:02 -07:00
Krrish Dholakia
92b1262caa test(test_braintrust.py): add testing for braintrust integration 2024-07-22 18:05:11 -07:00
Krrish Dholakia
e4ab50e1a1 feat(braintrust_logging.py): working braintrust logging for successful calls 2024-07-22 17:04:55 -07:00
Krrish Dholakia
1ce029c80e feat(braintrust.py): initial commit for braintrust integration 2024-07-22 15:06:15 -07:00
Ishaan Jaff
41e6c4a573 feat - arize ai log llm i/o 2024-07-22 13:47:58 -07:00
Ishaan Jaff
0436eba2fa otel - log to arize ai 2024-07-22 13:40:42 -07:00
Ishaan Jaff
1a5aaee386 add arize.py 2024-07-22 11:27:51 -07:00
Ishaan Jaff
68f8fe87e4 feat - arize ai open inference types 2024-07-22 11:07:48 -07:00
Ishaan Jaff
91cd3ab7f8 fix langsmith logging test 2024-07-17 18:34:49 -07:00
Ishaan Jaff
f945e7009b test streaming logs to langsmith 2024-07-17 16:25:32 -07:00
Ishaan Jaff
5f04f7b7c1 fix langsmith logging for streaming 2024-07-17 16:04:45 -07:00
Ishaan Jaff
b2b180e254 langsmith use verbose logger 2024-07-17 15:23:20 -07:00
Ishaan Jaff
1334bca371 fix use AsyncHTTPHandler for logging langsmith requests 2024-07-17 11:49:48 -07:00
Ishaan Jaff
2c720214fa fix langsmith log user api key, user_id etc 2024-07-17 11:19:08 -07:00
Ishaan Jaff
df446c52e4 test api_key not logged on langsmith 2024-07-17 10:56:33 -07:00
Ishaan Jaff
0119ca1ce1 fix langsmith - don't log api_key 2024-07-17 10:04:36 -07:00
Krrish Dholakia
0cc273d77b feat(pass_through_endpoint.py): support enforcing key rpm limits on pass through endpoints
Closes https://github.com/BerriAI/litellm/issues/4698
2024-07-13 13:29:44 -07:00
Krrish Dholakia
fd743aaefd feat(opentelemetry.py): support logging call metadata to otel 2024-07-12 15:41:34 -07:00
Andrea Ponti
496445481d Rollback to metadata deepcopy 2024-07-12 11:25:23 +02:00
Krish Dholakia
d72bcdbce3
Merge pull request #4669 from BerriAI/litellm_logging_only_masking
Flag for PII masking on Logging only
2024-07-11 22:03:37 -07:00
Krish Dholakia
5ad341d0ff
Merge pull request #4607 from maamalama/helicone-cohere
Helicone Headers & Cohere support
2024-07-11 22:01:44 -07:00
Krrish Dholakia
9d918d2ac7 fix(presidio_pii_masking.py): support logging_only pii masking 2024-07-11 18:04:12 -07:00
Krrish Dholakia
9deb9b4e3f feat(guardrails): Flag for PII Masking on Logging
Fixes https://github.com/BerriAI/litellm/issues/4580
2024-07-11 16:09:34 -07:00
Marc Abramowitz
fe27182e8e Add missing space in "Failed Tracking Cost" msg
Fixes stuff like this:

```
Message: Failed Tracking Cost forerror in tracking cost callback - Traceback (most recent call last):
                              ^^^^^^^^
```
2024-07-11 13:26:59 -07:00
Krrish Dholakia
2163434ff3 fix(llm_cost_calc/google.py): fix google embedding cost calculation
Fixes https://github.com/BerriAI/litellm/issues/4630
2024-07-11 11:55:48 -07:00
Ishaan Jaff
e3470d8e91
Merge pull request #4658 from BerriAI/litellm_check_otel_spans
[Test-Proxy] Otel Traces
2024-07-11 10:41:51 -07:00
Ishaan Jaff
02ab3cb73d test- otel span recording 2024-07-11 08:47:16 -07:00
Krish Dholakia
dacce3d78b
Merge pull request #4635 from BerriAI/litellm_anthropic_adapter
Anthropic `/v1/messages` endpoint support
2024-07-10 22:41:53 -07:00
Krrish Dholakia
2f8dbbeb97 feat(proxy_server.py): working /v1/messages endpoint
Works with claude engineer
2024-07-10 18:15:38 -07:00
Ishaan Jaff
d0a7983a41 fix try / except langfuse deep copy 2024-07-10 17:22:14 -07:00
Ishaan Jaff
e20b540dac add validation on slack 2024-07-10 10:10:32 -07:00
Krrish Dholakia
5d6e172d5c feat(anthropic_adapter.py): support for translating anthropic params to openai format 2024-07-10 00:32:28 -07:00
maamalama
3367c78113 fix 2024-07-08 14:37:47 -07:00
maamalama
75d7755d34 some fixes 2024-07-08 12:34:35 -07:00
Krrish Dholakia
1193ee8803 fix(presidio_pii_masking.py): fix presidio unset url check + add same check for langfuse 2024-07-06 17:50:55 -07:00
Ishaan Jaff
c2631ce860
Merge pull request #4422 from BerriAI/litellm_otel_env_name
[Feat] OTEL allow setting deployment environment
2024-07-06 15:23:07 -07:00
Ishaan Jaff
c91b254e25 fix OTEL TracerProvider 2024-07-06 15:15:49 -07:00
Ishaan Jaff
285cb50821 fix init for async http handler 2024-07-05 20:29:47 -07:00
Ishaan Jaff
e444b465a2 fix import galileo issue 2024-07-05 20:26:02 -07:00
maamalama
2c9560239a headers and custom gateway 2024-07-05 20:17:38 -07:00
Ishaan Jaff
7bab381029 feat - galileo logging 2024-07-05 16:25:08 -07:00
Ishaan Jaff
dc1d69f2a0 add galileo response pydantic obj 2024-07-05 16:21:00 -07:00
Krrish Dholakia
7618ec43b3 fix(proxy_server.py): support langfuse logging for rejected requests on /v1/chat/completions 2024-07-05 13:07:09 -07:00
Ishaan Jaff
85ecc13458 feat - show key alias on prometheus metrics 2024-07-04 09:57:00 -07:00
Krrish Dholakia
66c6992f8a fix(slack_alerting.py): use in-memory cache for checking request status 2024-07-02 13:01:59 -07:00
Ishaan Jaff
402799c8db
Merge pull request #4503 from BerriAI/litellm_log_remaining_rate_limit_prometheus
[Feat-Enterprise]  log `"x-ratelimit-remaining-tokens"` and `"x-ratelimit-remaining-requests"` on prometheus
2024-07-01 21:11:42 -07:00
Ishaan Jaff
c37d45d556 feat - prometheus log remaining headers 2024-07-01 20:00:47 -07:00
Krrish Dholakia
b761ce9dd1 fix(s3.py): fix s3 path logging on proxy 2024-07-01 17:22:31 -07:00
Krish Dholakia
5f942e7fcf
Merge pull request #4413 from BerriAI/litellm_clean_metadata_langfuse
fix(langfuse.py): use clean metadata instead of deepcopy
2024-06-29 19:28:31 -07:00