Commit graph

628 commits

Author SHA1 Message Date
Krrish Dholakia
a9a3282031 fix(langsmith.py): support langsmith 'extra' field object
Closes https://github.com/BerriAI/litellm/issues/5179
2024-08-13 15:20:50 -07:00
Ishaan Jaff
f1df555c79 allow using langfuse_default_tags 2024-08-13 12:26:37 -07:00
Ishaan Jaff
42bd5de7c0 feat allow controlling logged tags on langfuse 2024-08-13 12:24:01 -07:00
Ishaan Jaff
49b8dee14d feat log responses in folders 2024-08-12 16:28:12 -07:00
Ishaan Jaff
19240b6cfd feat gcs log user api key metadata 2024-08-12 16:06:10 -07:00
Ishaan Jaff
c401970522
Merge pull request #5166 from BerriAI/litellm_log_key_created_slack
[Feat-Security] Send Slack Alert when CRUD ops done on Virtual Keys, Teams, Internal Users
2024-08-12 12:18:04 -07:00
Ishaan Jaff
4435a23121 send alert on all key events 2024-08-12 11:39:24 -07:00
Krrish Dholakia
b3c7d63ec1 fix(proxy_server.py): add info log when spend logs is skipped because disable_spend_logs=True. 2024-08-12 11:20:30 -07:00
Ishaan Jaff
30a54ef007 v0 log KeyCreatedEvent 2024-08-12 10:56:11 -07:00
Ishaan Jaff
dd9be6f160 allow setting PROMETHEUS_SELECTED_INSTANCE 2024-08-10 17:31:05 -07:00
Ishaan Jaff
e46009f3d2
Merge pull request #5154 from BerriAI/litellm_send_prometheus_fallbacks_from_slack
[Feat-Proxy] send prometheus fallbacks stats to slack
2024-08-10 17:14:01 -07:00
Ishaan Jaff
cc3316104f doc new prometheus metrics 2024-08-10 17:13:36 -07:00
Ishaan Jaff
28b930c0b7 feat - use api to get prometheus api metrics 2024-08-10 16:36:06 -07:00
Ishaan Jaff
35de40e6eb add fallback_reports in slack alert types 2024-08-10 16:08:36 -07:00
Ishaan Jaff
4cdc5c2e25 feat add prometheus api to get data from endpoint 2024-08-10 16:07:08 -07:00
Ishaan Jaff
d1eedb04bd prometheus log_success_fallback_event 2024-08-10 14:05:18 -07:00
Ishaan Jaff
dc0559226a v0 add helper for loging success/fail fallback events 2024-08-10 13:26:39 -07:00
Ishaan Jaff
01f5456e3d feat - track latency per llm deployment 2024-08-10 12:53:56 -07:00
Ishaan Jaff
83446926af track llm_deployment_success_responses 2024-08-10 10:05:33 -07:00
Ishaan Jaff
05fba48cec feat - refactor prometheus metrics 2024-08-10 09:14:38 -07:00
Krish Dholakia
e1a8e6c394
Merge pull request #5145 from BerriAI/litellm_fix_stream_options_logging
fix(litellm_logging.py): fix calling success callback w/ stream_options true
2024-08-09 20:30:19 -07:00
Ishaan Jaff
4c4ccaff66 fix _hidden_params is None case 2024-08-09 19:17:11 -07:00
Krrish Dholakia
a26b23a3f4 fix(litellm_logging.py): fix calling success callback w/ stream_options true
Fixes https://github.com/BerriAI/litellm/issues/5118
2024-08-09 18:20:42 -07:00
Ishaan Jaff
3e2a1fe0aa log provider specific metadata as a span 2024-08-09 14:32:02 -07:00
Ishaan Jaff
0b9ad45790 refactor prom metrics 2024-08-09 09:02:23 -07:00
Ishaan Jaff
958e0fdfab show warning about prometheus moving to enterprise 2024-08-07 12:46:26 -07:00
Ishaan Jaff
579f09b334 fix logging cool down deployment 2024-08-07 11:27:05 -07:00
Ishaan Jaff
99ecde7744 allow setting outage metrics 2024-08-07 10:36:18 -07:00
Ishaan Jaff
9a8fa9f047 emit deployment_partial_outage on prometheus 2024-08-07 09:56:01 -07:00
Ishaan Jaff
0304513b67 rename to set_llm_deployment_success_metrics 2024-08-07 09:46:08 -07:00
Ishaan Jaff
13d1caf94a add set_remaining_tokens_requests_metric 2024-08-07 09:43:35 -07:00
Ishaan Jaff
237c3a0244
Merge pull request #5077 from BerriAI/litellm_fix_ui_emails
[Fix] Fix testing emails through Admin UI
2024-08-06 16:41:01 -07:00
Ishaan Jaff
1e90329c4b add error when trying to send emails 2024-08-06 16:03:20 -07:00
Krrish Dholakia
7bf1b4d661 fix(main.py): log hidden params for text completion calls 2024-08-05 21:26:48 -07:00
Ishaan Jaff
6e4098fa26 otel log service errors 2024-08-05 20:21:26 -07:00
Ishaan Jaff
05a2a4462e otel log event_metadata 2024-08-05 20:01:58 -07:00
Ishaan Jaff
0214ff5fe0
Merge pull request #5047 from BerriAI/litellm_log_request_response_gcs
[Feat-Proxy] Log request/response on GCS
2024-08-05 09:05:56 -07:00
Ishaan Jaff
8eb73381d6 simplify GCS payload 2024-08-05 08:48:23 -07:00
Krrish Dholakia
ac6c39c283 feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint
Fixes https://github.com/BerriAI/litellm/issues/5011
2024-08-03 20:16:19 -07:00
Ishaan Jaff
75fba18c9f fix langfuse hardcoded public key 2024-08-02 07:21:02 -07:00
Krrish Dholakia
f506eb341b feat(litellm_logging.py): log exception response headers to langfuse 2024-08-01 18:07:47 -07:00
Ishaan Jaff
026e380b92 enforce premium user cheks on gcs bucket 2024-08-01 18:07:38 -07:00
Ishaan Jaff
781bfd1517 fix type errors 2024-08-01 18:07:38 -07:00
Ishaan Jaff
fc447dee5e delete object from gcs 2024-08-01 18:07:38 -07:00
Ishaan Jaff
357a1b87df feat gcs bucket log payload 2024-08-01 18:07:38 -07:00
Ishaan Jaff
008fbdfea6 fix _handle_failure for otel 2024-08-01 18:07:38 -07:00
Ishaan Jaff
285925e10a log output from /audio on langfuse 2024-07-29 08:21:22 -07:00
Ishaan Jaff
95f063f978 fix default input/output values for /audio/trancription logging 2024-07-29 08:03:08 -07:00
Ishaan Jaff
19fb5cc11c use common helpers for writing to otel 2024-07-27 11:40:39 -07:00
Ishaan Jaff
2a89486948 move _get_parent_otel_span_from_kwargs to otel.py 2024-07-27 11:12:13 -07:00