946 commits

Author	SHA1	Message	Date
MarkRx	19e5299a6d	Support LangSmith parent_run_id, trace_id, session_id	2024-08-21 16:09:30 -04:00
Ishaan Jaff	1fdebfb0b7	working lakera ai during call hook	2024-08-20 14:39:04 -07:00
Ishaan Jaff	ae7cc6b198	fix _get_spend_report_for_time_range	2024-08-19 20:53:39 -07:00
Ishaan Jaff	8cd1963c11	feat - guardrails v2	2024-08-19 18:24:20 -07:00
Ishaan Jaff	4685b9909a	feat - allow accessing data post success call	2024-08-19 11:35:33 -07:00
Ishaan Jaff	feb8c3c5b4	Merge pull request #5259 from BerriAI/litellm_return_remaining_tokens_in_header ... [Feat] return `x-litellm-key-remaining-requests-{model}`: 1, `x-litellm-key-remaining-tokens-{model}: None` in response headers	2024-08-17 12:41:16 -07:00
Ishaan Jaff	5985c7e933	feat - use commong helper for getting model group	2024-08-17 10:46:04 -07:00
Ishaan Jaff	d630f77b73	show correct metric	2024-08-17 10:12:23 -07:00
Ishaan Jaff	412d30d362	add litellm-key-remaining-tokens on prometheus	2024-08-17 10:02:20 -07:00
Krrish Dholakia	61f4b71ef7	refactor: replace .error() with .exception() logging for better debugging on sentry	2024-08-16 09:22:47 -07:00
Krish Dholakia	6c3f37f8b4	Merge pull request #5235 from BerriAI/litellm_fix_s3_logs ... fix(s3.py): fix s3 logging payload to have valid json values	2024-08-15 23:00:18 -07:00
Krrish Dholakia	cda50e5d47	fix(s3.py): fix s3 logging payload to have valid json values ... Previously pydantic objects were being stringified, making them unparsable	2024-08-15 17:09:02 -07:00
Ishaan Jaff	a59ed00fd3	litellm always log cache_key on hits/misses	2024-08-15 09:59:58 -07:00
Ishaan Jaff	d8ef882905	fix langfuse log_provider_specific_information_as_span	2024-08-14 17:54:18 -07:00
Ishaan Jaff	98ea24aab0	Merge pull request #5202 from BerriAI/litellm_prom_prefix_litellm ... [Fix] Prometheus use 'litellm_' prefix for new deployment metrics	2024-08-14 09:50:36 -07:00
Ishaan Jaff	acadabe6c9	use litellm_ prefix for new deployment metrics	2024-08-14 09:08:14 -07:00
Ishaan Jaff	326d797111	log failure calls on gcs + testing	2024-08-14 08:55:51 -07:00
Ishaan Jaff	63af2942ab	feat log fail events on gcs	2024-08-14 08:39:16 -07:00
Krrish Dholakia	a9a3282031	fix(langsmith.py): support langsmith 'extra' field object ... Closes https://github.com/BerriAI/litellm/issues/5179	2024-08-13 15:20:50 -07:00
Ishaan Jaff	f1df555c79	allow using langfuse_default_tags	2024-08-13 12:26:37 -07:00
Ishaan Jaff	42bd5de7c0	feat allow controlling logged tags on langfuse	2024-08-13 12:24:01 -07:00
Ishaan Jaff	49b8dee14d	feat log responses in folders	2024-08-12 16:28:12 -07:00
Ishaan Jaff	19240b6cfd	feat gcs log user api key metadata	2024-08-12 16:06:10 -07:00
Ishaan Jaff	c401970522	Merge pull request #5166 from BerriAI/litellm_log_key_created_slack ... [Feat-Security] Send Slack Alert when CRUD ops done on Virtual Keys, Teams, Internal Users	2024-08-12 12:18:04 -07:00
Ishaan Jaff	4435a23121	send alert on all key events	2024-08-12 11:39:24 -07:00
Krrish Dholakia	b3c7d63ec1	fix(proxy_server.py): add info log when spend logs is skipped because disable_spend_logs=True.	2024-08-12 11:20:30 -07:00
Ishaan Jaff	30a54ef007	v0 log KeyCreatedEvent	2024-08-12 10:56:11 -07:00
Ishaan Jaff	dd9be6f160	allow setting PROMETHEUS_SELECTED_INSTANCE	2024-08-10 17:31:05 -07:00
Ishaan Jaff	e46009f3d2	Merge pull request #5154 from BerriAI/litellm_send_prometheus_fallbacks_from_slack ... [Feat-Proxy] send prometheus fallbacks stats to slack	2024-08-10 17:14:01 -07:00
Ishaan Jaff	cc3316104f	doc new prometheus metrics	2024-08-10 17:13:36 -07:00
Ishaan Jaff	28b930c0b7	feat - use api to get prometheus api metrics	2024-08-10 16:36:06 -07:00
Ishaan Jaff	35de40e6eb	add fallback_reports in slack alert types	2024-08-10 16:08:36 -07:00
Ishaan Jaff	4cdc5c2e25	feat add prometheus api to get data from endpoint	2024-08-10 16:07:08 -07:00
Ishaan Jaff	d1eedb04bd	prometheus log_success_fallback_event	2024-08-10 14:05:18 -07:00
Ishaan Jaff	dc0559226a	v0 add helper for loging success/fail fallback events	2024-08-10 13:26:39 -07:00
Ishaan Jaff	01f5456e3d	feat - track latency per llm deployment	2024-08-10 12:53:56 -07:00
Ishaan Jaff	83446926af	track llm_deployment_success_responses	2024-08-10 10:05:33 -07:00
Ishaan Jaff	05fba48cec	feat - refactor prometheus metrics	2024-08-10 09:14:38 -07:00
Krish Dholakia	e1a8e6c394	Merge pull request #5145 from BerriAI/litellm_fix_stream_options_logging ... fix(litellm_logging.py): fix calling success callback w/ stream_options true	2024-08-09 20:30:19 -07:00
Ishaan Jaff	4c4ccaff66	fix _hidden_params is None case	2024-08-09 19:17:11 -07:00
Krrish Dholakia	a26b23a3f4	fix(litellm_logging.py): fix calling success callback w/ stream_options true ... Fixes https://github.com/BerriAI/litellm/issues/5118	2024-08-09 18:20:42 -07:00
Ishaan Jaff	3e2a1fe0aa	log provider specific metadata as a span	2024-08-09 14:32:02 -07:00
Ishaan Jaff	0b9ad45790	refactor prom metrics	2024-08-09 09:02:23 -07:00
Ishaan Jaff	958e0fdfab	show warning about prometheus moving to enterprise	2024-08-07 12:46:26 -07:00
Ishaan Jaff	579f09b334	fix logging cool down deployment	2024-08-07 11:27:05 -07:00
Ishaan Jaff	99ecde7744	allow setting outage metrics	2024-08-07 10:36:18 -07:00
Ishaan Jaff	9a8fa9f047	emit deployment_partial_outage on prometheus	2024-08-07 09:56:01 -07:00
Ishaan Jaff	0304513b67	rename to set_llm_deployment_success_metrics	2024-08-07 09:46:08 -07:00
Ishaan Jaff	13d1caf94a	add set_remaining_tokens_requests_metric	2024-08-07 09:43:35 -07:00
Ishaan Jaff	237c3a0244	Merge pull request #5077 from BerriAI/litellm_fix_ui_emails ... [Fix] Fix testing emails through Admin UI	2024-08-06 16:41:01 -07:00