654 commits

Author	SHA1	Message	Date
Ishaan Jaff	443e1b3bba	prometheus - safe update start / end time	2024-08-28 16:13:56 -07:00
Ishaan Jaff	fb5be57bb8	v0 add rerank on litellm proxy	2024-08-27 17:28:39 -07:00
Ishaan Jaff	a99258440c	fix use guardrail for pre call hook	2024-08-23 09:34:08 -07:00
Ishaan Jaff	4ac78a0765	fix prom latency metrics	2024-08-23 06:59:19 -07:00
Ishaan Jaff	36b550b8db	update promtheus metric names	2024-08-22 14:03:00 -07:00
Ishaan Jaff	06a362d35f	track litellm_request_latency_metric	2024-08-22 13:58:10 -07:00
Ishaan Jaff	65c0626aa4	fix init correct prometheus metrics	2024-08-22 13:29:35 -07:00
Krish Dholakia	e961810139	Merge pull request #5323 from MarkRx/feature/langsmith-ids ... Support LangSmith parent_run_id, trace_id, session_id	2024-08-21 15:38:50 -07:00
MarkRx	19e5299a6d	Support LangSmith parent_run_id, trace_id, session_id	2024-08-21 16:09:30 -04:00
Ishaan Jaff	1fdebfb0b7	working lakera ai during call hook	2024-08-20 14:39:04 -07:00
Ishaan Jaff	ae7cc6b198	fix _get_spend_report_for_time_range	2024-08-19 20:53:39 -07:00
Ishaan Jaff	8cd1963c11	feat - guardrails v2	2024-08-19 18:24:20 -07:00
Ishaan Jaff	4685b9909a	feat - allow accessing data post success call	2024-08-19 11:35:33 -07:00
Ishaan Jaff	feb8c3c5b4	Merge pull request #5259 from BerriAI/litellm_return_remaining_tokens_in_header ... [Feat] return `x-litellm-key-remaining-requests-{model}`: 1, `x-litellm-key-remaining-tokens-{model}: None` in response headers	2024-08-17 12:41:16 -07:00
Ishaan Jaff	5985c7e933	feat - use commong helper for getting model group	2024-08-17 10:46:04 -07:00
Ishaan Jaff	d630f77b73	show correct metric	2024-08-17 10:12:23 -07:00
Ishaan Jaff	412d30d362	add litellm-key-remaining-tokens on prometheus	2024-08-17 10:02:20 -07:00
Krrish Dholakia	61f4b71ef7	refactor: replace .error() with .exception() logging for better debugging on sentry	2024-08-16 09:22:47 -07:00
Krish Dholakia	6c3f37f8b4	Merge pull request #5235 from BerriAI/litellm_fix_s3_logs ... fix(s3.py): fix s3 logging payload to have valid json values	2024-08-15 23:00:18 -07:00
Krrish Dholakia	cda50e5d47	fix(s3.py): fix s3 logging payload to have valid json values ... Previously pydantic objects were being stringified, making them unparsable	2024-08-15 17:09:02 -07:00
Ishaan Jaff	a59ed00fd3	litellm always log cache_key on hits/misses	2024-08-15 09:59:58 -07:00
Ishaan Jaff	d8ef882905	fix langfuse log_provider_specific_information_as_span	2024-08-14 17:54:18 -07:00
Ishaan Jaff	98ea24aab0	Merge pull request #5202 from BerriAI/litellm_prom_prefix_litellm ... [Fix] Prometheus use 'litellm_' prefix for new deployment metrics	2024-08-14 09:50:36 -07:00
Ishaan Jaff	acadabe6c9	use litellm_ prefix for new deployment metrics	2024-08-14 09:08:14 -07:00
Ishaan Jaff	326d797111	log failure calls on gcs + testing	2024-08-14 08:55:51 -07:00
Ishaan Jaff	63af2942ab	feat log fail events on gcs	2024-08-14 08:39:16 -07:00
Krrish Dholakia	a9a3282031	fix(langsmith.py): support langsmith 'extra' field object ... Closes https://github.com/BerriAI/litellm/issues/5179	2024-08-13 15:20:50 -07:00
Ishaan Jaff	f1df555c79	allow using langfuse_default_tags	2024-08-13 12:26:37 -07:00
Ishaan Jaff	42bd5de7c0	feat allow controlling logged tags on langfuse	2024-08-13 12:24:01 -07:00
Ishaan Jaff	49b8dee14d	feat log responses in folders	2024-08-12 16:28:12 -07:00
Ishaan Jaff	19240b6cfd	feat gcs log user api key metadata	2024-08-12 16:06:10 -07:00
Ishaan Jaff	c401970522	Merge pull request #5166 from BerriAI/litellm_log_key_created_slack ... [Feat-Security] Send Slack Alert when CRUD ops done on Virtual Keys, Teams, Internal Users	2024-08-12 12:18:04 -07:00
Ishaan Jaff	4435a23121	send alert on all key events	2024-08-12 11:39:24 -07:00
Krrish Dholakia	b3c7d63ec1	fix(proxy_server.py): add info log when spend logs is skipped because disable_spend_logs=True.	2024-08-12 11:20:30 -07:00
Ishaan Jaff	30a54ef007	v0 log KeyCreatedEvent	2024-08-12 10:56:11 -07:00
Ishaan Jaff	dd9be6f160	allow setting PROMETHEUS_SELECTED_INSTANCE	2024-08-10 17:31:05 -07:00
Ishaan Jaff	e46009f3d2	Merge pull request #5154 from BerriAI/litellm_send_prometheus_fallbacks_from_slack ... [Feat-Proxy] send prometheus fallbacks stats to slack	2024-08-10 17:14:01 -07:00
Ishaan Jaff	cc3316104f	doc new prometheus metrics	2024-08-10 17:13:36 -07:00
Ishaan Jaff	28b930c0b7	feat - use api to get prometheus api metrics	2024-08-10 16:36:06 -07:00
Ishaan Jaff	35de40e6eb	add fallback_reports in slack alert types	2024-08-10 16:08:36 -07:00
Ishaan Jaff	4cdc5c2e25	feat add prometheus api to get data from endpoint	2024-08-10 16:07:08 -07:00
Ishaan Jaff	d1eedb04bd	prometheus log_success_fallback_event	2024-08-10 14:05:18 -07:00
Ishaan Jaff	dc0559226a	v0 add helper for loging success/fail fallback events	2024-08-10 13:26:39 -07:00
Ishaan Jaff	01f5456e3d	feat - track latency per llm deployment	2024-08-10 12:53:56 -07:00
Ishaan Jaff	83446926af	track llm_deployment_success_responses	2024-08-10 10:05:33 -07:00
Ishaan Jaff	05fba48cec	feat - refactor prometheus metrics	2024-08-10 09:14:38 -07:00
Krish Dholakia	e1a8e6c394	Merge pull request #5145 from BerriAI/litellm_fix_stream_options_logging ... fix(litellm_logging.py): fix calling success callback w/ stream_options true	2024-08-09 20:30:19 -07:00
Ishaan Jaff	4c4ccaff66	fix _hidden_params is None case	2024-08-09 19:17:11 -07:00
Krrish Dholakia	a26b23a3f4	fix(litellm_logging.py): fix calling success callback w/ stream_options true ... Fixes https://github.com/BerriAI/litellm/issues/5118	2024-08-09 18:20:42 -07:00
Ishaan Jaff	3e2a1fe0aa	log provider specific metadata as a span	2024-08-09 14:32:02 -07:00