Commit graph

567 commits

Author SHA1 Message Date
Ishaan Jaff
174d6eaf13 OTEL allow setting deployment environment 2024-06-26 11:50:16 -07:00
Krrish Dholakia
b4c8af771d fix(langfuse.py): use clean metadata instead of deepcopy 2024-06-25 18:20:39 -07:00
Krrish Dholakia
d98e00d1e0 fix(router.py): set cooldown_time: per model 2024-06-25 16:51:55 -07:00
Krrish Dholakia
f8b390d421 fix(langfuse.py): cleanup 2024-06-24 21:43:40 -07:00
Krrish Dholakia
a4bea47a2d fix(router.py): log rejected router requests to langfuse
Fixes issue where rejected requests weren't being logged
2024-06-24 17:52:01 -07:00
7HR4IZ3
515dc9acc7
fix: Lunary integration
Fixes the bug of litellm not logging system messages to lunary
2024-06-24 14:09:40 +01:00
Krish Dholakia
961e7ac95d
Merge branch 'main' into litellm_dynamic_tpm_limits 2024-06-22 19:14:59 -07:00
Krrish Dholakia
a028600932 feat(dynamic_rate_limiter.py): update cache with active project 2024-06-21 20:25:40 -07:00
Krrish Dholakia
2584120012 refactor(litellm_logging.py): refactors how slack_alerting generates langfuse trace url
gets the url from logging object
2024-06-21 16:12:25 -07:00
Krrish Dholakia
941574a921 fix(proxy/utils.py): fix add langfuse trace id to alert
Fixing the import after refactor
2024-06-21 14:55:09 -07:00
Krrish Dholakia
682ec33aa0 fix(litellm_logging.py): initialize global variables
Fixes https://github.com/BerriAI/litellm/issues/4281
2024-06-19 18:39:45 -07:00
Ishaan Jaff
e1b646c304
Merge pull request #4275 from BerriAI/litellm_fix_langfuse_log_prompts
[Fix] Use Langfuse prompt Object with LiteLLM Proxy
2024-06-18 20:09:13 -07:00
Ishaan Jaff
04038a0bef feat - _add_prompt_to_generation_params for langfuse 2024-06-18 19:55:16 -07:00
Nejc Habjan
2ecd614a73
fix: add more type hints to init methods 2024-06-18 12:09:39 +02:00
Ishaan Jaff
253b504199 fix - otel fixes 2024-06-17 19:15:14 -07:00
Krish Dholakia
0cf99c47d4
Merge pull request #4141 from lunary-ai/main
fix: lunary callback tags
2024-06-17 16:13:01 -07:00
Krrish Dholakia
2623bb260f fix(litellm_logging.py): fix lago callback logic 2024-06-17 09:10:19 -07:00
Hugues Chocart
722e89b6a2
Merge branch 'BerriAI:main' into main 2024-06-17 11:15:23 -03:00
Hannes Burrichter
1b644fa0fc
Merge branch 'BerriAI:main' into main 2024-06-16 15:15:00 +02:00
Hannes Burrichter
d338a94a57 Set Langfuse output to null for embedding responses 2024-06-16 15:14:34 +02:00
Ishaan Jaff
2f9aa308f1 fix - remove deprecated clickhouse utils 2024-06-15 15:33:26 -07:00
Ishaan Jaff
da3ae00bd6 fix - proxy refactor user_api_key_auth 2024-06-15 10:33:58 -07:00
Krrish Dholakia
74d8605f5c fix(slack_alerting.py): check if webhook is in alerting list before triggering it
Fixes https://github.com/BerriAI/litellm/issues/4193
2024-06-14 21:20:58 -07:00
Ishaan Jaff
4bfd46d0a6
Merge pull request #4209 from BerriAI/litellm_send_email_alerts_budget_exceeded
[Feat] send email alerts when budget exceeded
2024-06-14 20:23:19 -07:00
Ishaan Jaff
408899dac8 fix - send emails on crossing team budget 2024-06-14 19:48:22 -07:00
Krish Dholakia
3ef5d40b73
Merge pull request #4205 from BerriAI/litellm_alerting_metadata
fix(slack_alerting.py): allow new 'alerting_metadata' arg
2024-06-14 19:04:30 -07:00
Ishaan Jaff
0ec52e57b4 fix - send team budget crossed 2024-06-14 18:52:13 -07:00
Ishaan Jaff
f6d0c6c272 add email alerting for budgets 2024-06-14 18:40:56 -07:00
Ishaan Jaff
84b281bf2a feat - send email alert to team members 2024-06-14 18:36:04 -07:00
Krrish Dholakia
e18002023a fix(slack_alerting.py): allow new 'alerting_metadata' arg
Allows user to pass in additional alerting metadata for debugging
2024-06-14 16:06:47 -07:00
Ishaan Jaff
a0ecc6f414 fix - send alert on router level exceptions 2024-06-14 08:41:12 -07:00
Krish Dholakia
056913fd70
Merge pull request #3559 from Intellegam/main
Langfuse integration support for `parent_observation_id` parameter
2024-06-14 06:55:45 -07:00
Ishaan Jaff
9b340fb2f8 feat - add remaining budget for key on prometheus 2024-06-13 14:37:02 -07:00
Ishaan Jaff
51157c148f feat - add remaining team budget gauge 2024-06-13 14:28:25 -07:00
hughcrt
e0608eae72
add tests 2024-06-13 15:10:24 -03:00
Hugues Chocart
03f63b9a79
Merge branch 'BerriAI:main' into main 2024-06-13 14:38:37 -03:00
Bram van Meurs
270dad93d5
feat(prometheus): add api_team_alias to exported labels 2024-06-13 12:50:40 +02:00
Hugues Chocart
9927d1e427
fix last commit 2024-06-12 09:55:23 -03:00
hughcrt
418caf800d fix: lunary callback tags 2024-06-11 21:30:11 -03:00
Ishaan Jaff
427f2ee1fa feat - otel log /team exceptions 2024-06-11 16:27:07 -07:00
Ishaan Jaff
13cb49688a feat - log management endpoint logs to otel 2024-06-11 16:09:11 -07:00
Ishaan Jaff
7ce1289548 feat - use traceparent to proporgate OTEL traces 2024-06-11 13:57:31 -07:00
Ishaan Jaff
1af3d34d8b fix OTEL semantic conventions does not exist 2024-06-11 12:28:38 -07:00
Ishaan Jaff
39bbc5d8ac
Merge pull request #4086 from BerriAI/litellm_sdk_tool_calling_fic
[Fix] Litellm sdk - allow ChatCompletionMessageToolCall, and Function to be used as dict
2024-06-08 20:48:54 -07:00
Krish Dholakia
b4fc4abb76
Merge pull request #4080 from BerriAI/litellm_predibase_exception_mapping
fix(utils.py): improved predibase exception mapping
2024-06-08 20:27:44 -07:00
Ishaan Jaff
0d3add56a6
Merge pull request #4078 from BerriAI/litellm_low_raw_request_response_otel
[FEAT]- OTEL Log raw LLM request/response on OTEL
2024-06-08 19:49:28 -07:00
Ishaan Jaff
0253c2b213 feat - allow ChatCompletionMessageToolCall, and Function to be used as dict 2024-06-08 19:47:31 -07:00
Ishaan Jaff
5b73bcfe31 fix - otel set tools attribute 2024-06-08 19:40:29 -07:00
Ishaan Jaff
8b187eb66d fix - show custom llm provider on OTEL span 2024-06-08 19:13:10 -07:00
Ishaan Jaff
090f350169 minor fix - _debug_otel 2024-06-08 18:16:35 -07:00