Commit graph

515 commits

Author SHA1 Message Date
Krrish Dholakia
c70d4ffafb fix(router.py): set cooldown_time: per model 2024-06-25 16:51:55 -07:00
Krrish Dholakia
589a83c82d fix(langfuse.py): cleanup 2024-06-24 21:43:40 -07:00
Krrish Dholakia
94830ec281 fix(router.py): log rejected router requests to langfuse
Fixes issue where rejected requests weren't being logged
2024-06-24 17:52:01 -07:00
7HR4IZ3
15fc99a3ff fix: Lunary integration
Fixes the bug of litellm not logging system messages to lunary
2024-06-24 14:09:40 +01:00
Krish Dholakia
63d0defa6d Merge branch 'main' into litellm_dynamic_tpm_limits 2024-06-22 19:14:59 -07:00
Krrish Dholakia
0430807178 feat(dynamic_rate_limiter.py): update cache with active project 2024-06-21 20:25:40 -07:00
Krrish Dholakia
c7b06c42b7 refactor(litellm_logging.py): refactors how slack_alerting generates langfuse trace url
gets the url from logging object
2024-06-21 16:12:25 -07:00
Krrish Dholakia
174b345766 fix(proxy/utils.py): fix add langfuse trace id to alert
Fixing the import after refactor
2024-06-21 14:55:09 -07:00
Krrish Dholakia
84043f4fd4 fix(litellm_logging.py): initialize global variables
Fixes https://github.com/BerriAI/litellm/issues/4281
2024-06-19 18:39:45 -07:00
Ishaan Jaff
e799ef02f0 Merge pull request #4275 from BerriAI/litellm_fix_langfuse_log_prompts
[Fix] Use Langfuse prompt Object with LiteLLM Proxy
2024-06-18 20:09:13 -07:00
Ishaan Jaff
373f232cdb feat - _add_prompt_to_generation_params for langfuse 2024-06-18 19:55:16 -07:00
Nejc Habjan
da343c7aca fix: add more type hints to init methods 2024-06-18 12:09:39 +02:00
Ishaan Jaff
b343911d59 fix - otel fixes 2024-06-17 19:15:14 -07:00
Krish Dholakia
daf0e477bb Merge pull request #4141 from lunary-ai/main
fix: lunary callback tags
2024-06-17 16:13:01 -07:00
Krrish Dholakia
fa6ddcde3c fix(litellm_logging.py): fix lago callback logic 2024-06-17 09:10:19 -07:00
Hugues Chocart
bf967392a9 Merge branch 'BerriAI:main' into main 2024-06-17 11:15:23 -03:00
Hannes Burrichter
cc20f49530 Merge branch 'BerriAI:main' into main 2024-06-16 15:15:00 +02:00
Hannes Burrichter
db1d72e113 Set Langfuse output to null for embedding responses 2024-06-16 15:14:34 +02:00
Ishaan Jaff
39ca66f46d fix - remove deprecated clickhouse utils 2024-06-15 15:33:26 -07:00
Ishaan Jaff
4bc2bfb176 fix - proxy refactor user_api_key_auth 2024-06-15 10:33:58 -07:00
Krrish Dholakia
ffe04e129d fix(slack_alerting.py): check if webhook is in alerting list before triggering it
Fixes https://github.com/BerriAI/litellm/issues/4193
2024-06-14 21:20:58 -07:00
Ishaan Jaff
8988b2e909 Merge pull request #4209 from BerriAI/litellm_send_email_alerts_budget_exceeded
[Feat] send email alerts when budget exceeded
2024-06-14 20:23:19 -07:00
Ishaan Jaff
c0dd9d275d fix - send emails on crossing team budget 2024-06-14 19:48:22 -07:00
Krish Dholakia
9e280ba235 Merge pull request #4205 from BerriAI/litellm_alerting_metadata
fix(slack_alerting.py): allow new 'alerting_metadata' arg
2024-06-14 19:04:30 -07:00
Ishaan Jaff
7e7f867860 fix - send team budget crossed 2024-06-14 18:52:13 -07:00
Ishaan Jaff
cdffda16a0 add email alerting for budgets 2024-06-14 18:40:56 -07:00
Ishaan Jaff
80d97c4fef feat - send email alert to team members 2024-06-14 18:36:04 -07:00
Krrish Dholakia
1cce99300f fix(slack_alerting.py): allow new 'alerting_metadata' arg
Allows user to pass in additional alerting metadata for debugging
2024-06-14 16:06:47 -07:00
Ishaan Jaff
bd341c69b5 fix - send alert on router level exceptions 2024-06-14 08:41:12 -07:00
Krish Dholakia
8c7aa24959 Merge pull request #3559 from Intellegam/main
Langfuse integration support for `parent_observation_id` parameter
2024-06-14 06:55:45 -07:00
Ishaan Jaff
ee9e2ef980 feat - add remaining budget for key on prometheus 2024-06-13 14:37:02 -07:00
Ishaan Jaff
8d3c9aeea3 feat - add remaining team budget gauge 2024-06-13 14:28:25 -07:00
hughcrt
89cee153eb add tests 2024-06-13 15:10:24 -03:00
Hugues Chocart
efffa37466 Merge branch 'BerriAI:main' into main 2024-06-13 14:38:37 -03:00
Bram van Meurs
3bd7ad6edf feat(prometheus): add api_team_alias to exported labels 2024-06-13 12:50:40 +02:00
Hugues Chocart
d94f1db5d4 fix last commit 2024-06-12 09:55:23 -03:00
hughcrt
93cb18c633 fix: lunary callback tags 2024-06-11 21:30:11 -03:00
Ishaan Jaff
4859244e67 feat - otel log /team exceptions 2024-06-11 16:27:07 -07:00
Ishaan Jaff
9d78e1bd5f feat - log management endpoint logs to otel 2024-06-11 16:09:11 -07:00
Ishaan Jaff
2d5904c9a5 feat - use traceparent to proporgate OTEL traces 2024-06-11 13:57:31 -07:00
Ishaan Jaff
6c19b76edc fix OTEL semantic conventions does not exist 2024-06-11 12:28:38 -07:00
Ishaan Jaff
ef9349e6a2 Merge pull request #4086 from BerriAI/litellm_sdk_tool_calling_fic
[Fix] Litellm sdk - allow ChatCompletionMessageToolCall, and Function to be used as dict
2024-06-08 20:48:54 -07:00
Krish Dholakia
3be558c4bb Merge pull request #4080 from BerriAI/litellm_predibase_exception_mapping
fix(utils.py): improved predibase exception mapping
2024-06-08 20:27:44 -07:00
Ishaan Jaff
8c5802d506 Merge pull request #4078 from BerriAI/litellm_low_raw_request_response_otel
[FEAT]- OTEL Log raw LLM request/response on OTEL
2024-06-08 19:49:28 -07:00
Ishaan Jaff
af61eff8e3 feat - allow ChatCompletionMessageToolCall, and Function to be used as dict 2024-06-08 19:47:31 -07:00
Ishaan Jaff
21ac0efaae fix - otel set tools attribute 2024-06-08 19:40:29 -07:00
Ishaan Jaff
638c4acbb2 fix - show custom llm provider on OTEL span 2024-06-08 19:13:10 -07:00
Ishaan Jaff
0d83ffb4e2 minor fix - _debug_otel 2024-06-08 18:16:35 -07:00
Ishaan Jaff
e7f6c5d651 fix otel don't log raw request / response when turn_off_message_logging 2024-06-08 14:37:06 -07:00
Krrish Dholakia
39ee6be477 fix(utils.py): improved predibase exception mapping
adds unit testing + better coverage for predibase errors
2024-06-08 14:32:43 -07:00