Commit graph

35 commits

Author SHA1 Message Date
Krrish Dholakia
547576f4d7 fix(redact_messages.py): fix pr 2024-06-22 23:27:13 -07:00
Krrish Dholakia
f3b8449bcc fix(redact_messages.py): fix get 2024-06-22 21:57:54 -07:00
Krish Dholakia
e66a569ab6 Merge pull request #4352 from msabramo/msabramo/turn-on-message-logging-via-request-header
Disable message redaction in logs via request header
2024-06-22 21:30:41 -07:00
Krish Dholakia
63d0defa6d Merge branch 'main' into litellm_dynamic_tpm_limits 2024-06-22 19:14:59 -07:00
Krrish Dholakia
4e6bc49b42 fix(litellm_logging.py): Fix gemini google ai studio system prompt logging
Fixes https://github.com/BerriAI/litellm/issues/2963
2024-06-22 09:11:23 -07:00
Krrish Dholakia
8f95381276 refactor: instrument 'dynamic_rate_limiting' callback on proxy 2024-06-22 00:32:29 -07:00
Marc Abramowitz
f66d1327d6 Rename request header 2024-06-21 21:52:55 -07:00
Marc Abramowitz
b564656651 Turn on message logging via request header 2024-06-21 20:21:19 -07:00
Krrish Dholakia
c7b06c42b7 refactor(litellm_logging.py): refactors how slack_alerting generates langfuse trace url
gets the url from logging object
2024-06-21 16:12:25 -07:00
Krrish Dholakia
61a4f35aa9 fix(litellm_logging.py): reset langfuse logger correctly 2024-06-19 22:09:38 -07:00
Ishaan Jaff
211c0329f4 fix test_langfuse_dynamic_logging 2024-06-19 20:53:58 -07:00
Krish Dholakia
63277d4b7a Merge pull request #4295 from BerriAI/litellm_gemini_pricing_2
Vertex AI - character based cost calculation
2024-06-19 19:17:09 -07:00
Krrish Dholakia
84043f4fd4 fix(litellm_logging.py): initialize global variables
Fixes https://github.com/BerriAI/litellm/issues/4281
2024-06-19 18:39:45 -07:00
Krrish Dholakia
edfe550165 feat(llm_cost_calc/google.py): do character based cost calculation for vertex ai
Calculate cost for vertex ai responses using characters in query/response

 Closes https://github.com/BerriAI/litellm/issues/4165
2024-06-19 17:18:42 -07:00
David Manouchehri
4c20bc93e5 fix(litellm_logging.py): Add missing import statement. 2024-06-19 05:48:46 +00:00
Krish Dholakia
4c5eb58fc9 Merge pull request #4266 from BerriAI/litellm_gemini_image_url
Support 'image url' to vertex ai / google ai studio gemini models
2024-06-18 20:39:25 -07:00
Ishaan Jaff
290ce5134f fix llm_request_utils 2024-06-18 20:06:58 -07:00
Ishaan Jaff
8a36a5e297 fix - log langfuse prompt 2024-06-18 19:25:51 -07:00
Krrish Dholakia
f745245ad5 fix(support-passing-image-url-to-gemini-via-vertex-ai): Closes https://github.com/BerriAI/litellm/issues/4262 2024-06-18 10:55:58 -07:00
Krrish Dholakia
a3e0267f1d fix(litellm_logging.py): fix error logging 2024-06-17 20:28:55 -07:00
Ishaan Jaff
ef20499bd9 use older logfire logging 2024-06-17 19:45:22 -07:00
Ishaan Jaff
0c7665c71f fix maintain older usage of logfire 2024-06-17 19:42:39 -07:00
Ishaan Jaff
94709e8309 fix deps 2024-06-17 19:33:10 -07:00
Ishaan Jaff
d89de2fd72 fix logfire 2024-06-17 19:21:35 -07:00
Ishaan Jaff
464a6e6256 fix - refactor logfire 2024-06-17 17:21:43 -07:00
Krrish Dholakia
4fd054f188 feat(cost_calculator.py): add cost calculating for dynamic context window (vertex ai / google ai studio) 2024-06-17 12:38:10 -07:00
Krrish Dholakia
fa6ddcde3c fix(litellm_logging.py): fix lago callback logic 2024-06-17 09:10:19 -07:00
Krrish Dholakia
019533d815 fix(utils.py): move 'set_callbacks' to litellm_logging.py 2024-06-15 12:02:30 -07:00
Krrish Dholakia
95aa27c10e fix(litellm_logging.py): fix import 2024-06-15 11:17:39 -07:00
Krrish Dholakia
9d7f5d503c refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines.
Easier debugging

 Reference: https://github.com/BerriAI/litellm/issues/4206
2024-06-15 10:57:20 -07:00
Ishaan Jaff
6c6c718997 fix - result 2024-06-14 21:15:49 -07:00
Ishaan Jaff
b5aa1ced06 fix redact_message_input_output_from_logging 2024-06-14 20:23:10 -07:00
Ishaan Jaff
84a546e801 test test_redact_msgs_from_logs 2024-06-13 13:49:23 -07:00
Ishaan Jaff
68f5db95e9 fix - redacting messages 2024-06-13 11:59:18 -07:00
Ishaan Jaff
72cc0618a4 fix - fix redacting messages litellm 2024-06-13 11:52:20 -07:00