Commit graph

53 commits

Author SHA1 Message Date
Krrish Dholakia
1b14202582 fix(litellm_logging.py): fix 'use_custom_pricing_for_model' helper function 2024-07-06 11:20:55 -07:00
Krish Dholakia
ea9718a848
Merge branch 'main' into litellm_proxy_tts_pricing 2024-07-06 11:16:07 -07:00
Krrish Dholakia
3f83e8a8d4 fix(caching.py): fix async redis health check 2024-07-06 09:14:29 -07:00
Krrish Dholakia
6e43cdcb17 feat(litellm_logging.py): support cost tracking for tts calls 2024-07-05 22:09:08 -07:00
Krrish Dholakia
407639cc7d fix(cost_calculator.py): support openai+azure tts calls 2024-07-05 20:58:08 -07:00
Ishaan Jaff
982dfe64c0
Merge pull request #4567 from BerriAI/litellm_add_galileo_logging
[Feat] Add Galileo Logging Callback
2024-07-05 19:55:30 -07:00
Ishaan Jaff
e9319085f8 feat - init galileo logger 2024-07-05 19:17:09 -07:00
Krrish Dholakia
6090fd37fa fix(test_proxy_reject_logging.py): fix test 2024-07-05 19:09:37 -07:00
Krrish Dholakia
b1b21b0340 fix(proxy/utils.py): support logging rejected requests to langfuse, etc. 2024-07-05 14:39:35 -07:00
Krrish Dholakia
19c982d0f9 fix: linting fixes 2024-07-03 21:55:00 -07:00
Krish Dholakia
6c5c8bbb28
Revert "fix(vertex_anthropic.py): Vertex Anthropic tool calling - native params " 2024-07-03 17:55:37 -07:00
Krrish Dholakia
7007ace6c2 fix(vertex_anthropic.py): Updates the vertex anthropic endpoint to do tool calling with the anthropic api params 2024-07-03 15:28:31 -07:00
Krrish Dholakia
a389f6bff4 fix(core_helpers.py): map vertex ai 'RECITATION' finish reason to 'content_filter'
Fixes https://github.com/BerriAI/litellm/issues/4491
2024-07-01 12:48:56 -07:00
Krish Dholakia
58d0330cd7
Merge pull request #4478 from BerriAI/litellm_support_response_schema_param_vertex_ai_old
feat(vertex_httpx.py): support the 'response_schema' param for older vertex ai models
2024-06-29 20:17:39 -07:00
Krrish Dholakia
b699d9a8b9 fix(utils.py): support json schema validation 2024-06-29 15:05:52 -07:00
Ishaan Jaff
a6bc878a2a fix - error str in OpenAI, Azure exception 2024-06-29 13:11:55 -07:00
Krrish Dholakia
d421486a45 fix(token_counter.py): New `get_modified_max_tokens' helper func
Fixes https://github.com/BerriAI/litellm/issues/4439
2024-06-27 15:38:09 -07:00
Krrish Dholakia
d98e00d1e0 fix(router.py): set cooldown_time: per model 2024-06-25 16:51:55 -07:00
Krrish Dholakia
d857d82b0e fix(redact_messages.py): fix pr 2024-06-22 23:27:13 -07:00
Krrish Dholakia
dc43ffb771 fix(redact_messages.py): fix get 2024-06-22 21:57:54 -07:00
Krish Dholakia
9bffa9a48e
Merge pull request #4352 from msabramo/msabramo/turn-on-message-logging-via-request-header
Disable message redaction in logs via request header
2024-06-22 21:30:41 -07:00
Krish Dholakia
961e7ac95d
Merge branch 'main' into litellm_dynamic_tpm_limits 2024-06-22 19:14:59 -07:00
Krrish Dholakia
f814f24d9d fix(litellm_logging.py): Fix gemini google ai studio system prompt logging
Fixes https://github.com/BerriAI/litellm/issues/2963
2024-06-22 09:11:23 -07:00
Krrish Dholakia
532f24bfb7 refactor: instrument 'dynamic_rate_limiting' callback on proxy 2024-06-22 00:32:29 -07:00
Marc Abramowitz
b7452cb383 Rename request header 2024-06-21 21:52:55 -07:00
Marc Abramowitz
91e2b661ca Turn on message logging via request header 2024-06-21 20:21:19 -07:00
Krrish Dholakia
2584120012 refactor(litellm_logging.py): refactors how slack_alerting generates langfuse trace url
gets the url from logging object
2024-06-21 16:12:25 -07:00
Krrish Dholakia
e5e81ca3b7 fix(litellm_logging.py): reset langfuse logger correctly 2024-06-19 22:09:38 -07:00
Ishaan Jaff
ca0b404299 fix test_langfuse_dynamic_logging 2024-06-19 20:53:58 -07:00
Krish Dholakia
71716bec48
Merge pull request #4295 from BerriAI/litellm_gemini_pricing_2
Vertex AI - character based cost calculation
2024-06-19 19:17:09 -07:00
Krrish Dholakia
682ec33aa0 fix(litellm_logging.py): initialize global variables
Fixes https://github.com/BerriAI/litellm/issues/4281
2024-06-19 18:39:45 -07:00
Krrish Dholakia
16da21e839 feat(llm_cost_calc/google.py): do character based cost calculation for vertex ai
Calculate cost for vertex ai responses using characters in query/response

 Closes https://github.com/BerriAI/litellm/issues/4165
2024-06-19 17:18:42 -07:00
David Manouchehri
c04680d54b
fix(litellm_logging.py): Add missing import statement. 2024-06-19 05:48:46 +00:00
Krish Dholakia
0c2c02ba8d
Merge pull request #4266 from BerriAI/litellm_gemini_image_url
Support 'image url' to vertex ai / google ai studio gemini models
2024-06-18 20:39:25 -07:00
Ishaan Jaff
f3ac3f85cd fix llm_request_utils 2024-06-18 20:06:58 -07:00
Ishaan Jaff
a26a023ff8 fix - log langfuse prompt 2024-06-18 19:25:51 -07:00
Krrish Dholakia
3f7252c422 fix(support-passing-image-url-to-gemini-via-vertex-ai): Closes https://github.com/BerriAI/litellm/issues/4262 2024-06-18 10:55:58 -07:00
Krrish Dholakia
84285b9dbb fix(litellm_logging.py): fix error logging 2024-06-17 20:28:55 -07:00
Ishaan Jaff
e37092aab6 use older logfire logging 2024-06-17 19:45:22 -07:00
Ishaan Jaff
c93463b535 fix maintain older usage of logfire 2024-06-17 19:42:39 -07:00
Ishaan Jaff
61ff712a08 fix deps 2024-06-17 19:33:10 -07:00
Ishaan Jaff
4a75e57b6f fix logfire 2024-06-17 19:21:35 -07:00
Ishaan Jaff
18f1a42c5a fix - refactor logfire 2024-06-17 17:21:43 -07:00
Krrish Dholakia
f597aa432b feat(cost_calculator.py): add cost calculating for dynamic context window (vertex ai / google ai studio) 2024-06-17 12:38:10 -07:00
Krrish Dholakia
2623bb260f fix(litellm_logging.py): fix lago callback logic 2024-06-17 09:10:19 -07:00
Krrish Dholakia
af88e55d46 fix(utils.py): move 'set_callbacks' to litellm_logging.py 2024-06-15 12:02:30 -07:00
Krrish Dholakia
c08e3b62dc fix(litellm_logging.py): fix import 2024-06-15 11:17:39 -07:00
Krrish Dholakia
4f91205530 refactor(utils.py): refactor Logging to it's own class. Cut down utils.py to <10k lines.
Easier debugging

 Reference: https://github.com/BerriAI/litellm/issues/4206
2024-06-15 10:57:20 -07:00
Ishaan Jaff
cb7521b11f fix - result 2024-06-14 21:15:49 -07:00
Ishaan Jaff
b6fee33307 fix redact_message_input_output_from_logging 2024-06-14 20:23:10 -07:00