971 commits

Author	SHA1	Message	Date
Krrish Dholakia	43e07503d6	fix(utils.py): fix logging	2024-01-26 22:25:20 -08:00
Krrish Dholakia	a299ac2328	fix(utils.py): enable cost tracking for image gen models on proxy	2024-01-26 20:51:13 -08:00
Krish Dholakia	b36f628fc8	Merge pull request #1641 from BerriAI/litellm_bedrock_region_based_pricing ... feat(utils.py): support region based pricing for bedrock + use bedrock's token counts if given	2024-01-26 20:28:16 -08:00
Krrish Dholakia	f5da95685a	feat(utils.py): support region based pricing for bedrock + use bedrock's token counts if given	2024-01-26 14:53:58 -08:00
ishaan-jaff	0fc8876ea2	(feat) support dimensions param	2024-01-26 10:55:38 -08:00
Krish Dholakia	612f74a426	Merge pull request #1618 from BerriAI/litellm_sagemaker_cost_tracking_fixes ... fix(utils.py): fix sagemaker cost tracking for streaming	2024-01-25 19:01:57 -08:00
Krrish Dholakia	ac131b3824	fix(utils.py): completion_cost support for image gen models	2024-01-25 18:08:18 -08:00
Krrish Dholakia	1ae22ea16d	refactor: trigger new bump	2024-01-25 16:40:23 -08:00
Krrish Dholakia	014f83c847	fix(main.py): allow vertex ai project and location to be set in completion() call	2024-01-25 16:40:23 -08:00
Krrish Dholakia	76468cc351	refactor: trigger new bump	2024-01-25 16:06:01 -08:00
Krrish Dholakia	72275ad8cb	fix(main.py): fix logging event loop for async logging but sync streaming	2024-01-25 15:59:53 -08:00
Krrish Dholakia	fbab810189	fix(main.py): allow vertex ai project and location to be set in completion() call	2024-01-25 15:00:51 -08:00
Krrish Dholakia	bbe6a92eb9	fix(main.py): fix order of assembly for streaming chunks	2024-01-25 14:51:08 -08:00
Krrish Dholakia	09ec6d6458	fix(utils.py): fix sagemaker async logging for sync streaming ... https://github.com/BerriAI/litellm/issues/1592	2024-01-25 12:49:45 -08:00
Krish Dholakia	6501fdb76e	Merge branch 'main' into litellm_global_spend_updates	2024-01-24 20:20:15 -08:00
Krrish Dholakia	43f139fafd	fix(ollama_chat.py): fix default token counting for ollama chat	2024-01-24 20:09:17 -08:00
Krrish Dholakia	574208f005	fix(proxy_server.py): track cost for global proxy	2024-01-24 16:06:10 -08:00
Krish Dholakia	9784d03d65	Merge branch 'main' into litellm_reset_key_budget	2024-01-23 18:10:32 -08:00
Krrish Dholakia	d6844f43c8	test(test_keys.py): use correct model name for token counting	2024-01-23 17:46:14 -08:00
Krish Dholakia	4ca4913468	Merge pull request #1574 from BerriAI/litellm_fix_streaming_spend_tracking ... [WIP] fix(utils.py): fix proxy streaming spend tracking	2024-01-23 17:07:40 -08:00
Krrish Dholakia	d52f5234b4	fix(utils.py): fix double hashing issue on spend logs, streaming usage metadata logging iss ... ue for spend logs	2024-01-23 16:14:01 -08:00
Krrish Dholakia	f8870fb48e	fix(utils.py): fix proxy streaming spend tracking	2024-01-23 15:59:03 -08:00
Krrish Dholakia	afada01ffc	fix(utils.py): fix streaming cost tracking	2024-01-23 14:39:45 -08:00
ishaan-jaff	39b4f19bd8	(fix) same response_id across chunk	2024-01-23 12:56:03 -08:00
ishaan-jaff	e8cd27f2b7	(fix) sagemaker streaming support	2024-01-23 12:31:16 -08:00
Krrish Dholakia	23b59ac9b8	fix(utils.py): fix content policy violation check for streaming	2024-01-23 06:55:04 -08:00
Ishaan Jaff	6d105754d7	Merge pull request #1561 from BerriAI/litellm_sagemaker_streaming ... [Feat] Add REAL Sagemaker streaming	2024-01-22 22:10:20 -08:00
ishaan-jaff	c8084bb9d9	v0 sagemaker_stream	2024-01-22 21:53:16 -08:00
Krrish Dholakia	5e0d99b2ef	fix(router.py): fix order of dereferenced dictionaries	2024-01-22 21:42:25 -08:00
Krish Dholakia	bedb08bdef	Merge pull request #1557 from BerriAI/litellm_emit_spend_logs ... feat(utils.py): emit response cost as part of logs	2024-01-22 21:02:40 -08:00
Krrish Dholakia	11e3ee4411	test: fix tests	2024-01-22 20:20:17 -08:00
Krrish Dholakia	3e8c8ef507	fix(openai.py): fix linting issue	2024-01-22 18:20:15 -08:00
Krish Dholakia	b1cced16fc	Merge pull request #1556 from BerriAI/litellm_importlib_issue ... fix(utils.py): move from pkg_resources to importlib	2024-01-22 15:56:07 -08:00
Krrish Dholakia	e917d0eee6	feat(utils.py): emit response cost as part of logs	2024-01-22 15:53:04 -08:00
Krrish Dholakia	36c6d3cd90	fix(utils.py): fix debug log	2024-01-22 15:15:34 -08:00
Krrish Dholakia	a343c4d22f	refactor(utils.py): fix linting errors	2024-01-22 15:15:34 -08:00
Krrish Dholakia	074ea17325	fix: support streaming custom cost completion tracking	2024-01-22 15:15:34 -08:00
Krrish Dholakia	2ce4258cc0	fix(main.py): support custom pricing for embedding calls	2024-01-22 15:15:34 -08:00
Krrish Dholakia	276a685a59	feat(utils.py): support custom cost tracking per second ... https://github.com/BerriAI/litellm/issues/1374	2024-01-22 15:15:34 -08:00
Krrish Dholakia	128cf4a81d	fix(utils.py): move from pkg_resources to importlib	2024-01-22 15:05:09 -08:00
Krrish Dholakia	6c39b2855f	fix(utils.py): fix async/sync streaming logging	2024-01-22 13:54:51 -08:00
Krrish Dholakia	2165dcf6fb	fix(utils.py): fix callback logging	2024-01-21 00:56:30 -08:00
Krrish Dholakia	e2831e9c80	fix: fix proxy logging	2024-01-20 18:22:45 -08:00
Krrish Dholakia	09b7235b31	fix: support info level logging on pkg + proxy	2024-01-20 17:45:47 -08:00
Krrish Dholakia	b07677c6be	fix(gemini.py): support streaming	2024-01-19 20:21:34 -08:00
Krrish Dholakia	f2a8ceddc2	fix(utils.py): revert exception mapping change	2024-01-19 17:39:35 -08:00
Krrish Dholakia	f05aba1f85	fix(utils.py): add metadata to logging obj on setup, if exists	2024-01-19 17:29:47 -08:00
ishaan-jaff	6a695477ba	(fix) async langfuse logger	2024-01-19 10:44:51 -08:00
ishaan-jaff	f2cfb76920	(fix) use asyncio run_in_executor	2024-01-19 09:52:51 -08:00
ishaan-jaff	a9c5b02303	(v0) fix	2024-01-19 08:51:14 -08:00