6033 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Ishaan Jaff	a0cd4e78fc	Merge branch 'main' into litellm_map_openai_auth_errors	2024-01-23 18:31:48 -08:00
Krish Dholakia	61cc8762f1	Merge pull request #1570 from BerriAI/litellm_reset_key_budget ... feat(proxy/utils.py): Support keys with budget duration (resets spend on duration end)	2024-01-23 18:10:42 -08:00
Krish Dholakia	9784d03d65	Merge branch 'main' into litellm_reset_key_budget	2024-01-23 18:10:32 -08:00
Krrish Dholakia	ef760cb21c	build(requirements.txt): add apscheduler to requirements	2024-01-23 17:56:11 -08:00
Krrish Dholakia	d6844f43c8	test(test_keys.py): use correct model name for token counting	2024-01-23 17:46:14 -08:00
ishaan-jaff	b3ce0ac728	(test) proxy_custom_auth use new exceptions	2024-01-23 17:36:13 -08:00
ishaan-jaff	d2675a1ff3	(test) switch dynamodb test to use new exceptions	2024-01-23 17:34:18 -08:00
ishaan-jaff	feb367bbb9	(feat) all endpoints raise OpenAI compatible exceptions	2024-01-23 17:32:47 -08:00
ishaan-jaff	37dd1114f2	(test) update prisma test	2024-01-23 17:30:01 -08:00
Krrish Dholakia	7b5e3b9934	refactor(proxy/utils.py): fix linting issue	2024-01-23 17:22:22 -08:00
Krish Dholakia	4ca4913468	Merge pull request #1574 from BerriAI/litellm_fix_streaming_spend_tracking ... [WIP] fix(utils.py): fix proxy streaming spend tracking	2024-01-23 17:07:40 -08:00
Ishaan Jaff	fdb6a7409b	Merge pull request #1575 from BerriAI/litellm_ui_view_spend ... [Feat] UI view spend per API Key	2024-01-23 17:02:19 -08:00
Krish Dholakia	5defa93a9d	Updated config.yml	2024-01-23 16:59:56 -08:00
ishaan-jaff	0e9339b390	(feat) /spend/logs	2024-01-23 16:57:51 -08:00
Krish Dholakia	7b8353e5c6	Updated config.yml	2024-01-23 16:52:08 -08:00
Krrish Dholakia	f47db44b4f	test(test_keys.py): fix streaming test	2024-01-23 16:27:45 -08:00
ishaan-jaff	8ae8edfdb4	(fix) add doc string for /spend/keys	2024-01-23 16:27:25 -08:00
ishaan-jaff	6a7126af93	(fix) UI	2024-01-23 16:24:13 -08:00
Krrish Dholakia	7e0adbb9bd	fix(proxy/utils.py): remove original auth sk-.. key before logging to spend logs	2024-01-23 16:19:32 -08:00
ishaan-jaff	e723df30f3	(feat) ui improvements	2024-01-23 16:14:39 -08:00
Krrish Dholakia	d52f5234b4	fix(utils.py): fix double hashing issue on spend logs, streaming usage metadata logging iss ... ue for spend logs	2024-01-23 16:14:01 -08:00
Krrish Dholakia	f8870fb48e	fix(utils.py): fix proxy streaming spend tracking	2024-01-23 15:59:03 -08:00
ishaan-jaff	1158ff4995	(feat) use cli args to start streamlit	2024-01-23 15:58:14 -08:00
ishaan-jaff	a2da9c30fb	(feat) add /spend/keys endpoint	2024-01-23 15:10:10 -08:00
Ishaan Jaff	5702be1601	Merge pull request #1572 from BerriAI/litellm_use_same_response_id_across_chunks ... [Fix] Streaming - Use same `response_id` across chunks	2024-01-23 14:40:50 -08:00
Krrish Dholakia	afada01ffc	fix(utils.py): fix streaming cost tracking	2024-01-23 14:39:45 -08:00
ishaan-jaff	2f11b92698	v0 view spend logs	2024-01-23 14:15:19 -08:00
Krish Dholakia	7eb96e46a4	Updated config.yml	2024-01-23 13:55:08 -08:00
ishaan-jaff	b40176810e	(test) dynamic timeouts - router	2024-01-23 13:27:49 -08:00
ishaan-jaff	64a387d09b	(test) test chunk_ids match across chunks for bedrock	2024-01-23 13:06:05 -08:00
ishaan-jaff	d455833dfb	(test) same response id across chunks	2024-01-23 12:57:04 -08:00
ishaan-jaff	39b4f19bd8	(fix) same response_id across chunk	2024-01-23 12:56:03 -08:00
ishaan-jaff	6d81da3f43	bump: version 1.18.10 → 1.18.11	2024-01-23 12:37:23 -08:00
Ishaan Jaff	861587e49d	Merge pull request #1569 from BerriAI/litellm_proxy_sagemaker_streaming ... [Fix] LiteLLM Proxy - Streaming Sagemaker Support on /chat/completions	2024-01-23 12:35:16 -08:00
Krrish Dholakia	b1a105e309	feat(proxy/utils.py): enable background process to reset key budgets	2024-01-23 12:33:13 -08:00
ishaan-jaff	e8cd27f2b7	(fix) sagemaker streaming support	2024-01-23 12:31:16 -08:00
ishaan-jaff	44e213e842	(fix) select_data_generator	2024-01-23 12:13:34 -08:00
ishaan-jaff	a61dbc1613	(fix) select_data_generator - sagemaker	2024-01-23 12:08:58 -08:00
ishaan-jaff	bd37a9cb5e	(fix) proxy - streaming sagemaker	2024-01-23 11:12:16 -08:00
Krrish Dholakia	01a2514b98	bump: version 1.18.9 → 1.18.10	2024-01-23 10:32:02 -08:00
Krrish Dholakia	05754ef238	test(test_router.py): add more testing for dynamically passing params to router	2024-01-23 10:31:49 -08:00
ishaan-jaff	6c1f8378c1	(test) fix sagemaker stream test	2024-01-23 10:07:13 -08:00
ishaan-jaff	3f37cf0bec	(test) router.py revert to stable version	2024-01-23 09:05:19 -08:00
ishaan-jaff	fa2c94aacb	(docs) remove custom_auth in example config.yaml	2024-01-23 08:40:21 -08:00
ishaan-jaff	d5b1cc7150	(ci/cd) run prisma.connect() before test	2024-01-23 08:36:49 -08:00
ishaan-jaff	5ad0971c5a	(test) fix incorrect test lol	2024-01-23 08:21:14 -08:00
Ishaan Jaff	5e72d1901b	Merge pull request #1534 from BerriAI/litellm_custom_cooldown_times ... [Feat] Litellm.Router set custom cooldown times	2024-01-23 08:05:59 -08:00
ishaan-jaff	24358a2a3e	(fix) router - update model_group on fallback	2024-01-23 08:04:29 -08:00
ishaan-jaff	22e26fcc4b	(fix) revert router.py to stable version	2024-01-23 08:03:29 -08:00
ishaan-jaff	b4cc227d1c	Revert "(feat) add typehints for litellm.acompletion" ... This reverts commit a9cf6cec80.	2024-01-23 07:57:09 -08:00