3426 commits

Author	SHA1	Message	Date
ishaan-jaff	770aa2e5c6	v0 max_budget per key	2024-01-23 13:47:21 -08:00
ishaan-jaff	16246f3ea2	(chore) docs	2024-01-22 16:59:52 -08:00
ishaan-jaff	9cbc388bd9	(test) auth errors - OpenAI compatible	2024-01-22 16:24:59 -08:00
ishaan-jaff	b03a751418	(feat) move Proxy Auth Exception to be OpenAI	2024-01-22 16:24:03 -08:00
Krrish Dholakia	36c6d3cd90	fix(utils.py): fix debug log	2024-01-22 15:15:34 -08:00
Krrish Dholakia	a343c4d22f	refactor(utils.py): fix linting errors	2024-01-22 15:15:34 -08:00
Krrish Dholakia	25311293e4	fix(utils.py): fix sync/async stream logging	2024-01-22 15:15:34 -08:00
Krrish Dholakia	074ea17325	fix: support streaming custom cost completion tracking	2024-01-22 15:15:34 -08:00
Krrish Dholakia	2ce4258cc0	fix(main.py): support custom pricing for embedding calls	2024-01-22 15:15:34 -08:00
Krrish Dholakia	39a1b4c3b5	fix(main.py): support custom pricing for embedding calls	2024-01-22 15:15:34 -08:00
Krrish Dholakia	276a685a59	feat(utils.py): support custom cost tracking per second ... https://github.com/BerriAI/litellm/issues/1374	2024-01-22 15:15:34 -08:00
Ishaan Jaff	6f8a6e1dae	Merge pull request #1555 from BerriAI/litellm_fix_router_tracking_tpm_rpm_with_fallbacks ... [Fix] Router - Usage Based Routing with fallbacks (Track the correct tpm/rpm)	2024-01-22 14:45:49 -08:00
ishaan-jaff	14585c9966	(fix) router - update model_group on fallback	2024-01-22 14:41:55 -08:00
ishaan-jaff	982cb04764	(feat) mock_response set custom_llm_provider in hidden param	2024-01-22 14:22:16 -08:00
ishaan-jaff	5807718a69	(test) usage based routing with fallbacks	2024-01-22 14:21:30 -08:00
Ishaan Jaff	5700d60e1a	Merge pull request #1538 from BerriAI/litellm_use_custom_key_gen ... [Feat] Proxy Auth - Use custom_key_generate	2024-01-22 14:21:19 -08:00
Krrish Dholakia	6c39b2855f	fix(utils.py): fix async/sync streaming logging	2024-01-22 13:54:51 -08:00
Krrish Dholakia	29800d1e01	fix(azure_dall_e_2.py): handle azure not returning a 'retry-after' param	2024-01-22 12:02:02 -08:00
ishaan-jaff	9988a39169	(ci/cd) deploy again	2024-01-22 08:25:17 -08:00
Krrish Dholakia	2165dcf6fb	fix(utils.py): fix callback logging	2024-01-21 00:56:30 -08:00
Krrish Dholakia	e2831e9c80	fix: fix proxy logging	2024-01-20 18:22:45 -08:00
Krrish Dholakia	09b7235b31	fix: support info level logging on pkg + proxy	2024-01-20 17:45:47 -08:00
Krrish Dholakia	3e5b743b89	fix(caching.py): add logging module support for caching	2024-01-20 17:34:29 -08:00
ishaan-jaff	ccfcc39681	(test) custom key/generate	2024-01-20 10:13:32 -08:00
ishaan-jaff	480f237fb5	(test) add custom_key_generate test	2024-01-20 09:59:04 -08:00
ishaan-jaff	13eb40e7bd	v0 using custom_key_generate	2024-01-20 08:39:52 -08:00
Ishaan Jaff	435d4b9279	Merge pull request #1534 from BerriAI/litellm_custom_cooldown_times ... [Feat] Litellm.Router set custom cooldown times	2024-01-19 20:49:17 -08:00
ishaan-jaff	ccbc47122c	(fix) test caching	2024-01-19 20:45:10 -08:00
ishaan-jaff	84684c50fa	(fix) router - timeout exception mapping	2024-01-19 20:30:41 -08:00
Krrish Dholakia	7cf0bb475f	fix(proxy_server.py): run all endpoints through custom auth	2024-01-19 20:24:33 -08:00
Krrish Dholakia	b07677c6be	fix(gemini.py): support streaming	2024-01-19 20:21:34 -08:00
Ishaan Jaff	b59e67f099	Merge pull request #1529 from BerriAI/litellm_router_add_type_hints ... [Feat] Add typehints for litellm.Router	2024-01-19 19:45:54 -08:00
ishaan-jaff	16b688d1ff	(feat) router - set custom cooldown times	2024-01-19 19:43:41 -08:00
ishaan-jaff	0fa9d8af82	(test) custom cooldown times - router	2024-01-19 19:41:52 -08:00
Krrish Dholakia	2c2163e4e5	fix(proxy_server.py): fix key info to handle pydantic v1	2024-01-19 18:52:09 -08:00
Krrish Dholakia	f2a8ceddc2	fix(utils.py): revert exception mapping change	2024-01-19 17:39:35 -08:00
Krrish Dholakia	f05aba1f85	fix(utils.py): add metadata to logging obj on setup, if exists	2024-01-19 17:29:47 -08:00
Krrish Dholakia	1ec5083542	fix(anthropic.py): fix pr for anthropic headers	2024-01-19 17:06:24 -08:00
Krrish Dholakia	1be4f7d2d1	fix(test_key_generate_prisma.py): fix testing ... n	2024-01-19 16:53:46 -08:00
ishaan-jaff	91e57bd039	(fix) add router typehints	2024-01-19 16:32:43 -08:00
ishaan-jaff	a9cf6cec80	(feat) add typehints for litellm.acompletion	2024-01-19 16:05:26 -08:00
ishaan-jaff	b730482aaf	v0	2024-01-19 15:49:37 -08:00
Ishaan Jaff	6134b655e8	Merge pull request #1513 from costly-ai/main ... Allow overriding headers for anthropic	2024-01-19 15:21:45 -08:00
ishaan-jaff	6bc7cc46b4	(docs) router debugging	2024-01-19 15:18:00 -08:00
Ishaan Jaff	73684bc93f	Merge pull request #1525 from BerriAI/litellm_router_improvements ... [Feat] Router improvements	2024-01-19 15:02:05 -08:00
ishaan-jaff	8a4f2c198b	(test) test_usage_based_routing	2024-01-19 14:59:56 -08:00
Krrish Dholakia	f5ced089d6	test(tests/): add unit testing for proxy server endpoints	2024-01-19 14:54:29 -08:00
ishaan-jaff	f408162449	(test) debug logs test - router	2024-01-19 14:22:18 -08:00
ishaan-jaff	0196ac6376	(test) router-fallbacks	2024-01-19 14:12:09 -08:00
Ishaan Jaff	b2b41727ce	Merge pull request #1524 from timothyasp/langsmith-project-env-bug-fix ... Langsmith: Add envs for project/run names; fix bug with None metadata	2024-01-19 14:04:16 -08:00