1058 commits

Author	SHA1	Message	Date
Krish Dholakia	e36566a212	Merge branch 'main' into litellm_admin_ui_view_all_keys	2024-02-06 14:34:57 -08:00
Krish Dholakia	f70bbc7b2e	Merge branch 'main' into litellm_vertex_ai_streaming_fix	2024-02-06 14:33:54 -08:00
Krish Dholakia	4fe4d0c1f3	Merge branch 'main' into litellm_fix_proxy_health_readiness	2024-02-06 14:31:57 -08:00
ishaan-jaff	d9f407b4c2	(feat) show semantic-cache on health/readiness	2024-02-06 13:58:20 -08:00
ishaan-jaff	d05984ef13	(feat) working semantic cache on proxy	2024-02-06 13:58:13 -08:00
ishaan-jaff	3d0ece828a	(feat) show semantic-cache on health/readiness	2024-02-06 13:35:34 -08:00
ishaan-jaff	755f44613d	(feat) redis-semantic cache on proxy	2024-02-06 13:32:03 -08:00
ishaan-jaff	e74363b480	(fix) use semantic cache on proxy	2024-02-06 13:32:03 -08:00
ishaan-jaff	2881e7b111	(feat) working semantic cache on proxy	2024-02-06 13:32:03 -08:00
ishaan-jaff	4265c7affb	(feat) redis-semantic cache on proxy	2024-02-06 13:30:59 -08:00
ishaan-jaff	76e479542e	(fix) use semantic cache on proxy	2024-02-06 13:30:59 -08:00
ishaan-jaff	e9d00a92ed	(feat) working semantic cache on proxy	2024-02-06 13:30:59 -08:00
ishaan-jaff	a8d190f507	(feat) redis-semantic cache on proxy	2024-02-06 13:30:31 -08:00
ishaan-jaff	63e91eb2c4	(fix) use semantic cache on proxy	2024-02-06 13:30:31 -08:00
ishaan-jaff	a7b3148c99	(feat) working semantic cache on proxy	2024-02-06 13:30:30 -08:00
Ishaan Jaff	8a8f538329	Merge pull request #1829 from BerriAI/litellm_add_semantic_cache ... [Feat] Add Semantic Caching to litellm💰	2024-02-06 13:18:59 -08:00
ishaan-jaff	f8491feebd	(fix) parallel_request_limiter debug	2024-02-06 13:17:57 -08:00
ishaan-jaff	1ef8b459ce	(feat) proxy - upperbound params /key/generate	2024-02-06 13:17:57 -08:00
ishaan-jaff	0871327ff0	(feat) upperbound_key_generate_params	2024-02-06 13:17:57 -08:00
ishaan-jaff	bdb9fc8f20	(fix) parallel_request_limiter debug	2024-02-06 13:17:26 -08:00
ishaan-jaff	b4372457c4	(fix) parallel_request_limiter debug	2024-02-06 13:15:51 -08:00
Krrish Dholakia	e5fec98e1f	fix(proxy_server.py): do a health check on db before returning if proxy ready (if db connected)	2024-02-06 12:57:05 -08:00
ishaan-jaff	13fe72d6d5	(fix) parallel_request_limiter debug	2024-02-06 12:43:28 -08:00
Ishaan Jaff	7cb69c72c8	Merge branch 'main' into litellm_add_semantic_cache	2024-02-06 11:18:43 -08:00
ishaan-jaff	2732c47b70	(feat) redis-semantic cache on proxy	2024-02-06 10:35:21 -08:00
ishaan-jaff	a1fc1e49c7	(fix) use semantic cache on proxy	2024-02-06 10:27:33 -08:00
Krrish Dholakia	3afa5230d6	fix(utils.py): return finish reason for last vertex ai chunk	2024-02-06 09:21:03 -08:00
ishaan-jaff	70a895329e	(feat) working semantic cache on proxy	2024-02-06 08:55:25 -08:00
Krrish Dholakia	e59aca925a	fix(proxy_server.py): update dynamodb load config	2024-02-06 08:18:17 -08:00
ishaan-jaff	71814d8149	(feat) proxy - upperbound params /key/generate	2024-02-05 22:40:52 -08:00
ishaan-jaff	a712596d46	(feat) upperbound_key_generate_params	2024-02-05 22:38:47 -08:00
Krrish Dholakia	f2a7e2ee98	feat(ui): enable admin to view all valid keys created on the proxy	2024-02-05 19:28:57 -08:00
Krrish Dholakia	e35a7c32cb	fix(proxy/utils.py): if langfuse trace id passed in, just send that as part of alert	2024-02-05 16:34:33 -08:00
ishaan-jaff	1f7c8e86a7	(fix) make sure route is str	2024-02-05 16:22:36 -08:00
ishaan-jaff	8d7698f24d	(fix) litellm-ui keys can never access /chat/completions	2024-02-05 16:10:49 -08:00
Krrish Dholakia	77fe71ee08	fix(utils.py): support together ai function calling	2024-02-05 15:30:44 -08:00
Krish Dholakia	640572647a	Merge pull request #1805 from BerriAI/litellm_cost_tracking_image_gen ... feat(utils.py): support cost tracking for openai/azure image gen models	2024-02-03 22:23:22 -08:00
Krish Dholakia	28df60b609	Merge pull request #1809 from BerriAI/litellm_embedding_caching_updates ... Support caching individual items in embedding list (Async embedding only)	2024-02-03 21:04:23 -08:00
ishaan-jaff	c6aadcbd34	(feat) new ui build	2024-02-03 18:53:05 -08:00
Krish Dholakia	9ab59045a3	Merge branch 'main' into litellm_embedding_caching_updates	2024-02-03 18:08:47 -08:00
ishaan-jaff	1fa85c03b8	(feat) allow users to view their spend/logs	2024-02-03 17:33:19 -08:00
Krrish Dholakia	ef0171e063	feat(utils.py): support cost tracking for openai/azure image gen models	2024-02-03 17:09:54 -08:00
ishaan-jaff	44b6c73351	(feat) only allow master key to update users	2024-02-03 14:16:14 -08:00
ishaan-jaff	16364d3879	(feat) update max_budget in /user/update	2024-02-03 14:12:18 -08:00
ishaan-jaff	3f2f864cc8	(docs) /user/new	2024-02-03 10:59:06 -08:00
ishaan-jaff	c9958eb329	(feat) raise error when user_role not in known roles	2024-02-03 10:40:59 -08:00
ishaan-jaff	29885bbdc1	(feat) set user_role for Users	2024-02-03 10:23:50 -08:00
ishaan-jaff	93c7e1d457	(feat) add user_role to _types	2024-02-03 10:15:03 -08:00
ishaan-jaff	d41f1b4997	(feat) set user_role for Users on proxy	2024-02-03 10:11:42 -08:00
ishaan-jaff	aee477f4aa	(feat) add user_rol to schema.prisma	2024-02-03 10:09:27 -08:00