1799 commits

Author	SHA1	Message	Date
Krrish Dholakia	db2b7bfd4e	fix(openai.py): fix linting issue	2024-01-22 18:20:15 -08:00
Krrish Dholakia	2ea18785ca	feat(utils.py): emit response cost as part of logs	2024-01-22 15:53:04 -08:00
Ishaan Jaff	742142f9bf	Merge branch 'main' into litellm_budget_per_key	2024-01-22 15:49:57 -08:00
Krrish Dholakia	e423aeff85	fix: support streaming custom cost completion tracking	2024-01-22 15:15:34 -08:00
Ishaan Jaff	8ba29125be	Merge pull request #1538 from BerriAI/litellm_use_custom_key_gen ... [Feat] Proxy Auth - Use custom_key_generate	2024-01-22 14:21:19 -08:00
ishaan-jaff	b7f1ad5355	(fix) spend tracking per key - when no cache hit	2024-01-22 13:18:33 -08:00
ishaan-jaff	1ba8e703e9	(feat) working budgets per key	2024-01-22 12:13:19 -08:00
ishaan-jaff	b13e3a0b90	(feat) working create budgets per key	2024-01-22 11:58:20 -08:00
Krrish Dholakia	59483da18b	fix: fix proxy logging	2024-01-20 18:22:45 -08:00
Krrish Dholakia	2acdcc6671	fix: support info level logging on pkg + proxy	2024-01-20 17:45:47 -08:00
Krrish Dholakia	a5afe5bf41	fix(caching.py): add logging module support for caching	2024-01-20 17:34:29 -08:00
ishaan-jaff	e3b605c703	v0 using custom_key_generate	2024-01-20 08:39:52 -08:00
Krrish Dholakia	d0265a4341	fix(proxy_server.py): run all endpoints through custom auth	2024-01-19 20:24:33 -08:00
Krrish Dholakia	27d2f2246e	fix(proxy_server.py): fix key info to handle pydantic v1	2024-01-19 18:52:09 -08:00
Krrish Dholakia	beca1eaae7	test(tests/): add unit testing for proxy server endpoints	2024-01-19 14:54:29 -08:00
Krrish Dholakia	43d52a4657	docs(health.md): add /health/readiness and /health/liveliness to docs	2024-01-19 08:45:23 -08:00
Ishaan Jaff	fe6ac13654	Merge pull request #1509 from BerriAI/litellm_track_cost_user_id_chat_completions ... [Feat] Proxy - Track Cost Per User (Using `user` passed to requests)	2024-01-18 20:44:02 -08:00
Krrish Dholakia	164a132751	Merge branch 'main' into litellm_tpm_rpm_rate_limits	2024-01-18 19:10:07 -08:00
ishaan-jaff	c4133314a5	(fix) safe access litellm_params, proxy_server_request	2024-01-18 18:05:51 -08:00
ishaan-jaff	9e952ef7e9	(feat) use user_id passed to request - cost track	2024-01-18 17:51:48 -08:00
Krrish Dholakia	9c0179d132	fix(proxy_server.py): support setting tpm/rpm limits per user / per key	2024-01-18 17:03:18 -08:00
Ishaan Jaff	6c6c2facad	Merge pull request #1500 from BerriAI/litellm_create_keys_with_team_id ... [Feat] /key/generate - create keys with`team_id`	2024-01-18 16:35:14 -08:00
ishaan-jaff	6aff6e5c1d	(fix) add team_id to doc string	2024-01-18 15:23:05 -08:00
ishaan-jaff	f2f2cabfcd	(feat) write team_id to User Table	2024-01-18 14:42:46 -08:00
Ishaan Jaff	e6ec5a2f8c	Merge pull request #1498 from BerriAI/litellm_spend_tracking_logs ... [Feat] Proxy - Add Spend tracking logs	2024-01-18 14:21:51 -08:00
ishaan-jaff	d50ba0e7ac	(fix) write team_id to key table	2024-01-18 13:54:08 -08:00
ishaan-jaff	260bb5f098	(fix) support team_id for /key/generate	2024-01-18 13:48:52 -08:00
ishaan-jaff	fab53c236d	(fix) use get_logging_payload	2024-01-18 13:40:48 -08:00
Krrish Dholakia	44553bcc3a	fix(parallel_request_limiter.py): decrement count for failed llm calls ... https://github.com/BerriAI/litellm/issues/1477	2024-01-18 12:42:14 -08:00
ishaan-jaff	d42db904f6	(feat) spendLogs table DynamoDB	2024-01-18 12:39:11 -08:00
ishaan-jaff	8855276500	(feat) track cost streaming	2024-01-18 12:21:56 -08:00
ishaan-jaff	d8420b430d	(v0 ) working - writing /chat/completion spend tracking	2024-01-18 11:54:15 -08:00
Krrish Dholakia	c00117679b	fix(proxy_server.py): show all models user has access to in /models	2024-01-18 10:56:37 -08:00
Krrish Dholakia	c2813594ea	fix(proxy/utils.py): fix isoformat to string logic	2024-01-18 09:32:30 -08:00
Krish Dholakia	05682f6eb4	Merge pull request #1483 from BerriAI/litellm_model_access_groups_feature ... feat(proxy_server.py): support model access groups	2024-01-17 18:16:53 -08:00
ishaan-jaff	622251ab8d	(fix) cleanup	2024-01-17 17:54:18 -08:00
ishaan-jaff	85dc671647	(feat) proxy - set endpoint called in callback	2024-01-17 17:44:28 -08:00
Krrish Dholakia	7a80df83b2	fix(proxy_server.py): handle empty insert_data response	2024-01-17 17:28:23 -08:00
ishaan-jaff	dda4ef58f9	(feat) proxy - log key metadata in calback	2024-01-17 16:42:49 -08:00
Krrish Dholakia	5242200243	feat(proxy_server.py): support model access groups	2024-01-17 15:45:31 -08:00
ishaan-jaff	d947929b18	(docs) add doc string for /key/delete	2024-01-17 15:27:48 -08:00
ishaan-jaff	e5c2193d7c	(fix) /key/delete	2024-01-17 14:54:29 -08:00
ishaan-jaff	20eaea951f	(test) expired key prisma	2024-01-17 13:24:15 -08:00
ishaan-jaff	1af44af91f	(v0) fix	2024-01-16 20:44:00 -08:00
ishaan-jaff	0011f9efa1	(ci/cd) undo change from PR 1464	2024-01-16 19:53:43 -08:00
ishaan-jaff	57af57d4e9	(fix) when budget, spend is None comparison	2024-01-16 17:35:39 -08:00
ishaan-jaff	ed93164e92	(ci/cd) fixes	2024-01-16 16:03:42 -08:00
ishaan-jaff	772547d625	(fix) proxy check expires time	2024-01-16 15:38:58 -08:00
ishaan-jaff	e8da289599	(fix) reject Auth if user crosses budget	2024-01-16 14:58:00 -08:00
ishaan-jaff	9bb5061815	(fix) check if budget crossed for api_key	2024-01-16 14:20:19 -08:00