3565 commits

Author	SHA1	Message	Date
Ishaan Jaff	aceab2669f	test guardrails with API Key	2024-08-20 08:40:00 -07:00
Ishaan Jaff	30e985d79c	feat control guardrails per API Key	2024-08-20 08:16:28 -07:00
Krrish Dholakia	e747127e3b	fix(pass_through_endpoints.py): fix query param pass through	2024-08-19 21:38:30 -07:00
Krrish Dholakia	a85a932e25	fix(litellm_pre_call_utils.py): handle no query params in request	2024-08-19 21:09:03 -07:00
Ishaan Jaff	cae51fc7fc	fix _get_request_ip_address	2024-08-19 21:08:27 -07:00
Ishaan Jaff	1170b3a510	fix import error guardrails	2024-08-19 21:03:37 -07:00
Ishaan Jaff	3c1360f328	fix importing _ENTERPRISE_Aporia	2024-08-19 21:03:37 -07:00
Ishaan Jaff	9f927e0e4e	add testing for aporia guardrails	2024-08-19 21:03:37 -07:00
Ishaan Jaff	c9d9c6444e	fix aporia typo	2024-08-19 21:03:37 -07:00
Ishaan Jaff	eb9da06033	feat - guardrails v2	2024-08-19 21:03:37 -07:00
Ishaan Jaff	49a27320dc	doc aporia_w_litellm	2024-08-19 21:03:37 -07:00
Ishaan Jaff	507fab06f8	run during_call_hook	2024-08-19 21:03:37 -07:00
Ishaan Jaff	b0f546d551	feat - return applied guardrails in response headers	2024-08-19 21:03:37 -07:00
Ishaan Jaff	edf0507399	feat - allow accessing data post success call	2024-08-19 21:03:37 -07:00
Ishaan Jaff	1998809f18	feat run aporia as post call success hook	2024-08-19 21:03:37 -07:00
Krrish Dholakia	2aba1f17cc	feat(langfuse_endpoints.py): support team based logging for langfuse pass-through endpoints	2024-08-19 21:03:37 -07:00
Krrish Dholakia	c1a3d86fe4	feat(langfuse_endpoints.py): support langfuse pass through endpoints by default	2024-08-19 21:03:37 -07:00
Krrish Dholakia	5bde7b0c70	fix(proxy_cli.py): support database_host, database_username, database_password, database_name	2024-08-19 21:03:37 -07:00
Ishaan Jaff	b919a1a42e	fix import error guardrails	2024-08-19 20:59:39 -07:00
Ishaan Jaff	c7b3978655	Merge pull request #5288 from BerriAI/litellm_aporia_refactor ... [Feat] V2 aporia guardrails litellm	2024-08-19 20:41:45 -07:00
Ishaan Jaff	6f12f6dcf8	fix importing _ENTERPRISE_Aporia	2024-08-19 20:39:24 -07:00
Ishaan Jaff	0431600f7b	add testing for aporia guardrails	2024-08-19 18:50:14 -07:00
Ishaan Jaff	ca9c81470b	fix aporia typo	2024-08-19 18:34:45 -07:00
Ishaan Jaff	8cd1963c11	feat - guardrails v2	2024-08-19 18:24:20 -07:00
Krrish Dholakia	f9640d8a58	feat(langfuse_endpoints.py): support team based logging for langfuse pass-through endpoints	2024-08-19 17:58:39 -07:00
Krrish Dholakia	1701c48ad5	feat(langfuse_endpoints.py): support langfuse pass through endpoints by default	2024-08-19 17:28:34 -07:00
Krrish Dholakia	8ce8680a9a	fix(proxy_cli.py): support database_host, database_username, database_password, database_name	2024-08-19 16:17:45 -07:00
Ishaan Jaff	b7d4031f89	doc aporia_w_litellm	2024-08-19 14:36:55 -07:00
Krrish Dholakia	49416e121c	feat(azure.py): support dynamic api versions ... Closes https://github.com/BerriAI/litellm/issues/5228	2024-08-19 12:17:43 -07:00
Ishaan Jaff	a0361b0e76	run during_call_hook	2024-08-19 12:07:46 -07:00
Ishaan Jaff	613bd1babd	feat - return applied guardrails in response headers	2024-08-19 11:56:20 -07:00
Ishaan Jaff	4685b9909a	feat - allow accessing data post success call	2024-08-19 11:35:33 -07:00
Ishaan Jaff	8cb62213e1	feat run aporia as post call success hook	2024-08-19 11:25:31 -07:00
Krrish Dholakia	417547b6f9	fix(user_api_key_auth.py): log requester ip address to logs on request rejection ... Closes https://github.com/BerriAI/litellm/issues/5220	2024-08-19 11:03:58 -07:00
Krrish Dholakia	3cafebbc65	test(test_caching.py): re-introduce testing for s3 cache w/ streaming ... Closes https://github.com/BerriAI/litellm/issues/3268	2024-08-19 10:56:48 -07:00
Krrish Dholakia	cc42f96d6a	fix(ollama_chat.py): fix sync tool calling ... Fixes https://github.com/BerriAI/litellm/issues/5245	2024-08-19 08:31:46 -07:00
Ishaan Jaff	398295116f	inly write model tpm/rpm tracking when user set it	2024-08-18 09:58:09 -07:00
Krish Dholakia	f42ac2c9d8	Merge pull request #5264 from BerriAI/litellm_bedrock_pass_through ... feat: Bedrock pass-through endpoint support (All endpoints)	2024-08-18 09:55:22 -07:00
Krrish Dholakia	663a0c1b83	feat(Support-pass-through-for-bedrock-endpoints): Allows pass-through support for bedrock endpoints	2024-08-17 17:57:43 -07:00
Ishaan Jaff	83515e88ce	Merge pull request #5263 from BerriAI/litellm_support_access_groups ... [Feat-Proxy] Use model access groups for teams	2024-08-17 17:11:11 -07:00
Krrish Dholakia	f7a2e04426	feat(pass_through_endpoints.py): add pass-through support for all cohere endpoints	2024-08-17 16:57:55 -07:00
Ishaan Jaff	08db691dec	use model access groups for teams	2024-08-17 16:45:53 -07:00
Ishaan Jaff	eff874bf05	fix proxy all models test	2024-08-17 15:54:51 -07:00
Ishaan Jaff	b83fa87880	update tpm / rpm limit per model	2024-08-17 15:26:12 -07:00
Krrish Dholakia	db54b66457	style(vertex_httpx.py): make vertex error string more helpful	2024-08-17 15:09:55 -07:00
Ishaan Jaff	a60fc3ad70	Merge pull request #5261 from BerriAI/litellm_set_model_rpm_tpm_limit ... [Feat-Proxy] set rpm/tpm limits per api key per model	2024-08-17 14:30:54 -07:00
Krish Dholakia	ff6ff133ee	Merge pull request #5260 from BerriAI/google_ai_studio_pass_through ... Pass-through endpoints for Gemini - Google AI Studio	2024-08-17 13:51:51 -07:00
Ishaan Jaff	68b54bed85	add tpm limits per api key per model	2024-08-17 13:20:55 -07:00
Krrish Dholakia	fd44cf8d26	feat(pass_through_endpoints.py): support streaming requests	2024-08-17 12:46:57 -07:00
Ishaan Jaff	fa96610bbc	fix async_pre_call_hook in parallel request limiter	2024-08-17 12:42:28 -07:00