1848 commits

Author	SHA1	Message	Date
Ishaan Jaff	319690ab5e	feat - guardrails v2	2024-08-19 18:24:20 -07:00
Krrish Dholakia	4b15f5bc83	feat(langfuse_endpoints.py): support langfuse pass through endpoints by default	2024-08-19 17:28:34 -07:00
Ishaan Jaff	f16e0472c2	feat - return applied guardrails in response headers	2024-08-19 11:56:20 -07:00
Ishaan Jaff	b4bca8db82	feat - allow accessing data post success call	2024-08-19 11:35:33 -07:00
Krish Dholakia	5e6700f985	Merge pull request #5260 from BerriAI/google_ai_studio_pass_through ... Pass-through endpoints for Gemini - Google AI Studio	2024-08-17 13:51:51 -07:00
Ishaan Jaff	db8f789318	Merge pull request #5259 from BerriAI/litellm_return_remaining_tokens_in_header ... [Feat] return `x-litellm-key-remaining-requests-{model}`: 1, `x-litellm-key-remaining-tokens-{model}: None` in response headers	2024-08-17 12:41:16 -07:00
Ishaan Jaff	9f6630912d	feat return rmng tokens for model for api key	2024-08-17 12:35:10 -07:00
Krrish Dholakia	29bedae79f	feat(google_ai_studio_endpoints.py): support pass-through endpoint for all google ai studio requests ... New Feature	2024-08-17 10:46:59 -07:00
Ishaan Jaff	a62277a6aa	feat - use commong helper for getting model group	2024-08-17 10:46:04 -07:00
Krrish Dholakia	2874b94fb1	refactor: replace .error() with .exception() logging for better debugging on sentry	2024-08-16 09:22:47 -07:00
Krish Dholakia	0f1b48162c	Merge branch 'main' into litellm_pass_through_endpoints_api	2024-08-15 22:39:19 -07:00
Krrish Dholakia	1c2decbfdd	feat(ui): for adding pass-through endpoints	2024-08-15 21:58:11 -07:00
Krrish Dholakia	362605ba65	feat(pass_through_endpoints.py): initial working CRUD endpoints for /pass_through_endoints	2024-08-15 21:23:26 -07:00
Ishaan Jaff	654df03678	refactor use 1 util for llm routing	2024-08-15 08:42:20 -07:00
Ishaan Jaff	4cbde8af39	use route_request for making llm call	2024-08-15 08:16:44 -07:00
Krrish Dholakia	7a67551927	feat(pass_through_endpoints.py): initial commit of crud endpoints for pass through endpoints	2024-08-14 21:36:07 -07:00
Krrish Dholakia	3ea4a3b8bd	feat(proxy_server.py): support returning available fields for pass_through_endpoints via `/config/field/list	2024-08-14 19:07:10 -07:00
Ishaan Jaff	2e3e06844c	feat read config from s3	2024-08-13 20:18:59 -07:00
Krrish Dholakia	3fa00408f1	fix(proxy_server.py): add info log when spend logs is skipped because disable_spend_logs=True.	2024-08-12 11:20:30 -07:00
Ishaan Jaff	dcf50ff219	feat add cron job for sending stats from prometheus	2024-08-10 16:56:03 -07:00
Krrish Dholakia	c919c15c4a	fix(proxy_server.py): ensure internal_user params only apply to internal_user role	2024-08-08 17:50:29 -07:00
Krrish Dholakia	488a78e5f4	fix(proxy_server.py): respect internal_user_budget_duration for sso user	2024-08-08 17:28:28 -07:00
Krrish Dholakia	384f8f4f54	fix(anthropic.py): fix translation from /v1/messages format to openai format	2024-08-08 17:19:12 -07:00
Krrish Dholakia	eb292e0b31	feat: set max_internal_budget for user w/ sso	2024-08-08 12:44:07 -07:00
Ishaan Jaff	25e6733da3	support provider wildcard routing	2024-08-07 14:20:22 -07:00
Ishaan Jaff	7bcb088ac0	clean up unused func	2024-08-06 20:58:51 -07:00
Ishaan Jaff	22ca6d6d30	fix forward ui requests when base url set	2024-08-06 18:10:34 -07:00
Ishaan Jaff	e207ac577e	add redirect_ui_middleware	2024-08-06 18:01:23 -07:00
Ishaan Jaff	53451834bd	Merge pull request #5077 from BerriAI/litellm_fix_ui_emails ... [Fix] Fix testing emails through Admin UI	2024-08-06 16:41:01 -07:00
Ishaan Jaff	7fbd0855b6	update alerting settings on ui	2024-08-06 16:05:33 -07:00
Ishaan Jaff	6a46899521	add debug statements on docker	2024-08-06 15:29:49 -07:00
Krrish Dholakia	5ffadd631d	feat(proxy_server.py): allow restricting allowed email domains for the UI	2024-08-06 12:53:03 -07:00
Ishaan Jaff	8ad43780cf	add debugging utils to print when connecting to prisma	2024-08-05 19:19:28 -07:00
Ishaan Jaff	357ca893f8	build ui on custom path	2024-08-05 16:34:37 -07:00
Ishaan Jaff	e6f4d7a81d	set PROXY_BASE_URL when server root path set	2024-08-05 15:48:44 -07:00
Krish Dholakia	88a2428ee6	Merge branch 'main' into litellm_anthropic_api_streaming	2024-08-03 21:16:50 -07:00
Krrish Dholakia	5810708c71	feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint ... Fixes https://github.com/BerriAI/litellm/issues/5011	2024-08-03 20:16:19 -07:00
Ishaan Jaff	c206a9c2d7	set native vertex endpoints	2024-08-03 16:52:03 -07:00
Krrish Dholakia	e6bc7e938a	fix(utils.py): handle scenario where model="azure/*" and custom_llm_provider="azure" ... Fixes https://github.com/BerriAI/litellm/issues/4912	2024-08-02 17:48:53 -07:00
Krrish Dholakia	e60bec92ac	feat(ui): add ability to enable traceloop + langsmith via ui	2024-07-31 21:40:29 -07:00
Krrish Dholakia	c5e38b3bec	feat(ui): add braintrust logging to ui	2024-07-31 21:15:19 -07:00
Ishaan Jaff	4f21ce2873	Merge pull request #4987 from BerriAI/litellm_add_ft_endpoints ... [Feat-Proxy] Add List fine-tuning jobs	2024-07-31 16:49:59 -07:00
Ishaan Jaff	f90f3f28fb	fix fine tuning endpoint postion on swagger	2024-07-31 16:46:58 -07:00
Ishaan Jaff	8a266a0493	fix routes order	2024-07-31 16:36:50 -07:00
Ishaan Jaff	d7c0e0c471	allow setting files config	2024-07-31 15:28:41 -07:00
Krrish Dholakia	368af6975a	fix(http_handler.py): correctly re-raise timeout exception	2024-07-31 14:51:28 -07:00
Ishaan Jaff	967d18d03d	read ft config	2024-07-31 13:31:00 -07:00
Ishaan Jaff	2a87aa0463	fix endpoint to create fine tuning jobs	2024-07-31 12:44:01 -07:00
Ishaan Jaff	0a3dbe0659	fix linting errors	2024-07-30 12:51:39 -07:00
Ishaan Jaff	b64e0fad81	test batches endpoint on proxy	2024-07-30 09:46:30 -07:00