3417 commits

Author	SHA1	Message	Date
Ishaan Jaff	6fd1685106	add debug statements when connected to prisma db	2024-08-05 19:13:46 -07:00
Krrish Dholakia	24e20718e4	feat(proxy_cli.py): support iam-based auth to rds ... Initial pr for iam-based auth support for rds	2024-08-05 17:35:48 -07:00
Ishaan Jaff	357ca893f8	build ui on custom path	2024-08-05 16:34:37 -07:00
Ishaan Jaff	e6f4d7a81d	set PROXY_BASE_URL when server root path set	2024-08-05 15:48:44 -07:00
Krrish Dholakia	b5e22bde06	fix: bump default allowed_fails + reduce default db pool limit ... Fixes issues with running proxy server in production	2024-08-05 15:07:46 -07:00
Ishaan Jaff	3d8befa655	fix get_request_route	2024-08-05 10:33:40 -07:00
Ishaan Jaff	7c7c8fe102	use get_request_route	2024-08-05 10:13:47 -07:00
Ishaan Jaff	9abe55fa86	add get_request_route	2024-08-05 10:12:34 -07:00
Krrish Dholakia	8fea55ffd7	fix(user_api_key_auth.py): handle older user_role's ... Fixes issue where older user_role's (e.g. app_user) weren't being recognized. + Adds testing for it	2024-08-05 08:57:06 -07:00
Krish Dholakia	88a2428ee6	Merge branch 'main' into litellm_anthropic_api_streaming	2024-08-03 21:16:50 -07:00
Krish Dholakia	3b79ff2ea6	Merge branch 'main' into litellm_loadbalancing_test	2024-08-03 20:29:54 -07:00
Krrish Dholakia	5810708c71	feat(anthropic_adapter.py): support streaming requests for /v1/messages endpoint ... Fixes https://github.com/BerriAI/litellm/issues/5011	2024-08-03 20:16:19 -07:00
Ishaan Jaff	5afb55576e	docs default vertex	2024-08-03 18:09:48 -07:00
Ishaan Jaff	e6e539fc4a	add vertex ai countTokens endpoint	2024-08-03 17:34:10 -07:00
Ishaan Jaff	01cd07fa75	add vertex embeddings endpoints	2024-08-03 17:26:49 -07:00
Ishaan Jaff	beb7f1b2c6	add vertex generateContent	2024-08-03 17:17:54 -07:00
Ishaan Jaff	a293bebdb1	working code for vertex ai routes	2024-08-03 16:56:33 -07:00
Ishaan Jaff	568fd8aa63	use native endpoints	2024-08-03 16:52:43 -07:00
Ishaan Jaff	c206a9c2d7	set native vertex endpoints	2024-08-03 16:52:03 -07:00
Krrish Dholakia	b0d2727bbf	feat(router.py): add flag for mock testing loadbalancing for rate limit errors	2024-08-03 12:34:11 -07:00
Ishaan Jaff	08d7b0f5c9	support v1/projects/tuningJobs	2024-08-03 11:46:39 -07:00
Ishaan Jaff	e07a38cca4	Merge pull request #5030 from BerriAI/litellm_add_vertex_ft_proxy ... [Feat] Add support for Vertex AI Fine tuning on LiteLLM Proxy	2024-08-03 08:29:11 -07:00
Ishaan Jaff	eb59eecedf	add vertex example on config.yaml	2024-08-03 08:26:59 -07:00
Ishaan Jaff	b2d4ab04a7	add vertex ai ft on proxy	2024-08-02 18:26:36 -07:00
Krrish Dholakia	e6bc7e938a	fix(utils.py): handle scenario where model="azure/*" and custom_llm_provider="azure" ... Fixes https://github.com/BerriAI/litellm/issues/4912	2024-08-02 17:48:53 -07:00
Krrish Dholakia	996763af1e	fix(user_api_key_auth.py): fix linting errors	2024-08-02 16:34:32 -07:00
Krrish Dholakia	cbad9e7502	build(ui): allow admin_viewer to view teams tab ... Allows admin viewe role to see available teams on proxy ui	2024-08-02 16:19:40 -07:00
Krrish Dholakia	857ec4af18	feat(litellm_logging.py): log exception response headers to langfuse	2024-08-01 18:07:47 -07:00
Ishaan Jaff	1a8d27299b	init gcs using gcs_bucket	2024-08-01 18:07:38 -07:00
Ishaan Jaff	31fba8c462	use itellm.forward_traceparent_to_llm_provider	2024-08-01 18:07:38 -07:00
Ishaan Jaff	54e0b75295	ui new build	2024-08-01 18:07:38 -07:00
Krrish Dholakia	08541d056c	fix(litellm_logging.py): use 1 cost calc function across response headers + logging integrations ... Ensures consistent cost calculation when azure base models are used	2024-08-01 10:26:59 -07:00
Krrish Dholakia	b9d12ea2ec	build(model_prices_and_context_window.json): add azure gpt-4o-mini regional + global standard pricing to model cost map	2024-08-01 09:44:40 -07:00
Krrish Dholakia	e60bec92ac	feat(ui): add ability to enable traceloop + langsmith via ui	2024-07-31 21:40:29 -07:00
Krrish Dholakia	c5e38b3bec	feat(ui): add braintrust logging to ui	2024-07-31 21:15:19 -07:00
Krrish Dholakia	c9efe0bb14	fix(_types.py): fix finetuning endpoints	2024-07-31 19:07:37 -07:00
Ishaan Jaff	4f21ce2873	Merge pull request #4987 from BerriAI/litellm_add_ft_endpoints ... [Feat-Proxy] Add List fine-tuning jobs	2024-07-31 16:49:59 -07:00
Ishaan Jaff	f90f3f28fb	fix fine tuning endpoint postion on swagger	2024-07-31 16:46:58 -07:00
Ishaan Jaff	dce1853f8c	enforce ft endpoints as premium feature	2024-07-31 16:43:54 -07:00
Ishaan Jaff	844d5c3ae0	fix mark fine tuning endpoints as enteprrise	2024-07-31 16:41:14 -07:00
Ishaan Jaff	8a266a0493	fix routes order	2024-07-31 16:36:50 -07:00
Ishaan Jaff	af0e3ac23a	fix linting errors	2024-07-31 16:30:08 -07:00
Ishaan Jaff	b1196c6afa	fix POST files	2024-07-31 16:27:59 -07:00
Ishaan Jaff	098e1eb8ad	fix reading files/ft config	2024-07-31 16:23:36 -07:00
Ishaan Jaff	6d88f4f31b	fix cancel ft job route	2024-07-31 16:19:15 -07:00
Ishaan Jaff	577fbcd770	add ft jobs in list of allowed routes	2024-07-31 16:19:00 -07:00
Ishaan Jaff	30b339739d	add cancel endpoint	2024-07-31 16:12:36 -07:00
Ishaan Jaff	956a082215	add GET fine_tuning/jobs	2024-07-31 15:58:35 -07:00
Ishaan Jaff	7cded198c2	add test for ft endpoints on azure	2024-07-31 15:30:26 -07:00
Ishaan Jaff	91c787a77b	add examples on config	2024-07-31 15:29:06 -07:00