1635 commits

Author	SHA1	Message	Date
Ishaan Jaff	d61cc598b0	Merge pull request #4576 from BerriAI/litellm_encrypt_decrypt_using_salt ... [Refactor] Use helper function to encrypt/decrypt model credentials	2024-07-06 15:11:09 -07:00
Krish Dholakia	127f08ee67	Merge branch 'main' into litellm_tts_pricing	2024-07-06 14:57:34 -07:00
Ishaan Jaff	7f6f85ec3c	improve sign up flow - show missing env vars	2024-07-06 13:57:19 -07:00
Ishaan Jaff	a5d9a6cebd	init litellm router	2024-07-06 13:14:04 -07:00
Ishaan Jaff	2e956f7c01	fix checking store_model_in_deb	2024-07-06 11:35:28 -07:00
Krrish Dholakia	71edb28d6a	fix(proxy_server.py): fix embedding model exception mapping	2024-07-06 11:14:41 -07:00
Ishaan Jaff	8f0b55879f	move encrypt / decrypt to helper	2024-07-06 11:09:47 -07:00
Krrish Dholakia	d528b66db0	fix(proxy_server.py): fix callback check order	2024-07-05 14:06:33 -07:00
Krrish Dholakia	7618ec43b3	fix(proxy_server.py): support langfuse logging for rejected requests on /v1/chat/completions	2024-07-05 13:07:09 -07:00
Ishaan Jaff	c1c2f9faa4	fix backend invite link sign up	2024-07-04 15:55:04 -07:00
Ishaan Jaff	a457aec761	add doc string for v1/model/info	2024-07-04 13:21:02 -07:00
Ishaan Jaff	12343650e4	feat - allow looking up model_id in model info	2024-07-04 13:13:42 -07:00
Ishaan Jaff	129c2e0c4f	init guardrails on proxy	2024-07-03 14:18:12 -07:00
Ishaan Jaff	174b2b69df	Merge pull request #4518 from BerriAI/litellm_fix_background_health_checks ... [Fix-Proxy] Background health checks use deep copy of model list for _run_background_health_check	2024-07-02 16:42:34 -07:00
Krrish Dholakia	66c6992f8a	fix(slack_alerting.py): use in-memory cache for checking request status	2024-07-02 13:01:59 -07:00
Ishaan Jaff	cd6b121642	use deep copy of router for _run_background_health_check	2024-07-02 11:29:24 -07:00
Ishaan Jaff	4910029eeb	Merge pull request #4479 from BerriAI/litellm_fix_admin_ui_login_issue ... [Fix] Admin UI - fix error users we're seeing when logging in (use correct user_id when creating key for admin ui)	2024-06-29 20:00:45 -07:00
Ishaan Jaff	37352ba692	fix - use correct user_id when creating key for admin ui	2024-06-29 14:36:58 -07:00
Ishaan Jaff	c7e89a571e	fix error logs store exception in DB	2024-06-29 12:15:14 -07:00
Ishaan Jaff	954c6ec9ed	fix support pass through endpoints	2024-06-28 15:06:51 -07:00
Krish Dholakia	869275585a	Merge branch 'main' into litellm_response_cost_headers	2024-06-27 21:33:09 -07:00
Ishaan Jaff	0cd25c250d	Merge pull request #4447 from BerriAI/litellm_fix_error_on_v2_model_info ... [fix] error message on /v2/model info when no models exist	2024-06-27 16:33:19 -07:00
Ishaan Jaff	0c6cd2c894	fix error message on v2/model info	2024-06-27 16:29:11 -07:00
Ishaan Jaff	80960facfa	fix secret redaction logic	2024-06-27 13:19:54 -07:00
Krrish Dholakia	f533e1da09	fix(utils.py): return 'response_cost' in completion call ... Closes https://github.com/BerriAI/litellm/issues/4335	2024-06-26 17:55:57 -07:00
Ishaan Jaff	e22c9ba0cc	init secret detection callback	2024-06-25 16:25:14 -07:00
Ishaan Jaff	b9f83f48ba	Merge pull request #4364 from BerriAI/litellm_use_tracemalloc_mem_usage ... [Feat] add endpoint to debug memory util	2024-06-25 10:32:52 -07:00
Ishaan Jaff	dd048cf342	Merge pull request #4382 from BerriAI/litellm_ui_fix_login_bug ... [Fix] - Admin UI login bug	2024-06-24 08:19:37 -07:00
Ishaan Jaff	acbcfef5af	fix ui login bug	2024-06-24 07:54:08 -07:00
Krrish Dholakia	cea630022e	fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions ... Fixes https://github.com/BerriAI/litellm/issues/4338	2024-06-22 21:26:15 -07:00
Krish Dholakia	961e7ac95d	Merge branch 'main' into litellm_dynamic_tpm_limits	2024-06-22 19:14:59 -07:00
Ishaan Jaff	3105eaebc3	feat - add debug_utils	2024-06-22 16:12:42 -07:00
Krrish Dholakia	a31a05d45d	feat(dynamic_rate_limiter.py): working e2e	2024-06-22 14:41:22 -07:00
Ishaan Jaff	c86efa55a5	use hash of master key encode the jwt	2024-06-22 08:58:31 -07:00
Ishaan Jaff	03d1d9229d	ui - use cookies to return JWTs	2024-06-22 08:50:26 -07:00
Krrish Dholakia	532f24bfb7	refactor: instrument 'dynamic_rate_limiting' callback on proxy	2024-06-22 00:32:29 -07:00
Ishaan Jaff	29c2155796	fix cost tracking by tags	2024-06-21 16:49:57 -07:00
Ishaan Jaff	eb8a9b2654	fix - /moderation don't require a model	2024-06-21 16:00:43 -07:00
Ishaan Jaff	10e88a939d	backend - new endpoint to show cache hit stats	2024-06-21 13:08:54 -07:00
Ishaan Jaff	12f4fb3a42	fix refactor - add batches endpoints proxy server.py	2024-06-21 07:55:53 -07:00
Ishaan Jaff	558c00931e	Merge pull request #4322 from BerriAI/litellm_bug_fix_spend_tracking ... [Fix] user field and user_api_key_* is sometimes omitted randomly	2024-06-20 21:10:13 -07:00
Ishaan Jaff	c4b34946ed	fix update_cache function	2024-06-20 17:27:25 -07:00
Ishaan Jaff	0003de41c1	fix don't store bad api key in user api key cache	2024-06-20 16:55:12 -07:00
Krrish Dholakia	16889b8478	feat(router.py): allow user to call specific deployment via id ... Allows easier health checks for specific deployments by just passing in model id	2024-06-19 13:02:46 -07:00
Krish Dholakia	3a3b3667ee	Merge branch 'main' into litellm_aws_kms_fixes	2024-06-19 09:30:54 -07:00
Krrish Dholakia	164dccbbd4	fix(router.py): support adding models across multiple orgs, with 1 model definition	2024-06-18 19:57:10 -07:00
Krrish Dholakia	6558abf845	fix(proxy_server.py): track team spend for cached team object ... fixes issue where team budgets for jwt tokens weren't asserted	2024-06-18 17:10:12 -07:00
John HU	3d16bd6eb8	fix: strip llm credential before returning	2024-06-17 12:14:40 -07:00
Ishaan Jaff	b718e7ec79	fix- refactor proxy place internal user endpoints in sep file	2024-06-15 16:39:06 -07:00
Ishaan Jaff	f84941bdc0	Merge pull request #4217 from BerriAI/litellm_refactor_proxy_server ... [Refactor-Proxy] Make proxy_server.py < 10K lines (move management, key, endpoints to their own files)	2024-06-15 16:27:31 -07:00