51 commits

Author	SHA1	Message	Date
ishaan-jaff	f2d6aab8f5	(feat) proxy - use acces groups	2024-02-14 17:23:25 -08:00
ishaan-jaff	a575efb4ee	(fix) fix moderation test	2024-02-14 11:40:58 -08:00
Ishaan Jaff	003feda33f	Merge branch 'main' into litellm_dynamo_use_arn	2024-02-13 21:27:38 -08:00
ishaan-jaff	b954b56407	(test) bedrock proxy	2024-02-12 21:49:54 -08:00
ishaan-jaff	7d27690203	(fix) use correct value for os.environ dynamo	2024-02-12 21:41:13 -08:00
ishaan-jaff	2bdc5a81ec	(feat) ui - show user key when creating key	2024-02-12 16:55:34 -08:00
ishaan-jaff	640011379c	(feat) set timeout on proxy config	2024-02-09 17:42:35 -08:00
ishaan-jaff	9c597cbe0b	(feat) use base_model for azure cost	2024-02-07 16:33:35 -08:00
ishaan-jaff	4e3f048967	(feat) max_user_budget	2024-02-06 15:16:20 -08:00
Ishaan Jaff	7cb69c72c8	Merge branch 'main' into litellm_add_semantic_cache	2024-02-06 11:18:43 -08:00
ishaan-jaff	a1fc1e49c7	(fix) use semantic cache on proxy	2024-02-06 10:27:33 -08:00
ishaan-jaff	70a895329e	(feat) working semantic cache on proxy	2024-02-06 08:55:25 -08:00
ishaan-jaff	71814d8149	(feat) proxy - upperbound params /key/generate	2024-02-05 22:40:52 -08:00
ishaan-jaff	9891b12ec0	(fix) ui - if user logged in set allow_user_auth: True	2024-01-31 15:53:49 -08:00
ishaan-jaff	0ccec8711c	(docs) config.yaml	2024-01-29 14:38:32 -08:00
ishaan-jaff	21db161373	(docs) config.yaml	2024-01-29 14:35:45 -08:00
ishaan-jaff	55b95e87dd	(fix) SpendLogs Table	2024-01-26 13:23:51 -08:00
ishaan-jaff	6dc9be4d43	(docs) config.yaml	2024-01-25 11:41:35 -08:00
ishaan-jaff	6fb3f8f239	(docs) track max_budget on proxy config.yaml	2024-01-25 11:40:56 -08:00
ishaan-jaff	9aae60f162	(FIX) improve slack alerting messages	2024-01-24 16:07:46 -08:00
ishaan-jaff	9b39893980	v0 set arn number on dynamoDB /key/gen	2024-01-24 10:29:28 -08:00
ishaan-jaff	2d26875eb0	(fix) together_ai use sync generator	2024-01-23 20:07:26 -08:00
ishaan-jaff	fa2c94aacb	(docs) remove custom_auth in example config.yaml	2024-01-23 08:40:21 -08:00
ishaan-jaff	13eb40e7bd	v0 using custom_key_generate	2024-01-20 08:39:52 -08:00
ishaan-jaff	e6b5152e63	(chore) update load test	2024-01-19 08:52:17 -08:00
ishaan-jaff	d14d36af9a	(v0 ) working - writing /chat/completion spend tracking	2024-01-18 11:54:15 -08:00
ishaan-jaff	85b5395692	(test) use os.environ/ for azure vision enhance	2024-01-17 21:26:47 -08:00
ishaan-jaff	d59ac23e82	(fix) proxy, dynamo - allow users to set ssl_verify False	2024-01-16 16:13:55 -08:00
ishaan-jaff	6c6c62f032	(temp) ssl_verify=False for dynamo	2024-01-16 12:24:40 -08:00
ishaan-jaff	2873f587fd	(docs) add example post call rules to proxy	2024-01-15 20:58:50 -08:00
ishaan-jaff	5136d5980f	(fix) use gunicorn to start proxt	2024-01-10 17:09:03 +05:30
ishaan-jaff	119ff2fe05	(docs) show fallbacks on proxy_config	2024-01-08 08:54:10 +05:30
ishaan-jaff	8e10a1eb81	(docs) config with cloudflare exampel	2024-01-04 10:25:35 +05:30
Krrish Dholakia	071283c102	fix(router.py): init deployment_latency_map even if model_list is empty	2023-12-18 17:50:26 -08:00
ishaan-jaff	43b0da3ebc	(docs) - proxy_config.yaml	2023-12-11 09:06:27 -08:00
ishaan-jaff	900b8d66f3	(feat) proxy use model_group_alias_map	2023-12-06 20:23:24 -08:00
ishaan-jaff	44bf51601a	(feat) proxy - custom on failure callback	2023-12-06 14:43:47 -08:00
ishaan-jaff	368934d160	(feat) proxy: use async_callback function	2023-12-06 13:51:24 -08:00
ishaan-jaff	f3c3a9860a	(feat) /v1/model/info	2023-12-06 13:03:29 -08:00
ishaan-jaff	29fb97f88a	(feat) proxy - define model info	2023-12-06 12:06:30 -08:00
ishaan-jaff	de58dcc016	(feat) proxy - allow setting cost, context window	2023-12-06 11:42:56 -08:00
ishaan-jaff	aefa4f36f9	(docs) update yaml with chat/embedding/completion mode	2023-12-06 11:36:16 -08:00
ishaan-jaff	fd86876164	(feat) proxy: add mode in model info	2023-12-06 11:29:59 -08:00
ishaan-jaff	7c77cc3cfa	(feat) add mode for config.yaml health checks	2023-12-06 11:16:29 -08:00
ishaan-jaff	1e2a8869a9	(docs) proxy config with azure, openai embedding models	2023-12-06 10:45:07 -08:00
ishaan-jaff	15f54c3072	(docs) default config proxy	2023-12-04 11:30:53 -08:00
ishaan-jaff	ec579d4821	(chore) rename proxy: custom_callbacks	2023-12-04 10:49:01 -08:00
ishaan-jaff	6599263a85	(feat) proxy: custom callbacks	2023-12-04 09:10:12 -08:00
ishaan-jaff	b1bd799be8	(feat) proxy: use custom_logger	2023-12-04 08:26:06 -08:00
ishaan-jaff	b9e1c66ebe	(fix) general proxy config yaml	2023-12-02 11:32:29 -08:00