2140 commits

Author	SHA1	Message	Date
Krrish Dholakia	ddea62fdb1	refactor(proxy_server.py): clean up print statements in proxy server	2023-12-05 11:14:16 -08:00
Krrish Dholakia	b46c73a46e	fix: fix proxy testing	2023-12-05 11:13:09 -08:00
ishaan-jaff	a602d59645	(fix) bug in completion: _check_valid_arg	2023-12-05 10:00:54 -08:00
ishaan-jaff	732a049513	(fix) patch max_retries for non openai llms	2023-12-05 09:36:38 -08:00
ishaan-jaff	3bdf61f02a	(test) test bedrock on router	2023-12-05 09:35:08 -08:00
ishaan-jaff	13261287ec	(fix) proxy: bug non OpenAI LLMs	2023-12-05 09:05:53 -08:00
Krrish Dholakia	71e64c34cb	fix(huggingface_restapi.py): raise better exceptions for unprocessable hf responses	2023-12-05 07:28:21 -08:00
ishaan-jaff	9ba17657ad	(feat) init redis cache with **kwargs	2023-12-04 20:50:08 -08:00
Krrish Dholakia	31f3187670	test: fix linting errors	2023-12-04 18:43:01 -08:00
Krrish Dholakia	030bd22078	feat(proxy_server.py): allow user to override api key auth	2023-12-04 18:32:58 -08:00
ishaan-jaff	ac486a3c4a	(docs) add example config.yaml	2023-12-04 18:08:57 -08:00
ishaan-jaff	fa5b453d39	(test) init router	2023-12-04 17:31:12 -08:00
ishaan-jaff	19646091fd	(feat) router: init stream, async stream, async, clients	2023-12-04 17:31:12 -08:00
ishaan-jaff	886b52d448	(test) init router clients	2023-12-04 17:31:12 -08:00
ishaan-jaff	cba98cf530	(test) init router with 4 clients	2023-12-04 17:31:12 -08:00
Krrish Dholakia	e0ccb281d8	feat(utils.py): add async success callbacks for custom functions	2023-12-04 16:42:40 -08:00
Krish Dholakia	b90fcbdac4	Merge pull request #970 from nbaldwin98/fixing-replicate-sys-prompt ... fix system prompts for replicate	2023-12-04 16:39:44 -08:00
ishaan-jaff	1247afb7a4	(feat) router: set max_retries + timeout	2023-12-04 16:09:31 -08:00
ishaan-jaff	a9905bcd0a	(test) fix config	2023-12-04 16:00:04 -08:00
ishaan-jaff	9b3a0c69f5	(fix) config testing	2023-12-04 15:24:46 -08:00
ishaan-jaff	b7281825d3	(test) add streaming sagemaker test	2023-12-04 15:20:06 -08:00
ishaan-jaff	bc691cbbcd	(fix) streaming init response_obj as {}	2023-12-04 15:19:47 -08:00
ishaan-jaff	41365b6e47	(test) palm/stream	2023-12-04 15:07:07 -08:00
ishaan-jaff	3a4e512a75	(fix) palm: streaming	2023-12-04 15:06:52 -08:00
ishaan-jaff	533b93f714	(test) proxy: reading configs	2023-12-04 14:49:59 -08:00
ishaan-jaff	32ecc1a677	(feat) replicate/deployments: add POST Req view	2023-12-04 13:43:03 -08:00
ishaan-jaff	07a2035651	(chore) rm old config examples	2023-12-04 13:26:55 -08:00
ishaan-jaff	50284771b7	(test) test_reading proxy	2023-12-04 13:24:41 -08:00
ishaan-jaff	de4a7b719d	(test) proxy: reading config.yaml	2023-12-04 13:16:19 -08:00
Krrish Dholakia	f20bdc9b79	test: fix linting errors	2023-12-04 12:45:15 -08:00
Krrish Dholakia	728b879c33	fix(utils.py): fix azure streaming bug	2023-12-04 12:38:22 -08:00
Krrish Dholakia	d0d8ba46c5	test(test_proxy_server_keys.py): fix relative import	2023-12-04 11:35:43 -08:00
ishaan-jaff	15f54c3072	(docs) default config proxy	2023-12-04 11:30:53 -08:00
ishaan-jaff	4ef0378e6e	(fix) proxy: custom callbacks	2023-12-04 11:29:26 -08:00
ishaan-jaff	c5b92837c2	(docs) custom callbacks proxy	2023-12-04 11:20:27 -08:00
ishaan-jaff	e96a608938	(feat) proxy: set custom headers in metadata	2023-12-04 10:49:01 -08:00
ishaan-jaff	ec579d4821	(chore) rename proxy: custom_callbacks	2023-12-04 10:49:01 -08:00
ishaan-jaff	9b1e02cdf1	(chore) rename: proxy-custom logger	2023-12-04 10:49:01 -08:00
Krrish Dholakia	63e55f1865	fix(proxy_server.py): fix /key/generate post endpoint	2023-12-04 10:44:13 -08:00
ishaan-jaff	d7d8c5f6e6	(fix) proxy	2023-12-04 10:23:55 -08:00
ishaan-jaff	ebd9404cfd	(test) proxy: don't overwrite user	2023-12-04 10:19:35 -08:00
ishaan-jaff	88cec3b9ab	(fix) proxy: don't overwrite user	2023-12-04 10:17:56 -08:00
ishaan-jaff	f3b939e603	(fix) access user in custom logger	2023-12-04 09:50:36 -08:00
ishaan-jaff	93f5c266da	(test) test completion: if 'user' passed to API	2023-12-04 09:50:36 -08:00
ishaan-jaff	0d44f5e441	(feat) proxy:custom_logger	2023-12-04 09:23:55 -08:00
ishaan-jaff	6599263a85	(feat) proxy: custom callbacks	2023-12-04 09:10:12 -08:00
ishaan-jaff	65e00b438e	(feat) proxy-read litellm custom callback class	2023-12-04 09:09:54 -08:00
ishaan-jaff	ed8c666922	(feat) proxy: custom_logger for I/O logging	2023-12-04 08:44:20 -08:00
ishaan-jaff	b1bd799be8	(feat) proxy: use custom_logger	2023-12-04 08:26:06 -08:00
Krrish Dholakia	69a4497550	fix(main.py): accept user in embedding()	2023-12-02 21:49:23 -08:00