4089 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Krrish Dholakia	ddea62fdb1	refactor(proxy_server.py): clean up print statements in proxy server	2023-12-05 11:14:16 -08:00
Krrish Dholakia	b46c73a46e	fix: fix proxy testing	2023-12-05 11:13:09 -08:00
ishaan-jaff	a602d59645	(fix) bug in completion: _check_valid_arg	2023-12-05 10:00:54 -08:00
ishaan-jaff	33cf5a3371	bump: version 1.10.5 → 1.10.6	2023-12-05 09:36:59 -08:00
ishaan-jaff	732a049513	(fix) patch max_retries for non openai llms	2023-12-05 09:36:38 -08:00
ishaan-jaff	3bdf61f02a	(test) test bedrock on router	2023-12-05 09:35:08 -08:00
ishaan-jaff	13261287ec	(fix) proxy: bug non OpenAI LLMs	2023-12-05 09:05:53 -08:00
Krrish Dholakia	943bf53b0b	bump: version 1.10.4 → 1.10.5	2023-12-05 07:28:21 -08:00
Krrish Dholakia	71e64c34cb	fix(huggingface_restapi.py): raise better exceptions for unprocessable hf responses	2023-12-05 07:28:21 -08:00
Krish Dholakia	1ff8f75752	Updated config.yml	2023-12-04 21:19:32 -08:00
ishaan-jaff	9ba17657ad	(feat) init redis cache with **kwargs	2023-12-04 20:50:08 -08:00
Krrish Dholakia	31f3187670	test: fix linting errors	2023-12-04 18:43:01 -08:00
Krrish Dholakia	030bd22078	feat(proxy_server.py): allow user to override api key auth	2023-12-04 18:32:58 -08:00
ishaan-jaff	51cddf1e97	bump: version 1.10.3 → 1.10.4	2023-12-04 18:09:25 -08:00
ishaan-jaff	ac486a3c4a	(docs) add example config.yaml	2023-12-04 18:08:57 -08:00
ishaan-jaff	05f585153f	(docs) add health check on load balancing	2023-12-04 18:01:21 -08:00
ishaan-jaff	acd1678d14	(docs) router	2023-12-04 17:51:31 -08:00
ishaan-jaff	3f541fe999	(docs) custom timeouts proxy	2023-12-04 17:37:09 -08:00
ishaan-jaff	fa5b453d39	(test) init router	2023-12-04 17:31:12 -08:00
ishaan-jaff	19646091fd	(feat) router: init stream, async stream, async, clients	2023-12-04 17:31:12 -08:00
ishaan-jaff	886b52d448	(test) init router clients	2023-12-04 17:31:12 -08:00
ishaan-jaff	cba98cf530	(test) init router with 4 clients	2023-12-04 17:31:12 -08:00
Krrish Dholakia	7adb8f493d	docs(custom_callback.md): add async callbacks to docs	2023-12-04 17:01:46 -08:00
Krrish Dholakia	e0ccb281d8	feat(utils.py): add async success callbacks for custom functions	2023-12-04 16:42:40 -08:00
Krish Dholakia	b90fcbdac4	Merge pull request #970 from nbaldwin98/fixing-replicate-sys-prompt ... fix system prompts for replicate	2023-12-04 16:39:44 -08:00
ishaan-jaff	1247afb7a4	(feat) router: set max_retries + timeout	2023-12-04 16:09:31 -08:00
ishaan-jaff	a9905bcd0a	(test) fix config	2023-12-04 16:00:04 -08:00
ishaan-jaff	bbdfd143b8	(docs) input	2023-12-04 15:47:27 -08:00
ishaan-jaff	9b3a0c69f5	(fix) config testing	2023-12-04 15:24:46 -08:00
ishaan-jaff	b7281825d3	(test) add streaming sagemaker test	2023-12-04 15:20:06 -08:00
ishaan-jaff	bc691cbbcd	(fix) streaming init response_obj as {}	2023-12-04 15:19:47 -08:00
ishaan-jaff	74d520b1b5	(docs) sagemaker - clarify max tokens	2023-12-04 15:15:39 -08:00
ishaan-jaff	41365b6e47	(test) palm/stream	2023-12-04 15:07:07 -08:00
ishaan-jaff	3a4e512a75	(fix) palm: streaming	2023-12-04 15:06:52 -08:00
ishaan-jaff	533b93f714	(test) proxy: reading configs	2023-12-04 14:49:59 -08:00
ishaan-jaff	32ecc1a677	(feat) replicate/deployments: add POST Req view	2023-12-04 13:43:03 -08:00
ishaan-jaff	07a2035651	(chore) rm old config examples	2023-12-04 13:26:55 -08:00
ishaan-jaff	50284771b7	(test) test_reading proxy	2023-12-04 13:24:41 -08:00
Ishaan Jaff	a99f471d29	Update README.md	2023-12-04 13:20:23 -08:00
ishaan-jaff	de4a7b719d	(test) proxy: reading config.yaml	2023-12-04 13:16:19 -08:00
Krrish Dholakia	f20bdc9b79	test: fix linting errors	2023-12-04 12:45:15 -08:00
Krrish Dholakia	728b879c33	fix(utils.py): fix azure streaming bug	2023-12-04 12:38:22 -08:00
Krish Dholakia	90c13d39ac	Updated config.yml	2023-12-04 12:01:22 -08:00
ishaan-jaff	6f8765125b	(docs) embedding: add api_base for HF	2023-12-04 11:57:41 -08:00
ishaan-jaff	333e77d161	(docs) custom logger	2023-12-04 11:44:12 -08:00
ishaan-jaff	533b5bcc44	(docs) clean up proxy logging	2023-12-04 11:37:15 -08:00
Krrish Dholakia	d0d8ba46c5	test(test_proxy_server_keys.py): fix relative import	2023-12-04 11:35:43 -08:00
ishaan-jaff	15f54c3072	(docs) default config proxy	2023-12-04 11:30:53 -08:00
ishaan-jaff	85ac2b179a	(docs) custom logger: proxy	2023-12-04 11:30:09 -08:00
ishaan-jaff	4ef0378e6e	(fix) proxy: custom callbacks	2023-12-04 11:29:26 -08:00