2161 commits

Author	SHA1	Message	Date
Krrish Dholakia	4328a66a3a	fix(proxy_server.py): don't override exceptions if they're of type httpexception	2023-12-05 14:33:28 -08:00
ishaan-jaff	8b9206ae51	(test) router: test async embedding + embedding	2023-12-05 14:28:23 -08:00
ishaan-jaff	a1ac6aad8d	(test) router: openai async, sync, stream, no stream	2023-12-05 14:21:37 -08:00
ishaan-jaff	e9ae3234e4	(test) router: add tests for azure completion, acompletion	2023-12-05 13:59:27 -08:00
ishaan-jaff	842c91ee31	(test) azure - test async + sync embedding	2023-12-05 13:35:05 -08:00
Krrish Dholakia	f2e8239678	refactor(router.py): linting fixes	2023-12-05 13:33:44 -08:00
ishaan-jaff	917d6bd7cb	(fix) linting	2023-12-05 13:30:12 -08:00
ishaan-jaff	1622a3e4fa	(test) router Azure regular chat completion call	2023-12-05 13:28:07 -08:00
ishaan-jaff	ca2cce2c56	(chore) linting fix	2023-12-05 13:23:35 -08:00
ishaan-jaff	0729770390	(test) Router: Test Azure acompletion, stream	2023-12-05 13:22:27 -08:00
Krrish Dholakia	2e5eb56e7c	fix(router.py): fix cache init	2023-12-05 12:54:27 -08:00
ishaan-jaff	0b3ea42af9	(test) router streaming + azure	2023-12-05 12:54:00 -08:00
ishaan-jaff	a781bb825c	(fix) router: Azure Client Init	2023-12-05 12:54:00 -08:00
ishaan-jaff	50e7de1ac6	(fix) router: remove misleading print statement	2023-12-05 12:54:00 -08:00
Krrish Dholakia	c2acdfce09	test: remove local test	2023-12-05 12:45:52 -08:00
Krrish Dholakia	3455f33230	fix(utils.py): map cohere finish reasons	2023-12-05 12:38:18 -08:00
Krrish Dholakia	733b1d87a7	fix(utils.py): set text if empty string	2023-12-05 12:26:44 -08:00
ishaan-jaff	7ba22141ed	(docs) proxy + langchain	2023-12-05 12:20:42 -08:00
ishaan-jaff	aab443c30c	(fix) router init: raise error Azure API Base not set	2023-12-05 12:20:42 -08:00
Krrish Dholakia	94abb14b99	fix(_redis.py): support additional params for redis	2023-12-05 12:16:51 -08:00
ishaan-jaff	67272e1d8e	(test) proxy: langchain compatible	2023-12-05 11:45:35 -08:00
Krrish Dholakia	a858a2752d	refactor(proxy_server.py): clean up print statements in proxy server	2023-12-05 11:14:16 -08:00
Krrish Dholakia	9318a29fb1	fix: fix proxy testing	2023-12-05 11:13:09 -08:00
ishaan-jaff	cf033be697	(fix) bug in completion: _check_valid_arg	2023-12-05 10:00:54 -08:00
ishaan-jaff	2038c9816f	(fix) patch max_retries for non openai llms	2023-12-05 09:36:38 -08:00
ishaan-jaff	8759a2f463	(test) test bedrock on router	2023-12-05 09:35:08 -08:00
ishaan-jaff	b7e98582f7	(fix) proxy: bug non OpenAI LLMs	2023-12-05 09:05:53 -08:00
Krrish Dholakia	9ca06e2827	fix(huggingface_restapi.py): raise better exceptions for unprocessable hf responses	2023-12-05 07:28:21 -08:00
ishaan-jaff	b95d3acb12	(feat) init redis cache with **kwargs	2023-12-04 20:50:08 -08:00
Krrish Dholakia	545ee2e16f	test: fix linting errors	2023-12-04 18:43:01 -08:00
Krrish Dholakia	4848b41abe	feat(proxy_server.py): allow user to override api key auth	2023-12-04 18:32:58 -08:00
ishaan-jaff	fc68e98198	(docs) add example config.yaml	2023-12-04 18:08:57 -08:00
ishaan-jaff	aaf9fb5513	(test) init router	2023-12-04 17:31:12 -08:00
ishaan-jaff	bd34c90b27	(feat) router: init stream, async stream, async, clients	2023-12-04 17:31:12 -08:00
ishaan-jaff	e33d8c37d3	(test) init router clients	2023-12-04 17:31:12 -08:00
ishaan-jaff	dd23be0ab7	(test) init router with 4 clients	2023-12-04 17:31:12 -08:00
Krrish Dholakia	d1a525b6c9	feat(utils.py): add async success callbacks for custom functions	2023-12-04 16:42:40 -08:00
Krish Dholakia	eab7d41cd3	Merge pull request #970 from nbaldwin98/fixing-replicate-sys-prompt ... fix system prompts for replicate	2023-12-04 16:39:44 -08:00
ishaan-jaff	76715e09ee	(feat) router: set max_retries + timeout	2023-12-04 16:09:31 -08:00
ishaan-jaff	06318218c3	(test) fix config	2023-12-04 16:00:04 -08:00
ishaan-jaff	8e70a6765c	(fix) config testing	2023-12-04 15:24:46 -08:00
ishaan-jaff	0cdef526b4	(test) add streaming sagemaker test	2023-12-04 15:20:06 -08:00
ishaan-jaff	d518447f80	(fix) streaming init response_obj as {}	2023-12-04 15:19:47 -08:00
ishaan-jaff	92417c7ba4	(test) palm/stream	2023-12-04 15:07:07 -08:00
ishaan-jaff	afd07e7f7c	(fix) palm: streaming	2023-12-04 15:06:52 -08:00
ishaan-jaff	a6159b9283	(test) proxy: reading configs	2023-12-04 14:49:59 -08:00
ishaan-jaff	9506f66846	(feat) replicate/deployments: add POST Req view	2023-12-04 13:43:03 -08:00
ishaan-jaff	b3be960885	(chore) rm old config examples	2023-12-04 13:26:55 -08:00
ishaan-jaff	2790d12b53	(test) test_reading proxy	2023-12-04 13:24:41 -08:00
ishaan-jaff	6f73a3e682	(test) proxy: reading config.yaml	2023-12-04 13:16:19 -08:00