4117 commits

This branch

This branch

All branches

Author	SHA1	Message	Date
Krrish Dholakia	4328a66a3a	fix(proxy_server.py): don't override exceptions if they're of type httpexception	2023-12-05 14:33:28 -08:00
ishaan-jaff	8b9206ae51	(test) router: test async embedding + embedding	2023-12-05 14:28:23 -08:00
ishaan-jaff	a1ac6aad8d	(test) router: openai async, sync, stream, no stream	2023-12-05 14:21:37 -08:00
ishaan-jaff	e9ae3234e4	(test) router: add tests for azure completion, acompletion	2023-12-05 13:59:27 -08:00
ishaan-jaff	842c91ee31	(test) azure - test async + sync embedding	2023-12-05 13:35:05 -08:00
Krrish Dholakia	f2e8239678	refactor(router.py): linting fixes	2023-12-05 13:33:44 -08:00
ishaan-jaff	917d6bd7cb	(fix) linting	2023-12-05 13:30:12 -08:00
ishaan-jaff	1622a3e4fa	(test) router Azure regular chat completion call	2023-12-05 13:28:07 -08:00
ishaan-jaff	ca2cce2c56	(chore) linting fix	2023-12-05 13:23:35 -08:00
ishaan-jaff	0729770390	(test) Router: Test Azure acompletion, stream	2023-12-05 13:22:27 -08:00
Krrish Dholakia	2e5eb56e7c	fix(router.py): fix cache init	2023-12-05 12:54:27 -08:00
ishaan-jaff	0b3ea42af9	(test) router streaming + azure	2023-12-05 12:54:00 -08:00
ishaan-jaff	a781bb825c	(fix) router: Azure Client Init	2023-12-05 12:54:00 -08:00
ishaan-jaff	50e7de1ac6	(fix) router: remove misleading print statement	2023-12-05 12:54:00 -08:00
Krrish Dholakia	c2acdfce09	test: remove local test	2023-12-05 12:45:52 -08:00
Krrish Dholakia	476d0e999b	bump: version 1.10.7 → 1.10.8	2023-12-05 12:38:42 -08:00
Krrish Dholakia	3455f33230	fix(utils.py): map cohere finish reasons	2023-12-05 12:38:18 -08:00
Krrish Dholakia	b7adb1e1e1	bump: version 1.10.6 → 1.10.7	2023-12-05 12:26:44 -08:00
Krrish Dholakia	733b1d87a7	fix(utils.py): set text if empty string	2023-12-05 12:26:44 -08:00
ishaan-jaff	7ba22141ed	(docs) proxy + langchain	2023-12-05 12:20:42 -08:00
ishaan-jaff	27cd4aa3a6	(docs) proxy: config example with langchain	2023-12-05 12:20:42 -08:00
ishaan-jaff	aab443c30c	(fix) router init: raise error Azure API Base not set	2023-12-05 12:20:42 -08:00
Krrish Dholakia	94abb14b99	fix(_redis.py): support additional params for redis	2023-12-05 12:16:51 -08:00
ishaan-jaff	91ffa5beca	(docs) proxy + configs	2023-12-05 12:02:35 -08:00
ishaan-jaff	4857edf0ba	(docs) using proxy with curl, OpenAI, langchain	2023-12-05 11:55:02 -08:00
ishaan-jaff	2d1e81bf35	(docs) litellm proxy + langchain	2023-12-05 11:46:42 -08:00
ishaan-jaff	67272e1d8e	(test) proxy: langchain compatible	2023-12-05 11:45:35 -08:00
ishaan-jaff	0bd62339a6	(docs) add example on using proxy with OpenAI	2023-12-05 11:45:35 -08:00
Krrish Dholakia	a858a2752d	refactor(proxy_server.py): clean up print statements in proxy server	2023-12-05 11:14:16 -08:00
Krrish Dholakia	9318a29fb1	fix: fix proxy testing	2023-12-05 11:13:09 -08:00
ishaan-jaff	cf033be697	(fix) bug in completion: _check_valid_arg	2023-12-05 10:00:54 -08:00
ishaan-jaff	447542b27e	bump: version 1.10.5 → 1.10.6	2023-12-05 09:36:59 -08:00
ishaan-jaff	2038c9816f	(fix) patch max_retries for non openai llms	2023-12-05 09:36:38 -08:00
ishaan-jaff	8759a2f463	(test) test bedrock on router	2023-12-05 09:35:08 -08:00
ishaan-jaff	b7e98582f7	(fix) proxy: bug non OpenAI LLMs	2023-12-05 09:05:53 -08:00
Krrish Dholakia	8b67da6368	bump: version 1.10.4 → 1.10.5	2023-12-05 07:28:21 -08:00
Krrish Dholakia	9ca06e2827	fix(huggingface_restapi.py): raise better exceptions for unprocessable hf responses	2023-12-05 07:28:21 -08:00
Krish Dholakia	966bd47697	Updated config.yml	2023-12-04 21:19:32 -08:00
ishaan-jaff	b95d3acb12	(feat) init redis cache with **kwargs	2023-12-04 20:50:08 -08:00
Krrish Dholakia	545ee2e16f	test: fix linting errors	2023-12-04 18:43:01 -08:00
Krrish Dholakia	4848b41abe	feat(proxy_server.py): allow user to override api key auth	2023-12-04 18:32:58 -08:00
ishaan-jaff	71e1333a96	bump: version 1.10.3 → 1.10.4	2023-12-04 18:09:25 -08:00
ishaan-jaff	fc68e98198	(docs) add example config.yaml	2023-12-04 18:08:57 -08:00
ishaan-jaff	7a06c81989	(docs) add health check on load balancing	2023-12-04 18:01:21 -08:00
ishaan-jaff	43ce4de175	(docs) router	2023-12-04 17:51:31 -08:00
ishaan-jaff	c5bc397845	(docs) custom timeouts proxy	2023-12-04 17:37:09 -08:00
ishaan-jaff	aaf9fb5513	(test) init router	2023-12-04 17:31:12 -08:00
ishaan-jaff	bd34c90b27	(feat) router: init stream, async stream, async, clients	2023-12-04 17:31:12 -08:00
ishaan-jaff	e33d8c37d3	(test) init router clients	2023-12-04 17:31:12 -08:00
ishaan-jaff	dd23be0ab7	(test) init router with 4 clients	2023-12-04 17:31:12 -08:00