1008 commits

Author	SHA1	Message	Date
ishaan-jaff	8b9206ae51	(test) router: test async embedding + embedding	2023-12-05 14:28:23 -08:00
ishaan-jaff	a1ac6aad8d	(test) router: openai async, sync, stream, no stream	2023-12-05 14:21:37 -08:00
ishaan-jaff	e9ae3234e4	(test) router: add tests for azure completion, acompletion	2023-12-05 13:59:27 -08:00
ishaan-jaff	842c91ee31	(test) azure - test async + sync embedding	2023-12-05 13:35:05 -08:00
ishaan-jaff	1622a3e4fa	(test) router Azure regular chat completion call	2023-12-05 13:28:07 -08:00
ishaan-jaff	0729770390	(test) Router: Test Azure acompletion, stream	2023-12-05 13:22:27 -08:00
ishaan-jaff	0b3ea42af9	(test) router streaming + azure	2023-12-05 12:54:00 -08:00
Krrish Dholakia	9318a29fb1	fix: fix proxy testing	2023-12-05 11:13:09 -08:00
ishaan-jaff	8759a2f463	(test) test bedrock on router	2023-12-05 09:35:08 -08:00
ishaan-jaff	b95d3acb12	(feat) init redis cache with **kwargs	2023-12-04 20:50:08 -08:00
Krrish Dholakia	4848b41abe	feat(proxy_server.py): allow user to override api key auth	2023-12-04 18:32:58 -08:00
ishaan-jaff	aaf9fb5513	(test) init router	2023-12-04 17:31:12 -08:00
ishaan-jaff	e33d8c37d3	(test) init router clients	2023-12-04 17:31:12 -08:00
ishaan-jaff	dd23be0ab7	(test) init router with 4 clients	2023-12-04 17:31:12 -08:00
Krrish Dholakia	d1a525b6c9	feat(utils.py): add async success callbacks for custom functions	2023-12-04 16:42:40 -08:00
ishaan-jaff	06318218c3	(test) fix config	2023-12-04 16:00:04 -08:00
ishaan-jaff	8e70a6765c	(fix) config testing	2023-12-04 15:24:46 -08:00
ishaan-jaff	0cdef526b4	(test) add streaming sagemaker test	2023-12-04 15:20:06 -08:00
ishaan-jaff	92417c7ba4	(test) palm/stream	2023-12-04 15:07:07 -08:00
ishaan-jaff	a6159b9283	(test) proxy: reading configs	2023-12-04 14:49:59 -08:00
ishaan-jaff	2790d12b53	(test) test_reading proxy	2023-12-04 13:24:41 -08:00
ishaan-jaff	6f73a3e682	(test) proxy: reading config.yaml	2023-12-04 13:16:19 -08:00
Krrish Dholakia	b76e3ff626	fix(utils.py): fix azure streaming bug	2023-12-04 12:38:22 -08:00
Krrish Dholakia	8b934d2798	test(test_proxy_server_keys.py): fix relative import	2023-12-04 11:35:43 -08:00
Krrish Dholakia	813bb15a00	fix(proxy_server.py): fix /key/generate post endpoint	2023-12-04 10:44:13 -08:00
ishaan-jaff	815ca33eff	(test) proxy: don't overwrite user	2023-12-04 10:19:35 -08:00
ishaan-jaff	fe985932be	(test) test completion: if 'user' passed to API	2023-12-04 09:50:36 -08:00
Krrish Dholakia	7d684fbd9e	test: commenting out local test	2023-12-02 20:53:24 -08:00
Krrish Dholakia	285f0b72c3	fix(main.py): fix pydantic warning for usage dict	2023-12-02 20:02:55 -08:00
Krrish Dholakia	1af2435636	fix(proxy_server.py): add testing for model info being added to /model/new	2023-12-02 14:15:45 -08:00
ishaan-jaff	04fb704efe	(ci/cd) HF embedding	2023-12-02 10:57:33 -08:00
ishaan-jaff	b66d86dffc	(chore) cleanup proxy	2023-12-02 09:37:14 -08:00
Krrish Dholakia	6556f060f7	test: fix flaky test	2023-12-01 15:46:39 -08:00
Krrish Dholakia	923f90aed2	fix(proxy_server.py): accept max tokens as int	2023-12-01 15:19:34 -08:00
Krrish Dholakia	6fd50177e8	test(test_completion.py): commenting out flaky test	2023-12-01 15:06:54 -08:00
Krrish Dholakia	3ffccf8804	test(test_token_counter.py): include testing for function calls	2023-11-30 18:24:21 -08:00
Krrish Dholakia	0e1c747f12	fix(router.py): support cloudflare ai gateway for azure models on router	2023-11-30 14:09:06 -08:00
ishaan-jaff	963dec91d1	(fix +test) langfuse log metadata	2023-11-30 13:53:43 -08:00
Krrish Dholakia	1600ad11fc	fix(langfuse.py): fix metadata logging for langfuse	2023-11-30 13:45:34 -08:00
Krrish Dholakia	49684e9eb4	fix(azure.py): fix linting errors	2023-11-30 13:32:29 -08:00
Krrish Dholakia	526cc3a9c4	feat(main.py): add support for azure-openai via cloudflare ai gateway	2023-11-30 13:19:49 -08:00
Krrish Dholakia	68e0eca6b8	fix(utils.py): include system fingerprint in streaming response object	2023-11-30 08:45:52 -08:00
Krrish Dholakia	0341b0cd07	feat(main.py): allow updating model cost via completion()	2023-11-29 20:14:39 -08:00
ishaan-jaff	f8918e3836	(chore) fix testing	2023-11-29 20:05:13 -08:00
Krrish Dholakia	a94b6b5cd5	test(test_streaming.py): refactor testing	2023-11-29 19:58:04 -08:00
Krrish Dholakia	a1ea893a73	fix(main.py): don't pass stream to petals	2023-11-29 19:58:04 -08:00
Krrish Dholakia	a05722571b	fix(replicate.py): fix custom prompt formatting	2023-11-29 19:44:09 -08:00
ishaan-jaff	dc9bafa959	(feat) Embedding: Async Azure	2023-11-29 19:43:47 -08:00
ishaan-jaff	8dfab66a67	(test) aembedding	2023-11-29 19:36:42 -08:00
ishaan-jaff	9149b25d72	(test) aembedding	2023-11-29 19:35:32 -08:00