328 commits

Author	SHA1	Message	Date
Krrish Dholakia	2e5dc00968	fix(sagemaker.py): prompt templating fixes	2023-12-05 17:47:44 -08:00
Krrish Dholakia	c01b15af17	docs(input.md): add hf_model_name to docs	2023-12-05 16:56:18 -08:00
Krrish Dholakia	f9b74e54a3	fix(sagemaker.py): enable passing hf model name for prompt template	2023-12-05 16:31:59 -08:00
Krrish Dholakia	7e42c64cc5	fix(utils.py): support sagemaker llama2 custom endpoints	2023-12-05 16:05:15 -08:00
ishaan-jaff	0cdef526b4	(test) add streaming sagemaker test	2023-12-04 15:20:06 -08:00
ishaan-jaff	92417c7ba4	(test) palm/stream	2023-12-04 15:07:07 -08:00
ishaan-jaff	fe985932be	(test) test completion: if 'user' passed to API	2023-12-04 09:50:36 -08:00
Krrish Dholakia	6fd50177e8	test(test_completion.py): commenting out flaky test	2023-12-01 15:06:54 -08:00
Krrish Dholakia	49684e9eb4	fix(azure.py): fix linting errors	2023-11-30 13:32:29 -08:00
Krrish Dholakia	526cc3a9c4	feat(main.py): add support for azure-openai via cloudflare ai gateway	2023-11-30 13:19:49 -08:00
Krrish Dholakia	a05722571b	fix(replicate.py): fix custom prompt formatting	2023-11-29 19:44:09 -08:00
ishaan-jaff	b733cee3f9	(feat+test) use passed OpenAI client	2023-11-28 16:09:10 -08:00
ishaan-jaff	544beba4e1	(test) pass client to Azure completion	2023-11-28 15:57:11 -08:00
ishaan-jaff	a0a6d5ceeb	(test) using client: compleition	2023-11-28 15:44:56 -08:00
ishaan-jaff	c34ff565cd	(ci/cd) run again	2023-11-27 11:12:11 -08:00
ishaan-jaff	73a135b0db	(test) competion	2023-11-27 10:13:46 -08:00
ishaan-jaff	0fdcbad2ca	(feat) completion:debugging - show raw POST request	2023-11-27 10:13:37 -08:00
ishaan-jaff	849536414b	(test) sagemaker add chat models	2023-11-27 10:11:56 -08:00
Krrish Dholakia	b1b2d0c2b7	fix(utils.py): fix bedrock + cohere calls	2023-11-25 14:45:42 -08:00
ishaan-jaff	9ef40a626e	(test) metadata test in litellm.completion	2023-11-25 11:10:06 -08:00
Krrish Dholakia	ff6975a98d	fix(main.py): logit bias mapping for batch_completions	2023-11-24 16:05:51 -08:00
ishaan-jaff	6d25be9182	(test) completion with many params	2023-11-24 14:01:21 -08:00
Krrish Dholakia	90385ef6a5	fix(utils.py): remove eos token for zephyr models	2023-11-23 17:47:39 -08:00
ishaan-jaff	2a1baad3cf	(test) cleanup	2023-11-23 17:09:36 -08:00
Krrish Dholakia	328cf356ad	test(test_completion.py): fix azure read from env variable test	2023-11-23 16:58:07 -08:00
ishaan-jaff	ebcfbe712a	(test) azure test passing key as completion param	2023-11-23 16:51:52 -08:00
ishaan-jaff	3b9359ea7c	(test) cost calc on azure	2023-11-23 13:50:09 -08:00
Krrish Dholakia	e4f40f4535	fix(utils.py): support reading api keys dynamically from the os environment	2023-11-23 13:41:56 -08:00
ishaan-jaff	771ce632f7	(chore) run ci/cd again	2023-11-22 20:34:14 -08:00
Krrish Dholakia	57e894ad5e	fix(proxy_server.py): If master key is set, only master key can be used to generate new keys	2023-11-22 10:18:28 -08:00
Krrish Dholakia	9bb2c7ee0f	fix(utils.py): add param mapping for perplexity, anyscale, deepinfra ... n n	2023-11-22 10:04:27 -08:00
ishaan-jaff	3e57b14cc6	(test) timeout error	2023-11-21 13:37:12 -08:00
Krrish Dholakia	f763666cf1	test(test_completion.py): fix replicate streaming test	2023-11-21 10:38:05 -08:00
Krrish Dholakia	a1c342c3ad	feat(factory.py): add support for anthropic system prompts for claude 2.1	2023-11-21 09:57:26 -08:00
Krrish Dholakia	c48e775908	fix(huggingface_restapi.py): fix huggingface response format	2023-11-21 09:57:26 -08:00
ishaan-jaff	a7596ae30b	(test) add claude-2.1	2023-11-21 09:53:47 -08:00
Krrish Dholakia	c0e3b2ece9	fix(utils.py): fix pre call rules	2023-11-21 07:10:04 -08:00
Krrish Dholakia	29906f6320	test(test_completion.py): change tgai model	2023-11-17 16:06:42 -08:00
ishaan-jaff	b3e36d0486	(test) test seed, response format, for gpt-3.5-turbo	2023-11-17 14:00:42 -08:00
Krrish Dholakia	a6e9f147d3	fix(openai.py): handling extra headers	2023-11-16 12:48:21 -08:00
Krrish Dholakia	e54056f0ed	fix(azure.py): use openai client sdk for handling sync+async calling	2023-11-16 12:08:12 -08:00
Krrish Dholakia	a80c5841b2	fix(openai.py): using openai sdk for completion calls	2023-11-15 20:25:27 -08:00
Krrish Dholakia	081400ecd4	fix(openai.py): fix timeout errors	2023-11-15 18:03:14 -08:00
Krrish Dholakia	f2020c2284	test: cleanup testing	2023-11-15 17:57:14 -08:00
Krrish Dholakia	ef4e5b9636	test: set request timeout at request level	2023-11-15 17:42:31 -08:00
Krrish Dholakia	e5929f2f7e	fix(azure.py-+-proxy_server.py): fix function calling response object + support router on proxy	2023-11-15 13:15:16 -08:00
Krrish Dholakia	545fcbf786	test(test_completion.py): fix palm test	2023-11-14 22:28:56 -08:00
ishaan-jaff	52e2730e44	(test) AI21 test	2023-11-14 15:01:50 -08:00
ishaan-jaff	74845f12a7	(test) completion azure_ad_token	2023-11-14 12:48:31 -08:00
ishaan-jaff	e3369bb260	(test) azure_ad_token	2023-11-14 12:12:14 -08:00