463 commits

Author	SHA1	Message	Date
ishaan-jaff	73a135b0db	(test) competion	2023-11-27 10:13:46 -08:00
ishaan-jaff	0fdcbad2ca	(feat) completion:debugging - show raw POST request	2023-11-27 10:13:37 -08:00
ishaan-jaff	849536414b	(test) sagemaker add chat models	2023-11-27 10:11:56 -08:00
Krrish Dholakia	b1b2d0c2b7	fix(utils.py): fix bedrock + cohere calls	2023-11-25 14:45:42 -08:00
ishaan-jaff	9ef40a626e	(test) metadata test in litellm.completion	2023-11-25 11:10:06 -08:00
Krrish Dholakia	ff6975a98d	fix(main.py): logit bias mapping for batch_completions	2023-11-24 16:05:51 -08:00
ishaan-jaff	6d25be9182	(test) completion with many params	2023-11-24 14:01:21 -08:00
Krrish Dholakia	90385ef6a5	fix(utils.py): remove eos token for zephyr models	2023-11-23 17:47:39 -08:00
ishaan-jaff	2a1baad3cf	(test) cleanup	2023-11-23 17:09:36 -08:00
Krrish Dholakia	328cf356ad	test(test_completion.py): fix azure read from env variable test	2023-11-23 16:58:07 -08:00
ishaan-jaff	ebcfbe712a	(test) azure test passing key as completion param	2023-11-23 16:51:52 -08:00
ishaan-jaff	3b9359ea7c	(test) cost calc on azure	2023-11-23 13:50:09 -08:00
Krrish Dholakia	e4f40f4535	fix(utils.py): support reading api keys dynamically from the os environment	2023-11-23 13:41:56 -08:00
ishaan-jaff	771ce632f7	(chore) run ci/cd again	2023-11-22 20:34:14 -08:00
Krrish Dholakia	57e894ad5e	fix(proxy_server.py): If master key is set, only master key can be used to generate new keys	2023-11-22 10:18:28 -08:00
Krrish Dholakia	9bb2c7ee0f	fix(utils.py): add param mapping for perplexity, anyscale, deepinfra ... n n	2023-11-22 10:04:27 -08:00
ishaan-jaff	3e57b14cc6	(test) timeout error	2023-11-21 13:37:12 -08:00
Krrish Dholakia	f763666cf1	test(test_completion.py): fix replicate streaming test	2023-11-21 10:38:05 -08:00
Krrish Dholakia	a1c342c3ad	feat(factory.py): add support for anthropic system prompts for claude 2.1	2023-11-21 09:57:26 -08:00
Krrish Dholakia	c48e775908	fix(huggingface_restapi.py): fix huggingface response format	2023-11-21 09:57:26 -08:00
ishaan-jaff	a7596ae30b	(test) add claude-2.1	2023-11-21 09:53:47 -08:00
Krrish Dholakia	c0e3b2ece9	fix(utils.py): fix pre call rules	2023-11-21 07:10:04 -08:00
Krrish Dholakia	29906f6320	test(test_completion.py): change tgai model	2023-11-17 16:06:42 -08:00
ishaan-jaff	b3e36d0486	(test) test seed, response format, for gpt-3.5-turbo	2023-11-17 14:00:42 -08:00
Krrish Dholakia	a6e9f147d3	fix(openai.py): handling extra headers	2023-11-16 12:48:21 -08:00
Krrish Dholakia	e54056f0ed	fix(azure.py): use openai client sdk for handling sync+async calling	2023-11-16 12:08:12 -08:00
Krrish Dholakia	a80c5841b2	fix(openai.py): using openai sdk for completion calls	2023-11-15 20:25:27 -08:00
Krrish Dholakia	081400ecd4	fix(openai.py): fix timeout errors	2023-11-15 18:03:14 -08:00
Krrish Dholakia	f2020c2284	test: cleanup testing	2023-11-15 17:57:14 -08:00
Krrish Dholakia	ef4e5b9636	test: set request timeout at request level	2023-11-15 17:42:31 -08:00
Krrish Dholakia	e5929f2f7e	fix(azure.py-+-proxy_server.py): fix function calling response object + support router on proxy	2023-11-15 13:15:16 -08:00
Krrish Dholakia	545fcbf786	test(test_completion.py): fix palm test	2023-11-14 22:28:56 -08:00
ishaan-jaff	52e2730e44	(test) AI21 test	2023-11-14 15:01:50 -08:00
ishaan-jaff	74845f12a7	(test) completion azure_ad_token	2023-11-14 12:48:31 -08:00
ishaan-jaff	e3369bb260	(test) azure_ad_token	2023-11-14 12:12:14 -08:00
Krrish Dholakia	526eb99ade	fix(palm.py): exception mapping bad requests / filtered responses	2023-11-14 11:53:13 -08:00
Krrish Dholakia	bdf801d987	fix(together_ai.py): exception mapping for tgai	2023-11-13 13:17:15 -08:00
Krrish Dholakia	d8121737d6	test(test_completion.py): cleanup tests	2023-11-13 11:23:38 -08:00
ishaan-jaff	a0ef7da7e0	(test) deepinfra with openai v1.0.0	2023-11-13 09:51:45 -08:00
Krrish Dholakia	8db19d0af4	fix(utils.py): replacing openai.error import statements	2023-11-11 19:25:21 -08:00
Krrish Dholakia	7b4e21e574	refactor(bedrock.py-+-cohere.py): making bedrock and cohere compatible with openai v1 sdk	2023-11-11 17:33:19 -08:00
Krrish Dholakia	c0a757a25f	refactor(azure.py): working azure completion calls with openai v1 sdk	2023-11-11 16:44:39 -08:00
Krrish Dholakia	a5ec85b1f2	refactor(openai.py): making it compatible for openai v1 ... BREAKING CHANGE:	2023-11-11 15:33:02 -08:00
ishaan-jaff	5675a82cfa	(test) try/pass APIError for TG AI	2023-11-11 11:34:15 -08:00
ishaan-jaff	d9365b62fb	(test) gpt4 vision	2023-11-11 10:34:37 -08:00
ishaan-jaff	8f0f9889a6	(test) add gpt-4 vision	2023-11-10 17:34:40 -08:00
Krrish Dholakia	11d1651d36	test(test_streaming.py): set cache to none	2023-11-10 15:24:17 -08:00
ishaan-jaff	8b41876257	(test) replicate with streaming, num retries	2023-11-10 12:46:33 -08:00
Krrish Dholakia	964e3da107	test(test_completion.py): fix openai testing	2023-11-09 19:05:34 -08:00
Krrish Dholakia	d392f6efb5	fix(utils.py): fix sync streaming	2023-11-09 18:47:20 -08:00