477 commits

Author	SHA1	Message	Date
Krrish Dholakia	d0bd932b3c	refactor(openai.py): working openai chat + text completion for openai v1 sdk	2023-11-11 16:25:10 -08:00
Krrish Dholakia	d3323ba637	refactor(openai.py): making it compatible for openai v1 ... BREAKING CHANGE:	2023-11-11 15:33:02 -08:00
ishaan-jaff	d8f735565c	(fix) tg ai raise errors on non 200 responses	2023-11-11 11:21:12 -08:00
ishaan-jaff	9b78bbc6ea	(fix) ssl changes	2023-11-10 15:57:59 -08:00
ishaan-jaff	f9d4505ea0	(fix) ssl for acompletion with openai	2023-11-10 15:55:04 -08:00
ishaan-jaff	af98f74c82	(feat) replicate add exception mapping for streaming + better logging when polling	2023-11-10 12:46:33 -08:00
ishaan-jaff	4c3765119b	(fix) replicate print verbose	2023-11-10 12:46:33 -08:00
ishaan-jaff	49c7c851a8	(feat) replicate exception mapping	2023-11-10 12:46:33 -08:00
ishaan-jaff	00e1b46e68	(feat) replicate exception mapping	2023-11-10 12:46:33 -08:00
Krrish Dholakia	18a8bd5543	fix(utils.py): return function call as part of response object	2023-11-10 11:02:10 -08:00
ishaan-jaff	2f07460333	(feat) completion ollama raise exception when ollama resp != 200	2023-11-10 08:54:05 -08:00
ishaan-jaff	d0c9bfd14a	(feat) completion - replicate custom deployments	2023-11-09 18:10:38 -08:00
Krrish Dholakia	b9e6989e41	test: fix linting issues	2023-11-09 16:50:43 -08:00
Krrish Dholakia	e12bff6d7f	refactor(azure.py): enabling async streaming with aiohttp	2023-11-09 16:41:06 -08:00
Krrish Dholakia	c053782d96	refactor(openai.py): support aiohttp streaming	2023-11-09 16:15:30 -08:00
Krrish Dholakia	86ef2a02f7	fix(azure.py): adding support for aiohttp calls on azure + openai	2023-11-09 10:40:33 -08:00
Krrish Dholakia	7c5fd5824b	refactor(azure.py): fix linting errors	2023-11-08 19:24:53 -08:00
Krrish Dholakia	6f4707bbb3	refactor(azure.py): moving embeddings to http call	2023-11-08 19:07:21 -08:00
Krrish Dholakia	70311502c8	refactor(openai.py): moving embedding calls to http	2023-11-08 19:01:17 -08:00
Krrish Dholakia	c2cbdb23fd	refactor(openai.py): moving openai text completion calls to http	2023-11-08 18:40:03 -08:00
Krrish Dholakia	c57ed0a9d7	refactor(openai.py): moving openai chat completion calls to http	2023-11-08 17:40:41 -08:00
Krrish Dholakia	53abc31c27	refactor(azure.py): moving azure openai calls to http calls	2023-11-08 16:52:18 -08:00
ishaan-jaff	a404b0fc3b	(fix) remove errant print from hf	2023-11-08 11:49:15 -08:00
Krrish Dholakia	ce27e08e7d	(fix): llama-2 non-chat models prompt template	2023-11-07 21:33:54 -08:00
ishaan-jaff	3c67de7f04	(fix) hf don't fail when logprob is None	2023-11-06 14:22:09 -08:00
Krrish Dholakia	65c01eae23	fix(huggingface_restapi.py): output parsing chat template models	2023-11-06 11:43:12 -08:00
Krrish Dholakia	7c46e85ed6	refactor(bedrock.py): better exception mapping for bedrock + huggingface	2023-11-04 16:12:12 -07:00
Krrish Dholakia	ab54262d37	fix(timeout.py): import errors	2023-11-04 16:05:14 -07:00
Krrish Dholakia	5b3978eff4	fix(main.py): fixing print_verbose	2023-11-04 14:41:34 -07:00
Krrish Dholakia	6b40546e59	refactor(all-files): removing all print statements; adding pre-commit + flake8 to prevent future regressions	2023-11-04 12:50:15 -07:00
Krrish Dholakia	1c4dd0671b	fix(bedrock.py): add exception mapping coverage for authentication scenarios	2023-11-03 18:25:34 -07:00
Krrish Dholakia	142750adff	fix(bedrock.py): fix bedrock exception mapping	2023-11-03 18:14:12 -07:00
ishaan-jaff	49650af444	(fix) bedrock: remove check for - if "error" in outputText	2023-11-03 18:06:23 -07:00
ishaan-jaff	df57e9247a	(fix) hf calculating usage non blocking	2023-11-03 18:03:19 -07:00
Krrish Dholakia	4e1885734a	refactor(proxy_server.py): print statement showing how to add debug for logs	2023-11-03 17:41:14 -07:00
ishaan-jaff	6fc0c74878	(fix) remove errant print statements	2023-11-03 13:02:52 -07:00
ishaan-jaff	89e32db321	(fix) remove errant tg ai print statements	2023-11-03 12:59:23 -07:00
ishaan-jaff	6c82abf5bf	(fix) vertex ai streaming	2023-11-03 12:54:36 -07:00
Krrish Dholakia	e3a1c58dd9	build(litellm_server/utils.py): add support for general settings + num retries as a module variable	2023-11-02 20:56:41 -07:00
Krrish Dholakia	512a1637eb	feat(completion()): enable setting prompt templates via completion()	2023-11-02 16:24:01 -07:00
ishaan-jaff	03860984eb	(feat) add setting input_type for cohere	2023-11-02 10:16:35 -07:00
ishaan-jaff	724e169f32	(fix) improve cohere error handling	2023-11-02 10:07:11 -07:00
Krrish Dholakia	b305492a0b	fix(huggingface_restapi.py): fix linting issue	2023-11-01 16:43:35 -07:00
Krrish Dholakia	2c4cb76ce5	fix(huggingface_restapi.py): fix embeddings for sentence-transformer models	2023-11-01 16:36:46 -07:00
ishaan-jaff	2ad81bdd7b	(feat) embedding() add bedrock/amazon.titan-embed-text-v1	2023-11-01 13:55:28 -07:00
ishaan-jaff	fa7e063198	(feat) add bedrock.cohere streaming	2023-10-31 22:26:43 -07:00
ishaan-jaff	9223f7cc7a	(feat) textcompletion - transform hf log probs to openai text completion	2023-10-31 17:15:35 -07:00
Krish Dholakia	523c08a646	Merge pull request #717 from canada4663/main ... support for custom bedrock runtime endpoint	2023-10-31 16:47:33 -07:00
Krrish Dholakia	0ed3917b09	feat(main.py): add support for maritalk api	2023-10-30 17:36:51 -07:00
canada4663	bfa297e82f	add ability to use custom AWS Bedrock Runtime endpoint via environment or .env variable AWS_BEDROCK_RUNTIME_ENDPOINT or as a parameter to init_bedrock_client	2023-10-28 22:25:45 -07:00