239 commits

Author	SHA1	Message	Date
ishaan-jaff	fc10cf5eeb	exception_type work	2023-09-19 21:29:51 -07:00
ishaan-jaff	2c30855389	new batch completion function	2023-09-19 13:29:41 -07:00
ishaan-jaff	5f808f9f87	petals on main	2023-09-19 09:27:28 -07:00
ishaan-jaff	385640b743	petals fixes	2023-09-19 09:24:34 -07:00
ishaan-jaff	934deab1f7	add petals to init and main	2023-09-19 09:24:34 -07:00
Krrish Dholakia	f134de1287	bug fix for litellm proxy implementation	2023-09-18 12:54:56 -07:00
Krrish Dholakia	8c809db567	bump version	2023-09-18 12:27:18 -07:00
Krrish Dholakia	9067ec3b43	add support for litellm proxy calls	2023-09-18 12:15:21 -07:00
Krish Dholakia	e83d89d12f	Merge pull request #387 from WilliamEspegren/main ... Rebuild stream chunks to openAI object	2023-09-18 09:30:42 -07:00
ishaan-jaff	a5425df91f	doc string for completion	2023-09-18 09:03:26 -07:00
ishaan-jaff	d684f75683	add doc string for a completion	2023-09-18 08:49:27 -07:00
WilliamEspegren	63a8614a14	Added function_call support to stream_chunk_builder	2023-09-17 19:42:55 +02:00
WilliamEspegren	404af1be0f	if "function_call" find name	2023-09-17 19:02:50 +02:00
WilliamEspegren	d2bdfecd96	remove unused parameter	2023-09-17 13:12:49 +02:00
WilliamEspegren	5544a9251f	rebuild chunks to openAI response ... Rebuild the cunks, but does not include the "usage"	2023-09-17 13:07:54 +02:00
WilliamEspegren	43a18b9528	add stream_chunk_builder function	2023-09-17 10:26:34 +02:00
Krrish Dholakia	c829798e04	bump version and clean print statements	2023-09-16 20:59:24 -07:00
Krrish Dholakia	e4fbc8d908	fix cohere streaming	2023-09-16 19:36:41 -07:00
Krrish Dholakia	e44c218c1b	fix streaming formatting for non-openai models	2023-09-16 19:20:07 -07:00
Krrish Dholakia	122c993e6f	except custom openai proxy	2023-09-16 16:15:44 -07:00
Krrish Dholakia	ce827faa93	fixes to testing	2023-09-16 11:40:01 -07:00
Krrish Dholakia	21cd55ab26	ensure streaming format is exactly the same as openai	2023-09-16 10:35:20 -07:00
ishaan-jaff	c714372b9d	streaming for amazon titan bedrock	2023-09-16 09:57:16 -07:00
Toni Engelhardt	73bea9345f	fix setting mock response	2023-09-16 17:03:32 +01:00
ishaan-jaff	5ec1fc5048	bump version	2023-09-15 14:15:09 -07:00
ishaan-jaff	abb3793e50	tests	2023-09-15 13:38:26 -07:00
ishaan-jaff	b2c4c3576c	add new tg ai llm check	2023-09-15 09:29:46 -07:00
ishaan-jaff	38bdb9335c	add bedrock to main and init	2023-09-14 13:51:09 -07:00
Krrish Dholakia	3b4064a58f	move cohere to http endpoint	2023-09-14 11:17:38 -07:00
Krrish Dholakia	e2ea4adb84	fixes to mock completion	2023-09-14 10:03:57 -07:00
Krish Dholakia	7c9779f0ac	Merge pull request #371 from promptmetheus/simplify-mock-logic ... Simplify mock logic	2023-09-14 09:23:45 -07:00
Krrish Dholakia	f98da9f13c	adding support for nlp cloud	2023-09-14 09:19:34 -07:00
ishaan-jaff	61737e67a1	pass api_type as an arg in ChatCompl	2023-09-14 08:48:59 -07:00
Toni Engelhardt	900cf2c2ee	simplify mock logic ... Adds shortcut for the mock_completion method.	2023-09-14 16:13:31 +01:00
Toni Engelhardt	630b5d2c1f	add kwargs to mock_completion ... Allows replacing `completion` with `mock_completion` without encountering errors.	2023-09-14 10:27:19 +01:00
Krrish Dholakia	aaa57abddd	map finish reason	2023-09-13 19:22:38 -07:00
Krrish Dholakia	5b6b9a9fab	huggingface conversational task support	2023-09-13 13:45:23 -07:00
ishaan-jaff	e3fa1d686e	remove verify_access_key from main	2023-09-12 11:50:30 -07:00
Ishaan Jaff	60e3e42fba	Merge branch 'main' into main	2023-09-12 11:43:03 -07:00
Krrish Dholakia	baa69734b0	raise better exception if llm provider isn't passed in or inferred	2023-09-12 11:28:50 -07:00
ishaan-jaff	0ffcf51445	fix azure logging	2023-09-12 10:35:47 -07:00
ishaan-jaff	0f89636b47	use api_version for azure completion call	2023-09-12 10:35:24 -07:00
William Espegren	261db15bcf	util: verify_access_key ... Verify that the user provided a valid openai token by creating a request to the openAI endpoint.	2023-09-12 18:48:23 +02:00
Ishaan Jaff	fdddd00bfd	Merge pull request #330 from Taik/main ... Add support for overriding API type for Azure calls	2023-09-11 17:04:25 -07:00
Krrish Dholakia	cc1313492b	code cleanup	2023-09-11 16:32:17 -07:00
Krrish Dholakia	cbc7e6dbc2	mock responses for streaming	2023-09-11 16:30:29 -07:00
Thinh Nguyen	8801f71a52	Add support for overriding API type for Azure calls	2023-09-11 16:28:00 -07:00
Krrish Dholakia	6da500c6e0	add mock request to docs	2023-09-11 12:19:13 -07:00
ishaan-jaff	1ef80c9a2a	begin using litellm.api_key	2023-09-11 07:32:20 -07:00
Krrish Dholakia	beecb60f51	update testing	2023-09-09 16:35:38 -07:00