134 commits

Author	SHA1	Message	Date
Krrish Dholakia	2f44191642	add completion configs	2023-09-21 14:00:11 -07:00
Krrish Dholakia	b76372cee0	add metadata logging to promptlayer	2023-09-21 10:45:02 -07:00
Krrish Dholakia	e48e1a4597	fix openrouter issue	2023-09-20 20:38:31 -07:00
Krrish Dholakia	fc922bc300	fix multithreading issue with response objects	2023-09-20 19:36:08 -07:00
Krrish Dholakia	93c41e8f6d	decouple model list from hardcoded package variables	2023-09-20 14:16:56 -07:00
Krrish Dholakia	ecad921b01	add oobabooga text web api support	2023-09-19 18:56:53 -07:00
Krrish Dholakia	45293613ba	fix meta llama prompt template mapping bug	2023-09-18 21:24:41 -07:00
Krrish Dholakia	5acd1c9d47	update budget manager	2023-09-18 15:48:29 -07:00
Krrish Dholakia	f134de1287	bug fix for litellm proxy implementation	2023-09-18 12:54:56 -07:00
Krrish Dholakia	8c809db567	bump version	2023-09-18 12:27:18 -07:00
Krrish Dholakia	9067ec3b43	add support for litellm proxy calls	2023-09-18 12:15:21 -07:00
Krrish Dholakia	5b294c704e	fix hf conversational task bug	2023-09-18 11:46:36 -07:00
Krrish Dholakia	4daaa1cf91	clean out print statements	2023-09-17 05:52:19 -07:00
Krrish Dholakia	66a3c59ebe	bump pyproject version	2023-09-16 20:45:16 -07:00
Krrish Dholakia	e4fbc8d908	fix cohere streaming	2023-09-16 19:36:41 -07:00
Krrish Dholakia	e44c218c1b	fix streaming formatting for non-openai models	2023-09-16 19:20:07 -07:00
Krrish Dholakia	d2f8a7b2ae	bug fixes	2023-09-16 16:32:12 -07:00
Krrish Dholakia	122c993e6f	except custom openai proxy	2023-09-16 16:15:44 -07:00
Krrish Dholakia	01978c6ec1	bump version	2023-09-16 12:28:57 -07:00
Krrish Dholakia	ce827faa93	fixes to testing	2023-09-16 11:40:01 -07:00
Krrish Dholakia	5470bc6fd0	improvements to streaming	2023-09-16 11:02:06 -07:00
Krrish Dholakia	21cd55ab26	ensure streaming format is exactly the same as openai	2023-09-16 10:35:20 -07:00
Krrish Dholakia	34c676a8ec	fix streaming error	2023-09-15 15:21:15 -07:00
Krrish Dholakia	f7e92bb0db	make max budget work for openai streaming	2023-09-14 16:22:52 -07:00
Krrish Dholakia	3b4064a58f	move cohere to http endpoint	2023-09-14 11:17:38 -07:00
Krrish Dholakia	e2ea4adb84	fixes to mock completion	2023-09-14 10:03:57 -07:00
Krrish Dholakia	f98da9f13c	adding support for nlp cloud	2023-09-14 09:19:34 -07:00
Krrish Dholakia	aaa57abddd	map finish reason	2023-09-13 19:22:38 -07:00
Krrish Dholakia	53b10e4372	allow updating budget manager cost by passing in text	2023-09-13 15:12:47 -07:00
Krrish Dholakia	5b6b9a9fab	huggingface conversational task support	2023-09-13 13:45:23 -07:00
Krrish Dholakia	e1c91903da	add reset budget on duration end to budget manager	2023-09-12 13:01:55 -07:00
Krrish Dholakia	e80457013b	doc cleanup for custom prompt templates	2023-09-12 12:16:47 -07:00
Krrish Dholakia	baa69734b0	raise better exception if llm provider isn't passed in or inferred	2023-09-12 11:28:50 -07:00
Krrish Dholakia	f946f61b4c	improvements to exception mapping	2023-09-11 18:33:57 -07:00
Krrish Dholakia	9d1a28c7ed	update mock_completion docs	2023-09-11 16:35:25 -07:00
Krrish Dholakia	cbc7e6dbc2	mock responses for streaming	2023-09-11 16:30:29 -07:00
Krrish Dholakia	6da500c6e0	add mock request to docs	2023-09-11 12:19:13 -07:00
Krrish Dholakia	d4806cd686	updating budget manager	2023-09-11 10:58:09 -07:00
Krrish Dholakia	511793f8ac	fix circle ci testing	2023-09-09 16:36:45 -07:00
Krrish Dholakia	beecb60f51	update testing	2023-09-09 16:35:38 -07:00
Krrish Dholakia	8ed85b0523	rename apimanager to budget manager	2023-09-09 16:10:41 -07:00
Krrish Dholakia	a39756bfda	add api manager	2023-09-09 15:55:38 -07:00
Krrish Dholakia	263704e942	fix exception	2023-09-09 11:24:10 -07:00
Krrish Dholakia	a9cab12a47	improve error message returned if model not passed in	2023-09-09 11:18:10 -07:00
Krrish Dholakia	93fb247b1d	fix exception mapping	2023-09-08 18:45:18 -07:00
Krrish Dholakia	323e095688	fix exception mapping error	2023-09-08 18:20:07 -07:00
Krrish Dholakia	147a877aca	bump version	2023-09-07 17:00:20 -07:00
Krrish Dholakia	e452ceb21e	fix litellm client	2023-09-07 16:22:00 -07:00
Krrish Dholakia	35cf6ef0a1	batch completions for vllm now works too	2023-09-06 19:26:19 -07:00
Krrish Dholakia	4cfcabd919	adding support for vllm	2023-09-06 18:07:44 -07:00