182 commits

Author	SHA1	Message	Date
Krrish Dholakia	2af46e8be9	remove budget manager	2023-09-30 11:42:56 -07:00
Krrish Dholakia	e8ec3e8795	add mistral prompt templating	2023-09-29 21:41:28 -07:00
Krrish Dholakia	dc9f02267a	update values	2023-09-29 20:53:55 -07:00
Krrish Dholakia	b8c8f01221	update openai proxy docs	2023-09-29 18:31:52 -07:00
Krrish Dholakia	f04d50d119	updates	2023-09-29 11:33:58 -07:00
Krrish Dholakia	4665b2a898	updates to proxy	2023-09-28 17:58:47 -07:00
Krrish Dholakia	09b8c08cad	update proxy cli	2023-09-28 16:24:41 -07:00
Krrish Dholakia	54409a2a30	fixing claude max token testing	2023-09-27 21:52:30 -07:00
Krrish Dholakia	4621582d49	updates	2023-09-27 17:43:22 -07:00
Krrish Dholakia	ce62dc40b9	remove trust remote code option	2023-09-26 19:20:48 -07:00
Krrish Dholakia	076affbff2	fix llama index validate environment error	2023-09-26 17:53:22 -07:00
Krrish Dholakia	eb1c7220ff	add support message on exception	2023-09-26 17:48:24 -07:00
Krrish Dholakia	73487d5910	add proxy server to docs	2023-09-26 14:42:01 -07:00
Krrish Dholakia	a72880925c	push cli tool	2023-09-26 13:30:47 -07:00
Krrish Dholakia	fd953b7ab4	allow backup api keys and api bases	2023-09-26 06:56:26 -07:00
Krrish Dholakia	102c81f863	add get help message	2023-09-25 10:26:28 -07:00
Krrish Dholakia	889679a0dd	fix exception mapping for streaming	2023-09-23 15:04:59 -07:00
Krrish Dholakia	e1d0c6096c	fix anthropic json location bug	2023-09-22 15:21:28 -07:00
Krrish Dholakia	e62b584439	adding support for cohere, anthropic, llama2 tokenizers	2023-09-22 14:03:52 -07:00
Krrish Dholakia	cf5060f136	add token trimming to adapt to prompt flag in config	2023-09-21 17:47:52 -07:00
Krrish Dholakia	38a4a2c376	bump version	2023-09-21 17:15:33 -07:00
Krrish Dholakia	e0c2bd7cf1	add docs on using completion with configs	2023-09-21 17:03:36 -07:00
Krrish Dholakia	be00dd6367	add adapt to prompt size to config	2023-09-21 15:08:05 -07:00
Krrish Dholakia	ebd763287a	support default fallback models	2023-09-21 14:28:07 -07:00
Krrish Dholakia	2f44191642	add completion configs	2023-09-21 14:00:11 -07:00
Krrish Dholakia	b76372cee0	add metadata logging to promptlayer	2023-09-21 10:45:02 -07:00
Krrish Dholakia	e48e1a4597	fix openrouter issue	2023-09-20 20:38:31 -07:00
Krrish Dholakia	86f9991412	bump litellm version	2023-09-20 20:20:34 -07:00
Krrish Dholakia	39c3f2d6ec	add response ms to response object	2023-09-20 19:50:38 -07:00
Krrish Dholakia	fc922bc300	fix multithreading issue with response objects	2023-09-20 19:36:08 -07:00
Krrish Dholakia	c63db48652	return all best of sequences	2023-09-20 14:43:25 -07:00
Krrish Dholakia	ecad921b01	add oobabooga text web api support	2023-09-19 18:56:53 -07:00
Krrish Dholakia	633e36de42	handle llama 2 eos tokens in streaming	2023-09-18 13:44:19 -07:00
Krrish Dholakia	8c809db567	bump version	2023-09-18 12:27:18 -07:00
Krrish Dholakia	9067ec3b43	add support for litellm proxy calls	2023-09-18 12:15:21 -07:00
Krrish Dholakia	5b294c704e	fix hf conversational task bug	2023-09-18 11:46:36 -07:00
Krrish Dholakia	78da8e7e65	update readme with contributing.md information	2023-09-18 09:30:30 -07:00
Krrish Dholakia	66a3c59ebe	bump pyproject version	2023-09-16 20:45:16 -07:00
Krrish Dholakia	e44c218c1b	fix streaming formatting for non-openai models	2023-09-16 19:20:07 -07:00
Krrish Dholakia	d2f8a7b2ae	bug fixes	2023-09-16 16:32:12 -07:00
Krrish Dholakia	122c993e6f	except custom openai proxy	2023-09-16 16:15:44 -07:00
Krrish Dholakia	01978c6ec1	bump version	2023-09-16 12:28:57 -07:00
Krrish Dholakia	ce827faa93	fixes to testing	2023-09-16 11:40:01 -07:00
Krrish Dholakia	8a3844692c	moving open interpreter tests	2023-09-16 11:04:35 -07:00
Krrish Dholakia	5470bc6fd0	improvements to streaming	2023-09-16 11:02:06 -07:00
Krrish Dholakia	21cd55ab26	ensure streaming format is exactly the same as openai	2023-09-16 10:35:20 -07:00
Krrish Dholakia	5b38f04524	fixes to streaming	2023-09-15 17:23:10 -07:00
Krrish Dholakia	7b19d62564	streaming fixes	2023-09-15 15:49:20 -07:00
Krrish Dholakia	fa441e9a3e	update streaming	2023-09-15 15:25:14 -07:00
Krrish Dholakia	34c676a8ec	fix streaming error	2023-09-15 15:21:15 -07:00