292 commits

Author	SHA1	Message	Date
Krrish Dholakia	060a2e40b2	fix: fixing mypy linting errors and being backwards compatible for azure=true flag	2023-10-05 22:36:32 -07:00
Krrish Dholakia	dd7e397650	style(test_completion.py): fix merge conflict	2023-10-05 22:09:38 -07:00
ishaan-jaff	8120477be4	fix(completion()): add request_timeout as a param, fix claude error when request_timeout set	2023-10-05 19:05:28 -07:00
ishaan-jaff	29509a48f8	ollama default api_base to http://localhost:11434	2023-10-05 11:04:51 -07:00
Krrish Dholakia	ed31860206	adding custom prompt templates to ollama	2023-10-05 10:48:16 -07:00
ishaan-jaff	2d4671a7ef	add ratelimitmanager	2023-10-04 16:03:58 -07:00
ishaan-jaff	68006ff584	make RateLimitHandler a class	2023-10-04 16:03:58 -07:00
ishaan-jaff	defc830e95	add batch_completion_rate_limits	2023-10-04 14:46:11 -07:00
Krrish Dholakia	430e2698a2	add param mapping to docs	2023-10-03 09:20:58 -07:00
Krrish Dholakia	345a14483e	Fixes to bedrock	2023-10-02 16:09:06 -07:00
Krrish Dholakia	0daf2e3880	fixes to get optional params	2023-10-02 14:44:11 -07:00
Krrish Dholakia	8b60d797e1	fixing optional param mapping	2023-10-02 14:14:30 -07:00
Krrish Dholakia	7cec308a2c	fixes to get_optional_params	2023-10-02 12:34:22 -07:00
Krrish Dholakia	8acad78fb3	fix linting issues	2023-10-02 12:12:34 -07:00
Krrish Dholakia	5a19ee1a71	fix get optional params	2023-10-02 12:02:53 -07:00
Krrish Dholakia	1cae080eb2	raise exception if optional param is not mapped to model	2023-10-02 11:17:51 -07:00
Krrish Dholakia	1c802c26fc	updates	2023-09-30 18:26:23 -07:00
ishaan-jaff	8d1f5ba69d	add fake streaming for petals	2023-09-30 10:22:04 -07:00
ishaan-jaff	1a8144360e	fix logging error	2023-09-29 16:02:19 -07:00
ishaan-jaff	3fbad7dfa7	add hf embedding models	2023-09-29 11:57:38 -07:00
ishaan-jaff	17be1d89b3	remove junk code in getting custom_llm_provider	2023-09-29 11:18:08 -07:00
ishaan-jaff	af914d4be1	add cohere embedding models	2023-09-29 09:59:31 -07:00
ishaan-jaff	13ff65a8fe	remove junk from completion	2023-09-28 17:57:48 -07:00
ishaan-jaff	0f3be26778	remove junk from completion input	2023-09-28 17:54:46 -07:00
ishaan-jaff	da4a9d3119	remove junk vars in completion.py	2023-09-28 17:50:06 -07:00
ishaan-jaff	1b74cd2790	clean out args passed to completion	2023-09-28 17:43:54 -07:00
ishaan-jaff	8d11a0c722	clean out args given to completion	2023-09-28 17:35:47 -07:00
Krrish Dholakia	e2d23afae4	fix hf routing bug	2023-09-28 13:32:39 -07:00
Krrish Dholakia	3658bdb61b	fix testing	2023-09-27 21:31:00 -07:00
Krrish Dholakia	d334031108	adding support for completions endpoint in proxy	2023-09-27 21:04:15 -07:00
Krrish Dholakia	a4ca26a189	cleanup	2023-09-26 21:55:25 -07:00
Krrish Dholakia	6e05fca714	add switching api keys + api bases to docs	2023-09-26 21:47:33 -07:00
Krrish Dholakia	ce62dc40b9	remove trust remote code option	2023-09-26 19:20:48 -07:00
ishaan-jaff	e7a9246414	palm streaming	2023-09-26 12:27:49 -07:00
ishaan-jaff	5944b1bbab	lint fix	2023-09-26 10:11:53 -07:00
ishaan-jaff	d6bc20d5be	add palm	2023-09-26 10:00:56 -07:00
ishaan-jaff	ed2d461770	add beta deep infra support	2023-09-25 21:42:46 -07:00
Krrish Dholakia	bdc6ef1df8	add contributor message to code	2023-09-25 10:00:10 -07:00
Krrish Dholakia	889679a0dd	fix exception mapping for streaming	2023-09-23 15:04:59 -07:00
ishaan-jaff	cd91312252	track vertex ai usage	2023-09-22 20:43:03 -07:00
Krrish Dholakia	9ef0ad9e66	expose vertex ai and hf api base as env var	2023-09-22 15:14:33 -07:00
ishaan-jaff	6add152818	sagemaker streaming	2023-09-21 16:14:44 -07:00
Krrish Dholakia	2f44191642	add completion configs	2023-09-21 14:00:11 -07:00
Krrish Dholakia	b76372cee0	add metadata logging to promptlayer	2023-09-21 10:45:02 -07:00
ishaan-jaff	35bb6f5a50	support acompletion + stream for ollama	2023-09-21 10:39:48 -07:00
Ishaan Jaff	a669f5a738	Merge pull request #416 from BerriAI/ishaan/error-logging ... Add Dashboard for showing error logs on exception	2023-09-20 20:17:18 -07:00
Krrish Dholakia	fc922bc300	fix multithreading issue with response objects	2023-09-20 19:36:08 -07:00
ishaan-jaff	eeeb95a6ac	add batch testing	2023-09-20 08:17:48 -07:00
ishaan-jaff	41a934a99c	add batch_completion_models_all_responses	2023-09-20 08:01:53 -07:00
ishaan-jaff	f9476b7a52	fix moderation	2023-09-19 22:18:02 -07:00