1282 commits

Author	SHA1	Message	Date
Krrish Dholakia	b98a58d1b1	test(test_completion.py): re-add bedrock + sagemaker testing	2023-10-31 16:49:13 -07:00
Krish Dholakia	ed8f1ab5dc	Merge pull request #717 from canada4663/main ... support for custom bedrock runtime endpoint	2023-10-31 16:47:33 -07:00
Krish Dholakia	a157a3da8c	Merge pull request #722 from karvetskiy/fix-router-caching ... Fix caching for Router	2023-10-31 16:39:18 -07:00
ishaan-jaff	1dead49538	(test) add support for returning logprobs	2023-10-31 15:33:45 -07:00
ishaan-jaff	d57dc616b8	(feat) text_completion return raw response for davinci003	2023-10-31 15:32:04 -07:00
ishaan-jaff	80c6920709	(feat) text_completion return raw openai response for text_completion requests	2023-10-31 15:31:24 -07:00
ishaan-jaff	b99b137f10	(fix) linting errors	2023-10-31 14:43:10 -07:00
ishaan-jaff	c05f8bf554	(test) text_completion pass prompt as array	2023-10-31 14:29:43 -07:00
ishaan-jaff	daeb4a7f9e	(feat) text_completion add support for passing prompt as array	2023-10-31 14:29:43 -07:00
mc-marcocheng	c7b6911c7b	Handle empty input edge case	2023-10-31 14:38:04 +08:00
Krrish Dholakia	297bd67a45	test: removing unstable tests	2023-10-30 21:10:36 -07:00
Krrish Dholakia	53b5409fac	test(test_async_fn.py): fix import issues	2023-10-30 20:57:24 -07:00
Krrish Dholakia	83fd829b49	fix(main.py): removing print_verbose	2023-10-30 20:37:12 -07:00
Krrish Dholakia	92d02a904d	test(test_sentry.py): fix testing	2023-10-30 20:21:40 -07:00
ishaan-jaff	6ec3e222b0	(test) add func to prompt	2023-10-30 20:06:06 -07:00
ishaan-jaff	fd31e2176e	(test) fix test test_exception_tracking	2023-10-30 20:05:37 -07:00
Krrish Dholakia	93b1cd7ab2	test(test_async_fn.py): test logging	2023-10-30 19:59:36 -07:00
Krrish Dholakia	d2919a121e	test(test_async_fn.py): debugging circle ci issue	2023-10-30 19:50:35 -07:00
Krrish Dholakia	2c274c5ad6	test(test_async_fn.py): addding sync test	2023-10-30 19:38:31 -07:00
Krrish Dholakia	655789ee10	test(test_async_fn.py): more logging	2023-10-30 19:29:37 -07:00
Krrish Dholakia	2c05513cd4	test(test_async_fn.py): adding more logging	2023-10-30 19:11:07 -07:00
Krrish Dholakia	9c9b205a7b	test(test_async_fn.py): more logging	2023-10-30 18:39:10 -07:00
Krrish Dholakia	9641cd0602	test(test_api_key_param.py): cleanup	2023-10-30 18:27:42 -07:00
Krrish Dholakia	6eb7205aba	test(test_async_fn.py): add better error logging	2023-10-30 18:18:11 -07:00
Krrish Dholakia	147d69f230	feat(main.py): add support for maritalk api	2023-10-30 17:36:51 -07:00
ishaan-jaff	85cd1faddd	(fix) improve batch_completion_models + multiple deployments, if 1 model fails, return result from 2nd	2023-10-30 17:20:07 -07:00
ishaan-jaff	d9f5989a7f	(docs) add docstring for batch_completion	2023-10-30 14:31:34 -07:00
ishaan-jaff	32b6714a8b	(docs) completion_with_config	2023-10-30 14:29:40 -07:00
ishaan-jaff	e0e468a56b	(docs) docstring for completion_with_retries	2023-10-30 14:20:09 -07:00
ishaan-jaff	ae376a9835	(docs) encode docstring	2023-10-30 14:10:29 -07:00
ishaan-jaff	fdef63439d	(docs) add docstring for validate_environment	2023-10-30 14:06:55 -07:00
ishaan-jaff	94542ae6be	def get_valid_models(): ... (docs) add docstring for	2023-10-30 14:05:09 -07:00
ishaan-jaff	bb5073fcbe	(docs) add doc string for check_valid_api_key	2023-10-30 14:02:31 -07:00
ishaan-jaff	fed0fec658	(docs) add doc string for aembedding	2023-10-30 13:59:56 -07:00
ishaan-jaff	263c5055ac	(fix) update acompletion docstring	2023-10-30 13:53:32 -07:00
seva	bac6f41eb7	Add tests for cache with TTL	2023-10-30 13:35:55 +01:00
seva	f0a9f8c61e	Router & Caching fixes: ... - Add optional TTL to Cache parameters - Fix tpm and rpm caching in Router	2023-10-30 13:29:35 +01:00
Krish Dholakia	97368e83bd	Merge pull request #706 from mc-marcocheng/router/fix_dict ... Fix Router.set_model_list & Avoid overwriting litellm_params	2023-10-29 21:11:26 -07:00
canada4663	49033bbe27	add ability to use custom AWS Bedrock Runtime endpoint via environment or .env variable AWS_BEDROCK_RUNTIME_ENDPOINT or as a parameter to init_bedrock_client	2023-10-28 22:25:45 -07:00
canada4663	46ef5a94b9	add in ability to read AWS boto3 default AWS Region name if litellm .env config AWS_REGION_NAME not available	2023-10-28 21:43:48 -07:00
ishaan-jaff	e80f07c76a	(tests) easily track cost for responses	2023-10-28 15:08:35 -07:00
ishaan-jaff	0069b09caa	(feat) track cost for responses easily	2023-10-28 15:08:35 -07:00
Krrish Dholakia	879b4b983f	test(test_streaming.py): commenting out sagemaker test due to aws key issue	2023-10-28 12:10:07 -07:00
ishaan-jaff	d5ad0f975f	(fix) remove bloat completion_with_split_tests	2023-10-27 18:13:30 -07:00
ishaan-jaff	446e50ce2e	(fix) remove bloat - rate limit manager	2023-10-27 18:11:54 -07:00
ishaan-jaff	19497d0c9a	(fix) remove bloat - ratelimitmanager	2023-10-27 18:11:39 -07:00
ishaan-jaff	8803116ec6	(feat) set litellm_call_id in fallbacks	2023-10-27 18:09:00 -07:00
ishaan-jaff	ef449f155e	(fix) utils - remove bloat - deprecated completion_with_split_tests	2023-10-27 18:04:15 -07:00
ishaan-jaff	8ab127d6a3	(fix) only set litellm call id if it's not set in completion()	2023-10-27 18:02:14 -07:00
ishaan-jaff	a88ed12a9a	(fix) remove print statements from completion fallbacks, make them print verbose	2023-10-27 17:54:48 -07:00