577 commits

Author	SHA1	Message	Date
ishaan-jaff	e01d83cea6	(feat) bedrock add finish_reason to streaming responses	2023-10-12 16:22:34 -07:00
ishaan-jaff	66cbba3f55	(feat) add Rate Limit Error for bedrock	2023-10-12 15:57:34 -07:00
ishaan-jaff	640541f2ce	(fix) add bedrock exception mapping for Auth	2023-10-12 15:38:09 -07:00
ishaan-jaff	897286ec15	(feat) add ollama exception mapping	2023-10-11 17:00:39 -07:00
Krrish Dholakia	e1ee2890b9	fix(utils): remove ui to view error message	2023-10-11 16:01:57 -07:00
Krrish Dholakia	e26f98dce2	fix(utils): don't wait for thread to complete to return response	2023-10-11 14:23:55 -07:00
ishaan-jaff	cc55bc886a	(feat) upgrade supabase callback + support logging streaming on supabase	2023-10-11 12:34:10 -07:00
Krrish Dholakia	d280a8c434	fix(proxy_cli-and-utils.py): fixing how config file is read + infering llm_provider for known openai endpoints	2023-10-10 20:53:02 -07:00
Krrish Dholakia	af2fd0e0de	fix: fix value error if model returns empty completion	2023-10-10 10:11:40 -07:00
ishaan-jaff	f97811fb1c	(fix) remove print from supabaseClient	2023-10-10 09:59:38 -07:00
ishaan-jaff	228d77d345	(fix) identify users in logging	2023-10-10 09:56:16 -07:00
ishaan-jaff	5de280c9e5	(fix) identify users in callbacks	2023-10-10 09:55:57 -07:00
ishaan-jaff	c94ee62bcf	(feat) allow messages to be passed in completion_cost	2023-10-10 08:35:31 -07:00
Krrish Dholakia	0d863f00ad	refactor(bedrock.py): take model names from model cost dict	2023-10-10 07:35:03 -07:00
Krrish Dholakia	253e8d27db	fix: bug fix when n>1 passed in	2023-10-09 16:46:33 -07:00
Krrish Dholakia	079122fbf1	style(utils.py): return better exceptions ... https://github.com/BerriAI/litellm/issues/563	2023-10-09 15:28:33 -07:00
Krrish Dholakia	704be9dcd1	feat(factory.py): option to add function details to prompt, if model doesn't support functions param	2023-10-09 09:53:53 -07:00
Krrish Dholakia	9cda24e1b2	fix(utils): adds complete streaming response to success handler	2023-10-07 15:42:00 -07:00
ishaan-jaff	228d6ea608	feat(rate limit aware acompletion calls):	2023-10-06 20:48:53 -07:00
ishaan-jaff	56c87febae	chore(stash rate limit manager changes ):	2023-10-06 16:22:02 -07:00
Krrish Dholakia	306a38880d	feat(ollama.py): exposing ollama config	2023-10-06 15:52:58 -07:00
Krrish Dholakia	7e34736a38	fix(add-custom-success-callback-for-streaming): add custom success callback for streaming	2023-10-06 15:02:02 -07:00
Krrish Dholakia	dd7e397650	style(test_completion.py): fix merge conflict	2023-10-05 22:09:38 -07:00
ishaan-jaff	4e6e79b20a	fix(n param in completion()): fix error thrown when passing n for cohere	2023-10-05 19:54:13 -07:00
ishaan-jaff	1897a1ee46	fix(llmonitor callback): correctly set user_id	2023-10-05 19:36:39 -07:00
ishaan-jaff	8120477be4	fix(completion()): add request_timeout as a param, fix claude error when request_timeout set	2023-10-05 19:05:28 -07:00
Krrish Dholakia	ed31860206	adding custom prompt templates to ollama	2023-10-05 10:48:16 -07:00
ishaan-jaff	e9160a1485	fix linting	2023-10-04 16:03:58 -07:00
ishaan-jaff	34dc176440	make rate limit hadler a class 2	2023-10-04 16:03:58 -07:00
Krish Dholakia	24c12d6b9b	Merge pull request #530 from vedant-z/patch-1 ... Update utils.py	2023-10-04 15:42:59 -07:00
ishaan-jaff	f6af10b2ca	add batch_completion with rate limits to utils	2023-10-04 14:46:11 -07:00
Vedant Borkar	c21eae7f79	Update utils.py	2023-10-05 03:07:50 +05:30
Krrish Dholakia	95899bf60e	add additional param mapping	2023-10-03 21:56:08 -07:00
Krrish Dholakia	851cb86daa	add support for ai21 input params	2023-10-03 21:05:28 -07:00
ishaan-jaff	20f990f652	remove print statement	2023-10-03 21:01:22 -07:00
ishaan-jaff	ac2d89aee6	remove junk print statements	2023-10-03 20:58:39 -07:00
Krrish Dholakia	e834c063ff	fix n=1 issue with langchain	2023-10-03 11:06:59 -07:00
Krrish Dholakia	512769e841	support n param for hf	2023-10-03 07:10:13 -07:00
Krrish Dholakia	50fc4de45f	support cohere top p	2023-10-02 21:38:56 -07:00
Krrish Dholakia	5a1a1908c1	fix replicate error	2023-10-02 21:35:16 -07:00
Krrish Dholakia	0daf2e3880	fixes to get optional params	2023-10-02 14:44:11 -07:00
Krrish Dholakia	8b60d797e1	fixing optional param mapping	2023-10-02 14:14:30 -07:00
Krrish Dholakia	7cec308a2c	fixes to get_optional_params	2023-10-02 12:34:22 -07:00
Krrish Dholakia	5a19ee1a71	fix get optional params	2023-10-02 12:02:53 -07:00
Krrish Dholakia	1cae080eb2	raise exception if optional param is not mapped to model	2023-10-02 11:17:51 -07:00
Krrish Dholakia	a7ee0bcc8c	raise exception if function call passed to provider that doesn't support it	2023-10-02 07:39:01 -07:00
Krrish Dholakia	3ca79a88bb	improvements to proxy cli and finish reason mapping for anthropic	2023-09-30 18:09:16 -07:00
ishaan-jaff	8d1f5ba69d	add fake streaming for petals	2023-09-30 10:22:04 -07:00
Krrish Dholakia	e8ec3e8795	add mistral prompt templating	2023-09-29 21:41:28 -07:00
ishaan-jaff	762d590500	fix co embeddings	2023-09-29 16:00:49 -07:00