466 commits

Author	SHA1	Message	Date
ishaan-jaff	5de280c9e5	(fix) identify users in callbacks	2023-10-10 09:55:57 -07:00
ishaan-jaff	c94ee62bcf	(feat) allow messages to be passed in completion_cost	2023-10-10 08:35:31 -07:00
Krrish Dholakia	0d863f00ad	refactor(bedrock.py): take model names from model cost dict	2023-10-10 07:35:03 -07:00
Krrish Dholakia	253e8d27db	fix: bug fix when n>1 passed in	2023-10-09 16:46:33 -07:00
Krrish Dholakia	079122fbf1	style(utils.py): return better exceptions ... https://github.com/BerriAI/litellm/issues/563	2023-10-09 15:28:33 -07:00
Krrish Dholakia	704be9dcd1	feat(factory.py): option to add function details to prompt, if model doesn't support functions param	2023-10-09 09:53:53 -07:00
Krrish Dholakia	9cda24e1b2	fix(utils): adds complete streaming response to success handler	2023-10-07 15:42:00 -07:00
ishaan-jaff	228d6ea608	feat(rate limit aware acompletion calls):	2023-10-06 20:48:53 -07:00
ishaan-jaff	56c87febae	chore(stash rate limit manager changes ):	2023-10-06 16:22:02 -07:00
Krrish Dholakia	306a38880d	feat(ollama.py): exposing ollama config	2023-10-06 15:52:58 -07:00
Krrish Dholakia	7e34736a38	fix(add-custom-success-callback-for-streaming): add custom success callback for streaming	2023-10-06 15:02:02 -07:00
Krrish Dholakia	dd7e397650	style(test_completion.py): fix merge conflict	2023-10-05 22:09:38 -07:00
ishaan-jaff	4e6e79b20a	fix(n param in completion()): fix error thrown when passing n for cohere	2023-10-05 19:54:13 -07:00
ishaan-jaff	1897a1ee46	fix(llmonitor callback): correctly set user_id	2023-10-05 19:36:39 -07:00
ishaan-jaff	8120477be4	fix(completion()): add request_timeout as a param, fix claude error when request_timeout set	2023-10-05 19:05:28 -07:00
Krrish Dholakia	ed31860206	adding custom prompt templates to ollama	2023-10-05 10:48:16 -07:00
ishaan-jaff	e9160a1485	fix linting	2023-10-04 16:03:58 -07:00
ishaan-jaff	34dc176440	make rate limit hadler a class 2	2023-10-04 16:03:58 -07:00
Krish Dholakia	24c12d6b9b	Merge pull request #530 from vedant-z/patch-1 ... Update utils.py	2023-10-04 15:42:59 -07:00
ishaan-jaff	f6af10b2ca	add batch_completion with rate limits to utils	2023-10-04 14:46:11 -07:00
Vedant Borkar	c21eae7f79	Update utils.py	2023-10-05 03:07:50 +05:30
Krrish Dholakia	95899bf60e	add additional param mapping	2023-10-03 21:56:08 -07:00
Krrish Dholakia	851cb86daa	add support for ai21 input params	2023-10-03 21:05:28 -07:00
ishaan-jaff	20f990f652	remove print statement	2023-10-03 21:01:22 -07:00
ishaan-jaff	ac2d89aee6	remove junk print statements	2023-10-03 20:58:39 -07:00
Krrish Dholakia	e834c063ff	fix n=1 issue with langchain	2023-10-03 11:06:59 -07:00
Krrish Dholakia	512769e841	support n param for hf	2023-10-03 07:10:13 -07:00
Krrish Dholakia	50fc4de45f	support cohere top p	2023-10-02 21:38:56 -07:00
Krrish Dholakia	5a1a1908c1	fix replicate error	2023-10-02 21:35:16 -07:00
Krrish Dholakia	0daf2e3880	fixes to get optional params	2023-10-02 14:44:11 -07:00
Krrish Dholakia	8b60d797e1	fixing optional param mapping	2023-10-02 14:14:30 -07:00
Krrish Dholakia	7cec308a2c	fixes to get_optional_params	2023-10-02 12:34:22 -07:00
Krrish Dholakia	5a19ee1a71	fix get optional params	2023-10-02 12:02:53 -07:00
Krrish Dholakia	1cae080eb2	raise exception if optional param is not mapped to model	2023-10-02 11:17:51 -07:00
Krrish Dholakia	a7ee0bcc8c	raise exception if function call passed to provider that doesn't support it	2023-10-02 07:39:01 -07:00
Krrish Dholakia	3ca79a88bb	improvements to proxy cli and finish reason mapping for anthropic	2023-09-30 18:09:16 -07:00
ishaan-jaff	8d1f5ba69d	add fake streaming for petals	2023-09-30 10:22:04 -07:00
Krrish Dholakia	e8ec3e8795	add mistral prompt templating	2023-09-29 21:41:28 -07:00
ishaan-jaff	762d590500	fix co embeddings	2023-09-29 16:00:49 -07:00
ishaan-jaff	6a81f860f9	add param mapping to claude bedrock	2023-09-29 15:36:57 -07:00
ishaan-jaff	acc15f5778	test fixes for embedding	2023-09-29 15:31:53 -07:00
ishaan-jaff	eb25e9f15f	add bedrock anthropic streaming	2023-09-29 15:19:42 -07:00
Krrish Dholakia	f04d50d119	updates	2023-09-29 11:33:58 -07:00
ishaan-jaff	af914d4be1	add cohere embedding models	2023-09-29 09:59:31 -07:00
Krrish Dholakia	4665b2a898	updates to proxy	2023-09-28 17:58:47 -07:00
Krrish Dholakia	09b8c08cad	update proxy cli	2023-09-28 16:24:41 -07:00
ishaan-jaff	8e2b139f8d	fix petals bug	2023-09-27 20:51:31 -07:00
Krrish Dholakia	4621582d49	updates	2023-09-27 17:43:22 -07:00
Krrish Dholakia	1f2a12fe1f	remove print statements	2023-09-27 17:06:49 -07:00
Krrish Dholakia	ce62dc40b9	remove trust remote code option	2023-09-26 19:20:48 -07:00