373 commits

Author	SHA1	Message	Date
Krrish Dholakia	382dd0a13d	fix(utils): remove ui to view error message	2023-10-11 16:01:57 -07:00
Krrish Dholakia	dac3a57095	fix(utils): don't wait for thread to complete to return response	2023-10-11 14:23:55 -07:00
ishaan-jaff	5c92b9c4c1	(feat) upgrade supabase callback + support logging streaming on supabase	2023-10-11 12:34:10 -07:00
Krrish Dholakia	87e5f79924	fix(proxy_cli-and-utils.py): fixing how config file is read + infering llm_provider for known openai endpoints	2023-10-10 20:53:02 -07:00
Krrish Dholakia	cc0e4f4f9f	fix: fix value error if model returns empty completion	2023-10-10 10:11:40 -07:00
ishaan-jaff	a214a0f328	(fix) remove print from supabaseClient	2023-10-10 09:59:38 -07:00
ishaan-jaff	303d27923e	(fix) identify users in logging	2023-10-10 09:56:16 -07:00
ishaan-jaff	0e5997c7ea	(fix) identify users in callbacks	2023-10-10 09:55:57 -07:00
ishaan-jaff	faaa263cd7	(feat) allow messages to be passed in completion_cost	2023-10-10 08:35:31 -07:00
Krrish Dholakia	22ee0c6931	refactor(bedrock.py): take model names from model cost dict	2023-10-10 07:35:03 -07:00
Krrish Dholakia	4a1bd8267f	fix: bug fix when n>1 passed in	2023-10-09 16:46:33 -07:00
Krrish Dholakia	0f146bce49	style(utils.py): return better exceptions ... https://github.com/BerriAI/litellm/issues/563	2023-10-09 15:28:33 -07:00
Krrish Dholakia	936548db40	feat(factory.py): option to add function details to prompt, if model doesn't support functions param	2023-10-09 09:53:53 -07:00
Krrish Dholakia	cf7e2595b8	fix(utils): adds complete streaming response to success handler	2023-10-07 15:42:00 -07:00
ishaan-jaff	b188816a89	feat(rate limit aware acompletion calls):	2023-10-06 20:48:53 -07:00
ishaan-jaff	e0eedbc183	chore(stash rate limit manager changes ):	2023-10-06 16:22:02 -07:00
Krrish Dholakia	37d7837b63	feat(ollama.py): exposing ollama config	2023-10-06 15:52:58 -07:00
Krrish Dholakia	5ab3a4b8d7	fix(add-custom-success-callback-for-streaming): add custom success callback for streaming	2023-10-06 15:02:02 -07:00
Krrish Dholakia	69cdf5347a	style(test_completion.py): fix merge conflict	2023-10-05 22:09:38 -07:00
ishaan-jaff	0da3150aa3	fix(n param in completion()): fix error thrown when passing n for cohere	2023-10-05 19:54:13 -07:00
ishaan-jaff	605369bc2a	fix(llmonitor callback): correctly set user_id	2023-10-05 19:36:39 -07:00
ishaan-jaff	2e1b02e189	fix(completion()): add request_timeout as a param, fix claude error when request_timeout set	2023-10-05 19:05:28 -07:00
Krrish Dholakia	1492916a37	adding custom prompt templates to ollama	2023-10-05 10:48:16 -07:00
ishaan-jaff	b8f6de1289	fix linting	2023-10-04 16:03:58 -07:00
ishaan-jaff	c8810b3f00	make rate limit hadler a class 2	2023-10-04 16:03:58 -07:00
Krish Dholakia	5827b30042	Merge pull request #530 from vedant-z/patch-1 ... Update utils.py	2023-10-04 15:42:59 -07:00
ishaan-jaff	236a021095	add batch_completion with rate limits to utils	2023-10-04 14:46:11 -07:00
Vedant Borkar	5c0354a924	Update utils.py	2023-10-05 03:07:50 +05:30
Krrish Dholakia	ae89a2a04b	add additional param mapping	2023-10-03 21:56:08 -07:00
Krrish Dholakia	c2d6804be0	add support for ai21 input params	2023-10-03 21:05:28 -07:00
ishaan-jaff	0696caf2cd	remove print statement	2023-10-03 21:01:22 -07:00
ishaan-jaff	b06839b567	remove junk print statements	2023-10-03 20:58:39 -07:00
Krrish Dholakia	7dcec75faf	fix n=1 issue with langchain	2023-10-03 11:06:59 -07:00
Krrish Dholakia	c7384859a3	support n param for hf	2023-10-03 07:10:13 -07:00
Krrish Dholakia	4ea7162a81	support cohere top p	2023-10-02 21:38:56 -07:00
Krrish Dholakia	4ce5c1d1dc	fix replicate error	2023-10-02 21:35:16 -07:00
Krrish Dholakia	8c48af11c2	fixes to get optional params	2023-10-02 14:44:11 -07:00
Krrish Dholakia	0ae93d1112	fixing optional param mapping	2023-10-02 14:14:30 -07:00
Krrish Dholakia	d735f48917	fixes to get_optional_params	2023-10-02 12:34:22 -07:00
Krrish Dholakia	eb4c7876e2	fix get optional params	2023-10-02 12:02:53 -07:00
Krrish Dholakia	12fa4069f3	raise exception if optional param is not mapped to model	2023-10-02 11:17:51 -07:00
Krrish Dholakia	cbb0fc14d1	raise exception if function call passed to provider that doesn't support it	2023-10-02 07:39:01 -07:00
Krrish Dholakia	eec2c848f1	improvements to proxy cli and finish reason mapping for anthropic	2023-09-30 18:09:16 -07:00
ishaan-jaff	48cad985ad	add fake streaming for petals	2023-09-30 10:22:04 -07:00
Krrish Dholakia	6ac9470203	add mistral prompt templating	2023-09-29 21:41:28 -07:00
ishaan-jaff	4f7c6f1c77	fix co embeddings	2023-09-29 16:00:49 -07:00
ishaan-jaff	aaa5ac0488	add param mapping to claude bedrock	2023-09-29 15:36:57 -07:00
ishaan-jaff	0e11fdda42	test fixes for embedding	2023-09-29 15:31:53 -07:00
ishaan-jaff	e039313b63	add bedrock anthropic streaming	2023-09-29 15:19:42 -07:00
Krrish Dholakia	932447e63a	updates	2023-09-29 11:33:58 -07:00