466 commits

Author	SHA1	Message	Date
ishaan-jaff	ca03f83597	(feat) async embeddings: OpenAI	2023-11-29 19:35:08 -08:00
Krrish Dholakia	67df0804eb	fix(main.py): fix null finish reason issue for ollama	2023-11-29 16:50:11 -08:00
Krrish Dholakia	2a5592abe7	fix(bedrock.py): support ai21 / bedrock streaming	2023-11-29 16:35:06 -08:00
ishaan-jaff	0fbbefca94	(feat) completion: add rpm, tpm as litellm params	2023-11-29 16:19:05 -08:00
Krrish Dholakia	18afb51d72	bump: version 1.7.13 → 1.7.14	2023-11-29 15:19:18 -08:00
Krrish Dholakia	00b55e4389	fix(main.py): have stream_chunk_builder return successful response even if token_counter fails	2023-11-29 15:19:11 -08:00
Krrish Dholakia	622eaf4a21	fix(utils.py): fix parallel tool calling when streaming	2023-11-29 10:56:21 -08:00
ishaan-jaff	e88f498201	(fix) embedding pop out client from params	2023-11-28 21:22:01 -08:00
Krrish Dholakia	ceadb1547d	fix(main.py): passing client as a litellm-specific kwarg	2023-11-28 21:20:05 -08:00
ishaan-jaff	9d69ea5b12	(fix) router: passing client	2023-11-28 16:34:16 -08:00
ishaan-jaff	efd5dbccd5	(feat) completion:openai pass OpenAI client	2023-11-28 16:05:01 -08:00
ishaan-jaff	a2d7623d6e	(feat) completion: Azure allow users to pass client to router	2023-11-28 15:56:52 -08:00
ishaan-jaff	ad6a3fb8fe	(feat) allow users to pass azure client for acmompletion	2023-11-28 15:44:56 -08:00
Krrish Dholakia	6a7a8be4fb	fix(utils.py): fix streaming on-success logging	2023-11-28 09:11:47 -08:00
ishaan-jaff	49afff8c88	(fix) completion: AZURE_OPENAI_API_KEY	2023-11-28 08:06:06 -08:00
Krrish Dholakia	91e8ff439d	fix(main.py): fix linting errors	2023-11-27 19:11:38 -08:00
Krrish Dholakia	01a71cd0dc	fix(stream_chunk_builder): adding support for tool calling in completion counting	2023-11-27 18:39:47 -08:00
Krrish Dholakia	e564f643f5	fix(router.py): speed improvements to the router	2023-11-27 17:35:26 -08:00
Krrish Dholakia	fb680ce4a2	fix(acompletion): fix acompletion raise exception issue when custom llm provider is none	2023-11-27 11:34:48 -08:00
ishaan-jaff	815e1f385b	(fix) embedding: filter out metadata from optional_params	2023-11-25 11:10:06 -08:00
Krrish Dholakia	ff6975a98d	fix(main.py): logit bias mapping for batch_completions	2023-11-24 16:05:51 -08:00
Krrish Dholakia	85854e00c9	fix(main.py): fixing linting issues	2023-11-24 15:25:51 -08:00
ishaan-jaff	95b7ba4634	(fix) completion: when logit bias is None	2023-11-24 14:01:21 -08:00
Krrish Dholakia	6f40fd8ee2	fix(proxy_server.py): fix linting issues	2023-11-24 11:39:01 -08:00
Krrish Dholakia	5a9a3aa89c	fix(main.py): fix streaming_chunk_builder to return usage	2023-11-24 11:27:04 -08:00
Krrish Dholakia	27f5703ca2	fix(main.py): only set api key to dynamic api key if it's not none	2023-11-23 16:45:44 -08:00
Krrish Dholakia	6999516f5b	fix: fix linting issues	2023-11-23 13:47:43 -08:00
Krrish Dholakia	e4f40f4535	fix(utils.py): support reading api keys dynamically from the os environment	2023-11-23 13:41:56 -08:00
ishaan-jaff	f3beb984ce	(feat) embedding() remove junk params	2023-11-22 14:25:55 -08:00
Krrish Dholakia	e495a8a9c2	fix(main.py): fix acompletion for anyscale, openrouter, deepinfra, perplexity endpoints	2023-11-22 13:22:58 -08:00
Krrish Dholakia	9bb2c7ee0f	fix(utils.py): add param mapping for perplexity, anyscale, deepinfra ... n n	2023-11-22 10:04:27 -08:00
ishaan-jaff	20ecef8664	(fix) request_timeout mapped to timeout for openai	2023-11-21 13:22:21 -08:00
Krrish Dholakia	8e1dcc540f	fix(main.py): revert model alias map change	2023-11-20 21:07:52 -08:00
Krrish Dholakia	d83c2b9ee8	fix(main.py): fix model alias map logic	2023-11-20 20:49:10 -08:00
Krrish Dholakia	c7e2cbd995	fix(utils.py): adding support for rules + mythomax/alpaca prompt template	2023-11-20 18:58:15 -08:00
ishaan-jaff	7bc28f3b1c	(fix) pydantic errors with response.time	2023-11-20 18:28:19 -08:00
ishaan-jaff	756f356897	(fix) completion: max_retries using OpenAI client	2023-11-20 16:57:37 -08:00
ishaan-jaff	903016ba2f	(fix) stream chunk builder when content == None in chunk	2023-11-18 17:16:05 -08:00
Krrish Dholakia	34decba3cf	fix(text_completion): allow either model or engine to be set	2023-11-17 18:25:21 -08:00
Krrish Dholakia	7d70bf84a7	test(test_langfuse.py): handle timeouts	2023-11-17 17:05:46 -08:00
Krrish Dholakia	aa6e6865cd	fix(main.py): fix linting issue	2023-11-17 15:45:00 -08:00
Krrish Dholakia	02ed97d0b2	fix(acompletion): support client side timeouts + raise exceptions correctly for async calls	2023-11-17 15:39:47 -08:00
ishaan-jaff	ef8d82a54c	(feat) completion: add response_format, seed, tools, tool_choice	2023-11-17 13:59:57 -08:00
Ishaan Jaff	c4f51594d5	(ci/cd) run again	2023-11-16 21:29:18 -08:00
Krrish Dholakia	a6e9f147d3	fix(openai.py): handling extra headers	2023-11-16 12:48:21 -08:00
ishaan-jaff	7ba8271250	(linting) fix	2023-11-16 12:33:03 -08:00
ishaan-jaff	6645c510ac	(fix) linting	2023-11-16 12:25:46 -08:00
Krrish Dholakia	9c2e74b6ea	fix(azure.py): fix linting errors	2023-11-16 12:15:50 -08:00
ishaan-jaff	3b75dfe490	(fix) linting	2023-11-16 11:44:26 -08:00
ishaan-jaff	985f9b1ec1	(feat) text_completion add rules on when to use engine & model together	2023-11-16 11:37:31 -08:00