566 commits

Author	SHA1	Message	Date
ishaan-jaff	09caab549a	(feat) async embeddings: OpenAI	2023-11-29 19:35:08 -08:00
Krrish Dholakia	61185aa12c	fix(main.py): fix null finish reason issue for ollama	2023-11-29 16:50:11 -08:00
Krrish Dholakia	ab76daa90b	fix(bedrock.py): support ai21 / bedrock streaming	2023-11-29 16:35:06 -08:00
ishaan-jaff	da75b15176	(feat) completion: add rpm, tpm as litellm params	2023-11-29 16:19:05 -08:00
Krrish Dholakia	6c98715b94	bump: version 1.7.13 → 1.7.14	2023-11-29 15:19:18 -08:00
Krrish Dholakia	451851e6a4	fix(main.py): have stream_chunk_builder return successful response even if token_counter fails	2023-11-29 15:19:11 -08:00
Krrish Dholakia	b6bc75e27a	fix(utils.py): fix parallel tool calling when streaming	2023-11-29 10:56:21 -08:00
ishaan-jaff	6f71299bb0	(fix) embedding pop out client from params	2023-11-28 21:22:01 -08:00
Krrish Dholakia	383dd53e86	fix(main.py): passing client as a litellm-specific kwarg	2023-11-28 21:20:05 -08:00
ishaan-jaff	282b9a37e5	(fix) router: passing client	2023-11-28 16:34:16 -08:00
ishaan-jaff	8ac7801283	(feat) completion:openai pass OpenAI client	2023-11-28 16:05:01 -08:00
ishaan-jaff	400a268934	(feat) completion: Azure allow users to pass client to router	2023-11-28 15:56:52 -08:00
ishaan-jaff	7914623fbc	(feat) allow users to pass azure client for acmompletion	2023-11-28 15:44:56 -08:00
Krrish Dholakia	150b91d476	fix(utils.py): fix streaming on-success logging	2023-11-28 09:11:47 -08:00
ishaan-jaff	224a028ab6	(fix) completion: AZURE_OPENAI_API_KEY	2023-11-28 08:06:06 -08:00
Krrish Dholakia	be9fa06da6	fix(main.py): fix linting errors	2023-11-27 19:11:38 -08:00
Krrish Dholakia	4cdd930fa2	fix(stream_chunk_builder): adding support for tool calling in completion counting	2023-11-27 18:39:47 -08:00
Krrish Dholakia	04f745e314	fix(router.py): speed improvements to the router	2023-11-27 17:35:26 -08:00
Krrish Dholakia	56bb39e52c	fix(acompletion): fix acompletion raise exception issue when custom llm provider is none	2023-11-27 11:34:48 -08:00
ishaan-jaff	6baaf629e5	(fix) embedding: filter out metadata from optional_params	2023-11-25 11:10:06 -08:00
Krrish Dholakia	e732fb8b97	fix(main.py): logit bias mapping for batch_completions	2023-11-24 16:05:51 -08:00
Krrish Dholakia	1a6ea20a0b	fix(main.py): fixing linting issues	2023-11-24 15:25:51 -08:00
ishaan-jaff	a6bea946b3	(fix) completion: when logit bias is None	2023-11-24 14:01:21 -08:00
Krrish Dholakia	2e8d582a34	fix(proxy_server.py): fix linting issues	2023-11-24 11:39:01 -08:00
Krrish Dholakia	4a5dae3941	fix(main.py): fix streaming_chunk_builder to return usage	2023-11-24 11:27:04 -08:00
Krrish Dholakia	bfaed56ffb	fix(main.py): only set api key to dynamic api key if it's not none	2023-11-23 16:45:44 -08:00
Krrish Dholakia	c074023e14	fix: fix linting issues	2023-11-23 13:47:43 -08:00
Krrish Dholakia	4f183dc6a0	fix(utils.py): support reading api keys dynamically from the os environment	2023-11-23 13:41:56 -08:00
ishaan-jaff	b3bca98561	(feat) embedding() remove junk params	2023-11-22 14:25:55 -08:00
Krrish Dholakia	78582e158a	fix(main.py): fix acompletion for anyscale, openrouter, deepinfra, perplexity endpoints	2023-11-22 13:22:58 -08:00
Krrish Dholakia	10fe16c965	fix(utils.py): add param mapping for perplexity, anyscale, deepinfra ... n n	2023-11-22 10:04:27 -08:00
ishaan-jaff	589cdce8d3	(fix) request_timeout mapped to timeout for openai	2023-11-21 13:22:21 -08:00
Krrish Dholakia	b991a35ebe	fix(main.py): revert model alias map change	2023-11-20 21:07:52 -08:00
Krrish Dholakia	b2e52eedf8	fix(main.py): fix model alias map logic	2023-11-20 20:49:10 -08:00
Krrish Dholakia	855964ed45	fix(utils.py): adding support for rules + mythomax/alpaca prompt template	2023-11-20 18:58:15 -08:00
ishaan-jaff	50f883a2fb	(fix) pydantic errors with response.time	2023-11-20 18:28:19 -08:00
ishaan-jaff	11ec2710c6	(fix) completion: max_retries using OpenAI client	2023-11-20 16:57:37 -08:00
ishaan-jaff	452bba1b5d	(fix) stream chunk builder when content == None in chunk	2023-11-18 17:16:05 -08:00
Krrish Dholakia	3ea776bdc0	fix(text_completion): allow either model or engine to be set	2023-11-17 18:25:21 -08:00
Krrish Dholakia	5cddab9e54	test(test_langfuse.py): handle timeouts	2023-11-17 17:05:46 -08:00
Krrish Dholakia	17bb1184bd	fix(main.py): fix linting issue	2023-11-17 15:45:00 -08:00
Krrish Dholakia	0ab6b2451d	fix(acompletion): support client side timeouts + raise exceptions correctly for async calls	2023-11-17 15:39:47 -08:00
ishaan-jaff	7abb65d53f	(feat) completion: add response_format, seed, tools, tool_choice	2023-11-17 13:59:57 -08:00
Ishaan Jaff	61705f3467	(ci/cd) run again	2023-11-16 21:29:18 -08:00
Krrish Dholakia	a94c09c13c	fix(openai.py): handling extra headers	2023-11-16 12:48:21 -08:00
ishaan-jaff	23d560071b	(linting) fix	2023-11-16 12:33:03 -08:00
ishaan-jaff	f8af5e0155	(fix) linting	2023-11-16 12:25:46 -08:00
Krrish Dholakia	f99a161d98	fix(azure.py): fix linting errors	2023-11-16 12:15:50 -08:00
ishaan-jaff	a1cecbafe6	(fix) linting	2023-11-16 11:44:26 -08:00
ishaan-jaff	77468e0a70	(feat) text_completion add rules on when to use engine & model together	2023-11-16 11:37:31 -08:00