597 commits

Author	SHA1	Message	Date
Krrish Dholakia	4cdd930fa2	fix(stream_chunk_builder): adding support for tool calling in completion counting	2023-11-27 18:39:47 -08:00
ishaan-jaff	9cef551623	(feat) raise APIConnectionError error for Azure +OpenAI	2023-11-27 18:08:47 -08:00
Krrish Dholakia	04f745e314	fix(router.py): speed improvements to the router	2023-11-27 17:35:26 -08:00
ishaan-jaff	d0538e32c9	(feat) completion: sagemaker debugging - show boto3 request sent	2023-11-27 09:04:50 -08:00
Krrish Dholakia	59ba1560e5	fix(router.py): fix fallbacks	2023-11-25 19:34:20 -08:00
Krrish Dholakia	ab0bc87427	fix(router.py): check if fallbacks is none	2023-11-25 14:58:07 -08:00
Krrish Dholakia	95579fda7d	fix(utils.py): fix bedrock + cohere calls	2023-11-25 14:45:42 -08:00
Krrish Dholakia	2eb7386095	fix(utils.py): fix embedding response object conversion	2023-11-25 14:25:06 -08:00
Krrish Dholakia	e43e1e9ab1	fix(utils.py): fix linting errors	2023-11-25 14:19:14 -08:00
Krrish Dholakia	ec81b393e2	fix(utils.py): fix linting erros	2023-11-25 14:14:46 -08:00
Krrish Dholakia	a070bee5be	fix(utils.py): fix linting issues	2023-11-25 14:11:40 -08:00
Krrish Dholakia	8970f12780	fix(utils.py): fix linting issues	2023-11-25 13:48:50 -08:00
Krrish Dholakia	6d9f7b8f9d	fix: fix nlp cloud streaming	2023-11-25 13:45:23 -08:00
Krrish Dholakia	30f47d3169	bump: version 1.7.0 → 1.7.1	2023-11-25 12:34:28 -08:00
Krrish Dholakia	dac76a4861	fix(utils.py): fix embedding response output parsing	2023-11-25 12:06:57 -08:00
Krrish Dholakia	e732fb8b97	fix(main.py): logit bias mapping for batch_completions	2023-11-24 16:05:51 -08:00
ishaan-jaff	0f873c756d	(fix) completion: OpenAI/Azure filter out None params	2023-11-24 14:01:21 -08:00
Krrish Dholakia	4a5dae3941	fix(main.py): fix streaming_chunk_builder to return usage	2023-11-24 11:27:04 -08:00
ishaan-jaff	19fb24cd15	(feat) cost tracking for azure llms	2023-11-23 21:41:38 -08:00
Krrish Dholakia	7d221fe863	fix(utils.py): make failure logging sync	2023-11-23 20:19:27 -08:00
ishaan-jaff	695eaac542	(fix) cost calculator for FT: gpt-3.5	2023-11-23 18:28:21 -08:00
Krrish Dholakia	1cf85b4eb9	fix(utils.py): vertex ai api error exception mapping	2023-11-23 17:50:50 -08:00
Krrish Dholakia	94dc3f66f3	fix(utils.py): remove eos token for zephyr models	2023-11-23 17:47:39 -08:00
Krrish Dholakia	f24786095a	fix(vertex_ai.py): fix exception mapping for vertex ai	2023-11-23 17:35:33 -08:00
ishaan-jaff	43ae3b94fa	(fix) debugging: viewing raw POST request	2023-11-23 16:28:19 -08:00
ishaan-jaff	37dedeee04	(fix) debugging: POST request	2023-11-23 16:08:59 -08:00
ishaan-jaff	bb00595429	(feat) cost: azure gpt + testing	2023-11-23 14:20:48 -08:00
ishaan-jaff	46fc8be4c8	(feat) cost tracking ft:gpt-3.5-turbo	2023-11-23 13:58:59 -08:00
ishaan-jaff	da7c07574f	(test) cost calc on azure	2023-11-23 13:50:09 -08:00
Krrish Dholakia	4f183dc6a0	fix(utils.py): support reading api keys dynamically from the os environment	2023-11-23 13:41:56 -08:00
Krrish Dholakia	3e76d4b422	feat(router.py): add server cooldown logic	2023-11-22 15:59:48 -08:00
ishaan-jaff	e8ff4d5eca	(feat) clean out junk params from litellm embedding	2023-11-22 13:50:45 -08:00
Krrish Dholakia	b0801f61e6	test(test_caching.py): cleaning up tests	2023-11-22 13:43:48 -08:00
Krrish Dholakia	10fe16c965	fix(utils.py): add param mapping for perplexity, anyscale, deepinfra ... n n	2023-11-22 10:04:27 -08:00
Krrish Dholakia	381fdcd37b	fix(utils.py): add response ms for async calls	2023-11-21 19:59:00 -08:00
Krrish Dholakia	2a681c1874	fix(utils.py): fix pre call rules	2023-11-21 07:10:04 -08:00
Krrish Dholakia	b991a35ebe	fix(main.py): revert model alias map change	2023-11-20 21:07:52 -08:00
Krrish Dholakia	ab2986290e	fix(utils.py): fix rules calling	2023-11-20 21:06:36 -08:00
Krrish Dholakia	b2e52eedf8	fix(main.py): fix model alias map logic	2023-11-20 20:49:10 -08:00
Krrish Dholakia	1306addfe8	fix(openai.py-+-azure.py): fix linting issues	2023-11-20 19:29:23 -08:00
Krrish Dholakia	855964ed45	fix(utils.py): adding support for rules + mythomax/alpaca prompt template	2023-11-20 18:58:15 -08:00
ishaan-jaff	4f46ac4ab5	(fix) linting error	2023-11-20 18:32:43 -08:00
ishaan-jaff	3f30f93516	(fix) pydantic errors openai usage	2023-11-20 18:28:19 -08:00
ishaan-jaff	980a3502de	(fix) completion - always map finish_reason	2023-11-20 17:24:16 -08:00
ishaan-jaff	11ec2710c6	(fix) completion: max_retries using OpenAI client	2023-11-20 16:57:37 -08:00
Krrish Dholakia	1976d0f7d6	fix(routing.py): update token usage on streaming	2023-11-20 14:19:25 -08:00
Krrish Dholakia	85932ac247	fix(utils.py): expanding exception mapping coverage for vertex ai	2023-11-18 20:05:40 -08:00
ishaan-jaff	69b6712707	(fix) streaming completion azure	2023-11-18 19:04:41 -08:00
ishaan-jaff	33c3665922	(fix) streaming ensure response obj is initialized	2023-11-18 17:31:58 -08:00
ishaan-jaff	ff8668aad5	(feat) print_verbose Raw openai chunk	2023-11-18 17:12:49 -08:00