208 commits

Author	SHA1	Message	Date
Krrish Dholakia	704be9dcd1	feat(factory.py): option to add function details to prompt, if model doesn't support functions param	2023-10-09 09:53:53 -07:00
Krrish Dholakia	212734f142	test(test_logging): adding print statements for debugging circle ci	2023-10-07 16:20:17 -07:00
Krrish Dholakia	9cda24e1b2	fix(utils): adds complete streaming response to success handler	2023-10-07 15:42:00 -07:00
Krrish Dholakia	b90f352736	docs(docs.md): cleanup litellm api docs	2023-10-07 10:58:14 -07:00
Krrish Dholakia	f0c9c24925	fix(proxy_cli.py): check if model passed in	2023-10-07 07:52:02 -07:00
Krrish Dholakia	52b0bcb5ec	feat(proxy_cli.py): when user calls ollama model, run ollama serve	2023-10-06 16:46:52 -07:00
Krrish Dholakia	306a38880d	feat(ollama.py): exposing ollama config	2023-10-06 15:52:58 -07:00
Krrish Dholakia	7e34736a38	fix(add-custom-success-callback-for-streaming): add custom success callback for streaming	2023-10-06 15:02:02 -07:00
Krrish Dholakia	060a2e40b2	fix: fixing mypy linting errors and being backwards compatible for azure=true flag	2023-10-05 22:36:32 -07:00
Krrish Dholakia	dd7e397650	style(test_completion.py): fix merge conflict	2023-10-05 22:09:38 -07:00
Krrish Dholakia	ed31860206	adding custom prompt templates to ollama	2023-10-05 10:48:16 -07:00
Krrish Dholakia	95899bf60e	add additional param mapping	2023-10-03 21:56:08 -07:00
Krrish Dholakia	851cb86daa	add support for ai21 input params	2023-10-03 21:05:28 -07:00
Krrish Dholakia	e834c063ff	fix n=1 issue with langchain	2023-10-03 11:06:59 -07:00
Krrish Dholakia	512769e841	support n param for hf	2023-10-03 07:10:13 -07:00
Krrish Dholakia	50fc4de45f	support cohere top p	2023-10-02 21:38:56 -07:00
Krrish Dholakia	5a1a1908c1	fix replicate error	2023-10-02 21:35:16 -07:00
Krrish Dholakia	345a14483e	Fixes to bedrock	2023-10-02 16:09:06 -07:00
Krrish Dholakia	0daf2e3880	fixes to get optional params	2023-10-02 14:44:11 -07:00
Krrish Dholakia	8b60d797e1	fixing optional param mapping	2023-10-02 14:14:30 -07:00
Krrish Dholakia	7cec308a2c	fixes to get_optional_params	2023-10-02 12:34:22 -07:00
Krrish Dholakia	5a19ee1a71	fix get optional params	2023-10-02 12:02:53 -07:00
Krrish Dholakia	1cae080eb2	raise exception if optional param is not mapped to model	2023-10-02 11:17:51 -07:00
Krrish Dholakia	e62b3ebdd1	add testing for function calling	2023-10-02 07:39:01 -07:00
Krrish Dholakia	3ca79a88bb	improvements to proxy cli and finish reason mapping for anthropic	2023-09-30 18:09:16 -07:00
Krrish Dholakia	16c755257b	add support for custom hf prompt templates	2023-09-30 15:37:30 -07:00
Krrish Dholakia	2af46e8be9	remove budget manager	2023-09-30 11:42:56 -07:00
Krrish Dholakia	e8ec3e8795	add mistral prompt templating	2023-09-29 21:41:28 -07:00
Krrish Dholakia	dc9f02267a	update values	2023-09-29 20:53:55 -07:00
Krrish Dholakia	b8c8f01221	update openai proxy docs	2023-09-29 18:31:52 -07:00
Krrish Dholakia	f04d50d119	updates	2023-09-29 11:33:58 -07:00
Krrish Dholakia	4665b2a898	updates to proxy	2023-09-28 17:58:47 -07:00
Krrish Dholakia	09b8c08cad	update proxy cli	2023-09-28 16:24:41 -07:00
Krrish Dholakia	54409a2a30	fixing claude max token testing	2023-09-27 21:52:30 -07:00
Krrish Dholakia	4621582d49	updates	2023-09-27 17:43:22 -07:00
Krrish Dholakia	ce62dc40b9	remove trust remote code option	2023-09-26 19:20:48 -07:00
Krrish Dholakia	076affbff2	fix llama index validate environment error	2023-09-26 17:53:22 -07:00
Krrish Dholakia	eb1c7220ff	add support message on exception	2023-09-26 17:48:24 -07:00
Krrish Dholakia	73487d5910	add proxy server to docs	2023-09-26 14:42:01 -07:00
Krrish Dholakia	a72880925c	push cli tool	2023-09-26 13:30:47 -07:00
Krrish Dholakia	fd953b7ab4	allow backup api keys and api bases	2023-09-26 06:56:26 -07:00
Krrish Dholakia	102c81f863	add get help message	2023-09-25 10:26:28 -07:00
Krrish Dholakia	889679a0dd	fix exception mapping for streaming	2023-09-23 15:04:59 -07:00
Krrish Dholakia	e1d0c6096c	fix anthropic json location bug	2023-09-22 15:21:28 -07:00
Krrish Dholakia	e62b584439	adding support for cohere, anthropic, llama2 tokenizers	2023-09-22 14:03:52 -07:00
Krrish Dholakia	cf5060f136	add token trimming to adapt to prompt flag in config	2023-09-21 17:47:52 -07:00
Krrish Dholakia	38a4a2c376	bump version	2023-09-21 17:15:33 -07:00
Krrish Dholakia	e0c2bd7cf1	add docs on using completion with configs	2023-09-21 17:03:36 -07:00
Krrish Dholakia	be00dd6367	add adapt to prompt size to config	2023-09-21 15:08:05 -07:00
Krrish Dholakia	ebd763287a	support default fallback models	2023-09-21 14:28:07 -07:00