222 commits

Author	SHA1	Message	Date
Krrish Dholakia	1afd53f452	fix(proxy_server): fix cors issue	2023-10-13 15:47:28 -07:00
Krrish Dholakia	90c8b3a193	fix(proxy_cli): add logs and config	2023-10-13 15:14:21 -07:00
Krrish Dholakia	d0b4dfd26c	feat(proxy_server): adds create-proxy feature	2023-10-12 18:27:07 -07:00
Krrish Dholakia	e150dc2e8e	fix(proxy_cli): prints the location of the config file	2023-10-11 21:19:44 -07:00
Krrish Dholakia	778648e84f	fix(proxy_server): fix prompt template for proxy server	2023-10-11 21:08:42 -07:00
Krrish Dholakia	75c811837d	fix(openai.py): fix linting errors	2023-10-10 21:04:13 -07:00
Krrish Dholakia	87e5f79924	fix(proxy_cli-and-utils.py): fixing how config file is read + infering llm_provider for known openai endpoints	2023-10-10 20:53:02 -07:00
Krrish Dholakia	67b3e792ff	fix(openai.py): enable custom proxy to pass in ca_bundle_path	2023-10-10 13:23:27 -07:00
Krrish Dholakia	cc0e4f4f9f	fix: fix value error if model returns empty completion	2023-10-10 10:11:40 -07:00
Krrish Dholakia	1c9f87751d	fix(test-fixes): test fixes	2023-10-10 08:09:42 -07:00
Krrish Dholakia	22ee0c6931	refactor(bedrock.py): take model names from model cost dict	2023-10-10 07:35:03 -07:00
Krrish Dholakia	4b0ba2ba47	fix(main.py): return n>1 response for openai text completion	2023-10-09 20:44:07 -07:00
Krrish Dholakia	4a1bd8267f	fix: bug fix when n>1 passed in	2023-10-09 16:46:33 -07:00
Krrish Dholakia	4d34bfe68a	feat(proxy_cli.py): add max budget to proxy	2023-10-09 14:11:30 -07:00
Krrish Dholakia	936548db40	feat(factory.py): option to add function details to prompt, if model doesn't support functions param	2023-10-09 09:53:53 -07:00
Krrish Dholakia	01ed325019	test(test_logging): adding print statements for debugging circle ci	2023-10-07 16:20:17 -07:00
Krrish Dholakia	cf7e2595b8	fix(utils): adds complete streaming response to success handler	2023-10-07 15:42:00 -07:00
Krrish Dholakia	60a3acf463	docs(docs.md): cleanup litellm api docs	2023-10-07 10:58:14 -07:00
Krrish Dholakia	5f946c201c	fix(proxy_cli.py): check if model passed in	2023-10-07 07:52:02 -07:00
Krrish Dholakia	0d45650972	feat(proxy_cli.py): when user calls ollama model, run ollama serve	2023-10-06 16:46:52 -07:00
Krrish Dholakia	37d7837b63	feat(ollama.py): exposing ollama config	2023-10-06 15:52:58 -07:00
Krrish Dholakia	5ab3a4b8d7	fix(add-custom-success-callback-for-streaming): add custom success callback for streaming	2023-10-06 15:02:02 -07:00
Krrish Dholakia	2326ad9d38	fix: fixing mypy linting errors and being backwards compatible for azure=true flag	2023-10-05 22:36:32 -07:00
Krrish Dholakia	69cdf5347a	style(test_completion.py): fix merge conflict	2023-10-05 22:09:38 -07:00
Krrish Dholakia	1492916a37	adding custom prompt templates to ollama	2023-10-05 10:48:16 -07:00
Krrish Dholakia	ae89a2a04b	add additional param mapping	2023-10-03 21:56:08 -07:00
Krrish Dholakia	c2d6804be0	add support for ai21 input params	2023-10-03 21:05:28 -07:00
Krrish Dholakia	7dcec75faf	fix n=1 issue with langchain	2023-10-03 11:06:59 -07:00
Krrish Dholakia	c7384859a3	support n param for hf	2023-10-03 07:10:13 -07:00
Krrish Dholakia	4ea7162a81	support cohere top p	2023-10-02 21:38:56 -07:00
Krrish Dholakia	4ce5c1d1dc	fix replicate error	2023-10-02 21:35:16 -07:00
Krrish Dholakia	d49a36004c	Fixes to bedrock	2023-10-02 16:09:06 -07:00
Krrish Dholakia	8c48af11c2	fixes to get optional params	2023-10-02 14:44:11 -07:00
Krrish Dholakia	0ae93d1112	fixing optional param mapping	2023-10-02 14:14:30 -07:00
Krrish Dholakia	d735f48917	fixes to get_optional_params	2023-10-02 12:34:22 -07:00
Krrish Dholakia	eb4c7876e2	fix get optional params	2023-10-02 12:02:53 -07:00
Krrish Dholakia	12fa4069f3	raise exception if optional param is not mapped to model	2023-10-02 11:17:51 -07:00
Krrish Dholakia	31b7022d17	add testing for function calling	2023-10-02 07:39:01 -07:00
Krrish Dholakia	eec2c848f1	improvements to proxy cli and finish reason mapping for anthropic	2023-09-30 18:09:16 -07:00
Krrish Dholakia	5e394ce95a	add support for custom hf prompt templates	2023-09-30 15:37:30 -07:00
Krrish Dholakia	af0f191f44	remove budget manager	2023-09-30 11:42:56 -07:00
Krrish Dholakia	6ac9470203	add mistral prompt templating	2023-09-29 21:41:28 -07:00
Krrish Dholakia	e258aa6f37	update values	2023-09-29 20:53:55 -07:00
Krrish Dholakia	25ddd2509a	update openai proxy docs	2023-09-29 18:31:52 -07:00
Krrish Dholakia	932447e63a	updates	2023-09-29 11:33:58 -07:00
Krrish Dholakia	56bb3cb261	updates to proxy	2023-09-28 17:58:47 -07:00
Krrish Dholakia	91521175f1	update proxy cli	2023-09-28 16:24:41 -07:00
Krrish Dholakia	49a93cd66b	fixing claude max token testing	2023-09-27 21:52:30 -07:00
Krrish Dholakia	8744b2a14b	updates	2023-09-27 17:43:22 -07:00
Krrish Dholakia	126a8bf909	remove trust remote code option	2023-09-26 19:20:48 -07:00