225 commits

Author	SHA1	Message	Date
Krrish Dholakia	9513d6b862	fix(utils.py): read env variables for known openai-compatible api's (e.g. perplexity), dynamically from th eenvironment	2023-10-13 22:43:32 -07:00
Krrish Dholakia	3210ebfc7a	fix(proxy_cli.py): fix adding keys flow - let user use --add_key to add new keys	2023-10-13 22:24:58 -07:00
Krrish Dholakia	91c8e92e71	fix(openai.p): adding support for exception mapping for openai-compatible apis via http calls	2023-10-13 21:56:51 -07:00
Krrish Dholakia	3fc0375e34	fix(proxy_server): fix cors issue	2023-10-13 15:47:28 -07:00
Krrish Dholakia	2c0280cff3	fix(proxy_cli): add logs and config	2023-10-13 15:14:21 -07:00
Krrish Dholakia	b28c055896	feat(proxy_server): adds create-proxy feature	2023-10-12 18:27:07 -07:00
Krrish Dholakia	098a86f678	fix(proxy_cli): prints the location of the config file	2023-10-11 21:19:44 -07:00
Krrish Dholakia	4b0f8825f3	fix(proxy_server): fix prompt template for proxy server	2023-10-11 21:08:42 -07:00
Krrish Dholakia	208a6d365b	fix(openai.py): fix linting errors	2023-10-10 21:04:13 -07:00
Krrish Dholakia	d280a8c434	fix(proxy_cli-and-utils.py): fixing how config file is read + infering llm_provider for known openai endpoints	2023-10-10 20:53:02 -07:00
Krrish Dholakia	b50013386f	fix(openai.py): enable custom proxy to pass in ca_bundle_path	2023-10-10 13:23:27 -07:00
Krrish Dholakia	af2fd0e0de	fix: fix value error if model returns empty completion	2023-10-10 10:11:40 -07:00
Krrish Dholakia	29b2fa7f75	fix(test-fixes): test fixes	2023-10-10 08:09:42 -07:00
Krrish Dholakia	0d863f00ad	refactor(bedrock.py): take model names from model cost dict	2023-10-10 07:35:03 -07:00
Krrish Dholakia	db20cb84d4	fix(main.py): return n>1 response for openai text completion	2023-10-09 20:44:07 -07:00
Krrish Dholakia	253e8d27db	fix: bug fix when n>1 passed in	2023-10-09 16:46:33 -07:00
Krrish Dholakia	a9f7a80e3d	feat(proxy_cli.py): add max budget to proxy	2023-10-09 14:11:30 -07:00
Krrish Dholakia	704be9dcd1	feat(factory.py): option to add function details to prompt, if model doesn't support functions param	2023-10-09 09:53:53 -07:00
Krrish Dholakia	212734f142	test(test_logging): adding print statements for debugging circle ci	2023-10-07 16:20:17 -07:00
Krrish Dholakia	9cda24e1b2	fix(utils): adds complete streaming response to success handler	2023-10-07 15:42:00 -07:00
Krrish Dholakia	b90f352736	docs(docs.md): cleanup litellm api docs	2023-10-07 10:58:14 -07:00
Krrish Dholakia	f0c9c24925	fix(proxy_cli.py): check if model passed in	2023-10-07 07:52:02 -07:00
Krrish Dholakia	52b0bcb5ec	feat(proxy_cli.py): when user calls ollama model, run ollama serve	2023-10-06 16:46:52 -07:00
Krrish Dholakia	306a38880d	feat(ollama.py): exposing ollama config	2023-10-06 15:52:58 -07:00
Krrish Dholakia	7e34736a38	fix(add-custom-success-callback-for-streaming): add custom success callback for streaming	2023-10-06 15:02:02 -07:00
Krrish Dholakia	060a2e40b2	fix: fixing mypy linting errors and being backwards compatible for azure=true flag	2023-10-05 22:36:32 -07:00
Krrish Dholakia	dd7e397650	style(test_completion.py): fix merge conflict	2023-10-05 22:09:38 -07:00
Krrish Dholakia	ed31860206	adding custom prompt templates to ollama	2023-10-05 10:48:16 -07:00
Krrish Dholakia	95899bf60e	add additional param mapping	2023-10-03 21:56:08 -07:00
Krrish Dholakia	851cb86daa	add support for ai21 input params	2023-10-03 21:05:28 -07:00
Krrish Dholakia	e834c063ff	fix n=1 issue with langchain	2023-10-03 11:06:59 -07:00
Krrish Dholakia	512769e841	support n param for hf	2023-10-03 07:10:13 -07:00
Krrish Dholakia	50fc4de45f	support cohere top p	2023-10-02 21:38:56 -07:00
Krrish Dholakia	5a1a1908c1	fix replicate error	2023-10-02 21:35:16 -07:00
Krrish Dholakia	345a14483e	Fixes to bedrock	2023-10-02 16:09:06 -07:00
Krrish Dholakia	0daf2e3880	fixes to get optional params	2023-10-02 14:44:11 -07:00
Krrish Dholakia	8b60d797e1	fixing optional param mapping	2023-10-02 14:14:30 -07:00
Krrish Dholakia	7cec308a2c	fixes to get_optional_params	2023-10-02 12:34:22 -07:00
Krrish Dholakia	5a19ee1a71	fix get optional params	2023-10-02 12:02:53 -07:00
Krrish Dholakia	1cae080eb2	raise exception if optional param is not mapped to model	2023-10-02 11:17:51 -07:00
Krrish Dholakia	e62b3ebdd1	add testing for function calling	2023-10-02 07:39:01 -07:00
Krrish Dholakia	3ca79a88bb	improvements to proxy cli and finish reason mapping for anthropic	2023-09-30 18:09:16 -07:00
Krrish Dholakia	16c755257b	add support for custom hf prompt templates	2023-09-30 15:37:30 -07:00
Krrish Dholakia	2af46e8be9	remove budget manager	2023-09-30 11:42:56 -07:00
Krrish Dholakia	e8ec3e8795	add mistral prompt templating	2023-09-29 21:41:28 -07:00
Krrish Dholakia	dc9f02267a	update values	2023-09-29 20:53:55 -07:00
Krrish Dholakia	b8c8f01221	update openai proxy docs	2023-09-29 18:31:52 -07:00
Krrish Dholakia	f04d50d119	updates	2023-09-29 11:33:58 -07:00
Krrish Dholakia	4665b2a898	updates to proxy	2023-09-28 17:58:47 -07:00
Krrish Dholakia	09b8c08cad	update proxy cli	2023-09-28 16:24:41 -07:00