218 commits

Author	SHA1	Message	Date
Krrish Dholakia	4b0f8825f3	fix(proxy_server): fix prompt template for proxy server	2023-10-11 21:08:42 -07:00
Krrish Dholakia	208a6d365b	fix(openai.py): fix linting errors	2023-10-10 21:04:13 -07:00
Krrish Dholakia	d280a8c434	fix(proxy_cli-and-utils.py): fixing how config file is read + infering llm_provider for known openai endpoints	2023-10-10 20:53:02 -07:00
Krrish Dholakia	b50013386f	fix(openai.py): enable custom proxy to pass in ca_bundle_path	2023-10-10 13:23:27 -07:00
Krrish Dholakia	af2fd0e0de	fix: fix value error if model returns empty completion	2023-10-10 10:11:40 -07:00
Krrish Dholakia	29b2fa7f75	fix(test-fixes): test fixes	2023-10-10 08:09:42 -07:00
Krrish Dholakia	0d863f00ad	refactor(bedrock.py): take model names from model cost dict	2023-10-10 07:35:03 -07:00
Krrish Dholakia	db20cb84d4	fix(main.py): return n>1 response for openai text completion	2023-10-09 20:44:07 -07:00
Krrish Dholakia	253e8d27db	fix: bug fix when n>1 passed in	2023-10-09 16:46:33 -07:00
Krrish Dholakia	a9f7a80e3d	feat(proxy_cli.py): add max budget to proxy	2023-10-09 14:11:30 -07:00
Krrish Dholakia	704be9dcd1	feat(factory.py): option to add function details to prompt, if model doesn't support functions param	2023-10-09 09:53:53 -07:00
Krrish Dholakia	212734f142	test(test_logging): adding print statements for debugging circle ci	2023-10-07 16:20:17 -07:00
Krrish Dholakia	9cda24e1b2	fix(utils): adds complete streaming response to success handler	2023-10-07 15:42:00 -07:00
Krrish Dholakia	b90f352736	docs(docs.md): cleanup litellm api docs	2023-10-07 10:58:14 -07:00
Krrish Dholakia	f0c9c24925	fix(proxy_cli.py): check if model passed in	2023-10-07 07:52:02 -07:00
Krrish Dholakia	52b0bcb5ec	feat(proxy_cli.py): when user calls ollama model, run ollama serve	2023-10-06 16:46:52 -07:00
Krrish Dholakia	306a38880d	feat(ollama.py): exposing ollama config	2023-10-06 15:52:58 -07:00
Krrish Dholakia	7e34736a38	fix(add-custom-success-callback-for-streaming): add custom success callback for streaming	2023-10-06 15:02:02 -07:00
Krrish Dholakia	060a2e40b2	fix: fixing mypy linting errors and being backwards compatible for azure=true flag	2023-10-05 22:36:32 -07:00
Krrish Dholakia	dd7e397650	style(test_completion.py): fix merge conflict	2023-10-05 22:09:38 -07:00
Krrish Dholakia	ed31860206	adding custom prompt templates to ollama	2023-10-05 10:48:16 -07:00
Krrish Dholakia	95899bf60e	add additional param mapping	2023-10-03 21:56:08 -07:00
Krrish Dholakia	851cb86daa	add support for ai21 input params	2023-10-03 21:05:28 -07:00
Krrish Dholakia	e834c063ff	fix n=1 issue with langchain	2023-10-03 11:06:59 -07:00
Krrish Dholakia	512769e841	support n param for hf	2023-10-03 07:10:13 -07:00
Krrish Dholakia	50fc4de45f	support cohere top p	2023-10-02 21:38:56 -07:00
Krrish Dholakia	5a1a1908c1	fix replicate error	2023-10-02 21:35:16 -07:00
Krrish Dholakia	345a14483e	Fixes to bedrock	2023-10-02 16:09:06 -07:00
Krrish Dholakia	0daf2e3880	fixes to get optional params	2023-10-02 14:44:11 -07:00
Krrish Dholakia	8b60d797e1	fixing optional param mapping	2023-10-02 14:14:30 -07:00
Krrish Dholakia	7cec308a2c	fixes to get_optional_params	2023-10-02 12:34:22 -07:00
Krrish Dholakia	5a19ee1a71	fix get optional params	2023-10-02 12:02:53 -07:00
Krrish Dholakia	1cae080eb2	raise exception if optional param is not mapped to model	2023-10-02 11:17:51 -07:00
Krrish Dholakia	e62b3ebdd1	add testing for function calling	2023-10-02 07:39:01 -07:00
Krrish Dholakia	3ca79a88bb	improvements to proxy cli and finish reason mapping for anthropic	2023-09-30 18:09:16 -07:00
Krrish Dholakia	16c755257b	add support for custom hf prompt templates	2023-09-30 15:37:30 -07:00
Krrish Dholakia	2af46e8be9	remove budget manager	2023-09-30 11:42:56 -07:00
Krrish Dholakia	e8ec3e8795	add mistral prompt templating	2023-09-29 21:41:28 -07:00
Krrish Dholakia	dc9f02267a	update values	2023-09-29 20:53:55 -07:00
Krrish Dholakia	b8c8f01221	update openai proxy docs	2023-09-29 18:31:52 -07:00
Krrish Dholakia	f04d50d119	updates	2023-09-29 11:33:58 -07:00
Krrish Dholakia	4665b2a898	updates to proxy	2023-09-28 17:58:47 -07:00
Krrish Dholakia	09b8c08cad	update proxy cli	2023-09-28 16:24:41 -07:00
Krrish Dholakia	54409a2a30	fixing claude max token testing	2023-09-27 21:52:30 -07:00
Krrish Dholakia	4621582d49	updates	2023-09-27 17:43:22 -07:00
Krrish Dholakia	ce62dc40b9	remove trust remote code option	2023-09-26 19:20:48 -07:00
Krrish Dholakia	076affbff2	fix llama index validate environment error	2023-09-26 17:53:22 -07:00
Krrish Dholakia	eb1c7220ff	add support message on exception	2023-09-26 17:48:24 -07:00
Krrish Dholakia	73487d5910	add proxy server to docs	2023-09-26 14:42:01 -07:00
Krrish Dholakia	a72880925c	push cli tool	2023-09-26 13:30:47 -07:00