282 commits

Author	SHA1	Message	Date
Krrish Dholakia	0f6713993d	fix(router.py): enabling retrying with expo backoff (without tenacity) for router	2023-11-14 20:57:51 -08:00
Krrish Dholakia	9b582b2c85	fix(main.py): keep client consistent across calls + exponential backoff retry on ratelimit errors	2023-11-14 16:26:05 -08:00
Krrish Dholakia	c0a757a25f	refactor(azure.py): working azure completion calls with openai v1 sdk	2023-11-11 16:44:39 -08:00
Krrish Dholakia	a5ec85b1f2	refactor(openai.py): making it compatible for openai v1 ... BREAKING CHANGE:	2023-11-11 15:33:02 -08:00
ishaan-jaff	b2f7076b9b	(fix) add APIError to litellm module	2023-11-11 11:33:02 -08:00
Krrish Dholakia	17f5e46080	refactor(azure.py): moving azure openai calls to http calls	2023-11-08 16:52:18 -08:00
Krrish Dholakia	597dc8f34c	bump: version 0.13.1 → 0.13.2.dev1	2023-11-05 21:12:13 -08:00
Krrish Dholakia	078c369e35	bump: version 0.13.1.dev2 → 0.13.1.dev3	2023-11-04 22:31:53 -07:00
Krrish Dholakia	e633566253	feat(utils.py): adding additional states for custom logging	2023-11-04 17:07:20 -07:00
Krrish Dholakia	2310e0c6eb	test(test_completion.py): num retries 3	2023-11-04 15:55:56 -07:00
Krrish Dholakia	fa24a61976	refactor(proxy_server.py): print statement showing how to add debug for logs	2023-11-03 17:41:14 -07:00
Krrish Dholakia	127972a80b	build(litellm_server/utils.py): add support for general settings + num retries as a module variable	2023-11-02 20:56:41 -07:00
ishaan-jaff	2bc891240b	(feat) add embed-english-v3.0	2023-11-02 10:05:22 -07:00
ishaan-jaff	f66e9c6bce	(feat) detect amazon.titan-embed-text-v1 as bedrock embedding model	2023-11-01 14:46:33 -07:00
Krrish Dholakia	147d69f230	feat(main.py): add support for maritalk api	2023-10-30 17:36:51 -07:00
ishaan-jaff	d5ad0f975f	(fix) remove bloat completion_with_split_tests	2023-10-27 18:13:30 -07:00
Krrish Dholakia	715ea54544	fix(utils.py): adding support for anyscale models	2023-10-25 09:08:10 -07:00
Krrish Dholakia	743dda9724	fix(init.py): fix linting errors	2023-10-24 15:54:21 -07:00
Krrish Dholakia	558d2582b5	fix(utils.py): allow url to be passed to model cost map	2023-10-24 15:38:05 -07:00
ishaan-jaff	bdb2da75ee	(feat) add perplexity llms	2023-10-20 14:39:29 -07:00
ishaan-jaff	d4c81814f1	(feat) native perplexity support	2023-10-20 14:29:07 -07:00
Krrish Dholakia	2fa22dc91e	feat(utils.py): adding encode and decode functions	2023-10-20 11:59:47 -07:00
Iskren Chernev	2219b12350	Load deepinfra models from json	2023-10-20 11:34:17 +03:00
Krrish Dholakia	f10a4ce16b	feat(utils.py): add register model helper function	2023-10-19 18:26:36 -07:00
Krrish Dholakia	154c2a025c	test(init.py): improving testing for get_model_cost_map ... b69449a811	2023-10-18 14:55:36 -07:00
Krrish Dholakia	2df47f1913	fix(init.py): adding local cached copy of model mapping for fallbacks	2023-10-18 13:59:12 -07:00
Krrish Dholakia	f23431fdc4	feat(router.py): add routing capabilities for multiple deployments	2023-10-17 22:28:31 -07:00
canada4663	f560530dd1	remove duplicate entry for bedrock in provider list	2023-10-14 21:44:16 -07:00
canada4663	25a2609e9d	Update __init__.py model_list to include bedrock models	2023-10-14 16:29:18 -07:00
Krrish Dholakia	74c0d5b7a0	feat(proxy_server): adding model fallbacks and default model to toml	2023-10-13 15:31:17 -07:00
Krrish Dholakia	72890e02cb	fix(init.py): fix linting errors	2023-10-12 21:31:53 -07:00
Krrish Dholakia	87e5f79924	fix(proxy_cli-and-utils.py): fixing how config file is read + infering llm_provider for known openai endpoints	2023-10-10 20:53:02 -07:00
Krrish Dholakia	70bfa022a4	fix(init.py): expose complete client session	2023-10-10 15:16:10 -07:00
Krrish Dholakia	67b3e792ff	fix(openai.py): enable custom proxy to pass in ca_bundle_path	2023-10-10 13:23:27 -07:00
Krrish Dholakia	22ee0c6931	refactor(bedrock.py): take model names from model cost dict	2023-10-10 07:35:03 -07:00
Krrish Dholakia	936548db40	feat(factory.py): option to add function details to prompt, if model doesn't support functions param	2023-10-09 09:53:53 -07:00
Kyle	8ce3e11db7	Add custom_openai type in provider list	2023-10-08 21:20:10 -07:00
Krrish Dholakia	c6d36fb59d	docs(completion-docs): adds more details on provider-specific params	2023-10-07 13:49:30 -07:00
Krrish Dholakia	37d7837b63	feat(ollama.py): exposing ollama config	2023-10-06 15:52:58 -07:00
Krrish Dholakia	37f9626422	fix(bedrock.py): adding provider-specific configs	2023-10-05 23:49:20 -07:00
Krrish Dholakia	69cdf5347a	style(test_completion.py): fix merge conflict	2023-10-05 22:09:38 -07:00
Krrish Dholakia	ae89a2a04b	add additional param mapping	2023-10-03 21:56:08 -07:00
Krrish Dholakia	4ce5c1d1dc	fix replicate error	2023-10-02 21:35:16 -07:00
ishaan-jaff	17c2863f02	add cohere embedding models	2023-09-29 09:59:31 -07:00
Krrish Dholakia	7f8c50eacf	fix proxy	2023-09-26 15:24:44 -07:00
Krrish Dholakia	bd6e8ba658	fix the litellm init issue	2023-09-26 15:15:46 -07:00
Krrish Dholakia	694265798d	push cli tool	2023-09-26 13:30:47 -07:00
ishaan-jaff	d1ab49f5ac	add palm to init	2023-09-26 09:33:03 -07:00
ishaan-jaff	59664f0c87	add beta deep infra support	2023-09-25 21:42:46 -07:00
Krrish Dholakia	5cead59de7	update to expose longer_context_model_fallback_dict	2023-09-25 20:30:12 -07:00