Commit graph

458 commits

Author SHA1 Message Date
Krrish Dholakia
154c2a025c test(init.py): improving testing for get_model_cost_map
b69449a811
2023-10-18 14:55:36 -07:00
Krrish Dholakia
2df47f1913 fix(init.py): adding local cached copy of model mapping for fallbacks 2023-10-18 13:59:12 -07:00
Krrish Dholakia
f23431fdc4 feat(router.py): add routing capabilities for multiple deployments 2023-10-17 22:28:31 -07:00
canada4663
f560530dd1 remove duplicate entry for bedrock in provider list 2023-10-14 21:44:16 -07:00
canada4663
25a2609e9d Update __init__.py model_list to include bedrock models 2023-10-14 16:29:18 -07:00
Krrish Dholakia
74c0d5b7a0 feat(proxy_server): adding model fallbacks and default model to toml 2023-10-13 15:31:17 -07:00
Krrish Dholakia
72890e02cb fix(init.py): fix linting errors 2023-10-12 21:31:53 -07:00
Krrish Dholakia
87e5f79924 fix(proxy_cli-and-utils.py): fixing how config file is read + infering llm_provider for known openai endpoints 2023-10-10 20:53:02 -07:00
Krrish Dholakia
70bfa022a4 fix(init.py): expose complete client session 2023-10-10 15:16:10 -07:00
Krrish Dholakia
67b3e792ff fix(openai.py): enable custom proxy to pass in ca_bundle_path 2023-10-10 13:23:27 -07:00
Krrish Dholakia
22ee0c6931 refactor(bedrock.py): take model names from model cost dict 2023-10-10 07:35:03 -07:00
Krrish Dholakia
936548db40 feat(factory.py): option to add function details to prompt, if model doesn't support functions param 2023-10-09 09:53:53 -07:00
Kyle
8ce3e11db7 Add custom_openai type in provider list 2023-10-08 21:20:10 -07:00
Krrish Dholakia
c6d36fb59d docs(completion-docs): adds more details on provider-specific params 2023-10-07 13:49:30 -07:00
Krrish Dholakia
37d7837b63 feat(ollama.py): exposing ollama config 2023-10-06 15:52:58 -07:00
Krrish Dholakia
37f9626422 fix(bedrock.py): adding provider-specific configs 2023-10-05 23:49:20 -07:00
Krrish Dholakia
69cdf5347a style(test_completion.py): fix merge conflict 2023-10-05 22:09:38 -07:00
Krrish Dholakia
ae89a2a04b add additional param mapping 2023-10-03 21:56:08 -07:00
Krrish Dholakia
4ce5c1d1dc fix replicate error 2023-10-02 21:35:16 -07:00
ishaan-jaff
17c2863f02 add cohere embedding models 2023-09-29 09:59:31 -07:00
Krrish Dholakia
7f8c50eacf fix proxy 2023-09-26 15:24:44 -07:00
Krrish Dholakia
bd6e8ba658 fix the litellm init issue 2023-09-26 15:15:46 -07:00
Krrish Dholakia
694265798d push cli tool 2023-09-26 13:30:47 -07:00
ishaan-jaff
d1ab49f5ac add palm to init 2023-09-26 09:33:03 -07:00
ishaan-jaff
59664f0c87 add beta deep infra support 2023-09-25 21:42:46 -07:00
Krrish Dholakia
5cead59de7 update to expose longer_context_model_fallback_dict 2023-09-25 20:30:12 -07:00
Krrish Dholakia
5a463d0a2a expose longer context model fallback dict 2023-09-25 20:04:57 -07:00
Krrish Dholakia
b4bdd0a615 remove get help message 2023-09-25 17:25:36 -07:00
Krrish Dholakia
e9d7904ffb add get help message 2023-09-25 10:26:28 -07:00
Krrish Dholakia
a3a36b80e9 add completion configs 2023-09-21 14:00:11 -07:00
ishaan-jaff
38d6025439 add ollama to providers 2023-09-21 10:39:48 -07:00
Krrish Dholakia
88e2641416 fix openrouter issue 2023-09-20 20:38:31 -07:00
Ishaan Jaff
cb63435850 Merge pull request #416 from BerriAI/ishaan/error-logging
Add Dashboard for showing error logs on exception
2023-09-20 20:17:18 -07:00
Krrish Dholakia
596ce23f04 decouple model list from hardcoded package variables 2023-09-20 14:16:56 -07:00
Krrish Dholakia
7109838322 updating model cost map with new models 2023-09-20 13:39:22 -07:00
ishaan-jaff
ca295e6072 exception_type work 2023-09-19 21:29:51 -07:00
Krrish Dholakia
4509b62cf8 add oobabooga text web api support 2023-09-19 18:56:53 -07:00
ishaan-jaff
7527b7ba0d petals fixes 2023-09-19 09:24:34 -07:00
ishaan-jaff
38348f9390 add petals to init and main 2023-09-19 09:24:34 -07:00
ishaan-jaff
de0d345257 add gpt-3.5-instruct 2023-09-18 12:14:52 -07:00
ishaan-jaff
5299401c1d fix linting errors 2023-09-18 10:57:55 -07:00
WilliamEspegren
287381cf58 Added Type stubs to __init__.py 2023-09-16 21:35:08 +02:00
ishaan-jaff
2cc1466fd6 new vert llms 2023-09-15 13:37:58 -07:00
ishaan-jaff
8f027e35a7 new init 2023-09-15 09:05:13 -07:00
ishaan-jaff
d7972c7ed6 update utils 2023-09-15 08:34:36 -07:00
Krrish Dholakia
d9eb7a248f make max budget work for openai streaming 2023-09-14 16:22:52 -07:00
Krrish Dholakia
e3293ee264 exposing a litellm.max budget 2023-09-14 14:20:06 -07:00
ishaan-jaff
486fe00ba6 add bedrock to main and init 2023-09-14 13:51:09 -07:00
Toni Engelhardt
f1d464bf3b fix openai completion model names
The model names are wrong, they need to be prefixed with `text-`.
2023-09-14 18:57:48 +01:00
Krrish Dholakia
bd01f70257 adding support for nlp cloud 2023-09-14 09:19:34 -07:00