Commit graph

207 commits

Author SHA1 Message Date
Krrish Dholakia
01ed325019 test(test_logging): adding print statements for debugging circle ci 2023-10-07 16:20:17 -07:00
Krrish Dholakia
cf7e2595b8 fix(utils): adds complete streaming response to success handler 2023-10-07 15:42:00 -07:00
Krrish Dholakia
60a3acf463 docs(docs.md): cleanup litellm api docs 2023-10-07 10:58:14 -07:00
Krrish Dholakia
5f946c201c fix(proxy_cli.py): check if model passed in 2023-10-07 07:52:02 -07:00
Krrish Dholakia
0d45650972 feat(proxy_cli.py): when user calls ollama model, run ollama serve 2023-10-06 16:46:52 -07:00
Krrish Dholakia
37d7837b63 feat(ollama.py): exposing ollama config 2023-10-06 15:52:58 -07:00
Krrish Dholakia
5ab3a4b8d7 fix(add-custom-success-callback-for-streaming): add custom success callback for streaming 2023-10-06 15:02:02 -07:00
Krrish Dholakia
2326ad9d38 fix: fixing mypy linting errors and being backwards compatible for azure=true flag 2023-10-05 22:36:32 -07:00
Krrish Dholakia
69cdf5347a style(test_completion.py): fix merge conflict 2023-10-05 22:09:38 -07:00
Krrish Dholakia
1492916a37 adding custom prompt templates to ollama 2023-10-05 10:48:16 -07:00
Krrish Dholakia
ae89a2a04b add additional param mapping 2023-10-03 21:56:08 -07:00
Krrish Dholakia
c2d6804be0 add support for ai21 input params 2023-10-03 21:05:28 -07:00
Krrish Dholakia
7dcec75faf fix n=1 issue with langchain 2023-10-03 11:06:59 -07:00
Krrish Dholakia
c7384859a3 support n param for hf 2023-10-03 07:10:13 -07:00
Krrish Dholakia
4ea7162a81 support cohere top p 2023-10-02 21:38:56 -07:00
Krrish Dholakia
4ce5c1d1dc fix replicate error 2023-10-02 21:35:16 -07:00
Krrish Dholakia
d49a36004c Fixes to bedrock 2023-10-02 16:09:06 -07:00
Krrish Dholakia
8c48af11c2 fixes to get optional params 2023-10-02 14:44:11 -07:00
Krrish Dholakia
0ae93d1112 fixing optional param mapping 2023-10-02 14:14:30 -07:00
Krrish Dholakia
d735f48917 fixes to get_optional_params 2023-10-02 12:34:22 -07:00
Krrish Dholakia
eb4c7876e2 fix get optional params 2023-10-02 12:02:53 -07:00
Krrish Dholakia
12fa4069f3 raise exception if optional param is not mapped to model 2023-10-02 11:17:51 -07:00
Krrish Dholakia
31b7022d17 add testing for function calling 2023-10-02 07:39:01 -07:00
Krrish Dholakia
eec2c848f1 improvements to proxy cli and finish reason mapping for anthropic 2023-09-30 18:09:16 -07:00
Krrish Dholakia
5e394ce95a add support for custom hf prompt templates 2023-09-30 15:37:30 -07:00
Krrish Dholakia
af0f191f44 remove budget manager 2023-09-30 11:42:56 -07:00
Krrish Dholakia
6ac9470203 add mistral prompt templating 2023-09-29 21:41:28 -07:00
Krrish Dholakia
e258aa6f37 update values 2023-09-29 20:53:55 -07:00
Krrish Dholakia
25ddd2509a update openai proxy docs 2023-09-29 18:31:52 -07:00
Krrish Dholakia
932447e63a updates 2023-09-29 11:33:58 -07:00
Krrish Dholakia
56bb3cb261 updates to proxy 2023-09-28 17:58:47 -07:00
Krrish Dholakia
91521175f1 update proxy cli 2023-09-28 16:24:41 -07:00
Krrish Dholakia
49a93cd66b fixing claude max token testing 2023-09-27 21:52:30 -07:00
Krrish Dholakia
8744b2a14b updates 2023-09-27 17:43:22 -07:00
Krrish Dholakia
126a8bf909 remove trust remote code option 2023-09-26 19:20:48 -07:00
Krrish Dholakia
7f62b5b6e0 fix llama index validate environment error 2023-09-26 17:53:22 -07:00
Krrish Dholakia
455f3370c8 add support message on exception 2023-09-26 17:48:24 -07:00
Krrish Dholakia
dd5ee015b2 add proxy server to docs 2023-09-26 14:42:01 -07:00
Krrish Dholakia
694265798d push cli tool 2023-09-26 13:30:47 -07:00
Krrish Dholakia
e8e1bf01f0 allow backup api keys and api bases 2023-09-26 06:56:26 -07:00
Krrish Dholakia
e9d7904ffb add get help message 2023-09-25 10:26:28 -07:00
Krrish Dholakia
3cac04f459 fix exception mapping for streaming 2023-09-23 15:04:59 -07:00
Krrish Dholakia
cb8fb8a19d fix anthropic json location bug 2023-09-22 15:21:28 -07:00
Krrish Dholakia
9876393355 adding support for cohere, anthropic, llama2 tokenizers 2023-09-22 14:03:52 -07:00
Krrish Dholakia
f3b6bd1beb add token trimming to adapt to prompt flag in config 2023-09-21 17:47:52 -07:00
Krrish Dholakia
e2ad738969 bump version 2023-09-21 17:15:33 -07:00
Krrish Dholakia
9434237cbf add docs on using completion with configs 2023-09-21 17:03:36 -07:00
Krrish Dholakia
4d63211e68 add adapt to prompt size to config 2023-09-21 15:08:05 -07:00
Krrish Dholakia
f3c334f27c support default fallback models 2023-09-21 14:28:07 -07:00
Krrish Dholakia
a3a36b80e9 add completion configs 2023-09-21 14:00:11 -07:00