Commit graph

305 commits

Author SHA1 Message Date
ishaan-jaff
4e64f123ef (fix) api_base, api_version and api_key 2023-10-09 14:11:05 -07:00
ishaan-jaff
bf4ce08640 (fix) acompletion for ollama non streaing 2023-10-09 13:47:08 -07:00
Krrish Dholakia
704be9dcd1 feat(factory.py): option to add function details to prompt, if model doesn't support functions param 2023-10-09 09:53:53 -07:00
ishaan-jaff
f6f7c0b891 (feat) add api_key, api_base, api_version to completion 2023-10-09 08:13:12 -07:00
Krrish Dholakia
bcf0b0ac7b style(main.py): clean up print statement 2023-10-07 15:43:40 -07:00
Krrish Dholakia
9cda24e1b2 fix(utils): adds complete streaming response to success handler 2023-10-07 15:42:00 -07:00
Krrish Dholakia
d69038883c docs(completion-docs): adds more details on provider-specific params 2023-10-07 13:49:30 -07:00
Krrish Dholakia
306a38880d feat(ollama.py): exposing ollama config 2023-10-06 15:52:58 -07:00
ishaan-jaff
47521c5a97 test commitizen bump 2023-10-06 15:41:38 -07:00
ishaan-jaff
4ae8a71aa3 bump: version 0.2.5 → 0.3.0 2023-10-06 15:40:01 -07:00
Krrish Dholakia
7e34736a38 fix(add-custom-success-callback-for-streaming): add custom success callback for streaming 2023-10-06 15:02:02 -07:00
Krrish Dholakia
a977e94a5d style(main.py): adding spacing 2023-10-06 06:16:17 -07:00
Krrish Dholakia
e0f1cffa87 fix: azure flag check 2023-10-05 22:44:41 -07:00
Krrish Dholakia
060a2e40b2 fix: fixing mypy linting errors and being backwards compatible for azure=true flag 2023-10-05 22:36:32 -07:00
Krrish Dholakia
dd7e397650 style(test_completion.py): fix merge conflict 2023-10-05 22:09:38 -07:00
ishaan-jaff
8120477be4 fix(completion()): add request_timeout as a param, fix claude error when request_timeout set 2023-10-05 19:05:28 -07:00
ishaan-jaff
29509a48f8 ollama default api_base to http://localhost:11434 2023-10-05 11:04:51 -07:00
Krrish Dholakia
ed31860206 adding custom prompt templates to ollama 2023-10-05 10:48:16 -07:00
ishaan-jaff
2d4671a7ef add ratelimitmanager 2023-10-04 16:03:58 -07:00
ishaan-jaff
68006ff584 make RateLimitHandler a class 2023-10-04 16:03:58 -07:00
ishaan-jaff
defc830e95 add batch_completion_rate_limits 2023-10-04 14:46:11 -07:00
Krrish Dholakia
430e2698a2 add param mapping to docs 2023-10-03 09:20:58 -07:00
Krrish Dholakia
345a14483e Fixes to bedrock 2023-10-02 16:09:06 -07:00
Krrish Dholakia
0daf2e3880 fixes to get optional params 2023-10-02 14:44:11 -07:00
Krrish Dholakia
8b60d797e1 fixing optional param mapping 2023-10-02 14:14:30 -07:00
Krrish Dholakia
7cec308a2c fixes to get_optional_params 2023-10-02 12:34:22 -07:00
Krrish Dholakia
8acad78fb3 fix linting issues 2023-10-02 12:12:34 -07:00
Krrish Dholakia
5a19ee1a71 fix get optional params 2023-10-02 12:02:53 -07:00
Krrish Dholakia
1cae080eb2 raise exception if optional param is not mapped to model 2023-10-02 11:17:51 -07:00
Krrish Dholakia
1c802c26fc updates 2023-09-30 18:26:23 -07:00
ishaan-jaff
8d1f5ba69d add fake streaming for petals 2023-09-30 10:22:04 -07:00
ishaan-jaff
1a8144360e fix logging error 2023-09-29 16:02:19 -07:00
ishaan-jaff
3fbad7dfa7 add hf embedding models 2023-09-29 11:57:38 -07:00
ishaan-jaff
17be1d89b3 remove junk code in getting custom_llm_provider 2023-09-29 11:18:08 -07:00
ishaan-jaff
af914d4be1 add cohere embedding models 2023-09-29 09:59:31 -07:00
ishaan-jaff
13ff65a8fe remove junk from completion 2023-09-28 17:57:48 -07:00
ishaan-jaff
0f3be26778 remove junk from completion input 2023-09-28 17:54:46 -07:00
ishaan-jaff
da4a9d3119 remove junk vars in completion.py 2023-09-28 17:50:06 -07:00
ishaan-jaff
1b74cd2790 clean out args passed to completion 2023-09-28 17:43:54 -07:00
ishaan-jaff
8d11a0c722 clean out args given to completion 2023-09-28 17:35:47 -07:00
Krrish Dholakia
e2d23afae4 fix hf routing bug 2023-09-28 13:32:39 -07:00
Krrish Dholakia
3658bdb61b fix testing 2023-09-27 21:31:00 -07:00
Krrish Dholakia
d334031108 adding support for completions endpoint in proxy 2023-09-27 21:04:15 -07:00
Krrish Dholakia
a4ca26a189 cleanup 2023-09-26 21:55:25 -07:00
Krrish Dholakia
6e05fca714 add switching api keys + api bases to docs 2023-09-26 21:47:33 -07:00
Krrish Dholakia
ce62dc40b9 remove trust remote code option 2023-09-26 19:20:48 -07:00
ishaan-jaff
e7a9246414 palm streaming 2023-09-26 12:27:49 -07:00
ishaan-jaff
5944b1bbab lint fix 2023-09-26 10:11:53 -07:00
ishaan-jaff
d6bc20d5be add palm 2023-09-26 10:00:56 -07:00
ishaan-jaff
ed2d461770 add beta deep infra support 2023-09-25 21:42:46 -07:00