Commit graph

462 commits

Author SHA1 Message Date
Krrish Dholakia
079122fbf1 style(utils.py): return better exceptions
https://github.com/BerriAI/litellm/issues/563
2023-10-09 15:28:33 -07:00
Krrish Dholakia
704be9dcd1 feat(factory.py): option to add function details to prompt, if model doesn't support functions param 2023-10-09 09:53:53 -07:00
Krrish Dholakia
9cda24e1b2 fix(utils): adds complete streaming response to success handler 2023-10-07 15:42:00 -07:00
ishaan-jaff
228d6ea608 feat(rate limit aware acompletion calls): 2023-10-06 20:48:53 -07:00
ishaan-jaff
56c87febae chore(stash rate limit manager changes ): 2023-10-06 16:22:02 -07:00
Krrish Dholakia
306a38880d feat(ollama.py): exposing ollama config 2023-10-06 15:52:58 -07:00
Krrish Dholakia
7e34736a38 fix(add-custom-success-callback-for-streaming): add custom success callback for streaming 2023-10-06 15:02:02 -07:00
Krrish Dholakia
dd7e397650 style(test_completion.py): fix merge conflict 2023-10-05 22:09:38 -07:00
ishaan-jaff
4e6e79b20a fix(n param in completion()): fix error thrown when passing n for cohere 2023-10-05 19:54:13 -07:00
ishaan-jaff
1897a1ee46 fix(llmonitor callback): correctly set user_id 2023-10-05 19:36:39 -07:00
ishaan-jaff
8120477be4 fix(completion()): add request_timeout as a param, fix claude error when request_timeout set 2023-10-05 19:05:28 -07:00
Krrish Dholakia
ed31860206 adding custom prompt templates to ollama 2023-10-05 10:48:16 -07:00
ishaan-jaff
e9160a1485 fix linting 2023-10-04 16:03:58 -07:00
ishaan-jaff
34dc176440 make rate limit hadler a class 2 2023-10-04 16:03:58 -07:00
Krish Dholakia
24c12d6b9b
Merge pull request #530 from vedant-z/patch-1
Update utils.py
2023-10-04 15:42:59 -07:00
ishaan-jaff
f6af10b2ca add batch_completion with rate limits to utils 2023-10-04 14:46:11 -07:00
Vedant Borkar
c21eae7f79
Update utils.py 2023-10-05 03:07:50 +05:30
Krrish Dholakia
95899bf60e add additional param mapping 2023-10-03 21:56:08 -07:00
Krrish Dholakia
851cb86daa add support for ai21 input params 2023-10-03 21:05:28 -07:00
ishaan-jaff
20f990f652 remove print statement 2023-10-03 21:01:22 -07:00
ishaan-jaff
ac2d89aee6 remove junk print statements 2023-10-03 20:58:39 -07:00
Krrish Dholakia
e834c063ff fix n=1 issue with langchain 2023-10-03 11:06:59 -07:00
Krrish Dholakia
512769e841 support n param for hf 2023-10-03 07:10:13 -07:00
Krrish Dholakia
50fc4de45f support cohere top p 2023-10-02 21:38:56 -07:00
Krrish Dholakia
5a1a1908c1 fix replicate error 2023-10-02 21:35:16 -07:00
Krrish Dholakia
0daf2e3880 fixes to get optional params 2023-10-02 14:44:11 -07:00
Krrish Dholakia
8b60d797e1 fixing optional param mapping 2023-10-02 14:14:30 -07:00
Krrish Dholakia
7cec308a2c fixes to get_optional_params 2023-10-02 12:34:22 -07:00
Krrish Dholakia
5a19ee1a71 fix get optional params 2023-10-02 12:02:53 -07:00
Krrish Dholakia
1cae080eb2 raise exception if optional param is not mapped to model 2023-10-02 11:17:51 -07:00
Krrish Dholakia
a7ee0bcc8c raise exception if function call passed to provider that doesn't support it 2023-10-02 07:39:01 -07:00
Krrish Dholakia
3ca79a88bb improvements to proxy cli and finish reason mapping for anthropic 2023-09-30 18:09:16 -07:00
ishaan-jaff
8d1f5ba69d add fake streaming for petals 2023-09-30 10:22:04 -07:00
Krrish Dholakia
e8ec3e8795 add mistral prompt templating 2023-09-29 21:41:28 -07:00
ishaan-jaff
762d590500 fix co embeddings 2023-09-29 16:00:49 -07:00
ishaan-jaff
6a81f860f9 add param mapping to claude bedrock 2023-09-29 15:36:57 -07:00
ishaan-jaff
acc15f5778 test fixes for embedding 2023-09-29 15:31:53 -07:00
ishaan-jaff
eb25e9f15f add bedrock anthropic streaming 2023-09-29 15:19:42 -07:00
Krrish Dholakia
f04d50d119 updates 2023-09-29 11:33:58 -07:00
ishaan-jaff
af914d4be1 add cohere embedding models 2023-09-29 09:59:31 -07:00
Krrish Dholakia
4665b2a898 updates to proxy 2023-09-28 17:58:47 -07:00
Krrish Dholakia
09b8c08cad update proxy cli 2023-09-28 16:24:41 -07:00
ishaan-jaff
8e2b139f8d fix petals bug 2023-09-27 20:51:31 -07:00
Krrish Dholakia
4621582d49 updates 2023-09-27 17:43:22 -07:00
Krrish Dholakia
1f2a12fe1f remove print statements 2023-09-27 17:06:49 -07:00
Krrish Dholakia
ce62dc40b9 remove trust remote code option 2023-09-26 19:20:48 -07:00
Krrish Dholakia
b64306d633 fix linting issue 2023-09-26 18:10:59 -07:00
Krrish Dholakia
076affbff2 fix llama index validate environment error 2023-09-26 17:53:22 -07:00
Krrish Dholakia
eb1c7220ff add support message on exception 2023-09-26 17:48:24 -07:00
Krrish Dholakia
a72880925c push cli tool 2023-09-26 13:30:47 -07:00