Commit graph

571 commits

Author SHA1 Message Date
Krrish Dholakia
beecb60f51 update testing 2023-09-09 16:35:38 -07:00
Krrish Dholakia
a39756bfda add api manager 2023-09-09 15:55:38 -07:00
ishaan-jaff
56bd8c1c52 olla upgrades, fix streaming, add non streaming resp 2023-09-09 14:07:13 -07:00
Krrish Dholakia
6cb03d7c63 modification to arg checking 2023-09-09 13:17:51 -07:00
Krrish Dholakia
263704e942 fix exception 2023-09-09 11:24:10 -07:00
Krrish Dholakia
a9cab12a47 improve error message returned if model not passed in 2023-09-09 11:18:10 -07:00
ishaan-jaff
26773a5d14 safe get_or_generate_uuid 2023-09-08 21:34:09 -07:00
Krrish Dholakia
59d6703b0c bump version 2023-09-08 19:26:41 -07:00
Krrish Dholakia
d02ab9bfcd update exception logic 2023-09-08 18:55:11 -07:00
Krrish Dholakia
93fb247b1d fix exception mapping 2023-09-08 18:45:18 -07:00
Krrish Dholakia
323e095688 fix exception mapping error 2023-09-08 18:20:07 -07:00
ishaan-jaff
0ab62f13e8 caching updates 2023-09-08 18:06:47 -07:00
ishaan-jaff
c5ae0147d0 better exception raising for package not imported 2023-09-08 17:42:01 -07:00
ishaan-jaff
a9cb373d04 fix exception handling 2023-09-08 15:42:27 -07:00
Krrish Dholakia
8acf959430 bump version 2023-09-08 13:12:27 -07:00
ishaan-jaff
b0a2e57a8a fix:completion fails when client=True&no email set 2023-09-08 12:36:33 -07:00
Krrish Dholakia
554b05015e fix litedebugger double logging error 2023-09-07 18:02:24 -07:00
Krrish Dholakia
147a877aca bump version 2023-09-07 17:00:20 -07:00
Krrish Dholakia
81ac07644d bump version 2023-09-07 16:24:05 -07:00
Krrish Dholakia
e452ceb21e fix litellm client 2023-09-07 16:22:00 -07:00
ishaan-jaff
8f5e2d0013 bug fix - issue 277 2023-09-07 14:11:10 -07:00
Ishaan Jaff
19b78c3f6f
Merge pull request #294 from shauryr/patch-1
added import aiohttp
2023-09-07 13:58:34 -07:00
Krrish Dholakia
c7e34bce5f update get model list 2023-09-07 13:15:50 -07:00
Shaurya Rohatgi
f4596c52b8
added import aiohttp 2023-09-07 12:31:14 -05:00
Krrish Dholakia
072d93696c remove print statement 2023-09-07 08:21:25 -07:00
ishaan-jaff
2880a7b6b4 allow users to pass custom timing for replicate 2023-09-06 18:32:40 -07:00
ishaan-jaff
8b3b682000 add replicate pricing 2023-09-06 18:14:34 -07:00
Krrish Dholakia
4cfcabd919 adding support for vllm 2023-09-06 18:07:44 -07:00
ishaan-jaff
bd77d5ac21 docs update 2023-09-06 17:16:24 -07:00
ishaan-jaff
1ba6b6761b show pricing for tg ai completion 2023-09-06 17:10:49 -07:00
ishaan-jaff
bab27634a8 rename max_tokens.json 2023-09-06 16:28:17 -07:00
ishaan-jaff
fbd67bc24c add experimental together_computer cost calc 2023-09-06 16:08:44 -07:00
Krrish Dholakia
44f71aa321 logging replicate response logs 2023-09-06 11:28:40 -07:00
ishaan-jaff
1da6026622 add flan + vicuna + fix replicate errors 2023-09-06 11:23:58 -07:00
ishaan-jaff
af60b2ba77 add vicuna translation 2023-09-06 11:14:24 -07:00
Krrish Dholakia
afcd6b28cc bump version 2023-09-06 11:05:11 -07:00
ishaan-jaff
0ddda7c035 send optional_params for llama2-70b chat replicate 2023-09-06 11:01:39 -07:00
ishaan-jaff
d4c4a138ca add replicate support for max_tokens 2023-09-06 10:38:21 -07:00
Krrish Dholakia
ef43141554 updates to exception mapping 2023-09-06 10:36:22 -07:00
ishaan-jaff
1c61b7b229 add replicate streaming 2023-09-06 10:23:13 -07:00
Krrish Dholakia
b4a9699138 update docs on together ai 2023-09-06 08:26:05 -07:00
ishaan-jaff
2a36f06763 remove install_and_import remove petals 2023-09-05 15:06:24 -07:00
Krrish Dholakia
2384806cfd adding first-party + custom prompt templates for huggingface 2023-09-04 14:54:09 -07:00
Krrish Dholakia
73bb1b96e9 update exception mapping and get model cost map 2023-09-04 11:53:20 -07:00
ishaan-jaff
e03d442e8f add optional params for llama-2 2023-09-04 11:41:20 -07:00
yujong-lee
44d2b2ca74 Remove print 2023-09-03 17:47:36 +09:00
ishaan-jaff
09ae510a58 use api_base instead of custom_api_base 2023-09-02 17:11:30 -07:00
ishaan-jaff
e6836985c8 test without id 2023-09-02 16:54:04 -07:00
Krrish Dholakia
56853aca53 fix azure streaming 2023-09-02 16:10:19 -07:00
Krrish Dholakia
895e3c1a94 update to logging 2023-09-02 15:45:45 -07:00