Commit graph

391 commits

Author SHA1 Message Date
Krrish Dholakia
69cdf5347a style(test_completion.py): fix merge conflict 2023-10-05 22:09:38 -07:00
ishaan-jaff
2e1b02e189 fix(completion()): add request_timeout as a param, fix claude error when request_timeout set 2023-10-05 19:05:28 -07:00
ishaan-jaff
f0d6d713e0 ollama default api_base to http://localhost:11434 2023-10-05 11:04:51 -07:00
Krrish Dholakia
1492916a37 adding custom prompt templates to ollama 2023-10-05 10:48:16 -07:00
ishaan-jaff
1dc264d7e4 add ratelimitmanager 2023-10-04 16:03:58 -07:00
ishaan-jaff
e82ba26651 make RateLimitHandler a class 2023-10-04 16:03:58 -07:00
ishaan-jaff
743c97c8da add batch_completion_rate_limits 2023-10-04 14:46:11 -07:00
Krrish Dholakia
cd23205564 add param mapping to docs 2023-10-03 09:20:58 -07:00
Krrish Dholakia
d49a36004c Fixes to bedrock 2023-10-02 16:09:06 -07:00
Krrish Dholakia
8c48af11c2 fixes to get optional params 2023-10-02 14:44:11 -07:00
Krrish Dholakia
0ae93d1112 fixing optional param mapping 2023-10-02 14:14:30 -07:00
Krrish Dholakia
d735f48917 fixes to get_optional_params 2023-10-02 12:34:22 -07:00
Krrish Dholakia
3880ef7739 fix linting issues 2023-10-02 12:12:34 -07:00
Krrish Dholakia
eb4c7876e2 fix get optional params 2023-10-02 12:02:53 -07:00
Krrish Dholakia
12fa4069f3 raise exception if optional param is not mapped to model 2023-10-02 11:17:51 -07:00
Krrish Dholakia
b2c49e44ef updates 2023-09-30 18:26:23 -07:00
ishaan-jaff
48cad985ad add fake streaming for petals 2023-09-30 10:22:04 -07:00
ishaan-jaff
7c3c91994a fix logging error 2023-09-29 16:02:19 -07:00
ishaan-jaff
0dbb5a10e9 add hf embedding models 2023-09-29 11:57:38 -07:00
ishaan-jaff
db69b34973 remove junk code in getting custom_llm_provider 2023-09-29 11:18:08 -07:00
ishaan-jaff
17c2863f02 add cohere embedding models 2023-09-29 09:59:31 -07:00
ishaan-jaff
797d954e1b remove junk from completion 2023-09-28 17:57:48 -07:00
ishaan-jaff
427400276e remove junk from completion input 2023-09-28 17:54:46 -07:00
ishaan-jaff
8fb13388b7 remove junk vars in completion.py 2023-09-28 17:50:06 -07:00
ishaan-jaff
8e4e62897e clean out args passed to completion 2023-09-28 17:43:54 -07:00
ishaan-jaff
47e54c869c clean out args given to completion 2023-09-28 17:35:47 -07:00
Krrish Dholakia
46044b70a8 fix hf routing bug 2023-09-28 13:32:39 -07:00
Krrish Dholakia
de7c5a9a30 fix testing 2023-09-27 21:31:00 -07:00
Krrish Dholakia
c737462beb adding support for completions endpoint in proxy 2023-09-27 21:04:15 -07:00
Krrish Dholakia
47f93024dd cleanup 2023-09-26 21:55:25 -07:00
Krrish Dholakia
7aaa857c90 add switching api keys + api bases to docs 2023-09-26 21:47:33 -07:00
Krrish Dholakia
126a8bf909 remove trust remote code option 2023-09-26 19:20:48 -07:00
ishaan-jaff
d1692e89dd palm streaming 2023-09-26 12:27:49 -07:00
ishaan-jaff
660a223663 lint fix 2023-09-26 10:11:53 -07:00
ishaan-jaff
a178082d89 add palm 2023-09-26 10:00:56 -07:00
ishaan-jaff
59664f0c87 add beta deep infra support 2023-09-25 21:42:46 -07:00
Krrish Dholakia
7cf5be98a2 add contributor message to code 2023-09-25 10:00:10 -07:00
Krrish Dholakia
3cac04f459 fix exception mapping for streaming 2023-09-23 15:04:59 -07:00
ishaan-jaff
689ca2e82d track vertex ai usage 2023-09-22 20:43:03 -07:00
Krrish Dholakia
1d86448b6a expose vertex ai and hf api base as env var 2023-09-22 15:14:33 -07:00
ishaan-jaff
be2f687a07 sagemaker streaming 2023-09-21 16:14:44 -07:00
Krrish Dholakia
a3a36b80e9 add completion configs 2023-09-21 14:00:11 -07:00
Krrish Dholakia
fdcfca7699 add metadata logging to promptlayer 2023-09-21 10:45:02 -07:00
ishaan-jaff
9219fd90c7 support acompletion + stream for ollama 2023-09-21 10:39:48 -07:00
Ishaan Jaff
cb63435850 Merge pull request #416 from BerriAI/ishaan/error-logging
Add Dashboard for showing error logs on exception
2023-09-20 20:17:18 -07:00
Krrish Dholakia
f075646dee fix multithreading issue with response objects 2023-09-20 19:36:08 -07:00
ishaan-jaff
fc7bcf3d77 add batch testing 2023-09-20 08:17:48 -07:00
ishaan-jaff
a6300f8067 add batch_completion_models_all_responses 2023-09-20 08:01:53 -07:00
ishaan-jaff
c8ee924f26 fix moderation 2023-09-19 22:18:02 -07:00
ishaan-jaff
0ba9a26ecd bump v 2023-09-19 21:57:35 -07:00