Krrish Dholakia
|
b1fd0a164b
|
fix(huggingface_restapi.py): support timeouts for huggingface + openai text completions
https://github.com/BerriAI/litellm/issues/1334
|
2024-01-08 11:40:56 +05:30 |
|
Krrish Dholakia
|
4905929de3
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
|
ishaan-jaff
|
20b5505476
|
(feat) show POST request for HF embeddings
|
2023-12-16 13:09:49 +05:30 |
|
Krrish Dholakia
|
add153d110
|
fix(huggingface_restapi.py): add support for additional hf embedding formats
|
2023-12-15 21:02:41 -08:00 |
|
Krrish Dholakia
|
71e64c34cb
|
fix(huggingface_restapi.py): raise better exceptions for unprocessable hf responses
|
2023-12-05 07:28:21 -08:00 |
|
Ori Kotek
|
e74ac03169
|
Do not timeout when calling HF through acomplete
|
2023-11-23 15:56:59 +02:00 |
|
Krrish Dholakia
|
1218121e47
|
fix(huggingface_restapi.pyu): fix linting errors
|
2023-11-21 10:05:35 -08:00 |
|
Krrish Dholakia
|
846a32ca87
|
fix(huggingface_restapi.py): fixing formatting
|
2023-11-21 09:57:26 -08:00 |
|
Krrish Dholakia
|
6892fd8b51
|
fix(huggingface_restapi.py): fix huggingface response format
|
2023-11-21 09:57:26 -08:00 |
|
Krrish Dholakia
|
a89b8f55e3
|
fix(huggingface_restapi.py): handle generate text output
|
2023-11-21 09:57:26 -08:00 |
|
ishaan-jaff
|
50f883a2fb
|
(fix) pydantic errors with response.time
|
2023-11-20 18:28:19 -08:00 |
|
Krrish Dholakia
|
03efc9185e
|
fix(huggingface_restapi.py): async implementation
|
2023-11-15 16:54:15 -08:00 |
|
Krrish Dholakia
|
bcea28e2e4
|
fix(utils): fixing exception mapping
|
2023-11-15 15:51:17 -08:00 |
|
Krrish Dholakia
|
a59494571f
|
fix(huggingface_restapi.py): fix linting errors
|
2023-11-15 15:34:21 -08:00 |
|
Krrish Dholakia
|
1a705bfbcb
|
refactor(huggingface_restapi.py): moving async completion + streaming to real async calls
|
2023-11-15 15:14:21 -08:00 |
|
ishaan-jaff
|
f650be4fee
|
(feat) completion debug view HF POST request
|
2023-11-14 17:57:41 -08:00 |
|
Krrish Dholakia
|
45b6f8b853
|
refactor: fixing linting issues
|
2023-11-11 18:52:28 -08:00 |
|
Krrish Dholakia
|
4f42beb9d9
|
refactor(huggingface,-anthropic,-replicate,-sagemaker): making huggingface, anthropic, replicate, sagemaker compatible openai v1 sdk
|
2023-11-11 17:38:15 -08:00 |
|
Krrish Dholakia
|
547598a134
|
refactor(bedrock.py-+-cohere.py): making bedrock and cohere compatible with openai v1 sdk
|
2023-11-11 17:33:19 -08:00 |
|
ishaan-jaff
|
a404b0fc3b
|
(fix) remove errant print from hf
|
2023-11-08 11:49:15 -08:00 |
|
ishaan-jaff
|
3c67de7f04
|
(fix) hf don't fail when logprob is None
|
2023-11-06 14:22:09 -08:00 |
|
Krrish Dholakia
|
65c01eae23
|
fix(huggingface_restapi.py): output parsing chat template models
|
2023-11-06 11:43:12 -08:00 |
|
Krrish Dholakia
|
7c46e85ed6
|
refactor(bedrock.py): better exception mapping for bedrock + huggingface
|
2023-11-04 16:12:12 -07:00 |
|
Krrish Dholakia
|
ab54262d37
|
fix(timeout.py): import errors
|
2023-11-04 16:05:14 -07:00 |
|
Krrish Dholakia
|
5b3978eff4
|
fix(main.py): fixing print_verbose
|
2023-11-04 14:41:34 -07:00 |
|
ishaan-jaff
|
df57e9247a
|
(fix) hf calculating usage non blocking
|
2023-11-03 18:03:19 -07:00 |
|
Krrish Dholakia
|
4e1885734a
|
refactor(proxy_server.py): print statement showing how to add debug for logs
|
2023-11-03 17:41:14 -07:00 |
|
ishaan-jaff
|
6fc0c74878
|
(fix) remove errant print statements
|
2023-11-03 13:02:52 -07:00 |
|
Krrish Dholakia
|
512a1637eb
|
feat(completion()): enable setting prompt templates via completion()
|
2023-11-02 16:24:01 -07:00 |
|
Krrish Dholakia
|
b305492a0b
|
fix(huggingface_restapi.py): fix linting issue
|
2023-11-01 16:43:35 -07:00 |
|
Krrish Dholakia
|
2c4cb76ce5
|
fix(huggingface_restapi.py): fix embeddings for sentence-transformer models
|
2023-11-01 16:36:46 -07:00 |
|
ishaan-jaff
|
9223f7cc7a
|
(feat) textcompletion - transform hf log probs to openai text completion
|
2023-10-31 17:15:35 -07:00 |
|
ishaan-jaff
|
63928fa166
|
(feat) use usage class for model responses for cohere, hf, tg ai, cohere
|
2023-10-27 09:58:47 -07:00 |
|
Krrish Dholakia
|
dcb866b353
|
docs(proxy_server.md): update proxy server docs to include multi-agent autogen tutorial
|
2023-10-17 09:22:34 -07:00 |
|
Krrish Dholakia
|
7572086231
|
style: fix linting errors
|
2023-10-16 17:35:08 -07:00 |
|
Krrish Dholakia
|
7358d2e4ea
|
bump: version 0.8.4 → 0.8.5
|
2023-10-14 16:43:06 -07:00 |
|
ishaan-jaff
|
5a0284dd58
|
(fix) fix linting errors
|
2023-10-13 21:23:00 -07:00 |
|
Krrish Dholakia
|
af2fd0e0de
|
fix: fix value error if model returns empty completion
|
2023-10-10 10:11:40 -07:00 |
|
Krrish Dholakia
|
dd7e397650
|
style(test_completion.py): fix merge conflict
|
2023-10-05 22:09:38 -07:00 |
|
Krrish Dholakia
|
512769e841
|
support n param for hf
|
2023-10-03 07:10:13 -07:00 |
|
Krrish Dholakia
|
5a19ee1a71
|
fix get optional params
|
2023-10-02 12:02:53 -07:00 |
|
Krrish Dholakia
|
1cae080eb2
|
raise exception if optional param is not mapped to model
|
2023-10-02 11:17:51 -07:00 |
|
ishaan-jaff
|
3fbad7dfa7
|
add hf embedding models
|
2023-09-29 11:57:38 -07:00 |
|
ishaan-jaff
|
156d4f27de
|
auto-detect HF task
|
2023-09-27 17:49:31 -07:00 |
|
Krrish Dholakia
|
9ef0ad9e66
|
expose vertex ai and hf api base as env var
|
2023-09-22 15:14:33 -07:00 |
|
Krrish Dholakia
|
9ec8ea89bb
|
fixing huggingface tgi index issue for best of
|
2023-09-21 10:05:22 -07:00 |
|
Krrish Dholakia
|
a8711dc5c2
|
fix hf tgi best of bug
|
2023-09-20 20:53:32 -07:00 |
|
Krrish Dholakia
|
c63db48652
|
return all best of sequences
|
2023-09-20 14:43:25 -07:00 |
|
Krrish Dholakia
|
5b294c704e
|
fix hf conversational task bug
|
2023-09-18 11:46:36 -07:00 |
|
ishaan-jaff
|
0bee6e0d38
|
cleanup
|
2023-09-18 10:43:44 -07:00 |
|