Commit graph

293 commits

Author SHA1 Message Date
ishaan-jaff
e8b844abae (fix) azure: better debugging 2023-11-23 16:08:59 -08:00
Krish Dholakia
6ba4eeb961
Merge pull request #885 from Codium-ai/bugfix/hf_timeout
Do not timeout when calling HF through acomplete
2023-11-23 07:48:59 -08:00
Ori Kotek
e74ac03169
Do not timeout when calling HF through acomplete 2023-11-23 15:56:59 +02:00
maqsoodshaik
0f89c3375a this commit fixes #883 2023-11-23 12:45:38 +01:00
ishaan-jaff
4260e0c1f0 (fix) linting error 2023-11-22 16:22:05 -08:00
ishaan-jaff
5abd566b7c (feat) embedding() support for timeouts 2023-11-22 14:25:55 -08:00
ishaan-jaff
4247df02c7 (fix) Azure - only use ad_token when api_key is None 2023-11-22 14:25:55 -08:00
Krish Dholakia
e4f1e2b138
Merge pull request #845 from canada4663/upstream-main
Added support for multiple embeddings via Bedrock
2023-11-21 14:00:06 -08:00
Krrish Dholakia
1218121e47 fix(huggingface_restapi.pyu): fix linting errors 2023-11-21 10:05:35 -08:00
Krrish Dholakia
41483d2660 feat(factory.py): add support for anthropic system prompts for claude 2.1 2023-11-21 09:57:26 -08:00
Krrish Dholakia
846a32ca87 fix(huggingface_restapi.py): fixing formatting 2023-11-21 09:57:26 -08:00
Krrish Dholakia
6892fd8b51 fix(huggingface_restapi.py): fix huggingface response format 2023-11-21 09:57:26 -08:00
Krrish Dholakia
a89b8f55e3 fix(huggingface_restapi.py): handle generate text output 2023-11-21 09:57:26 -08:00
Krrish Dholakia
1306addfe8 fix(openai.py-+-azure.py): fix linting issues 2023-11-20 19:29:23 -08:00
Krrish Dholakia
855964ed45 fix(utils.py): adding support for rules + mythomax/alpaca prompt template 2023-11-20 18:58:15 -08:00
ishaan-jaff
50f883a2fb (fix) pydantic errors with response.time 2023-11-20 18:28:19 -08:00
ishaan-jaff
99515c2e25 (fix) linting 2023-11-20 17:00:20 -08:00
ishaan-jaff
11ec2710c6 (fix) completion: max_retries using OpenAI client 2023-11-20 16:57:37 -08:00
canada4663
74ed37c4f2 bedrock embedding changes pre-testing 2023-11-18 21:00:06 -08:00
ishaan-jaff
32f22adf8b (feat) openai improve logging post_call 2023-11-17 15:51:27 -08:00
Krrish Dholakia
17bb1184bd fix(main.py): fix linting issue 2023-11-17 15:45:00 -08:00
Krrish Dholakia
0ab6b2451d fix(acompletion): support client side timeouts + raise exceptions correctly for async calls 2023-11-17 15:39:47 -08:00
Krrish Dholakia
7ef1014e59 fix(factory.py): for ollama models check if it's instruct or not before applying prompt template 2023-11-16 15:45:08 -08:00
Krrish Dholakia
51bf637656 feat: global client for sync + async calls (openai + Azure only) 2023-11-16 14:44:13 -08:00
Krrish Dholakia
d7f7694848 fix(openai.py): fix linting issues 2023-11-16 12:57:53 -08:00
Krrish Dholakia
a94c09c13c fix(openai.py): handling extra headers 2023-11-16 12:48:21 -08:00
Krrish Dholakia
f99a161d98 fix(azure.py): fix linting errors 2023-11-16 12:15:50 -08:00
Krrish Dholakia
bf0f8b824c fix(azure.py): use openai client sdk for handling sync+async calling 2023-11-16 12:08:12 -08:00
Krrish Dholakia
a23c0a2599 fix(openai.py): fix linting issues 2023-11-16 11:01:28 -08:00
Krrish Dholakia
bb51216846 fix(openai.py): supporting openai client sdk for handling sync + async calls (incl. for openai-compatible apis) 2023-11-16 10:35:03 -08:00
Ishaan Jaff
d6ad62d793
Merge pull request #811 from dchristian3188/bedrock-llama
Bedrock llama
2023-11-16 07:57:50 -08:00
Krrish Dholakia
93aae8669d fix(openai.py): using openai sdk for completion calls 2023-11-15 20:25:27 -08:00
Krrish Dholakia
da68e1ea81 perf(openai.py): extending request timeout 2023-11-15 18:45:45 -08:00
Krrish Dholakia
a575ff867f fix(openai.py): fix linting errors 2023-11-15 18:33:01 -08:00
Krrish Dholakia
d090562dc1 fix(openai.py): move chat completions post call to requests 2023-11-15 18:29:07 -08:00
Krrish Dholakia
fc8b54eb73 fix(openai.py): switch back to using requests instead of httpx 2023-11-15 18:25:21 -08:00
Krrish Dholakia
2750a26633 fix(openai.py): fix timeout errors 2023-11-15 18:03:14 -08:00
Krrish Dholakia
a3d280baa3 test: cleanup testing 2023-11-15 17:57:14 -08:00
Krrish Dholakia
9fd7c5b343 test: set request timeout at request level 2023-11-15 17:42:31 -08:00
Krrish Dholakia
d6e142428b fix(openai-+-azure): async calling 2023-11-15 17:03:02 -08:00
Krrish Dholakia
03efc9185e fix(huggingface_restapi.py): async implementation 2023-11-15 16:54:15 -08:00
Krrish Dholakia
bcea28e2e4 fix(utils): fixing exception mapping 2023-11-15 15:51:17 -08:00
Krrish Dholakia
a59494571f fix(huggingface_restapi.py): fix linting errors 2023-11-15 15:34:21 -08:00
Krrish Dholakia
1a705bfbcb refactor(huggingface_restapi.py): moving async completion + streaming to real async calls 2023-11-15 15:14:21 -08:00
Krrish Dholakia
8c104e9c6a fix(azure.py-+-proxy_server.py): fix function calling response object + support router on proxy 2023-11-15 13:15:16 -08:00
Krrish Dholakia
efe81032f4 fix: fix linting errors 2023-11-14 21:51:39 -08:00
Krrish Dholakia
59eaeba92a fix(router.py): enabling retrying with expo backoff (without tenacity) for router 2023-11-14 20:57:51 -08:00
Krrish Dholakia
1738341dcb fix(main.py): misrouting ollama models to nlp cloud 2023-11-14 18:55:08 -08:00
ishaan-jaff
f650be4fee (feat) completion debug view HF POST request 2023-11-14 17:57:41 -08:00
ishaan-jaff
e82b8ed7e2 (feat) debug ollama POST request 2023-11-14 17:53:48 -08:00