Commit graph

844 commits

Author SHA1 Message Date
ishaan-jaff
9ad8cf396f (chore) remvoe bloat testing 2023-11-15 17:33:15 -08:00
ishaan-jaff
fd0b284a92 (chore) remove bloat 2023-11-15 17:16:14 -08:00
Krrish Dholakia
e28b9534e4 fix(huggingface_restapi.py): async implementation 2023-11-15 16:54:15 -08:00
Krrish Dholakia
0ede0e836e feat(get_max_tokens): get max tokens for huggingface hub models 2023-11-15 15:25:40 -08:00
Krrish Dholakia
e35ce15a89 refactor(huggingface_restapi.py): moving async completion + streaming to real async calls 2023-11-15 15:14:21 -08:00
Krrish Dholakia
04ce14e404 fix(utils.py): fix langfuse integration 2023-11-15 14:05:40 -08:00
Krrish Dholakia
e5929f2f7e fix(azure.py-+-proxy_server.py): fix function calling response object + support router on proxy 2023-11-15 13:15:16 -08:00
Krrish Dholakia
c47ca6cc50 refactor(router.py): renaming variable 2023-11-15 12:31:29 -08:00
Krrish Dholakia
4676b3dabd feat(router.py): enable passing chat completion params for Router.chat.completion.create 2023-11-15 12:28:16 -08:00
Krrish Dholakia
545fcbf786 test(test_completion.py): fix palm test 2023-11-14 22:28:56 -08:00
Krrish Dholakia
29a0c29eb3 fix(utils.py): await async function in client wrapper 2023-11-14 22:07:28 -08:00
Krrish Dholakia
0f6713993d fix(router.py): enabling retrying with expo backoff (without tenacity) for router 2023-11-14 20:57:51 -08:00
Krrish Dholakia
5d58bb9cd0 fix(main.py): misrouting ollama models to nlp cloud 2023-11-14 18:55:08 -08:00
Krrish Dholakia
9b582b2c85 fix(main.py): keep client consistent across calls + exponential backoff retry on ratelimit errors 2023-11-14 16:26:05 -08:00
ishaan-jaff
52e2730e44 (test) AI21 test 2023-11-14 15:01:50 -08:00
ishaan-jaff
74845f12a7 (test) completion azure_ad_token 2023-11-14 12:48:31 -08:00
ishaan-jaff
e3369bb260 (test) azure_ad_token 2023-11-14 12:12:14 -08:00
Krrish Dholakia
526eb99ade fix(palm.py): exception mapping bad requests / filtered responses 2023-11-14 11:53:13 -08:00
Krrish Dholakia
34fea89fb0 fix(utils.py): streaming 2023-11-13 18:15:14 -08:00
Krrish Dholakia
68a4229d0c test(test_streaming.py): turning on print verbose for streaming tests 2023-11-13 18:00:48 -08:00
Krrish Dholakia
c86be7665d test(utils.py): adding logging for azure streaming 2023-11-13 17:53:15 -08:00
Krrish Dholakia
4031f25345 test(test_streaming.py): adding retries to streaming tests 2023-11-13 16:34:59 -08:00
Krrish Dholakia
777a924e6b fix(utils.py): fix response object mapping 2023-11-13 15:58:25 -08:00
Krrish Dholakia
4e233c915b fix(router.py): enable calling router with instructor 2023-11-13 15:16:57 -08:00
Krrish Dholakia
330708e7ef fix(tests): fixing response objects for testing 2023-11-13 14:39:30 -08:00
Krrish Dholakia
bdf801d987 fix(together_ai.py): exception mapping for tgai 2023-11-13 13:17:15 -08:00
Krrish Dholakia
d8121737d6 test(test_completion.py): cleanup tests 2023-11-13 11:23:38 -08:00
Krrish Dholakia
b6eea3cf8e fix(timeout.py): fix timeout issue 2023-11-13 11:07:17 -08:00
Krrish Dholakia
8ba438b3a2 fix(caching.py): dump model response object as json 2023-11-13 10:41:04 -08:00
ishaan-jaff
a0ef7da7e0 (test) deepinfra with openai v1.0.0 2023-11-13 09:51:45 -08:00
ishaan-jaff
cf244fc5bf (test) token_counter 2023-11-13 08:02:46 -08:00
ishaan-jaff
ea2c029c50 (test) add test token counter 2023-11-13 07:42:08 -08:00
Krrish Dholakia
8db19d0af4 fix(utils.py): replacing openai.error import statements 2023-11-11 19:25:21 -08:00
Krrish Dholakia
4b74ddcb17 refactor: fixing linting issues 2023-11-11 18:52:28 -08:00
Krrish Dholakia
e7d1840d5f fix(main.py): fix caching for router 2023-11-11 17:45:23 -08:00
Krrish Dholakia
7b4e21e574 refactor(bedrock.py-+-cohere.py): making bedrock and cohere compatible with openai v1 sdk 2023-11-11 17:33:19 -08:00
Krrish Dholakia
c0a757a25f refactor(azure.py): working azure completion calls with openai v1 sdk 2023-11-11 16:44:39 -08:00
Krrish Dholakia
1ec07c0aba refactor(openai.py): working openai chat + text completion for openai v1 sdk 2023-11-11 16:25:10 -08:00
Krrish Dholakia
a5ec85b1f2 refactor(openai.py): making it compatible for openai v1
BREAKING CHANGE:
2023-11-11 15:33:02 -08:00
ishaan-jaff
5ab7470c84 (test) tokenizer worked test 2023-11-11 12:13:57 -08:00
ishaan-jaff
5675a82cfa (test) try/pass APIError for TG AI 2023-11-11 11:34:15 -08:00
ishaan-jaff
d9365b62fb (test) gpt4 vision 2023-11-11 10:34:37 -08:00
Ishaan Jaff
292b12b191 Merge pull request #787 from duc-phamh/improve_message_trimming
Improve message trimming
2023-11-11 09:39:43 -08:00
ishaan-jaff
4319aa415a (test) async_fn with stream 2023-11-10 17:47:15 -08:00
ishaan-jaff
8f0f9889a6 (test) add gpt-4 vision 2023-11-10 17:34:40 -08:00
Krrish Dholakia
11d1651d36 test(test_streaming.py): set cache to none 2023-11-10 15:24:17 -08:00
ishaan-jaff
4e071291bb (test) fix caching 2023-11-10 15:23:56 -08:00
Krrish Dholakia
429ed2cfba test(test_langfuse.py): add retries to langfuse test 2023-11-10 15:09:21 -08:00
Krrish Dholakia
4c103592e3 test(test_streaming.py): set cache to none 2023-11-10 15:04:01 -08:00
ishaan-jaff
8b41876257 (test) replicate with streaming, num retries 2023-11-10 12:46:33 -08:00