Commit graph

47 commits

Author SHA1 Message Date
Krrish Dholakia
77be3e3114 fix(main.py): don't set timeout as an optional api param 2023-12-30 11:47:07 +05:30
ishaan-jaff
243ad31e90 (test) async + stream clooudflare 2023-12-29 12:03:29 +05:30
ishaan-jaff
a999e80b46 (test) async cloudflare 2023-12-29 11:50:09 +05:30
Krrish Dholakia
e06840b571 refactor: move async text completion testing to test_text_completion.py 2023-12-29 11:46:40 +05:30
Krrish Dholakia
6f2734100f fix(main.py): fix async text completion streaming + add new tests 2023-12-29 11:33:42 +05:30
Krrish Dholakia
4905929de3 refactor: add black formatting 2023-12-25 14:11:20 +05:30
Krrish Dholakia
032f71adb2 fix(router.py): support cloudflare ai gateway for azure models on router 2023-11-30 14:09:06 -08:00
Krrish Dholakia
bb1267eb07 fix(router.py): fix exponential backoff to use retry-after if present in headers 2023-11-28 17:25:03 -08:00
Krrish Dholakia
78582e158a fix(main.py): fix acompletion for anyscale, openrouter, deepinfra, perplexity endpoints 2023-11-22 13:22:58 -08:00
Krrish Dholakia
381fdcd37b fix(utils.py): add response ms for async calls 2023-11-21 19:59:00 -08:00
ishaan-jaff
b5968a3ed8 (test) async for chunk 2023-11-18 17:17:39 -08:00
ishaan-jaff
d7e215a3e0 (test) do nothing if token==None in stream chunk 2023-11-18 17:13:16 -08:00
Krrish Dholakia
8e430fcfbe test(test_async_fn.py): catch timeouts 2023-11-17 18:01:52 -08:00
Krrish Dholakia
5cddab9e54 test(test_langfuse.py): handle timeouts 2023-11-17 17:05:46 -08:00
Krrish Dholakia
0ab6b2451d fix(acompletion): support client side timeouts + raise exceptions correctly for async calls 2023-11-17 15:39:47 -08:00
Krrish Dholakia
51bf637656 feat: global client for sync + async calls (openai + Azure only) 2023-11-16 14:44:13 -08:00
Krrish Dholakia
a94c09c13c fix(openai.py): handling extra headers 2023-11-16 12:48:21 -08:00
Krrish Dholakia
bf0f8b824c fix(azure.py): use openai client sdk for handling sync+async calling 2023-11-16 12:08:12 -08:00
Krrish Dholakia
a23c0a2599 fix(openai.py): fix linting issues 2023-11-16 11:01:28 -08:00
Krrish Dholakia
bb51216846 fix(openai.py): supporting openai client sdk for handling sync + async calls (incl. for openai-compatible apis) 2023-11-16 10:35:03 -08:00
Krrish Dholakia
03efc9185e fix(huggingface_restapi.py): async implementation 2023-11-15 16:54:15 -08:00
Krrish Dholakia
1a705bfbcb refactor(huggingface_restapi.py): moving async completion + streaming to real async calls 2023-11-15 15:14:21 -08:00
Krrish Dholakia
c8b73d90f1 fix(utils.py): fix langfuse integration 2023-11-15 14:05:40 -08:00
Krrish Dholakia
e07bf0a8de fix(utils.py): await async function in client wrapper 2023-11-14 22:07:28 -08:00
Krrish Dholakia
547598a134 refactor(bedrock.py-+-cohere.py): making bedrock and cohere compatible with openai v1 sdk 2023-11-11 17:33:19 -08:00
Krrish Dholakia
39c2597c33 refactor(azure.py): working azure completion calls with openai v1 sdk 2023-11-11 16:44:39 -08:00
Krrish Dholakia
d0bd932b3c refactor(openai.py): working openai chat + text completion for openai v1 sdk 2023-11-11 16:25:10 -08:00
Krrish Dholakia
d3323ba637 refactor(openai.py): making it compatible for openai v1
BREAKING CHANGE:
2023-11-11 15:33:02 -08:00
ishaan-jaff
9d3a28e391 (test) async_fn with stream 2023-11-10 17:47:15 -08:00
Krrish Dholakia
e12bff6d7f refactor(azure.py): enabling async streaming with aiohttp 2023-11-09 16:41:06 -08:00
Krrish Dholakia
c053782d96 refactor(openai.py): support aiohttp streaming 2023-11-09 16:15:30 -08:00
Krrish Dholakia
86ef2a02f7 fix(azure.py): adding support for aiohttp calls on azure + openai 2023-11-09 10:40:33 -08:00
Krrish Dholakia
9a0c785741 test(test_async_fn.py): fix import issues 2023-10-30 20:57:24 -07:00
Krrish Dholakia
9c70da56df test(test_async_fn.py): test logging 2023-10-30 19:59:36 -07:00
Krrish Dholakia
a30fca4f60 test(test_async_fn.py): addding sync test 2023-10-30 19:38:31 -07:00
Krrish Dholakia
b798d7de89 test(test_async_fn.py): more logging 2023-10-30 18:39:10 -07:00
Krrish Dholakia
844ab5f1e5 test(test_async_fn.py): add better error logging 2023-10-30 18:18:11 -07:00
Krrish Dholakia
1eca893d2f test(test_async_fn.py): adding additional logging for tests 2023-10-24 12:54:18 -07:00
Krrish Dholakia
2c371bb8d1 refactor(test_async_fn.py): refactor for testing 2023-10-24 12:46:30 -07:00
Krrish Dholakia
8b60d797e1 fixing optional param mapping 2023-10-02 14:14:30 -07:00
Krrish Dholakia
abe3286ec6 bump version 2023-09-17 08:07:19 -07:00
ishaan-jaff
3e5c972e91 bump version litellm 2023-09-07 14:03:37 -07:00
ishaan-jaff
301eb36095 cleanup async func test 2023-09-07 13:56:46 -07:00
ishaan-jaff
a611409e0f async streaming generator 2023-09-07 13:53:40 -07:00
Krrish Dholakia
3d9518abbb acreate thin-client 2023-08-21 16:04:15 -07:00
ishaan-jaff
15b1da9dc8 add linting 2023-08-18 11:05:05 -07:00
Krrish Dholakia
82a75a9d92 fixing acompletion 2023-08-03 13:53:38 -07:00