Commit graph

63 commits

Author SHA1 Message Date
Krrish Dholakia
3560f0ef2c refactor: move all testing to top-level of repo
Closes https://github.com/BerriAI/litellm/issues/486
2024-09-28 21:08:14 -07:00
Ishaan Jaff
80831ce73f ci/cd - anyscale discontinued their API endoints - skip test 2024-08-01 17:58:48 -07:00
Ishaan Jaff
2758a9165b test_async_response_azure 2024-07-12 19:04:05 -07:00
Krrish Dholakia
a1986fab60 fix(vertex_httpx.py): add sync vertex image gen support
Fixes https://github.com/BerriAI/litellm/issues/4623
2024-07-09 13:33:54 -07:00
Krish Dholakia
0633eecdb8
Merge pull request #2236 from BerriAI/litellm_faster_usage_logs_pg_db
fix(proxy_server.py): introduces a beta endpoint for admin to view global spend
2024-02-28 17:08:55 -08:00
Krrish Dholakia
4c951d20bc test: removing aws tests - account suspended - pending their approval 2024-02-28 13:46:20 -08:00
ishaan-jaff
382dad6c01 (test) hf catch rate limit errors 2024-02-28 12:02:54 -08:00
Krrish Dholakia
e745502032 test(test_async_fn.py): handle hf tgi model not being loaded yet 2024-02-15 18:37:32 -08:00
Krrish Dholakia
460b48914e feat(sagemaker.py): initial commit of working sagemaker with aioboto3 2024-02-12 17:25:57 -08:00
ishaan-jaff
cf86af46a8 (fix) litellm.acompletion with type hints 2024-01-11 10:47:12 +05:30
Krrish Dholakia
b1fd0a164b fix(huggingface_restapi.py): support timeouts for huggingface + openai text completions
https://github.com/BerriAI/litellm/issues/1334
2024-01-08 11:40:56 +05:30
Krish Dholakia
8d32f08858
Merge pull request #1342 from BerriAI/litellm_dockerfile_updates
build(Dockerfile): moves prisma logic to dockerfile
2024-01-06 16:03:25 +05:30
ishaan-jaff
0d152b3748 (fix) cloudflare tests 2024-01-06 15:35:49 +05:30
Krrish Dholakia
9375570547 test(test_async_fn.py): skip cloudflare test - flaky 2024-01-06 15:17:42 +05:30
ishaan-jaff
20256c45ad (fix) retry cloudflare ai workers 3 times 2024-01-05 13:55:47 +05:30
ishaan-jaff
bcf22725a6 (ci/cd) run cloudflare test 3 retries 2024-01-05 11:55:12 +05:30
Krrish Dholakia
77be3e3114 fix(main.py): don't set timeout as an optional api param 2023-12-30 11:47:07 +05:30
ishaan-jaff
243ad31e90 (test) async + stream clooudflare 2023-12-29 12:03:29 +05:30
ishaan-jaff
a999e80b46 (test) async cloudflare 2023-12-29 11:50:09 +05:30
Krrish Dholakia
e06840b571 refactor: move async text completion testing to test_text_completion.py 2023-12-29 11:46:40 +05:30
Krrish Dholakia
6f2734100f fix(main.py): fix async text completion streaming + add new tests 2023-12-29 11:33:42 +05:30
Krrish Dholakia
4905929de3 refactor: add black formatting 2023-12-25 14:11:20 +05:30
Krrish Dholakia
032f71adb2 fix(router.py): support cloudflare ai gateway for azure models on router 2023-11-30 14:09:06 -08:00
Krrish Dholakia
bb1267eb07 fix(router.py): fix exponential backoff to use retry-after if present in headers 2023-11-28 17:25:03 -08:00
Krrish Dholakia
78582e158a fix(main.py): fix acompletion for anyscale, openrouter, deepinfra, perplexity endpoints 2023-11-22 13:22:58 -08:00
Krrish Dholakia
381fdcd37b fix(utils.py): add response ms for async calls 2023-11-21 19:59:00 -08:00
ishaan-jaff
b5968a3ed8 (test) async for chunk 2023-11-18 17:17:39 -08:00
ishaan-jaff
d7e215a3e0 (test) do nothing if token==None in stream chunk 2023-11-18 17:13:16 -08:00
Krrish Dholakia
8e430fcfbe test(test_async_fn.py): catch timeouts 2023-11-17 18:01:52 -08:00
Krrish Dholakia
5cddab9e54 test(test_langfuse.py): handle timeouts 2023-11-17 17:05:46 -08:00
Krrish Dholakia
0ab6b2451d fix(acompletion): support client side timeouts + raise exceptions correctly for async calls 2023-11-17 15:39:47 -08:00
Krrish Dholakia
51bf637656 feat: global client for sync + async calls (openai + Azure only) 2023-11-16 14:44:13 -08:00
Krrish Dholakia
a94c09c13c fix(openai.py): handling extra headers 2023-11-16 12:48:21 -08:00
Krrish Dholakia
bf0f8b824c fix(azure.py): use openai client sdk for handling sync+async calling 2023-11-16 12:08:12 -08:00
Krrish Dholakia
a23c0a2599 fix(openai.py): fix linting issues 2023-11-16 11:01:28 -08:00
Krrish Dholakia
bb51216846 fix(openai.py): supporting openai client sdk for handling sync + async calls (incl. for openai-compatible apis) 2023-11-16 10:35:03 -08:00
Krrish Dholakia
03efc9185e fix(huggingface_restapi.py): async implementation 2023-11-15 16:54:15 -08:00
Krrish Dholakia
1a705bfbcb refactor(huggingface_restapi.py): moving async completion + streaming to real async calls 2023-11-15 15:14:21 -08:00
Krrish Dholakia
c8b73d90f1 fix(utils.py): fix langfuse integration 2023-11-15 14:05:40 -08:00
Krrish Dholakia
e07bf0a8de fix(utils.py): await async function in client wrapper 2023-11-14 22:07:28 -08:00
Krrish Dholakia
547598a134 refactor(bedrock.py-+-cohere.py): making bedrock and cohere compatible with openai v1 sdk 2023-11-11 17:33:19 -08:00
Krrish Dholakia
39c2597c33 refactor(azure.py): working azure completion calls with openai v1 sdk 2023-11-11 16:44:39 -08:00
Krrish Dholakia
d0bd932b3c refactor(openai.py): working openai chat + text completion for openai v1 sdk 2023-11-11 16:25:10 -08:00
Krrish Dholakia
d3323ba637 refactor(openai.py): making it compatible for openai v1
BREAKING CHANGE:
2023-11-11 15:33:02 -08:00
ishaan-jaff
9d3a28e391 (test) async_fn with stream 2023-11-10 17:47:15 -08:00
Krrish Dholakia
e12bff6d7f refactor(azure.py): enabling async streaming with aiohttp 2023-11-09 16:41:06 -08:00
Krrish Dholakia
c053782d96 refactor(openai.py): support aiohttp streaming 2023-11-09 16:15:30 -08:00
Krrish Dholakia
86ef2a02f7 fix(azure.py): adding support for aiohttp calls on azure + openai 2023-11-09 10:40:33 -08:00
Krrish Dholakia
9a0c785741 test(test_async_fn.py): fix import issues 2023-10-30 20:57:24 -07:00
Krrish Dholakia
9c70da56df test(test_async_fn.py): test logging 2023-10-30 19:59:36 -07:00