Krrish Dholakia
|
3560f0ef2c
|
refactor: move all testing to top-level of repo
Closes https://github.com/BerriAI/litellm/issues/486
|
2024-09-28 21:08:14 -07:00 |
|
Ishaan Jaff
|
80831ce73f
|
ci/cd - anyscale discontinued their API endoints - skip test
|
2024-08-01 17:58:48 -07:00 |
|
Ishaan Jaff
|
2758a9165b
|
test_async_response_azure
|
2024-07-12 19:04:05 -07:00 |
|
Krrish Dholakia
|
a1986fab60
|
fix(vertex_httpx.py): add sync vertex image gen support
Fixes https://github.com/BerriAI/litellm/issues/4623
|
2024-07-09 13:33:54 -07:00 |
|
Krish Dholakia
|
0633eecdb8
|
Merge pull request #2236 from BerriAI/litellm_faster_usage_logs_pg_db
fix(proxy_server.py): introduces a beta endpoint for admin to view global spend
|
2024-02-28 17:08:55 -08:00 |
|
Krrish Dholakia
|
4c951d20bc
|
test: removing aws tests - account suspended - pending their approval
|
2024-02-28 13:46:20 -08:00 |
|
ishaan-jaff
|
382dad6c01
|
(test) hf catch rate limit errors
|
2024-02-28 12:02:54 -08:00 |
|
Krrish Dholakia
|
e745502032
|
test(test_async_fn.py): handle hf tgi model not being loaded yet
|
2024-02-15 18:37:32 -08:00 |
|
Krrish Dholakia
|
460b48914e
|
feat(sagemaker.py): initial commit of working sagemaker with aioboto3
|
2024-02-12 17:25:57 -08:00 |
|
ishaan-jaff
|
cf86af46a8
|
(fix) litellm.acompletion with type hints
|
2024-01-11 10:47:12 +05:30 |
|
Krrish Dholakia
|
b1fd0a164b
|
fix(huggingface_restapi.py): support timeouts for huggingface + openai text completions
https://github.com/BerriAI/litellm/issues/1334
|
2024-01-08 11:40:56 +05:30 |
|
Krish Dholakia
|
8d32f08858
|
Merge pull request #1342 from BerriAI/litellm_dockerfile_updates
build(Dockerfile): moves prisma logic to dockerfile
|
2024-01-06 16:03:25 +05:30 |
|
ishaan-jaff
|
0d152b3748
|
(fix) cloudflare tests
|
2024-01-06 15:35:49 +05:30 |
|
Krrish Dholakia
|
9375570547
|
test(test_async_fn.py): skip cloudflare test - flaky
|
2024-01-06 15:17:42 +05:30 |
|
ishaan-jaff
|
20256c45ad
|
(fix) retry cloudflare ai workers 3 times
|
2024-01-05 13:55:47 +05:30 |
|
ishaan-jaff
|
bcf22725a6
|
(ci/cd) run cloudflare test 3 retries
|
2024-01-05 11:55:12 +05:30 |
|
Krrish Dholakia
|
77be3e3114
|
fix(main.py): don't set timeout as an optional api param
|
2023-12-30 11:47:07 +05:30 |
|
ishaan-jaff
|
243ad31e90
|
(test) async + stream clooudflare
|
2023-12-29 12:03:29 +05:30 |
|
ishaan-jaff
|
a999e80b46
|
(test) async cloudflare
|
2023-12-29 11:50:09 +05:30 |
|
Krrish Dholakia
|
e06840b571
|
refactor: move async text completion testing to test_text_completion.py
|
2023-12-29 11:46:40 +05:30 |
|
Krrish Dholakia
|
6f2734100f
|
fix(main.py): fix async text completion streaming + add new tests
|
2023-12-29 11:33:42 +05:30 |
|
Krrish Dholakia
|
4905929de3
|
refactor: add black formatting
|
2023-12-25 14:11:20 +05:30 |
|
Krrish Dholakia
|
032f71adb2
|
fix(router.py): support cloudflare ai gateway for azure models on router
|
2023-11-30 14:09:06 -08:00 |
|
Krrish Dholakia
|
bb1267eb07
|
fix(router.py): fix exponential backoff to use retry-after if present in headers
|
2023-11-28 17:25:03 -08:00 |
|
Krrish Dholakia
|
78582e158a
|
fix(main.py): fix acompletion for anyscale, openrouter, deepinfra, perplexity endpoints
|
2023-11-22 13:22:58 -08:00 |
|
Krrish Dholakia
|
381fdcd37b
|
fix(utils.py): add response ms for async calls
|
2023-11-21 19:59:00 -08:00 |
|
ishaan-jaff
|
b5968a3ed8
|
(test) async for chunk
|
2023-11-18 17:17:39 -08:00 |
|
ishaan-jaff
|
d7e215a3e0
|
(test) do nothing if token==None in stream chunk
|
2023-11-18 17:13:16 -08:00 |
|
Krrish Dholakia
|
8e430fcfbe
|
test(test_async_fn.py): catch timeouts
|
2023-11-17 18:01:52 -08:00 |
|
Krrish Dholakia
|
5cddab9e54
|
test(test_langfuse.py): handle timeouts
|
2023-11-17 17:05:46 -08:00 |
|
Krrish Dholakia
|
0ab6b2451d
|
fix(acompletion): support client side timeouts + raise exceptions correctly for async calls
|
2023-11-17 15:39:47 -08:00 |
|
Krrish Dholakia
|
51bf637656
|
feat: global client for sync + async calls (openai + Azure only)
|
2023-11-16 14:44:13 -08:00 |
|
Krrish Dholakia
|
a94c09c13c
|
fix(openai.py): handling extra headers
|
2023-11-16 12:48:21 -08:00 |
|
Krrish Dholakia
|
bf0f8b824c
|
fix(azure.py): use openai client sdk for handling sync+async calling
|
2023-11-16 12:08:12 -08:00 |
|
Krrish Dholakia
|
a23c0a2599
|
fix(openai.py): fix linting issues
|
2023-11-16 11:01:28 -08:00 |
|
Krrish Dholakia
|
bb51216846
|
fix(openai.py): supporting openai client sdk for handling sync + async calls (incl. for openai-compatible apis)
|
2023-11-16 10:35:03 -08:00 |
|
Krrish Dholakia
|
03efc9185e
|
fix(huggingface_restapi.py): async implementation
|
2023-11-15 16:54:15 -08:00 |
|
Krrish Dholakia
|
1a705bfbcb
|
refactor(huggingface_restapi.py): moving async completion + streaming to real async calls
|
2023-11-15 15:14:21 -08:00 |
|
Krrish Dholakia
|
c8b73d90f1
|
fix(utils.py): fix langfuse integration
|
2023-11-15 14:05:40 -08:00 |
|
Krrish Dholakia
|
e07bf0a8de
|
fix(utils.py): await async function in client wrapper
|
2023-11-14 22:07:28 -08:00 |
|
Krrish Dholakia
|
547598a134
|
refactor(bedrock.py-+-cohere.py): making bedrock and cohere compatible with openai v1 sdk
|
2023-11-11 17:33:19 -08:00 |
|
Krrish Dholakia
|
39c2597c33
|
refactor(azure.py): working azure completion calls with openai v1 sdk
|
2023-11-11 16:44:39 -08:00 |
|
Krrish Dholakia
|
d0bd932b3c
|
refactor(openai.py): working openai chat + text completion for openai v1 sdk
|
2023-11-11 16:25:10 -08:00 |
|
Krrish Dholakia
|
d3323ba637
|
refactor(openai.py): making it compatible for openai v1
BREAKING CHANGE:
|
2023-11-11 15:33:02 -08:00 |
|
ishaan-jaff
|
9d3a28e391
|
(test) async_fn with stream
|
2023-11-10 17:47:15 -08:00 |
|
Krrish Dholakia
|
e12bff6d7f
|
refactor(azure.py): enabling async streaming with aiohttp
|
2023-11-09 16:41:06 -08:00 |
|
Krrish Dholakia
|
c053782d96
|
refactor(openai.py): support aiohttp streaming
|
2023-11-09 16:15:30 -08:00 |
|
Krrish Dholakia
|
86ef2a02f7
|
fix(azure.py): adding support for aiohttp calls on azure + openai
|
2023-11-09 10:40:33 -08:00 |
|
Krrish Dholakia
|
9a0c785741
|
test(test_async_fn.py): fix import issues
|
2023-10-30 20:57:24 -07:00 |
|
Krrish Dholakia
|
9c70da56df
|
test(test_async_fn.py): test logging
|
2023-10-30 19:59:36 -07:00 |
|