Commit graph

2244 commits

Author SHA1 Message Date
ishaan-jaff
e82b8ed7e2 (feat) debug ollama POST request 2023-11-14 17:53:48 -08:00
ishaan-jaff
7c317b78eb (feat) add ability to view POST requests from litellm.completion() 2023-11-14 17:27:20 -08:00
Krrish Dholakia
a7222f257c fix(main.py): keep client consistent across calls + exponential backoff retry on ratelimit errors 2023-11-14 16:26:05 -08:00
ishaan-jaff
75cf3b3555 (fix) AI21 exception mapping - raise error when status !=200 2023-11-14 15:01:22 -08:00
ishaan-jaff
0779dfbbd6 (fix) azure_ad_token 2023-11-14 12:20:14 -08:00
ishaan-jaff
ed56f280d9 (feat) add azure_ad_token 2023-11-14 12:12:14 -08:00
Krrish Dholakia
e9e86cac79 fix(palm.py): exception mapping bad requests / filtered responses 2023-11-14 11:53:13 -08:00
Krrish Dholakia
b722594792 test(utils.py): add logging and fix azure streaming 2023-11-13 17:24:13 -08:00
David Christian
fe7e3ff038 added support for bedrock llama models 2023-11-13 15:41:21 -08:00
Krrish Dholakia
8a3b771e50 fix(tests): fixing response objects for testing 2023-11-13 14:39:30 -08:00
Krrish Dholakia
d4de55b053 fix(together_ai.py): exception mapping for tgai 2023-11-13 13:17:15 -08:00
Krrish Dholakia
45b6f8b853 refactor: fixing linting issues 2023-11-11 18:52:28 -08:00
Krrish Dholakia
ae35c13015 refactor(ai21,-aleph-alpha,-ollama): making ai21, aleph-alpha, ollama compatible with openai v1 sdk 2023-11-11 17:49:13 -08:00
Krrish Dholakia
c6ce3fedcd fix(main.py): fix caching for router 2023-11-11 17:45:23 -08:00
Krrish Dholakia
4f42beb9d9 refactor(huggingface,-anthropic,-replicate,-sagemaker): making huggingface, anthropic, replicate, sagemaker compatible openai v1 sdk 2023-11-11 17:38:15 -08:00
Krrish Dholakia
547598a134 refactor(bedrock.py-+-cohere.py): making bedrock and cohere compatible with openai v1 sdk 2023-11-11 17:33:19 -08:00
Krrish Dholakia
39c2597c33 refactor(azure.py): working azure completion calls with openai v1 sdk 2023-11-11 16:44:39 -08:00
Krrish Dholakia
d0bd932b3c refactor(openai.py): working openai chat + text completion for openai v1 sdk 2023-11-11 16:25:10 -08:00
Krrish Dholakia
d3323ba637 refactor(openai.py): making it compatible for openai v1
BREAKING CHANGE:
2023-11-11 15:33:02 -08:00
ishaan-jaff
d8f735565c (fix) tg ai raise errors on non 200 responses 2023-11-11 11:21:12 -08:00
ishaan-jaff
9b78bbc6ea (fix) ssl changes 2023-11-10 15:57:59 -08:00
ishaan-jaff
f9d4505ea0 (fix) ssl for acompletion with openai 2023-11-10 15:55:04 -08:00
ishaan-jaff
af98f74c82 (feat) replicate add exception mapping for streaming + better logging when polling 2023-11-10 12:46:33 -08:00
ishaan-jaff
4c3765119b (fix) replicate print verbose 2023-11-10 12:46:33 -08:00
ishaan-jaff
49c7c851a8 (feat) replicate exception mapping 2023-11-10 12:46:33 -08:00
ishaan-jaff
00e1b46e68 (feat) replicate exception mapping 2023-11-10 12:46:33 -08:00
Krrish Dholakia
18a8bd5543 fix(utils.py): return function call as part of response object 2023-11-10 11:02:10 -08:00
ishaan-jaff
2f07460333 (feat) completion ollama raise exception when ollama resp != 200 2023-11-10 08:54:05 -08:00
ishaan-jaff
d0c9bfd14a (feat) completion - replicate custom deployments 2023-11-09 18:10:38 -08:00
Krrish Dholakia
b9e6989e41 test: fix linting issues 2023-11-09 16:50:43 -08:00
Krrish Dholakia
e12bff6d7f refactor(azure.py): enabling async streaming with aiohttp 2023-11-09 16:41:06 -08:00
Krrish Dholakia
c053782d96 refactor(openai.py): support aiohttp streaming 2023-11-09 16:15:30 -08:00
Krrish Dholakia
86ef2a02f7 fix(azure.py): adding support for aiohttp calls on azure + openai 2023-11-09 10:40:33 -08:00
Krrish Dholakia
7c5fd5824b refactor(azure.py): fix linting errors 2023-11-08 19:24:53 -08:00
Krrish Dholakia
6f4707bbb3 refactor(azure.py): moving embeddings to http call 2023-11-08 19:07:21 -08:00
Krrish Dholakia
70311502c8 refactor(openai.py): moving embedding calls to http 2023-11-08 19:01:17 -08:00
Krrish Dholakia
c2cbdb23fd refactor(openai.py): moving openai text completion calls to http 2023-11-08 18:40:03 -08:00
Krrish Dholakia
c57ed0a9d7 refactor(openai.py): moving openai chat completion calls to http 2023-11-08 17:40:41 -08:00
Krrish Dholakia
53abc31c27 refactor(azure.py): moving azure openai calls to http calls 2023-11-08 16:52:18 -08:00
ishaan-jaff
a404b0fc3b (fix) remove errant print from hf 2023-11-08 11:49:15 -08:00
Krrish Dholakia
ce27e08e7d (fix): llama-2 non-chat models prompt template 2023-11-07 21:33:54 -08:00
ishaan-jaff
3c67de7f04 (fix) hf don't fail when logprob is None 2023-11-06 14:22:09 -08:00
Krrish Dholakia
65c01eae23 fix(huggingface_restapi.py): output parsing chat template models 2023-11-06 11:43:12 -08:00
Krrish Dholakia
7c46e85ed6 refactor(bedrock.py): better exception mapping for bedrock + huggingface 2023-11-04 16:12:12 -07:00
Krrish Dholakia
ab54262d37 fix(timeout.py): import errors 2023-11-04 16:05:14 -07:00
Krrish Dholakia
5b3978eff4 fix(main.py): fixing print_verbose 2023-11-04 14:41:34 -07:00
Krrish Dholakia
6b40546e59 refactor(all-files): removing all print statements; adding pre-commit + flake8 to prevent future regressions 2023-11-04 12:50:15 -07:00
Krrish Dholakia
1c4dd0671b fix(bedrock.py): add exception mapping coverage for authentication scenarios 2023-11-03 18:25:34 -07:00
Krrish Dholakia
142750adff fix(bedrock.py): fix bedrock exception mapping 2023-11-03 18:14:12 -07:00
ishaan-jaff
49650af444 (fix) bedrock: remove check for - if "error" in outputText 2023-11-03 18:06:23 -07:00