Commit graph

524 commits

Author SHA1 Message Date
Rodney Rodriguez
5d39279ac0 bugfixes for ollama 2023-11-15 19:27:06 -06:00
Krrish Dholakia
bcea28e2e4 fix(utils): fixing exception mapping 2023-11-15 15:51:17 -08:00
Krrish Dholakia
f84db3ce14 feat(get_max_tokens): get max tokens for huggingface hub models 2023-11-15 15:25:40 -08:00
Krrish Dholakia
1a705bfbcb refactor(huggingface_restapi.py): moving async completion + streaming to real async calls 2023-11-15 15:14:21 -08:00
Krrish Dholakia
c8b73d90f1 fix(utils.py): fix langfuse integration 2023-11-15 14:05:40 -08:00
Krrish Dholakia
60d2dff74a fix(utils.py): check for none params 2023-11-15 13:39:09 -08:00
Krrish Dholakia
4348fd6435 fix(utils.py): azure streaming initial format 2023-11-15 13:30:08 -08:00
Krrish Dholakia
8c104e9c6a fix(azure.py-+-proxy_server.py): fix function calling response object + support router on proxy 2023-11-15 13:15:16 -08:00
Krrish Dholakia
e07bf0a8de fix(utils.py): await async function in client wrapper 2023-11-14 22:07:28 -08:00
Krrish Dholakia
59eaeba92a fix(router.py): enabling retrying with expo backoff (without tenacity) for router 2023-11-14 20:57:51 -08:00
ishaan-jaff
465f427465 (feat) debug POST logs 2023-11-14 18:16:45 -08:00
ishaan-jaff
c7780cbc40 (fix) debugging with POST request 2023-11-14 18:05:34 -08:00
ishaan-jaff
cb5669f679 (feat) improve logging of raw POST curl command 2023-11-14 17:54:09 -08:00
ishaan-jaff
7c317b78eb (feat) add ability to view POST requests from litellm.completion() 2023-11-14 17:27:20 -08:00
Krrish Dholakia
a7222f257c fix(main.py): keep client consistent across calls + exponential backoff retry on ratelimit errors 2023-11-14 16:26:05 -08:00
Krrish Dholakia
e9e86cac79 fix(palm.py): exception mapping bad requests / filtered responses 2023-11-14 11:53:13 -08:00
Jack Collins
223ec8933d Provide response to ServiceUnavailableError where needed 2023-11-13 21:20:40 -08:00
Krrish Dholakia
dd925d3de3 fix(utils.py): streaming 2023-11-13 18:15:14 -08:00
Krrish Dholakia
afc19caf0f test(utils.py): adding logging for azure streaming 2023-11-13 17:53:15 -08:00
Krrish Dholakia
661b78f4a3 test(utils.py): test logging 2023-11-13 17:41:45 -08:00
Krrish Dholakia
b722594792 test(utils.py): add logging and fix azure streaming 2023-11-13 17:24:13 -08:00
Krrish Dholakia
c489f41964 test(utils.py): additional logging 2023-11-13 17:13:41 -08:00
Krrish Dholakia
681da80e55 test(utils.py): additional logging 2023-11-13 17:06:24 -08:00
Krrish Dholakia
c1a0411186 test(utils.py): additional logging 2023-11-13 16:59:04 -08:00
Krrish Dholakia
05d720075b test(utils.py): adding more logging for streaming test 2023-11-13 16:54:16 -08:00
Krrish Dholakia
38ff412b9a fix(utils.py): fix response object mapping 2023-11-13 15:58:25 -08:00
Krrish Dholakia
9d8f872f38 fix(promptlayer.py): fixing promptlayer logging integration 2023-11-13 15:04:15 -08:00
Krrish Dholakia
f20820fd00 fix(main.py): fix linting errors 2023-11-13 14:52:37 -08:00
Krrish Dholakia
8a3b771e50 fix(tests): fixing response objects for testing 2023-11-13 14:39:30 -08:00
Krrish Dholakia
d4de55b053 fix(together_ai.py): exception mapping for tgai 2023-11-13 13:17:15 -08:00
Krrish Dholakia
aa8ca781ba test(test_completion.py): cleanup tests 2023-11-13 11:23:38 -08:00
ishaan-jaff
4439109658 (fix) text completion response 2023-11-13 10:29:23 -08:00
ishaan-jaff
27cbd7d895 (fix) deepinfra with openai v1.0.0 2023-11-13 09:51:22 -08:00
ishaan-jaff
c91abc8ad1 (fix) token_counter - use openai token counter only for chat completion 2023-11-13 08:00:27 -08:00
Krrish Dholakia
62013520aa fix(utils.py): replacing openai.error import statements 2023-11-11 19:25:21 -08:00
Krrish Dholakia
45b6f8b853 refactor: fixing linting issues 2023-11-11 18:52:28 -08:00
Krrish Dholakia
39c2597c33 refactor(azure.py): working azure completion calls with openai v1 sdk 2023-11-11 16:44:39 -08:00
Krrish Dholakia
d0bd932b3c refactor(openai.py): working openai chat + text completion for openai v1 sdk 2023-11-11 16:25:10 -08:00
Krrish Dholakia
d3323ba637 refactor(openai.py): making it compatible for openai v1
BREAKING CHANGE:
2023-11-11 15:33:02 -08:00
ishaan-jaff
4d67cee135 (fix) completion gpt-4 vision check finish_details or finish_reason 2023-11-11 10:28:20 -08:00
Ishaan Jaff
fd6064b571
Merge pull request #787 from duc-phamh/improve_message_trimming
Improve message trimming
2023-11-11 09:39:43 -08:00
Krrish Dholakia
abee5a0e05 fix(utils.py): caching for embedding 2023-11-10 14:33:17 -08:00
ishaan-jaff
49c8c8a74f (fix) streaming replicate 2023-11-10 12:46:33 -08:00
Krrish Dholakia
62290ec5d9 fix(utils.py): fix exception raised 2023-11-10 11:28:17 -08:00
Krrish Dholakia
18a8bd5543 fix(utils.py): return function call as part of response object 2023-11-10 11:02:10 -08:00
Krrish Dholakia
a4c9e6bd46 fix(utils.py): fix cached responses - translate dict to objects 2023-11-10 10:38:20 -08:00
Krrish Dholakia
3d4c5e10a7 fix(utils.py): fix sync streaming 2023-11-09 18:47:20 -08:00
Krrish Dholakia
249cde3d40 fix(main.py): accepting azure deployment_id 2023-11-09 18:16:02 -08:00
Krrish Dholakia
b19e7dcc5a fix(utils.py): fix logging integrations 2023-11-09 17:09:49 -08:00
Krrish Dholakia
e12bff6d7f refactor(azure.py): enabling async streaming with aiohttp 2023-11-09 16:41:06 -08:00