Commit graph

1415 commits

Author SHA1 Message Date
Krrish Dholakia
78fb8cf941 fix(router.py): fix linting issues 2023-11-06 18:50:09 -08:00
ishaan-jaff
65917815d5 (fix) ignore rate limit error for gpt4 turbo 2023-11-06 18:34:45 -08:00
Krrish Dholakia
a7a0605b4f fix(router.py): adding health checks 2023-11-06 18:26:41 -08:00
Krrish Dholakia
632533f2e2 bump: version 0.13.6.dev3 → 0.13.6 2023-11-06 18:19:20 -08:00
ishaan-jaff
28b8321c5a (test) run ci/cd again 2023-11-06 18:13:18 -08:00
ishaan-jaff
9ae4b6ae22 (test) run ci/cd again 2023-11-06 18:11:29 -08:00
ishaan-jaff
f8bcf32c4f (feat) parallel HF text completion + completion_with_retries show exception 2023-11-06 17:58:06 -08:00
ishaan-jaff
7de10d184a (test) hf inference api - text_completion 2023-11-06 17:56:41 -08:00
ishaan-jaff
654e31af1c (fix) proxy server - print error msg on exceptions 2023-11-06 17:55:33 -08:00
ishaan-jaff
6c4f8358bd (fix) stability imp: completion() timeout during high traffic, should not raise exception 2023-11-06 17:54:35 -08:00
ishaan-jaff
857e5fe6b8 (fix) proxy server remove bloat 2023-11-06 15:55:18 -08:00
ishaan-jaff
df774cdc29 (fix) linting errors 2023-11-06 14:42:12 -08:00
ishaan-jaff
ae44302c16 (test) hf max tokens, temp 2023-11-06 14:38:21 -08:00
ishaan-jaff
4d8d50d97e (fix) HF round up temperature 0 -> 0.01 2023-11-06 14:35:06 -08:00
ishaan-jaff
b75a113e39 (fix) hf fix this error: Failed: Error occurred: HuggingfaceException - Input validation error: temperature must be strictly positive 2023-11-06 14:22:33 -08:00
ishaan-jaff
e7b6ef8f50 (fix) hf don't fail when logprob is None 2023-11-06 14:22:09 -08:00
ishaan-jaff
825bd6709b (test) add gpt-4-turbo 2023-11-06 13:32:53 -08:00
ishaan-jaff
b4fd02c9e5 (test) text_completion 2023-11-06 13:17:49 -08:00
ishaan-jaff
fdded281a9 (fix) bug fix: completion, text_completion, check if optional params are not None and pass to LLM 2023-11-06 13:17:19 -08:00
ishaan-jaff
70fc10c010 (fix) linting fixes 2023-11-06 13:02:11 -08:00
ishaan-jaff
de66e42fd0 (fix) text_completion naming 2023-11-06 12:47:06 -08:00
Krrish Dholakia
713c659d09 fix(utils.py): remove special characters from streaming output 2023-11-06 12:21:50 -08:00
ishaan-jaff
82e44c7f84 (fix) text completion linting 2023-11-06 11:53:50 -08:00
Krrish Dholakia
9baafd7dbf fix(huggingface_restapi.py): output parsing chat template models 2023-11-06 11:43:12 -08:00
ishaan-jaff
2a15da509f (fix) text_completion fixes 2023-11-06 09:11:10 -08:00
ishaan-jaff
c166b14a3b (test) text completion 2023-11-06 09:10:48 -08:00
ishaan-jaff
b2322b8802 (test) text completion 2023-11-06 08:37:01 -08:00
ishaan-jaff
03738ac0d9 (test) text_completion more testing 2023-11-06 08:36:50 -08:00
ishaan-jaff
a2f8ab7eb1 (feat) text_completion add docstring 2023-11-06 08:36:09 -08:00
ishaan-jaff
441ef48a54 (fix) improve litellm.set_verbose prints 2023-11-06 08:00:03 -08:00
Krrish Dholakia
10987304ba bump: version 0.13.3.dev1 → 0.13.3.dev2 2023-11-06 06:44:15 -08:00
Krrish Dholakia
b8cc981db5 fix(utils.py): better exception raising if logging object is not able to get set 2023-11-06 06:34:27 -08:00
Krrish Dholakia
c4ed875f47 fix(proxy_server.py): fixing import issues 2023-11-05 21:14:59 -08:00
Krrish Dholakia
597dc8f34c bump: version 0.13.1 → 0.13.2.dev1 2023-11-05 21:12:13 -08:00
Krrish Dholakia
078c369e35 bump: version 0.13.1.dev2 → 0.13.1.dev3 2023-11-04 22:31:53 -07:00
Krrish Dholakia
2e9d00994e bump: version 0.13.1.dev1 → 0.13.1.dev2 2023-11-04 22:31:53 -07:00
Krrish Dholakia
3aa538f369 fix(proxy_cli.py): uvicorn issue 2023-11-04 22:31:53 -07:00
Krrish Dholakia
e633566253 feat(utils.py): adding additional states for custom logging 2023-11-04 17:07:20 -07:00
Krrish Dholakia
d53a0d9663 refactor(bedrock.py): better exception mapping for bedrock + huggingface 2023-11-04 16:12:12 -07:00
Krrish Dholakia
b1dcd0f1b9 fix(timeout.py): import errors 2023-11-04 16:05:14 -07:00
Krrish Dholakia
2310e0c6eb test(test_completion.py): num retries 3 2023-11-04 15:55:56 -07:00
Krrish Dholakia
f7c5595a0d fix(main.py): fixing print_verbose 2023-11-04 14:41:34 -07:00
Krrish Dholakia
a83b07b310 test(test_text_completion.py): fixing print verbose 2023-11-04 14:03:09 -07:00
Krrish Dholakia
d59c9d96bb test(test_batch_completions.py): handle timeouts 2023-11-04 13:35:04 -07:00
ishaan-jaff
3477604c90 (fix) linting 2023-11-04 13:28:09 -07:00
ishaan-jaff
6e0e79e3ce (test) anyscale stream 2023-11-04 13:23:19 -07:00
ishaan-jaff
342328d301 (test) anyscale streaming 2023-11-04 13:23:02 -07:00
ishaan-jaff
e53f5316d0 (fix) anyscale streaming detect [DONE] special char 2023-11-04 13:23:02 -07:00
Krrish Dholakia
d0b23a2722 refactor(all-files): removing all print statements; adding pre-commit + flake8 to prevent future regressions 2023-11-04 12:50:15 -07:00
ishaan-jaff
343c6b8b18 (fix) test get_model_cost_map 2023-11-04 09:12:22 -07:00