Commit graph

47 commits

Author SHA1 Message Date
Ishaan Jaff
c1981f5534 fix text completion response from codestral 2024-06-17 15:01:26 -07:00
Ishaan Jaff
9641533709 test - codestral streaming 2024-06-17 14:17:25 -07:00
Ishaan Jaff
87386b5cc3 feat - add fim codestral api 2024-06-17 13:46:03 -07:00
Ishaan Jaff
2a5eabcceb feat add text completion config for mistral text 2024-06-17 12:48:46 -07:00
Ishaan Jaff
55bfb181a3 working chat, text for codestral 2024-06-17 11:30:22 -07:00
Krrish Dholakia
b3d53787da test(test_text_completion.py): skip unstable test 2024-06-10 19:45:24 -07:00
Krrish Dholakia
24ffb1e601 fix(main.py): fix together ai text completion call 2024-05-08 09:10:45 -07:00
Krrish Dholakia
7880dcbdf7 fix(openai.py): support passing prompt as list instead of concat string 2024-04-03 15:23:20 -07:00
Krrish Dholakia
f3fcfe3007 fix(proxy_server.py): return original model response via response headers - /v1/completions
to help devs with debugging
2024-04-03 13:05:43 -07:00
Krrish Dholakia
be3146c505 test(test_text_completion.py): unit testing for text completion pydantic object 2024-04-03 12:26:51 -07:00
Krrish Dholakia
ed46af19ec fix(openai.py): return logprobs for text completion calls 2024-04-02 14:05:56 -07:00
Krrish Dholakia
ecc0cf5d9c fix(utils.py): fix text completion streaming 2024-03-25 16:47:17 -07:00
ishaan-jaff
7c6fe0f8d2 (test-fix) hf is unstable 2024-03-04 08:44:39 -08:00
ishaan-jaff
1d581c128d (test) hf currently loading error 2024-01-15 17:07:49 -08:00
ishaan-jaff
56b21a053b (test) fix - skip HF is currently loading exception 2024-01-09 15:53:19 +05:30
Krrish Dholakia
11ff324ff7 test(test_router.py): fix router test 2024-01-09 11:08:35 +05:30
ishaan-jaff
83835f10f6 (fix) test - deprecated textdavinci003 2024-01-09 10:55:35 +05:30
Krrish Dholakia
d89a58ec54 fix(ollama.py): use tiktoken as backup for prompt token counting 2024-01-09 09:47:18 +05:30
Krrish Dholakia
5daa3ce237 fix(main.py): support cost calculation for text completion streaming object 2024-01-08 12:41:43 +05:30
Krrish Dholakia
9cf43cd5dc refactor: move async text completion testing to test_text_completion.py 2023-12-29 11:46:40 +05:30
ishaan-jaff
e212afc46c (ci/cd) set num retries for HF test 2023-12-29 10:52:45 +05:30
ishaan-jaff
3d2049a9f0 (test) gpt-3.5-turbo-instruct finish reason 2023-12-27 15:45:40 +05:30
Krrish Dholakia
79978c44ba refactor: add black formatting 2023-12-25 14:11:20 +05:30
Krrish Dholakia
e03713ef74 fix(main.py): return async completion calls 2023-12-18 17:41:54 -08:00
Krrish Dholakia
bb5b883316 fix(main.py): support async streaming for text completions endpoint 2023-12-14 13:56:32 -08:00
ishaan-jaff
158bf444f4 (test) hf text completion 2023-12-11 10:27:43 -08:00
Krrish Dholakia
34decba3cf fix(text_completion): allow either model or engine to be set 2023-11-17 18:25:21 -08:00
ishaan-jaff
945761c36b (test) hf streaming 2023-11-16 12:24:31 -08:00
ishaan-jaff
bef9ead3a6 (test) regular hf tests 2023-11-16 12:00:49 -08:00
ishaan-jaff
d951f849a7 (test) text_completion 2023-11-16 11:37:46 -08:00
Krrish Dholakia
8ba438b3a2 fix(caching.py): dump model response object as json 2023-11-13 10:41:04 -08:00
ishaan-jaff
fa61276407 (test) add text completion steaming test 2023-11-08 11:59:31 -08:00
ishaan-jaff
739e9c4732 (test) remove dup hf test 2023-11-08 09:54:40 -08:00
ishaan-jaff
c570de72fe bump: version 0.13.7 → 0.13.8 2023-11-08 09:46:57 -08:00
ishaan-jaff
7de10d184a (test) hf inference api - text_completion 2023-11-06 17:56:41 -08:00
ishaan-jaff
df774cdc29 (fix) linting errors 2023-11-06 14:42:12 -08:00
ishaan-jaff
ae44302c16 (test) hf max tokens, temp 2023-11-06 14:38:21 -08:00
ishaan-jaff
b4fd02c9e5 (test) text_completion 2023-11-06 13:17:49 -08:00
ishaan-jaff
70fc10c010 (fix) linting fixes 2023-11-06 13:02:11 -08:00
ishaan-jaff
c166b14a3b (test) text completion 2023-11-06 09:10:48 -08:00
ishaan-jaff
b2322b8802 (test) text completion 2023-11-06 08:37:01 -08:00
ishaan-jaff
03738ac0d9 (test) text_completion more testing 2023-11-06 08:36:50 -08:00
Krrish Dholakia
a83b07b310 test(test_text_completion.py): fixing print verbose 2023-11-04 14:03:09 -07:00
ishaan-jaff
abee1ef0ca (test) text_completion responses 2023-11-03 22:14:36 -07:00
ishaan-jaff
fafdc825ad (test) add text_completion with prompt list 2023-11-03 18:03:19 -07:00
ishaan-jaff
413f9ccba4 (fix) testing text_completion 2023-11-03 16:39:06 -07:00
ishaan-jaff
4f48511148 (test) text_completion requests 2023-11-03 16:36:38 -07:00