Commit graph

439 commits

Author SHA1 Message Date
Krrish Dholakia
17b319cc84 test(test_completion.py): assert completion cost > 0.0 2023-12-11 07:59:06 -08:00
Krrish Dholakia
d4b4030f96 test: trigger ci/cd build 2023-12-09 11:03:19 -08:00
ishaan-jaff
d8e60d7290 (ci/cd) run again 2023-12-08 19:26:55 -08:00
ishaan-jaff
acc5a8bcfc (test) init success_callback = [] for ci/cd 2023-12-08 19:16:12 -08:00
ishaan-jaff
25edcf6868 (ci/cd) run another test 2023-12-08 19:04:45 -08:00
ishaan-jaff
d7c142070f (ci/cd) run again 2023-12-08 18:11:01 -08:00
ishaan-jaff
e7bf4ff1d4 (ci/cd) run tests 2023-12-08 17:50:14 -08:00
ishaan-jaff
0f231a1d6d (test) add vertex ai to ci/cd 2023-12-07 10:20:21 -08:00
Krrish Dholakia
7187aee359 fix(together_ai.py): improve together ai custom prompt templating 2023-12-06 19:34:49 -08:00
Krrish Dholakia
dc7aba8c01 fix(factory.py): fix claude 2.1 prompt template to handle system, assistant, user prompt 2023-12-06 18:02:06 -08:00
Krrish Dholakia
5515783be3 test: skip flaky test 2023-12-06 16:50:02 -08:00
Krrish Dholakia
2e5dc00968 fix(sagemaker.py): prompt templating fixes 2023-12-05 17:47:44 -08:00
Krrish Dholakia
c01b15af17 docs(input.md): add hf_model_name to docs 2023-12-05 16:56:18 -08:00
Krrish Dholakia
f9b74e54a3 fix(sagemaker.py): enable passing hf model name for prompt template 2023-12-05 16:31:59 -08:00
Krrish Dholakia
7e42c64cc5 fix(utils.py): support sagemaker llama2 custom endpoints 2023-12-05 16:05:15 -08:00
ishaan-jaff
0cdef526b4 (test) add streaming sagemaker test 2023-12-04 15:20:06 -08:00
ishaan-jaff
92417c7ba4 (test) palm/stream 2023-12-04 15:07:07 -08:00
ishaan-jaff
fe985932be (test) test completion: if 'user' passed to API 2023-12-04 09:50:36 -08:00
Krrish Dholakia
6fd50177e8 test(test_completion.py): commenting out flaky test 2023-12-01 15:06:54 -08:00
Krrish Dholakia
49684e9eb4 fix(azure.py): fix linting errors 2023-11-30 13:32:29 -08:00
Krrish Dholakia
526cc3a9c4 feat(main.py): add support for azure-openai via cloudflare ai gateway 2023-11-30 13:19:49 -08:00
Krrish Dholakia
a05722571b fix(replicate.py): fix custom prompt formatting 2023-11-29 19:44:09 -08:00
ishaan-jaff
b733cee3f9 (feat+test) use passed OpenAI client 2023-11-28 16:09:10 -08:00
ishaan-jaff
544beba4e1 (test) pass client to Azure completion 2023-11-28 15:57:11 -08:00
ishaan-jaff
a0a6d5ceeb (test) using client: compleition 2023-11-28 15:44:56 -08:00
ishaan-jaff
c34ff565cd (ci/cd) run again 2023-11-27 11:12:11 -08:00
ishaan-jaff
73a135b0db (test) competion 2023-11-27 10:13:46 -08:00
ishaan-jaff
0fdcbad2ca (feat) completion:debugging - show raw POST request 2023-11-27 10:13:37 -08:00
ishaan-jaff
849536414b (test) sagemaker add chat models 2023-11-27 10:11:56 -08:00
Krrish Dholakia
b1b2d0c2b7 fix(utils.py): fix bedrock + cohere calls 2023-11-25 14:45:42 -08:00
ishaan-jaff
9ef40a626e (test) metadata test in litellm.completion 2023-11-25 11:10:06 -08:00
Krrish Dholakia
ff6975a98d fix(main.py): logit bias mapping for batch_completions 2023-11-24 16:05:51 -08:00
ishaan-jaff
6d25be9182 (test) completion with many params 2023-11-24 14:01:21 -08:00
Krrish Dholakia
90385ef6a5 fix(utils.py): remove eos token for zephyr models 2023-11-23 17:47:39 -08:00
ishaan-jaff
2a1baad3cf (test) cleanup 2023-11-23 17:09:36 -08:00
Krrish Dholakia
328cf356ad test(test_completion.py): fix azure read from env variable test 2023-11-23 16:58:07 -08:00
ishaan-jaff
ebcfbe712a (test) azure test passing key as completion param 2023-11-23 16:51:52 -08:00
ishaan-jaff
3b9359ea7c (test) cost calc on azure 2023-11-23 13:50:09 -08:00
Krrish Dholakia
e4f40f4535 fix(utils.py): support reading api keys dynamically from the os environment 2023-11-23 13:41:56 -08:00
ishaan-jaff
771ce632f7 (chore) run ci/cd again 2023-11-22 20:34:14 -08:00
Krrish Dholakia
57e894ad5e fix(proxy_server.py): If master key is set, only master key can be used to generate new keys 2023-11-22 10:18:28 -08:00
Krrish Dholakia
9bb2c7ee0f fix(utils.py): add param mapping for perplexity, anyscale, deepinfra
n

n
2023-11-22 10:04:27 -08:00
ishaan-jaff
3e57b14cc6 (test) timeout error 2023-11-21 13:37:12 -08:00
Krrish Dholakia
f763666cf1 test(test_completion.py): fix replicate streaming test 2023-11-21 10:38:05 -08:00
Krrish Dholakia
a1c342c3ad feat(factory.py): add support for anthropic system prompts for claude 2.1 2023-11-21 09:57:26 -08:00
Krrish Dholakia
c48e775908 fix(huggingface_restapi.py): fix huggingface response format 2023-11-21 09:57:26 -08:00
ishaan-jaff
a7596ae30b (test) add claude-2.1 2023-11-21 09:53:47 -08:00
Krrish Dholakia
c0e3b2ece9 fix(utils.py): fix pre call rules 2023-11-21 07:10:04 -08:00
Krrish Dholakia
29906f6320 test(test_completion.py): change tgai model 2023-11-17 16:06:42 -08:00
ishaan-jaff
b3e36d0486 (test) test seed, response format, for gpt-3.5-turbo 2023-11-17 14:00:42 -08:00