Commit graph

1072 commits

Author SHA1 Message Date
Krrish Dholakia
96cdee7d18 refactor(main.py): remove print statement 2023-10-16 07:33:15 -07:00
Krrish Dholakia
38fa9827d5 docs(main.py): adding docstring for text_completion 2023-10-16 07:31:48 -07:00
Zeeland
7b1d55d110 fix: llm_provider add openai finetune compatibility 2023-10-16 18:44:45 +08:00
ishaan-jaff
1e90f4ee9c (fix) deepinfra/llama should go to deepinfra not to openrouter 2023-10-14 16:47:25 -07:00
Krrish Dholakia
5f9dd0b21f bump: version 0.8.4 → 0.8.5 2023-10-14 16:43:06 -07:00
ishaan-jaff
1772478655 (feat) add doc string for embedding 2023-10-14 16:08:13 -07:00
Krrish Dholakia
fa0ff12570 fix(utils.py): read env variables for known openai-compatible api's (e.g. perplexity), dynamically from th eenvironment 2023-10-13 22:43:32 -07:00
Krrish Dholakia
ec5e7aa4a9 fix(openai.p): adding support for exception mapping for openai-compatible apis via http calls 2023-10-13 21:56:51 -07:00
ishaan-jaff
30634492d2 (feat) set api_base, api_key, api_version for embedding() 2023-10-13 21:09:44 -07:00
Krrish Dholakia
74c0d5b7a0 feat(proxy_server): adding model fallbacks and default model to toml 2023-10-13 15:31:17 -07:00
ishaan-jaff
1a7ffbe7b8 (fix) Ollama use new streaming format 2023-10-11 17:00:39 -07:00
ishaan-jaff
64949ff5cf (feat) add CustomStreamWrapper for Ollama - match OpenAI streaming 2023-10-11 17:00:39 -07:00
Krrish Dholakia
87e5f79924 fix(proxy_cli-and-utils.py): fixing how config file is read + infering llm_provider for known openai endpoints 2023-10-10 20:53:02 -07:00
Krrish Dholakia
67b3e792ff fix(openai.py): enable custom proxy to pass in ca_bundle_path 2023-10-10 13:23:27 -07:00
Krrish Dholakia
cc0e4f4f9f fix: fix value error if model returns empty completion 2023-10-10 10:11:40 -07:00
Krrish Dholakia
4b0ba2ba47 fix(main.py): return n>1 response for openai text completion 2023-10-09 20:44:07 -07:00
Krrish Dholakia
6c7fa8a4aa fix(main.py): read openai org from env 2023-10-09 16:49:22 -07:00
ishaan-jaff
344fa14980 (fix) api_base, api_version and api_key 2023-10-09 14:11:05 -07:00
ishaan-jaff
9d6088f65c (fix) acompletion for ollama non streaing 2023-10-09 13:47:08 -07:00
Krrish Dholakia
936548db40 feat(factory.py): option to add function details to prompt, if model doesn't support functions param 2023-10-09 09:53:53 -07:00
ishaan-jaff
7ee9294c07 (feat) add api_key, api_base, api_version to completion 2023-10-09 08:13:12 -07:00
Krrish Dholakia
55bd413585 style(main.py): clean up print statement 2023-10-07 15:43:40 -07:00
Krrish Dholakia
cf7e2595b8 fix(utils): adds complete streaming response to success handler 2023-10-07 15:42:00 -07:00
Krrish Dholakia
c6d36fb59d docs(completion-docs): adds more details on provider-specific params 2023-10-07 13:49:30 -07:00
Krrish Dholakia
37d7837b63 feat(ollama.py): exposing ollama config 2023-10-06 15:52:58 -07:00
ishaan-jaff
f4eb94b7aa test commitizen bump 2023-10-06 15:41:38 -07:00
ishaan-jaff
0dbe507a0e bump: version 0.2.5 → 0.3.0 2023-10-06 15:40:01 -07:00
Krrish Dholakia
5ab3a4b8d7 fix(add-custom-success-callback-for-streaming): add custom success callback for streaming 2023-10-06 15:02:02 -07:00
Krrish Dholakia
366d48929d style(main.py): adding spacing 2023-10-06 06:16:17 -07:00
Krrish Dholakia
6a572cdf1c fix: azure flag check 2023-10-05 22:44:41 -07:00
Krrish Dholakia
2326ad9d38 fix: fixing mypy linting errors and being backwards compatible for azure=true flag 2023-10-05 22:36:32 -07:00
Krrish Dholakia
69cdf5347a style(test_completion.py): fix merge conflict 2023-10-05 22:09:38 -07:00
ishaan-jaff
2e1b02e189 fix(completion()): add request_timeout as a param, fix claude error when request_timeout set 2023-10-05 19:05:28 -07:00
ishaan-jaff
f0d6d713e0 ollama default api_base to http://localhost:11434 2023-10-05 11:04:51 -07:00
Krrish Dholakia
1492916a37 adding custom prompt templates to ollama 2023-10-05 10:48:16 -07:00
ishaan-jaff
1dc264d7e4 add ratelimitmanager 2023-10-04 16:03:58 -07:00
ishaan-jaff
e82ba26651 make RateLimitHandler a class 2023-10-04 16:03:58 -07:00
ishaan-jaff
743c97c8da add batch_completion_rate_limits 2023-10-04 14:46:11 -07:00
Krrish Dholakia
cd23205564 add param mapping to docs 2023-10-03 09:20:58 -07:00
Krrish Dholakia
d49a36004c Fixes to bedrock 2023-10-02 16:09:06 -07:00
Krrish Dholakia
8c48af11c2 fixes to get optional params 2023-10-02 14:44:11 -07:00
Krrish Dholakia
0ae93d1112 fixing optional param mapping 2023-10-02 14:14:30 -07:00
Krrish Dholakia
d735f48917 fixes to get_optional_params 2023-10-02 12:34:22 -07:00
Krrish Dholakia
3880ef7739 fix linting issues 2023-10-02 12:12:34 -07:00
Krrish Dholakia
eb4c7876e2 fix get optional params 2023-10-02 12:02:53 -07:00
Krrish Dholakia
12fa4069f3 raise exception if optional param is not mapped to model 2023-10-02 11:17:51 -07:00
Krrish Dholakia
b2c49e44ef updates 2023-09-30 18:26:23 -07:00
ishaan-jaff
48cad985ad add fake streaming for petals 2023-09-30 10:22:04 -07:00
ishaan-jaff
7c3c91994a fix logging error 2023-09-29 16:02:19 -07:00
ishaan-jaff
0dbb5a10e9 add hf embedding models 2023-09-29 11:57:38 -07:00