Commit graph

481 commits

Author SHA1 Message Date
ishaan-jaff
9223f7cc7a (feat) textcompletion - transform hf log probs to openai text completion 2023-10-31 17:15:35 -07:00
Krish Dholakia
523c08a646
Merge pull request #717 from canada4663/main
support for custom bedrock runtime endpoint
2023-10-31 16:47:33 -07:00
Krrish Dholakia
0ed3917b09 feat(main.py): add support for maritalk api 2023-10-30 17:36:51 -07:00
canada4663
bfa297e82f add ability to use custom AWS Bedrock Runtime endpoint via environment or .env variable AWS_BEDROCK_RUNTIME_ENDPOINT or as a parameter to init_bedrock_client 2023-10-28 22:25:45 -07:00
canada4663
1add0d604e add in ability to read AWS boto3 default AWS Region name if litellm .env config AWS_REGION_NAME not available 2023-10-28 21:43:48 -07:00
ishaan-jaff
6515eef382 (fix) bedrock region name defaults to None 2023-10-27 10:17:45 -07:00
ishaan-jaff
63928fa166 (feat) use usage class for model responses for cohere, hf, tg ai, cohere 2023-10-27 09:58:47 -07:00
ishaan-jaff
194f85e92f (feat) add model_response.usage.completion_tokens for bedrock, palm, petals, sagemaker 2023-10-27 09:51:50 -07:00
ishaan-jaff
3691dc9b08 (feat) use usage class for vertex ai 2023-10-27 09:38:37 -07:00
ishaan-jaff
0a2de59932 (feat) use usage class for anthropic 2023-10-27 09:32:25 -07:00
Krrish Dholakia
f12dc5df21 fix(vertex_ai.py): fix output parsing 2023-10-24 12:08:22 -07:00
Krrish Dholakia
b0842e328c fix(vertex_ai.py): parse out text response from response object 2023-10-24 08:53:22 -07:00
Krrish Dholakia
4b48af7c3c fix(anthropic.py-+-bedrock.py): anthropic prompt format 2023-10-20 10:56:15 -07:00
Krrish Dholakia
00993f3575 fix: allow api base to be set for all providers
enables proxy use cases
2023-10-19 19:07:42 -07:00
Krrish Dholakia
76bf8c4be3 fix(anthropic.py): enable api base to be customized 2023-10-19 18:45:29 -07:00
Krrish Dholakia
dcb866b353 docs(proxy_server.md): update proxy server docs to include multi-agent autogen tutorial 2023-10-17 09:22:34 -07:00
Krrish Dholakia
7572086231 style: fix linting errors 2023-10-16 17:35:08 -07:00
Krrish Dholakia
7358d2e4ea bump: version 0.8.4 → 0.8.5 2023-10-14 16:43:06 -07:00
Krrish Dholakia
d77eee34f0 fix(openai.py): fix linting errors 2023-10-13 22:24:58 -07:00
Krrish Dholakia
91c8e92e71 fix(openai.p): adding support for exception mapping for openai-compatible apis via http calls 2023-10-13 21:56:51 -07:00
ishaan-jaff
5a0284dd58 (fix) fix linting errors 2023-10-13 21:23:00 -07:00
Krrish Dholakia
b28c055896 feat(proxy_server): adds create-proxy feature 2023-10-12 18:27:07 -07:00
ishaan-jaff
7b3ee8d129 (feat) ollama raise Exceptions + use LiteLLM stream wrapper 2023-10-11 17:00:39 -07:00
Krrish Dholakia
dfd91c5d46 fix(openai-py): fix linting errors 2023-10-10 21:56:14 -07:00
Krrish Dholakia
68461f5863 fix(openai-py): fix linting issues 2023-10-10 21:49:14 -07:00
Krrish Dholakia
208a6d365b fix(openai.py): fix linting errors 2023-10-10 21:04:13 -07:00
Krrish Dholakia
0e7b83785b fix(init.py): expose complete client session 2023-10-10 15:16:10 -07:00
Krrish Dholakia
b50013386f fix(openai.py): enable custom proxy to pass in ca_bundle_path 2023-10-10 13:23:27 -07:00
Krrish Dholakia
af2fd0e0de fix: fix value error if model returns empty completion 2023-10-10 10:11:40 -07:00
Krrish Dholakia
29b2fa7f75 fix(test-fixes): test fixes 2023-10-10 08:09:42 -07:00
Krrish Dholakia
253e8d27db fix: bug fix when n>1 passed in 2023-10-09 16:46:33 -07:00
Krrish Dholakia
a6968d06e6 fix(anthropic.py): fix anthropic prompt 2023-10-09 15:22:58 -07:00
Krrish Dholakia
704be9dcd1 feat(factory.py): option to add function details to prompt, if model doesn't support functions param 2023-10-09 09:53:53 -07:00
Zeeshan Hooda
112df4a19d
(test) add bedrock existing client auth test 2023-10-09 03:39:40 -06:00
Zeeshan Hooda
f735ca7e46
(docs) bedrock pass existing client to completion 2023-10-09 01:14:53 -06:00
Zeeshan Hooda
5f55b4a1ab
(feat) bedrock pass client to completion 2023-10-09 00:51:58 -06:00
Krrish Dholakia
58da58d5e1 style(openai.py): using typing for params 2023-10-07 15:51:16 -07:00
ishaan-jaff
acef90b923 (feat) sagemaker auth in completion 2023-10-07 15:27:58 -07:00
ishaan-jaff
48f5662b80 (feat) bedrock auth in completion 2023-10-07 15:27:58 -07:00
Krrish Dholakia
d69038883c docs(completion-docs): adds more details on provider-specific params 2023-10-07 13:49:30 -07:00
Krrish Dholakia
306a38880d feat(ollama.py): exposing ollama config 2023-10-06 15:52:58 -07:00
Krrish Dholakia
7e34736a38 fix(add-custom-success-callback-for-streaming): add custom success callback for streaming 2023-10-06 15:02:02 -07:00
Krrish Dholakia
06f279807b fix(bedrock.py): adding provider-specific configs 2023-10-05 23:49:20 -07:00
Krrish Dholakia
060a2e40b2 fix: fixing mypy linting errors and being backwards compatible for azure=true flag 2023-10-05 22:36:32 -07:00
Krrish Dholakia
dd7e397650 style(test_completion.py): fix merge conflict 2023-10-05 22:09:38 -07:00
Krrish Dholakia
512769e841 support n param for hf 2023-10-03 07:10:13 -07:00
Krrish Dholakia
5a1a1908c1 fix replicate error 2023-10-02 21:35:16 -07:00
Krrish Dholakia
345a14483e Fixes to bedrock 2023-10-02 16:09:06 -07:00
Krrish Dholakia
0daf2e3880 fixes to get optional params 2023-10-02 14:44:11 -07:00
Krrish Dholakia
5a19ee1a71 fix get optional params 2023-10-02 12:02:53 -07:00