Commit graph

13391 commits

Author SHA1 Message Date
Krrish Dholakia
5a1a1908c1 fix replicate error 2023-10-02 21:35:16 -07:00
Krrish Dholakia
345a14483e Fixes to bedrock 2023-10-02 16:09:06 -07:00
Krrish Dholakia
0daf2e3880 fixes to get optional params 2023-10-02 14:44:11 -07:00
Krrish Dholakia
8b60d797e1 fixing optional param mapping 2023-10-02 14:14:30 -07:00
Krrish Dholakia
7cec308a2c fixes to get_optional_params 2023-10-02 12:34:22 -07:00
Krrish Dholakia
8acad78fb3 fix linting issues 2023-10-02 12:12:34 -07:00
Krrish Dholakia
5a19ee1a71 fix get optional params 2023-10-02 12:02:53 -07:00
ishaan-jaff
606b787842 update caching tests 2023-10-02 11:48:35 -07:00
Krrish Dholakia
1cae080eb2 raise exception if optional param is not mapped to model 2023-10-02 11:17:51 -07:00
ishaan-jaff
49f65b7eb8 add litellm hosted cache test 2023-10-02 10:28:19 -07:00
ishaan-jaff
6f6d5fae3a add hosted api.litellm.ai for caching 2023-10-02 10:27:18 -07:00
ishaan-jaff
6313858687 remove import requests from palm.py 2023-10-02 09:07:14 -07:00
ishaan-jaff
a4d135eef9 modify replicate polling interval 2023-10-02 07:43:38 -07:00
Krrish Dholakia
e62b3ebdd1 add testing for function calling 2023-10-02 07:39:01 -07:00
Krrish Dholakia
a7ee0bcc8c raise exception if function call passed to provider that doesn't support it 2023-10-02 07:39:01 -07:00
Ishaan Jaff
a30d5236c9
Merge pull request #500 from linediconsine/remove-.DS_Store-and-updated-.gitignore
remove .DS_Store and update .gitignore
2023-10-02 06:55:01 -07:00
Krish Dholakia
8381bb19a9
Merge pull request #499 from canada4663/bedrock-anthropic-changes
add bedrock.anthropic support for system prompt using <admin> tag
2023-10-02 06:47:33 -07:00
canada4663
2896df2645 added similar changes to anthropic.py based on recommendation from @krrishdholakia 2023-10-01 20:54:36 -07:00
Marco Amato
24cc90594e remove .DS_Store and update .gitignore 2023-10-01 12:15:55 -04:00
canada4663
07ed0abf82 add bedrock.anthropic support for system prompt using <admin> tag 2023-09-30 21:22:46 -07:00
Krrish Dholakia
1c802c26fc updates 2023-09-30 18:26:23 -07:00
Krrish Dholakia
3ca79a88bb improvements to proxy cli and finish reason mapping for anthropic 2023-09-30 18:09:16 -07:00
ishaan-jaff
9b55152d55 use render endpoint for proxy 2023-09-30 17:27:03 -07:00
Krrish Dholakia
5ee4d10656 fix streaming test 2023-09-30 15:59:27 -07:00
ishaan-jaff
84133f8f45 better cli 2023-09-30 15:52:44 -07:00
ishaan-jaff
0c640ab5ef cli deploy 2023-09-30 15:45:00 -07:00
ishaan-jaff
16942458a2 more stuff for cli 2023-09-30 15:45:00 -07:00
ishaan-jaff
b2e3d3bf7d add --test to proxy 2023-09-30 15:45:00 -07:00
Krrish Dholakia
16c755257b add support for custom hf prompt templates 2023-09-30 15:37:30 -07:00
Krrish Dholakia
2af46e8be9 remove budget manager 2023-09-30 11:42:56 -07:00
ishaan-jaff
8d1f5ba69d add fake streaming for petals 2023-09-30 10:22:04 -07:00
Ishaan Jaff
141c9c5bac
Merge pull request #498 from lucashofer/main
added model openrouter/mistralai/mistral-7b-instruct with test
2023-09-30 09:50:25 -07:00
Krrish Dholakia
1d8b56cc74 fix testing 2023-09-30 08:50:51 -07:00
Lucas Hofer
42cc4e2464 added model openrouter/mistralai/mistral-7b-instruct with test 2023-09-30 16:49:18 +01:00
Krrish Dholakia
905a3f08ee fix streaming tests 2023-09-29 22:41:04 -07:00
Ishaan Jaff
202d57f891
Merge pull request #497 from coconut49/main
Update boto3 dependency to version 1.28.57, refactor bedrock client initialization and remove troubleshooting guide from documentation.
2023-09-29 22:31:41 -07:00
ishaan-jaff
7804aa1ddf use deploy flag 2023-09-29 22:03:38 -07:00
Krrish Dholakia
31494796a4 fix linting test 2023-09-29 21:44:46 -07:00
Krrish Dholakia
e8ec3e8795 add mistral prompt templating 2023-09-29 21:41:28 -07:00
coconut49
4f67261c3c
Update boto3 dependency to version 1.28.57, refactor bedrock client initialization and remove troubleshooting guide from documentation. 2023-09-30 12:31:26 +08:00
ishaan-jaff
82c642f78d fix merge conflicts 2023-09-29 21:16:06 -07:00
ishaan-jaff
3f7740ddbc add deploy flag to cli 2023-09-29 21:14:01 -07:00
ishaan-jaff
71dbd9b61f add --deploy 2023-09-29 21:12:03 -07:00
Krrish Dholakia
dc9f02267a update values 2023-09-29 20:53:55 -07:00
Krrish Dholakia
b8c8f01221 update openai proxy docs 2023-09-29 18:31:52 -07:00
ishaan-jaff
19b14182b7 add --deploy 2023-09-29 18:27:47 -07:00
ishaan-jaff
1a8144360e fix logging error 2023-09-29 16:02:19 -07:00
ishaan-jaff
762d590500 fix co embeddings 2023-09-29 16:00:49 -07:00
ishaan-jaff
76956cce52 update claude testing 2023-09-29 15:37:05 -07:00
ishaan-jaff
6a81f860f9 add param mapping to claude bedrock 2023-09-29 15:36:57 -07:00