Commit graph

2080 commits

Author SHA1 Message Date
Krrish Dholakia
f4e674b41b clean out print statements 2023-09-17 05:52:19 -07:00
Krrish Dholakia
b45bb78bee bump pyproject version 2023-09-16 20:45:16 -07:00
Krrish Dholakia
e7974d95d5 fix streaming formatting for non-openai models 2023-09-16 19:20:07 -07:00
Krrish Dholakia
1ac316cc0a bug fixes 2023-09-16 16:32:12 -07:00
Krrish Dholakia
d80fe482ce except custom openai proxy 2023-09-16 16:15:44 -07:00
Krrish Dholakia
925ec2ded9 fixes to testing 2023-09-16 11:40:01 -07:00
ishaan-jaff
296961a19b fix print stement in sent_first_chunk 2023-09-16 11:20:32 -07:00
Krrish Dholakia
1e2d6846ac improvements to streaming 2023-09-16 11:02:06 -07:00
Krrish Dholakia
0a1f3af840 ensure streaming format is exactly the same as openai 2023-09-16 10:35:20 -07:00
ishaan-jaff
9ee3faed5b streaming for amazon titan bedrock 2023-09-16 09:57:16 -07:00
ishaan-jaff
1dc6be8895 new bedroc ai21 test 2023-09-16 09:27:34 -07:00
ishaan-jaff
8a1a090fba support optional params for bedrock amazon 2023-09-16 09:19:07 -07:00
ishaan-jaff
9638cfff3a streaming fixes 2023-09-15 17:49:27 -07:00
Krrish Dholakia
0e6ace7875 fixes to streaming 2023-09-15 17:23:10 -07:00
Krrish Dholakia
ec559e854d streaming fixes 2023-09-15 15:49:20 -07:00
Krrish Dholakia
8892b50e2a update streaming 2023-09-15 15:25:14 -07:00
Krrish Dholakia
205cac5f26 fix merge conflict 2023-09-15 15:22:30 -07:00
Krrish Dholakia
e7b31bb7fc fix streaming error 2023-09-15 15:21:15 -07:00
ishaan-jaff
0e6460e4f0 undo change to always setting role to assistant 2023-09-15 15:16:58 -07:00
Krrish Dholakia
4278f81a62 fix streaming error 2023-09-15 14:50:14 -07:00
ishaan-jaff
a68e31a967 bump version 2023-09-15 14:49:03 -07:00
ishaan-jaff
75de6a3516 bump version 2023-09-15 14:15:09 -07:00
Krrish Dholakia
97d9bf17c0 bump version 2023-09-15 12:24:09 -07:00
ishaan-jaff
d7972c7ed6 update utils 2023-09-15 08:34:36 -07:00
ishaan-jaff
04fc1007c8 add top_k + stop to litellm utils 2023-09-15 08:34:36 -07:00
Krrish Dholakia
d87988d42f bump version 2023-09-14 20:01:53 -07:00
Krrish Dholakia
47253018bb fixes to streaming 2023-09-14 19:27:12 -07:00
Krrish Dholakia
90af4e2808 fix linting errors 2023-09-14 17:24:43 -07:00
Krrish Dholakia
8b5a90aac7 fix streaming objects 2023-09-14 17:16:43 -07:00
Krrish Dholakia
b65a1d4c9c bug fixes 2023-09-14 16:32:06 -07:00
Krrish Dholakia
d9eb7a248f make max budget work for openai streaming 2023-09-14 16:22:52 -07:00
Krrish Dholakia
e3293ee264 exposing a litellm.max budget 2023-09-14 14:20:06 -07:00
Krrish Dholakia
22fb574009 move cohere to http endpoint 2023-09-14 11:17:38 -07:00
Krrish Dholakia
52a02c719a fixes to mock completion 2023-09-14 10:03:57 -07:00
Krrish Dholakia
bd01f70257 adding support for nlp cloud 2023-09-14 09:19:34 -07:00
Krrish Dholakia
3496bebdc5 map finish reason 2023-09-13 19:22:38 -07:00
Krrish Dholakia
f493779a97 huggingface conversational task support 2023-09-13 13:45:23 -07:00
Krrish Dholakia
6cd950a031 return model name as part of streaming object 2023-09-13 09:48:49 -07:00
Krrish Dholakia
f015cd908a doc cleanup for custom prompt templates 2023-09-12 12:16:47 -07:00
ishaan-jaff
e6595d7e6f update check_valid_key 2023-09-12 11:50:30 -07:00
Krrish Dholakia
abc595998d fix get llm provider 2023-09-12 11:48:44 -07:00
Ishaan Jaff
5cec386ae2 Merge branch 'main' into main 2023-09-12 11:43:03 -07:00
Krrish Dholakia
01564578ce fix linting error 2023-09-12 11:38:00 -07:00
ishaan-jaff
6dfe6bca2e fix linting error 2023-09-12 11:36:20 -07:00
ishaan-jaff
385a5a0d2b add valid models in utils.py 2023-09-12 11:29:18 -07:00
Krrish Dholakia
3f6b194b71 raise better exception if llm provider isn't passed in or inferred 2023-09-12 11:28:50 -07:00
William Espegren
e6cd8963e8 renamed and added test_good_key() 2023-09-12 19:02:55 +02:00
William Espegren
09022ad61d util: verify_access_key
Verify that the user provided a valid openai token by creating a request to the openAI endpoint.
2023-09-12 18:48:23 +02:00
ishaan-jaff
9f1a8844cd rename safe_messages to trim_messages 2023-09-11 18:54:18 -07:00
Krrish Dholakia
355c2ed00c improvements to exception mapping 2023-09-11 18:33:57 -07:00