Commit graph

1481 commits

Author SHA1 Message Date
Krrish Dholakia
633e36de42 handle llama 2 eos tokens in streaming 2023-09-18 13:44:19 -07:00
Krrish Dholakia
d81c75a0b3 bump version 2023-09-18 13:12:38 -07:00
Krrish Dholakia
f134de1287 bug fix for litellm proxy implementation 2023-09-18 12:54:56 -07:00
Krrish Dholakia
8c809db567 bump version 2023-09-18 12:27:18 -07:00
ishaan-jaff
5cc5429652 add 3.5-instruct pricing 2023-09-18 12:26:59 -07:00
ishaan-jaff
9c154dc718 add instruct pricing 2023-09-18 12:20:52 -07:00
ishaan-jaff
451ce6eeb3 make test more verbose 2023-09-18 12:20:52 -07:00
Krrish Dholakia
9067ec3b43 add support for litellm proxy calls 2023-09-18 12:15:21 -07:00
ishaan-jaff
0f88b82c4f add gpt-3.5-instruct 2023-09-18 12:14:52 -07:00
ishaan-jaff
205bc9bab6 docs 2023-09-18 12:14:52 -07:00
Krrish Dholakia
5b294c704e fix hf conversational task bug 2023-09-18 11:46:36 -07:00
ishaan-jaff
154aa83b5b bump v 2023-09-18 10:59:35 -07:00
ishaan-jaff
6b548eeb28 fix linting errors 2023-09-18 10:57:55 -07:00
ishaan-jaff
e057e3cedd docs 2023-09-18 10:52:03 -07:00
ishaan-jaff
0bee6e0d38 cleanup 2023-09-18 10:43:44 -07:00
ishaan-jaff
071e77ccad hf non conv + tgi llms 2023-09-18 10:43:40 -07:00
ishaan-jaff
e7f4e8b4a4 allow non tgi llms 2023-09-18 10:26:57 -07:00
Krish Dholakia
e83d89d12f
Merge pull request #387 from WilliamEspegren/main
Rebuild stream chunks to openAI object
2023-09-18 09:30:42 -07:00
Krrish Dholakia
78da8e7e65 update readme with contributing.md information 2023-09-18 09:30:30 -07:00
ishaan-jaff
a5425df91f doc string for completion 2023-09-18 09:03:26 -07:00
ishaan-jaff
d684f75683 add doc string for a completion 2023-09-18 08:49:27 -07:00
ishaan-jaff
4a17a6c2b3 add doc string for completion_cost 2023-09-18 08:44:40 -07:00
WilliamEspegren
518deae394
resolve merge conflicts 2023-09-18 09:15:03 +02:00
Krish Dholakia
16f0af214c
Merge pull request #390 from promptmetheus/main
Add PROMPTMETHEUS to projects using LiteLLM
2023-09-17 21:37:57 -07:00
Toni Engelhardt
637c371fb5
bump version 2023-09-17 18:45:32 +01:00
Toni Engelhardt
596ba6df7e
Add PROMPTMETHEUS to projects 2023-09-17 18:44:20 +01:00
WilliamEspegren
63a8614a14
Added function_call support to stream_chunk_builder 2023-09-17 19:42:55 +02:00
WilliamEspegren
404af1be0f
if "function_call" find name 2023-09-17 19:02:50 +02:00
Krish Dholakia
0bdfd5b366
Merge pull request #388 from Phodaie/main
Fix typo in prompt factory templates
2023-09-17 08:49:54 -07:00
Phodaie
35b5d773c8 code typo in falcon related prompt factory 2023-09-17 15:40:36 +00:00
Krrish Dholakia
abe3286ec6 bump version 2023-09-17 08:07:19 -07:00
Krrish Dholakia
8fb856047e update proxy docs 2023-09-17 06:01:00 -07:00
Krrish Dholakia
4daaa1cf91 clean out print statements 2023-09-17 05:52:19 -07:00
WilliamEspegren
d2bdfecd96
remove unused parameter 2023-09-17 13:12:49 +02:00
WilliamEspegren
5544a9251f
rebuild chunks to openAI response
Rebuild the cunks, but does not include the "usage"
2023-09-17 13:07:54 +02:00
WilliamEspegren
e07b3f5bfe
append chunk to chunks 2023-09-17 10:29:09 +02:00
WilliamEspegren
fe37f97423
add empty chunks list 2023-09-17 10:28:37 +02:00
WilliamEspegren
a39a204457
import stream_chunk_builder 2023-09-17 10:28:01 +02:00
WilliamEspegren
71afdbc0e5
add max_tokens 2023-09-17 10:27:32 +02:00
WilliamEspegren
43a18b9528
add stream_chunk_builder function 2023-09-17 10:26:34 +02:00
WilliamEspegren
14fd6770be
Merge branch 'main' of https://github.com/WilliamEspegren/litellm 2023-09-17 09:29:10 +02:00
Krrish Dholakia
c829798e04 bump version and clean print statements 2023-09-16 20:59:24 -07:00
Krrish Dholakia
66a3c59ebe bump pyproject version 2023-09-16 20:45:16 -07:00
Krrish Dholakia
e4fbc8d908 fix cohere streaming 2023-09-16 19:36:41 -07:00
Krrish Dholakia
e44c218c1b fix streaming formatting for non-openai models 2023-09-16 19:20:07 -07:00
Krrish Dholakia
a63784d5b3 add proxy as submodule 2023-09-16 16:37:27 -07:00
Krrish Dholakia
d2f8a7b2ae bug fixes 2023-09-16 16:32:12 -07:00
Krrish Dholakia
122c993e6f except custom openai proxy 2023-09-16 16:15:44 -07:00
Krrish Dholakia
15bc5f2bdc check function call + streaming format 2023-09-16 13:31:18 -07:00
Krrish Dholakia
61874f77ab remove flaky circle ci tests 2023-09-16 13:04:59 -07:00