Commit graph

5 commits

Author SHA1 Message Date
Xi Yan
bce79617bf refactor & cleanup 2024-09-19 22:11:59 -07:00
Xi Yan
5d3c02d0fb clean up router inference 2024-09-19 21:53:27 -07:00
Xi Yan
4b083eec03 work with 2 different models 2024-09-19 21:40:37 -07:00
Xi Yan
7071c46422 instantiate inference models 2024-09-19 21:33:35 -07:00
Xi Yan
d2ec822b12 routers for inference chat_completion with models dependency 2024-09-19 20:59:32 -07:00