phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-12-08 19:10:56 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
llama-stack-mirror/llama_stack/providers/adapters/inference
History
Ashwin Bharambe 0c9eb3341c Separate chat_completion stream and non-stream implementations 
This is a pretty important requirement. The streaming response type is
an AsyncGenerator while the non-stream one is a single object. So far
this has worked _sometimes_ due to various pre-existing hacks (and in
some cases, just failed.)
2024-10-08 17:23:40 -07:00
..
bedrock inference registry updates 2024-10-08 17:23:02 -07:00
databricks Introduce model_store, shield_store, memory_bank_store 2024-10-08 17:23:02 -07:00
fireworks Fix fireworks and update the test 2024-10-08 17:23:02 -07:00
ollama Separate chat_completion stream and non-stream implementations 2024-10-08 17:23:40 -07:00
sample Introduce model_store, shield_store, memory_bank_store 2024-10-08 17:23:02 -07:00
tgi Add inference test 2024-10-08 17:23:02 -07:00
together Fix fireworks and update the test 2024-10-08 17:23:02 -07:00
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00