phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-08-15 14:08:00 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

fix: huge speed boost (#3132)

Browse source 
# What does this PR do?
make llama stack fast again


## Test Plan
This commit is contained in:
ehhuang 2025-08-13 09:51:35 -07:00 • committed by GitHub
parent 25e0553eed
commit 2f51273215
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 0 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

1
llama_stack/core/server/server.py
View file

@ -181,7 +181,6 @@ async def sse_generator(event_gen_coroutine):
event_gen = await event_gen_coroutine event_gen = await event_gen_coroutine
async for item in event_gen: async for item in event_gen:
yield create_sse_event(item) yield create_sse_event(item)
await asyncio.sleep(0.01)
except asyncio.CancelledError: except asyncio.CancelledError:
logger.info("Generator cancelled") logger.info("Generator cancelled")
if event_gen: if event_gen: