Temporary Commit at 1/6/2025, 8:13:09 PM

Summary:
### THIS DIFF

### PLAN

### CONTEXT

### DESIGN

Test Plan:
# Test Setup

**Type checker and check that the build compiles**

**Unit Tests**

**E2E Tests**

// Screenshots and videos
| Before | After |
|--|
| … | … |

# Monitoring Plan.
This commit is contained in:
Sixian Yi 2025-01-06 20:13:10 -08:00
parent b719743be9
commit bf610adf9b
25 changed files with 305 additions and 3 deletions

View file

@ -16,8 +16,6 @@ from llama_models.llama3.api.datatypes import (
ToolPromptFormat,
)
from pydantic import BaseModel, ValidationError
from llama_stack.apis.inference import (
ChatCompletionResponse,
ChatCompletionResponseEventType,
@ -33,6 +31,9 @@ from llama_stack.apis.inference import (
UserMessage,
)
from llama_stack.apis.models import Model
from pydantic import BaseModel, ValidationError
from .utils import group_chunks