phoenix-oss/llama-stack
1
0
Fork 0
forked from phoenix-oss/llama-stack-mirror
Code Pull requests Releases Packages 2 Activity Actions

RFC-0001-The-Llama-Stack (#8)

Browse source 
* RFC-0001-The-Llama-Stack

* Add OpenAPI generation utility, update SPEC to reflect latest types

* First cut at an observability API

* llama3_1 -> llama3

---------

Co-authored-by: Ashwin Bharambe <ashwin.bharambe@gmail.com>
This commit is contained in:
raghotham 2024-08-20 19:01:18 -07:00 • committed by GitHub
parent 57881c08c1
commit 2232bfa8b5
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
19 changed files with 9177 additions and 10 deletions
Download patch file Download diff file Expand all files Collapse all files

6
llama_toolchain/evaluations/api/endpoints.py
View file

@ -60,19 +60,19 @@ class EvaluationJobArtifactsResponse(BaseModel):
class Evaluations(Protocol):
@webmethod(route="/evaluate/text_generation/")
def post_evaluate_text_generation(
def evaluate_text_generation(
self,
request: EvaluateTextGenerationRequest,
) -> EvaluationJob: ...
@webmethod(route="/evaluate/question_answering/")
def post_evaluate_question_answering(
def evaluate_question_answering(
self,
request: EvaluateQuestionAnsweringRequest,
) -> EvaluationJob: ...
@webmethod(route="/evaluate/summarization/")
def post_evaluate_summarization(
def evaluate_summarization(
self,
request: EvaluateSummarizationRequest,
) -> EvaluationJob: ...