added more docs

This commit is contained in:
Raghotham Murthy 2024-07-11 03:12:28 -07:00
parent 8631d90f1e
commit 6d6c07b882
3 changed files with 14 additions and 67 deletions

View file

@ -1502,40 +1502,10 @@ components:
pattern: ^(https?://|file://|data:)
type: string
info:
description: "Meta has built out a fairly sophisticated platform internally to post\
\ train, evaluate, and \n serve Llama models to support Metas\
\ products. Given the newer capabilities of the llama models, \n \
\ the model development and model serving capabilities of the platform need\
\ to be enhanced in \n specific ways in order to best leverage\
\ the models. For example, the inference platform needs \n to support\
\ code execution to take advantage of the built-in knowledge of tools of the model.\
\ \n The largest models are of high enough quality to be used to\
\ generate synthetic data or be used \n as reward models. There\
\ are specific fine tuning and quantization techniques that we have found \n \
\ result in the best performing Llama models. We would like to share\
\ ways in which an LLM Ops \n toolchain can be designed by leveraging\
\ our learnings in getting Llama models to power Metas products.\n \
\ <br>\n In addition, the Llama 3 models Meta will release\
\ in July should not just be seen as a model, but \n really as\
\ a system starting the transition towards an entity capable of performing \"\
agentic\" tasks \n which require the ability to act as the central\
\ planner and break a task down and perform multi-step \n reasoning\
\ and call tools for specific operations. In addition, there needs to be general\
\ model-level \n safety checks as well as task-specific safety\
\ checks that are performed at a system level. \n <br>\n \
\ We are defining the Llama Stack as a set of APIs and standards by synthesizing\
\ our learnings while \n working with Llama models. The APIs are\
\ divided into the llama-toolchain-api and the llama-agentic-system-api. \n \
\ These APIs provide a coherent way for model developers to fine\
\ tune and serve Llama models, and agentic app \n developers to\
\ leverage all the capabilities of the Llama models seamlessly. We would like\
\ to work with the \n ecosystem to enhance and simplify the API.\
\ In addition, we will be releasing a plug-in architecture to allow \n \
\ creating distributions of the llama stack with different implementations.\n\
\ <br>\n This is the specification of the llama\
\ stack that provides \n a set of endpoints and their corresponding\
\ interfaces that are tailored to \n best leverage Llama Models.\
\ The specification is still in draft and subject to change."
description: "This is the specification of the llama stack that provides \n \
\ a set of endpoints and their corresponding interfaces that are tailored\
\ to \n best leverage Llama Models. The specification is still\
\ in draft and subject to change."
title: '[DRAFT] Llama Stack Specification'
version: 0.0.1
jsonSchemaDialect: https://json-schema.org/draft/2020-12/schema
@ -2053,12 +2023,12 @@ security:
servers:
- url: http://any-hosted-llama-stack.com
tags:
- name: Datasets
- name: SyntheticDataGeneration
- name: Inference
- name: MemoryBanks
- name: AgenticSystem
- name: Datasets
- name: RewardScoring
- name: AgenticSystem
- name: PostTraining
- description: <SchemaDefinition schemaRef="#/components/schemas/ShieldConfig" />
name: ShieldConfig