mirror of
https://github.com/meta-llama/llama-stack.git
synced 2025-06-28 19:04:19 +00:00
c810a4184d
* move docs -> source * Add files via upload * mv image * Add files via upload * colocate iOS setup doc * delete image * Add files via upload * fix * delete image * Add files via upload * Update developer_cookbook.md * toctree * wip subfolder * docs update * subfolder * updates * name * updates * index * updates * refactor structure * depth * docs * content * docs * getting started * distributions * fireworks * fireworks * update * theme * theme * theme * pdj theme * pytorch theme * css * theme * agents example * format * index * headers * copy button * test tabs * test tabs * fix * tabs * tab * tabs * sphinx_design * quick start commands * size * width * css * css * download models * asthetic fix * tab format * update * css * width * css * docs * tab based * tab * tabs * docs * style * image * css * color * typo * update docs * missing links * list templates * links * links update * troubleshooting * fix * distributions * docs * fix table * kill llamastack-local-gpu/cpu * Update index.md * Update index.md * mv ios_setup.md * Update ios_setup.md * Add remote_or_local.gif * Update ios_setup.md * release notes * typos * Add ios_setup to index * nav bar * hide torctree * ios image * links update * rename * rename * docs * rename * links * distributions * distributions * distributions * distributions * remove release * remote --------- Co-authored-by: dltn <6599399+dltn@users.noreply.github.com> Co-authored-by: Ashwin Bharambe <ashwin.bharambe@gmail.com>
41 lines
1.9 KiB
Markdown
41 lines
1.9 KiB
Markdown
# Llama Stack Developer Cookbook
|
|
|
|
Based on your developer needs, below are references to guides to help you get started.
|
|
|
|
### Hosted Llama Stack Endpoint
|
|
* Developer Need: I want to connect to a Llama Stack endpoint to build my applications.
|
|
* Effort: 1min
|
|
* Guide:
|
|
- Checkout our [DeepLearning course](https://www.deeplearning.ai/short-courses/introducing-multimodal-llama-3-2) on building with Llama Stack apps on pre-hosted Llama Stack endpoint.
|
|
|
|
|
|
### Local meta-reference Llama Stack Server
|
|
* Developer Need: I want to start a local Llama Stack server with my GPU using meta-reference implementations.
|
|
* Effort: 5min
|
|
* Guide:
|
|
- Please see our [meta-reference-gpu](https://llama-stack.readthedocs.io/en/latest/getting_started/distributions/meta-reference-gpu.html) on starting up a meta-reference Llama Stack server.
|
|
|
|
### Llama Stack Server with Remote Providers
|
|
* Developer need: I want a Llama Stack distribution with a remote provider.
|
|
* Effort: 10min
|
|
* Guide
|
|
- Please see our [Distributions Guide](https://llama-stack.readthedocs.io/en/latest/getting_started/distributions/index.html) on starting up distributions with remote providers.
|
|
|
|
|
|
### On-Device (iOS) Llama Stack
|
|
* Developer Need: I want to use Llama Stack on-Device
|
|
* Effort: 1.5hr
|
|
* Guide:
|
|
- Please see our [iOS Llama Stack SDK](./ios_sdk.md) implementations
|
|
|
|
### Assemble your own Llama Stack Distribution
|
|
* Developer Need: I want to assemble my own distribution with API providers to my likings
|
|
* Effort: 30min
|
|
* Guide
|
|
- Please see our [Building Distribution](./building_distro.md) guide for assembling your own Llama Stack distribution with your choice of API providers.
|
|
|
|
### Adding a New API Provider
|
|
* Developer Need: I want to add a new API provider to Llama Stack.
|
|
* Effort: 3hr
|
|
* Guide
|
|
- Please see our [Adding a New API Provider](https://llama-stack.readthedocs.io/en/latest/api_providers/new_api_provider.html) guide for adding a new API provider.
|