phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-08-03 17:29:01 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

added quickstart w ollama and toolcalling using together

Browse source
This commit is contained in:
Justin Lee 2024-11-09 10:18:42 -08:00 • committed by Justin Lee
parent 2137b0af40
commit f40b78a941
2 changed files with 476 additions and 472 deletions
Download patch file Download diff file Expand all files Collapse all files

6
zero_to_hero_guide/quickstart.md
View file

@ -38,6 +38,10 @@ If you're looking for more specific topics like tool calling or agent setup, we
``` ```
**Note**: The supported models for llama stack for now is listed in [here](https://github.com/meta-llama/llama-stack/blob/main/llama_stack/providers/remote/inference/ollama/ollama.py#L43) **Note**: The supported models for llama stack for now is listed in [here](https://github.com/meta-llama/llama-stack/blob/main/llama_stack/providers/remote/inference/ollama/ollama.py#L43)
1. **Download Ollama App**:
- Go to [https://ollama.com/download](https://ollama.com/download).
- Download and unzip `Ollama-darwin.zip`.
- Run the `Ollama` application.
--- ---
@ -107,7 +111,7 @@ After setting up the server, open a new terminal window and verify it's working
curl http://localhost:5050/inference/chat_completion \ curl http://localhost:5050/inference/chat_completion \
-H "Content-Type: application/json" \ -H "Content-Type: application/json" \
-d '{ -d '{
"model": "Llama3.2-3B-Instruct", "model": "llama3.2:1b",
"messages": [ "messages": [
{"role": "system", "content": "You are a helpful assistant."}, {"role": "system", "content": "You are a helpful assistant."},
{"role": "user", "content": "Write me a 2-sentence poem about the moon"} {"role": "user", "content": "Write me a 2-sentence poem about the moon"}