llama-stack-mirror/llama_stack
Matthew Farrellee e21c8b6d80
add image support to NVIDIA inference provider (#907)
# What does this PR do?

add support to the NVIDIA Inference provider for image inputs


## Test Plan

1. Run local [Llama 3.2 11b vision
instruct](https://build.nvidia.com/meta/llama-3.2-11b-vision-instruct?snippet_tab=Docker)
NIM
2. Start a stack, e.g. `llama stack run
llama_stack/templates/nvidia/run.yaml --env
NVIDIA_BASE_URL=http://localhost:8000`
3. Run image tests, e.g. `LLAMA_STACK_BASE_URL=http://localhost:8321
pytest -v tests/client-sdk/inference/test_inference.py
--vision-inference-model meta-llama/Llama-3.2-11B-Vision-Instruct -k
image`


## Before submitting

- [ ] This PR fixes a typo or improves the docs (you can dismiss the
other checks if that's the case).
- [x] Ran pre-commit to handle lint / formatting issues.
- [x] Read the [contributor
guideline](https://github.com/meta-llama/llama-stack/blob/main/CONTRIBUTING.md),
      Pull Request section?
- [ ] Updated relevant documentation.
- [x] Wrote necessary unit or integration tests.
2025-02-01 09:02:27 -08:00
..
apis fix ImageContentItem to take base64 string as image.data (#909) 2025-01-30 15:58:23 -08:00
cli Use uv pip install instead of pip install (#921) 2025-01-31 22:29:41 -08:00
distribution Use uv pip install instead of pip install (#921) 2025-01-31 22:29:41 -08:00
providers add image support to NVIDIA inference provider (#907) 2025-02-01 09:02:27 -08:00
scripts Use uv pip install instead of pip install (#921) 2025-01-31 22:29:41 -08:00
templates Use uv pip install instead of pip install (#921) 2025-01-31 22:29:41 -08:00
__init__.py export LibraryClient 2024-12-13 12:08:00 -08:00