llama-stack/llama_stack/providers/remote/inference/nvidia
Matthew Farrellee 1a5c17a92f
align with CompletionResponseStreamChunk.delta as str (instead of TextDelta) (#900)
# What does this PR do?

fix type mismatch in /v1/inference/completion

## Test Plan

`llama stack run ./llama_stack/templates/nvidia/run.yaml`

`LLAMA_STACK_BASE_URL="http://localhost:8321" pytest -v
tests/client-sdk/inference/test_inference.py`

## Before submitting

- [ ] This PR fixes a typo or improves the docs (you can dismiss the
other checks if that's the case).
- [x] Ran pre-commit to handle lint / formatting issues.
- [x] Read the [contributor
guideline](https://github.com/meta-llama/llama-stack/blob/main/CONTRIBUTING.md),
      Pull Request section?
- [ ] Updated relevant documentation.
- [ ] Wrote necessary unit or integration tests.
2025-01-29 09:25:50 -08:00
..
__init__.py add NVIDIA NIM inference adapter (#355) 2024-11-23 15:59:00 -08:00
config.py add nvidia distribution (#565) 2025-01-15 14:04:43 -08:00
nvidia.py remove conflicting default for tool prompt format in chat completion (#742) 2025-01-10 10:41:53 -08:00
openai_utils.py align with CompletionResponseStreamChunk.delta as str (instead of TextDelta) (#900) 2025-01-29 09:25:50 -08:00
utils.py add NVIDIA NIM inference adapter (#355) 2024-11-23 15:59:00 -08:00