phoenix-oss/llama-stack-mirror
0
0
Fork 1
mirror of https://github.com/meta-llama/llama-stack.git synced 2025-07-21 20:18:52 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

chore: remove vision model URL workarounds and simplify client creation (#2775)

Browse source 
The vision models are now available at the standard URL, so the
workaround code has been removed. This also simplifies the codebase by
eliminating the need for per-model client caching.

- Remove special URL handling for meta/llama-3.2-11b/90b-vision-instruct
models
- Convert _get_client method to _client property for cleaner API
- Remove unnecessary lru_cache decorator and functools import
- Simplify client creation logic to use single base URL for all models
This commit is contained in:
Matthew Farrellee 2025-07-16 10:10:04 -04:00 • committed by GitHub
parent fa1bb9ae00
commit a3e249807b
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 15 additions and 35 deletions
Download patch file Download diff file Expand all files Collapse all files

3
tests/unit/providers/nvidia/test_supervised_fine_tuning.py
View file

@ -54,7 +54,8 @@ class TestNvidiaPostTraining(unittest.TestCase):
self.mock_client.chat.completions.create = unittest.mock.AsyncMock()
self.inference_mock_make_request = self.mock_client.chat.completions.create
self.inference_make_request_patcher = patch(
"llama_stack.providers.remote.inference.nvidia.nvidia.NVIDIAInferenceAdapter._get_client",
"llama_stack.providers.remote.inference.nvidia.nvidia.NVIDIAInferenceAdapter._client",
new_callable=unittest.mock.PropertyMock,
return_value=self.mock_client,
)
self.inference_make_request_patcher.start()