Commit graph

2 commits

Author SHA1 Message Date
Ashwin Bharambe
80f836a2ba fix: update telemetry import path after module move
The telemetry module was moved from llama_stack.apis.telemetry to llama_stack.core.telemetry in PR #3919. This updates the import in the provider data routing test to use the new location.
2025-10-28 10:50:22 -07:00
Ashwin Bharambe
d089a6d106 fix(inference): enable routing of models with provider_data alone
Assume a remote inference provider which works only when users provide
their own API keys via provider_data. By definition, we cannot list
models and hence update our routing registry. But because we _require_ a
provider ID in the models now, we can identify which provider to route
to and let that provider decide.

Note that we still try to look up our registry since it may have a
pre-registered alias. Just that we don't outright fail when we are not
able to look it up.

Also, updated inference router so that the responses have the _exact_
model that the request had.

Added an integration test
2025-10-27 18:58:32 -07:00