Commit graph

1 commit

Author SHA1 Message Date
Ben Browning
fa9e2dd543 fix: Don't cache clients for passthrough auth providers
Some of our inference providers support passthrough authentication via
`x-llamastack-provider-data` header values. This fixes the providers
that support passthrough auth to not cache their clients to the
backend providers (mostly OpenAI client instances) so that the client
connecting to Llama Stack has to provide those auth values on each and
every request.

Signed-off-by: Ben Browning <bbrownin@redhat.com>
2025-07-11 10:18:35 -04:00