llama-stack-mirror/llama_stack/providers/remote/inference
Sébastien Han bc64635835
feat: load config class when doing variable substitution
When using bash style substitution env variable in distribution
template, we are processing the string and convert it to the type
associated with the provider's config class. This allows us to return
the proper type. This is crucial for api key since they are not strings
anymore but SecretStr. If the key is unset we will get an empty string
which will result in a Pydantic error like:

```
ERROR    2025-09-25 21:40:44,565 __main__:527 core::server: Error creating app: 1 validation error for AnthropicConfig
         api_key
           Input should be a valid string
             For further information visit
             https://errors.pydantic.dev/2.11/v/string_type
```

Signed-off-by: Sébastien Han <seb@redhat.com>
2025-09-29 09:55:19 +02:00
..
anthropic feat: load config class when doing variable substitution 2025-09-29 09:55:19 +02:00
azure feat: load config class when doing variable substitution 2025-09-29 09:55:19 +02:00
bedrock feat: add static embedding metadata to dynamic model listings for providers using OpenAIMixin (#3547) 2025-09-25 17:17:00 -04:00
cerebras feat: load config class when doing variable substitution 2025-09-29 09:55:19 +02:00
databricks feat: load config class when doing variable substitution 2025-09-29 09:55:19 +02:00
fireworks feat: load config class when doing variable substitution 2025-09-29 09:55:19 +02:00
gemini feat: load config class when doing variable substitution 2025-09-29 09:55:19 +02:00
groq feat: load config class when doing variable substitution 2025-09-29 09:55:19 +02:00
llama_openai_compat feat: load config class when doing variable substitution 2025-09-29 09:55:19 +02:00
nvidia feat: load config class when doing variable substitution 2025-09-29 09:55:19 +02:00
ollama feat(internal): add image_url download feature to OpenAIMixin (#3516) 2025-09-26 17:32:16 -04:00
openai feat: load config class when doing variable substitution 2025-09-29 09:55:19 +02:00
passthrough feat: load config class when doing variable substitution 2025-09-29 09:55:19 +02:00
runpod feat: load config class when doing variable substitution 2025-09-29 09:55:19 +02:00
sambanova feat: load config class when doing variable substitution 2025-09-29 09:55:19 +02:00
tgi feat: load config class when doing variable substitution 2025-09-29 09:55:19 +02:00
together feat: load config class when doing variable substitution 2025-09-29 09:55:19 +02:00
vertexai feat: load config class when doing variable substitution 2025-09-29 09:55:19 +02:00
vllm feat: load config class when doing variable substitution 2025-09-29 09:55:19 +02:00
watsonx feat: load config class when doing variable substitution 2025-09-29 09:55:19 +02:00
__init__.py impls -> inline, adapters -> remote (#381) 2024-11-06 14:54:05 -08:00