llama-stack/llama_stack/apis
Dinesh Yeduguru 8af6951106
remove conflicting default for tool prompt format in chat completion (#742)
# What does this PR do?
We are setting a default value of json for tool prompt format, which
conflicts with llama 3.2/3.3 models since they use python list. This PR
changes the defaults to None and in the code, we infer default based on
the model.

Addresses: #695 

Tests:
❯ LLAMA_STACK_BASE_URL=http://localhost:5000 pytest -v
tests/client-sdk/inference/test_inference.py -k
"test_text_chat_completion"

 pytest llama_stack/providers/tests/inference/test_prompt_adapter.py
2025-01-10 10:41:53 -08:00
..
agents agents to use tools api (#673) 2025-01-08 19:01:00 -08:00
batch_inference remove conflicting default for tool prompt format in chat completion (#742) 2025-01-10 10:41:53 -08:00
common [bugfix] fix broken vision inference, change serialization for bytes (#693) 2024-12-30 13:57:41 -08:00
datasetio [remove import *] clean up import *'s (#689) 2024-12-27 15:45:44 -08:00
datasets Update the "InterleavedTextMedia" type (#635) 2024-12-17 11:18:31 -08:00
eval Import from the right path (#708) 2025-01-02 13:15:31 -08:00
eval_tasks Add version to REST API url (#478) 2024-11-18 22:44:14 -08:00
inference remove conflicting default for tool prompt format in chat completion (#742) 2025-01-10 10:41:53 -08:00
inspect add --version to llama stack CLI & /version endpoint (#732) 2025-01-08 16:30:06 -08:00
memory Update the "InterleavedTextMedia" type (#635) 2024-12-17 11:18:31 -08:00
memory_banks [tests] add client-sdk pytests & delete client.py (#638) 2024-12-16 12:04:56 -08:00
models [tests] add client-sdk pytests & delete client.py (#638) 2024-12-16 12:04:56 -08:00
post_training [Post training] make validation steps configurable (#715) 2025-01-03 08:43:24 -08:00
safety Update the "InterleavedTextMedia" type (#635) 2024-12-17 11:18:31 -08:00
scoring [rag evals] refactor & add ability to eval retrieval + generation in agentic eval pipeline (#664) 2025-01-02 11:21:33 -08:00
scoring_functions [/scoring] add ability to define aggregation functions for scoring functions & refactors (#597) 2024-12-11 10:03:42 -08:00
shields [tests] add client-sdk pytests & delete client.py (#638) 2024-12-16 12:04:56 -08:00
synthetic_data_generation [remove import *] clean up import *'s (#689) 2024-12-27 15:45:44 -08:00
telemetry Update Telemetry API so OpenAPI generation can work (#640) 2024-12-16 13:00:14 -08:00
tools remove conflicting default for tool prompt format in chat completion (#742) 2025-01-10 10:41:53 -08:00
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00
resource.py Tools API with brave and MCP providers (#639) 2024-12-19 21:25:17 -08:00
version.py Fix the pyopenapi generator avoid potential circular imports 2024-11-18 23:37:52 -08:00