llama-stack-mirror/llama_stack/providers/utils
Ben Browning 8bf1d91d38 feat: Add synthetic-data-kit for file_search doc conversion
This adds a `builtin::document_conversion` tool for converting
documents when used with file_search that uses
meta-llama/synthetic-data-kit. I also have another local
implementation that uses Docling, but need to debug some segfault
issues I'm hitting locally with that so pushing this first as a
simpler reference implementation.

Long-term I think we'll want a remote implemention here as well - like
perhaps docling-serve or unstructured.io - but need to look more into
that.

This passes the existing
`tests/verifications/openai_api/test_responses.py` but doesn't yet add
any new tests for file types besides text and pdf.

Signed-off-by: Ben Browning <bbrownin@redhat.com>
2025-06-27 13:31:38 -04:00
..
bedrock feat: drop python 3.10 support (#2469) 2025-06-19 12:07:14 +05:30
common chore: enable pyupgrade fixes (#1806) 2025-05-01 14:23:50 -07:00
datasetio chore(refact): move paginate_records fn outside of datasetio (#2137) 2025-05-12 10:56:14 -07:00
inference chore: remove nested imports (#2515) 2025-06-26 08:01:05 +05:30
kvstore refactor(env)!: enhanced environment variable substitution (#2490) 2025-06-26 08:20:08 +05:30
memory feat: Add synthetic-data-kit for file_search doc conversion 2025-06-27 13:31:38 -04:00
responses feat: support auth attributes in inference/responses stores (#2389) 2025-06-20 10:24:45 -07:00
scoring chore: enable pyupgrade fixes (#1806) 2025-05-01 14:23:50 -07:00
sqlstore refactor(env)!: enhanced environment variable substitution (#2490) 2025-06-26 08:20:08 +05:30
telemetry fix: fix test of root span to match what is being set (#2494) 2025-06-26 11:41:35 -04:00
tools chore: bump python supported version to 3.12 (#2475) 2025-06-24 09:22:04 +05:30
vector_io feat: Add ChunkMetadata to Chunk (#2497) 2025-06-25 15:55:23 -04:00
__init__.py API Updates (#73) 2024-09-17 19:51:35 -07:00
pagination.py chore(refact): move paginate_records fn outside of datasetio (#2137) 2025-05-12 10:56:14 -07:00
scheduler.py chore: bump python supported version to 3.12 (#2475) 2025-06-24 09:22:04 +05:30