feat(api): add file_processor API skeleton

This change adds a file_processor API skeleton that provides a foundationfor converting files into structured content for vector store ingestionwith support for chunking strategies and optional embedding generation.

Signed-off-by: Alina Ryan <aliryan@redhat.com>
This commit is contained in:
Alina Ryan 2025-11-08 23:50:49 -05:00
parent 6147321083
commit 2664aeee2a
21 changed files with 258 additions and 0 deletions

View file

@ -5,6 +5,7 @@ apis:
- batches
- datasetio
- eval
- file_processor
- files
- inference
- post_training
@ -154,6 +155,9 @@ providers:
metadata_store:
table_name: files_metadata
backend: sql_default
file_processor:
- provider_id: reference
provider_type: inline::reference
safety:
- provider_id: llama-guard
provider_type: inline::llama-guard