phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 03:04:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

(Feat - Batches API) add support for retrieving vertex api batch jobs (#7661)

Browse source 
* add _async_retrieve_batch

* fix aretrieve_batch

* fix _get_batch_id_from_vertex_ai_batch_response

* fix batches docs
This commit is contained in:
Ishaan Jaff 2025-01-09 18:35:03 -08:00 • committed by GitHub
parent 2507c275f6
commit 13f364682d
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
5 changed files with 177 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

6
tests/batches_tests/test_openai_batches_and_files.py
View file

@ -393,4 +393,10 @@ async def test_avertex_batch_prediction():
metadata={"key1": "value1", "key2": "value2"},
)
print("create_batch_response=", create_batch_response)
retrieved_batch = await litellm.aretrieve_batch(
batch_id=create_batch_response.id,
custom_llm_provider="vertex_ai",
)
print("retrieved_batch=", retrieved_batch)
pass