phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-24 10:14:26 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

doc batch settings

Browse source
This commit is contained in:
Ishaan Jaff 2025-01-17 10:02:22 -08:00
parent 8185e1990f
commit 6598d817ec
1 changed files with 2 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

4
docs/my-website/docs/batches.md
View file

@ -179,7 +179,7 @@ First, set up where you want to store the batch files. You can use S3, GCS, or A
```yaml
model_list:
- model_name: vllm-models
- model_name: vllm-model
litellm_params:
model: openai/facebook/opt-125m # the `openai/` prefix tells litellm it's openai compatible
api_base: http://0.0.0.0:4000/v1
@ -187,7 +187,7 @@ model_list:
batch_settings:
# Configure S3 for batch file storage
model: vllm-models
model: vllm-model
batch_storage_params:
s3_bucket_name: my-batch-bucket # AWS Bucket Name for S3
s3_region_name: us-west-2 # AWS Region Name for S3