phoenix/litellm-mirror
0
0
Fork 1
mirror of https://github.com/BerriAI/litellm.git synced 2025-04-26 03:04:13 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions
litellm-mirror/docs/my-website/docs/proxy/config_management.md
Ishaan Jaff 1eb0365783 (feat) Allow using include to include external YAML files in a config.yaml (#6922) 
* add helper to process inlcudes directive on yaml

* add doc on config management

* unit tests for `include` on config.yaml
2024-11-26 20:27:12 -08:00

1.2 KiB
Raw Blame History

File Management

include external YAML files in a config.yaml

You can use include to include external YAML files in a config.yaml.

Quick Start Usage:

To include a config file, use include with either a single file or a list of files.

Contents of parent_config.yaml:

include:
  - model_config.yaml # 👈 Key change, will include the contents of model_config.yaml

litellm_settings:
  callbacks: ["prometheus"]

Contents of model_config.yaml:

model_list:
  - model_name: gpt-4o
    litellm_params:
      model: openai/gpt-4o
      api_base: https://exampleopenaiendpoint-production.up.railway.app/
  - model_name: fake-anthropic-endpoint
    litellm_params:
      model: anthropic/fake
      api_base: https://exampleanthropicendpoint-production.up.railway.app/

Start proxy server

This will start the proxy server with config parent_config.yaml. Since the include directive is used, the server will also include the contents of model_config.yaml.

litellm --config parent_config.yaml --detailed_debug

Examples using include

Include a single file:

include:
  - model_config.yaml

Include multiple files:

include:
  - model_config.yaml
  - another_config.yaml