litellm/docs/my-website/docs/fine_tuning.md
2024-07-31 17:13:02 -07:00

1.1 KiB

[Beta] Fine-tuning API

:::info

This is an Enterprise only endpoint Get Started with Enterprise here

:::

Supported Providers

  • Azure OpenAI
  • OpenAI

Usage

model_list:
  - model_name: gpt-4
    litellm_params:
      model: openai/fake
      api_key: fake-key
      api_base: https://exampleopenaiendpoint-production.up.railway.app/

# For /fine_tuning/jobs endpoints
finetune_settings:
  - custom_llm_provider: azure
    api_base: https://exampleopenaiendpoint-production.up.railway.app
    api_key: fake-key
    api_version: "2023-03-15-preview"
  - custom_llm_provider: openai
    api_key: os.environ/OPENAI_API_KEY

# for /files endpoints
files_settings:
  - custom_llm_provider: azure
    api_base: https://exampleopenaiendpoint-production.up.railway.app
    api_key: fake-key
    api_version: "2023-03-15-preview"
  - custom_llm_provider: openai
    api_key: os.environ/OPENAI_API_KEY

Create File for Fine Tuning

Create fine-tuning job

Cancel fine-tuning job

List fine-tuning jobs