""" Translate from OpenAI's `/v1/chat/completions` to LM Studio's `/chat/completions` """ import types from typing import List, Optional, Tuple, Union from pydantic import BaseModel import litellm from litellm.secret_managers.main import get_secret_str from litellm.types.llms.openai import AllMessageValues, ChatCompletionAssistantMessage from ....utils import _remove_additional_properties, _remove_strict_from_schema from ...openai.chat.gpt_transformation import OpenAIGPTConfig class LMStudioChatConfig(OpenAIGPTConfig): def _get_openai_compatible_provider_info( self, api_base: Optional[str], api_key: Optional[str] ) -> Tuple[Optional[str], Optional[str]]: api_base = api_base or get_secret_str("LM_STUDIO_API_BASE") # type: ignore dynamic_api_key = ( api_key or get_secret_str("LM_STUDIO_API_KEY") or "" ) # vllm does not require an api key return api_base, dynamic_api_key