Realtime API: Support 'base_model' cost tracking + show response in spend logs (if enabled) (#9897)

* refactor(litellm_logging.py): refactor realtime cost tracking to use common code as rest

Ensures basic features like base model just work

* feat(realtime/): support 'base_model' cost tracking on realtime api

Fixes issue where base model was not working on realtime

* fix: fix ruff linting error

* test: fix test
This commit is contained in:
Krish Dholakia 2025-04-10 21:24:45 -07:00 committed by GitHub
parent 113d8522f5
commit efd69834e1
6 changed files with 102 additions and 46 deletions

View file

@ -2138,6 +2138,7 @@ class Router:
request_kwargs=kwargs,
)
self._update_kwargs_with_deployment(deployment=deployment, kwargs=kwargs)
data = deployment["litellm_params"].copy()
for k, v in self.default_litellm_params.items():
if (