litellm-mirror/docs/my-website/release_notes/v1.56.4/index.md
Krish Dholakia 513874858b fix(model_hub.tsx): clarify cost in model hub is per 1m tokens (#7687)
* fix(model_hub.tsx): clarify cost in model hub is per 1m tokens

* docs: test blog

* docs: improve release note docs

* docs(docs/): new stable release doc

* docs(docs/): specify date in all posts

* docs(docs/): add git diff to stable release docs
2025-01-11 09:57:09 -08:00

2.4 KiB

title slug date authors tags hide_table_of_contents
v1.56.4 v1.56.4 2024-12-29T10:00:00
name title url image_url
Krrish Dholakia CEO, LiteLLM https://www.linkedin.com/in/krish-d/ 1517455593
name title url image_url
Ishaan Jaffer CTO, LiteLLM https://www.linkedin.com/in/reffajnaahsi/ 1675971026
deepgram
fireworks ai
vision
admin ui
dependency upgrades
false

import Image from '@theme/IdealImage';

deepgram, fireworks ai, vision, admin ui, dependency upgrades

New Models

Deepgram Speech to Text

New Speech to Text support for Deepgram models. Start Here

from litellm import transcription
import os 

# set api keys 
os.environ["DEEPGRAM_API_KEY"] = ""
audio_file = open("/path/to/audio.mp3", "rb")

response = transcription(model="deepgram/nova-2", file=audio_file)

print(f"response: {response}")

Fireworks AI - Vision support for all models

LiteLLM supports document inlining for Fireworks AI models. This is useful for models that are not vision models, but still need to parse documents/images/etc. LiteLLM will add #transform=inline to the url of the image_url, if the model is not a vision model See Code

Proxy Admin UI

  • Test Key Tab displays model used in response

<Image img={require('../../img/release_notes/ui_model.png')} />

  • Test Key Tab renders content in .md, .py (any code/markdown format)

<Image img={require('../../img/release_notes/ui_format.png')} />

Dependency Upgrades

Bug Fixes