mirror of
https://github.com/BerriAI/litellm.git
synced 2025-04-27 11:43:54 +00:00
513874858b
* fix(model_hub.tsx): clarify cost in model hub is per 1m tokens * docs: test blog * docs: improve release note docs * docs(docs/): new stable release doc * docs(docs/): specify date in all posts * docs(docs/): add git diff to stable release docs
72 lines
2.4 KiB
Markdown
72 lines
2.4 KiB
Markdown
---
|
|
title: v1.56.4
|
|
slug: v1.56.4
|
|
date: 2024-12-29T10:00:00
|
|
authors:
|
|
- name: Krrish Dholakia
|
|
title: CEO, LiteLLM
|
|
url: https://www.linkedin.com/in/krish-d/
|
|
image_url: https://media.licdn.com/dms/image/v2/C5103AQHYMXJfHTf4Ng/profile-displayphoto-shrink_800_800/profile-displayphoto-shrink_800_800/0/1517455593871?e=1741824000&v=beta&t=udmat6jS-s3EQZp1DTykf7NZmf-3sefD_I9B1aMjE5Y
|
|
- name: Ishaan Jaffer
|
|
title: CTO, LiteLLM
|
|
url: https://www.linkedin.com/in/reffajnaahsi/
|
|
image_url: https://media.licdn.com/dms/image/v2/D4D03AQGiM7ZrUwqu_Q/profile-displayphoto-shrink_800_800/profile-displayphoto-shrink_800_800/0/1675971026692?e=1741824000&v=beta&t=eQnRdXPJo4eiINWTZARoYTfqh064pgZ-E21pQTSy8jc
|
|
tags: [deepgram, fireworks ai, vision, admin ui, dependency upgrades]
|
|
hide_table_of_contents: false
|
|
---
|
|
|
|
import Image from '@theme/IdealImage';
|
|
|
|
|
|
`deepgram`, `fireworks ai`, `vision`, `admin ui`, `dependency upgrades`
|
|
|
|
## New Models
|
|
|
|
### **Deepgram Speech to Text**
|
|
|
|
New Speech to Text support for Deepgram models. [**Start Here**](https://docs.litellm.ai/docs/providers/deepgram)
|
|
|
|
```python
|
|
from litellm import transcription
|
|
import os
|
|
|
|
# set api keys
|
|
os.environ["DEEPGRAM_API_KEY"] = ""
|
|
audio_file = open("/path/to/audio.mp3", "rb")
|
|
|
|
response = transcription(model="deepgram/nova-2", file=audio_file)
|
|
|
|
print(f"response: {response}")
|
|
```
|
|
|
|
### **Fireworks AI - Vision** support for all models
|
|
LiteLLM supports document inlining for Fireworks AI models. This is useful for models that are not vision models, but still need to parse documents/images/etc.
|
|
LiteLLM will add `#transform=inline` to the url of the image_url, if the model is not a vision model [See Code](https://github.com/BerriAI/litellm/blob/1ae9d45798bdaf8450f2dfdec703369f3d2212b7/litellm/llms/fireworks_ai/chat/transformation.py#L114)
|
|
|
|
|
|
## Proxy Admin UI
|
|
|
|
- `Test Key` Tab displays `model` used in response
|
|
|
|
<Image img={require('../../img/release_notes/ui_model.png')} />
|
|
|
|
- `Test Key` Tab renders content in `.md`, `.py` (any code/markdown format)
|
|
|
|
<Image img={require('../../img/release_notes/ui_format.png')} />
|
|
|
|
|
|
## Dependency Upgrades
|
|
|
|
- (Security fix) Upgrade to `fastapi==0.115.5` https://github.com/BerriAI/litellm/pull/7447
|
|
|
|
## Bug Fixes
|
|
|
|
- Add health check support for realtime models [Here](https://docs.litellm.ai/docs/proxy/health#realtime-models)
|
|
- Health check error with audio_transcription model https://github.com/BerriAI/litellm/issues/5999
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|