Spaces:
Configuration error
Configuration error
title: v1.56.4 | |
slug: v1.56.4 | |
date: 2024-12-29T10:00:00 | |
authors: | |
- name: Krrish Dholakia | |
title: CEO, LiteLLM | |
url: https://www.linkedin.com/in/krish-d/ | |
image_url: https://media.licdn.com/dms/image/v2/D4D03AQGrlsJ3aqpHmQ/profile-displayphoto-shrink_400_400/B4DZSAzgP7HYAg-/0/1737327772964?e=1749686400&v=beta&t=Hkl3U8Ps0VtvNxX0BNNq24b4dtX5wQaPFp6oiKCIHD8 | |
- name: Ishaan Jaffer | |
title: CTO, LiteLLM | |
url: https://www.linkedin.com/in/reffajnaahsi/ | |
image_url: https://media.licdn.com/dms/image/v2/D4D03AQGiM7ZrUwqu_Q/profile-displayphoto-shrink_800_800/profile-displayphoto-shrink_800_800/0/1675971026692?e=1741824000&v=beta&t=eQnRdXPJo4eiINWTZARoYTfqh064pgZ-E21pQTSy8jc | |
tags: [deepgram, fireworks ai, vision, admin ui, dependency upgrades] | |
hide_table_of_contents: false | |
import Image from '@theme/IdealImage'; | |
`deepgram`, `fireworks ai`, `vision`, `admin ui`, `dependency upgrades` | |
## New Models | |
### **Deepgram Speech to Text** | |
New Speech to Text support for Deepgram models. [**Start Here**](https://docs.litellm.ai/docs/providers/deepgram) | |
```python | |
from litellm import transcription | |
import os | |
# set api keys | |
os.environ["DEEPGRAM_API_KEY"] = "" | |
audio_file = open("/path/to/audio.mp3", "rb") | |
response = transcription(model="deepgram/nova-2", file=audio_file) | |
print(f"response: {response}") | |
``` | |
### **Fireworks AI - Vision** support for all models | |
LiteLLM supports document inlining for Fireworks AI models. This is useful for models that are not vision models, but still need to parse documents/images/etc. | |
LiteLLM will add `#transform=inline` to the url of the image_url, if the model is not a vision model [See Code](https://github.com/BerriAI/litellm/blob/1ae9d45798bdaf8450f2dfdec703369f3d2212b7/litellm/llms/fireworks_ai/chat/transformation.py#L114) | |
## Proxy Admin UI | |
- `Test Key` Tab displays `model` used in response | |
<Image img={require('../../img/release_notes/ui_model.png')} /> | |
- `Test Key` Tab renders content in `.md`, `.py` (any code/markdown format) | |
<Image img={require('../../img/release_notes/ui_format.png')} /> | |
## Dependency Upgrades | |
- (Security fix) Upgrade to `fastapi==0.115.5` https://github.com/BerriAI/litellm/pull/7447 | |
## Bug Fixes | |
- Add health check support for realtime models [Here](https://docs.litellm.ai/docs/proxy/health#realtime-models) | |
- Health check error with audio_transcription model https://github.com/BerriAI/litellm/issues/5999 | |