Spaces:
Configuration error
Configuration error
metadata
title: v1.56.4
slug: v1.56.4
date: 2024-12-29T10:00:00.000Z
authors:
- name: Krrish Dholakia
title: CEO, LiteLLM
url: https://www.linkedin.com/in/krish-d/
image_url: >-
https://media.licdn.com/dms/image/v2/D4D03AQGrlsJ3aqpHmQ/profile-displayphoto-shrink_400_400/B4DZSAzgP7HYAg-/0/1737327772964?e=1749686400&v=beta&t=Hkl3U8Ps0VtvNxX0BNNq24b4dtX5wQaPFp6oiKCIHD8
- name: Ishaan Jaffer
title: CTO, LiteLLM
url: https://www.linkedin.com/in/reffajnaahsi/
image_url: >-
https://media.licdn.com/dms/image/v2/D4D03AQGiM7ZrUwqu_Q/profile-displayphoto-shrink_800_800/profile-displayphoto-shrink_800_800/0/1675971026692?e=1741824000&v=beta&t=eQnRdXPJo4eiINWTZARoYTfqh064pgZ-E21pQTSy8jc
tags:
- deepgram
- fireworks ai
- vision
- admin ui
- dependency upgrades
hide_table_of_contents: false
import Image from '@theme/IdealImage';
deepgram
, fireworks ai
, vision
, admin ui
, dependency upgrades
New Models
Deepgram Speech to Text
New Speech to Text support for Deepgram models. Start Here
from litellm import transcription
import os
# set api keys
os.environ["DEEPGRAM_API_KEY"] = ""
audio_file = open("/path/to/audio.mp3", "rb")
response = transcription(model="deepgram/nova-2", file=audio_file)
print(f"response: {response}")
Fireworks AI - Vision support for all models
LiteLLM supports document inlining for Fireworks AI models. This is useful for models that are not vision models, but still need to parse documents/images/etc.
LiteLLM will add #transform=inline
to the url of the image_url, if the model is not a vision model See Code
Proxy Admin UI
Test Key
Tab displaysmodel
used in response
<Image img={require('../../img/release_notes/ui_model.png')} />
Test Key
Tab renders content in.md
,.py
(any code/markdown format)
<Image img={require('../../img/release_notes/ui_format.png')} />
Dependency Upgrades
- (Security fix) Upgrade to
fastapi==0.115.5
https://github.com/BerriAI/litellm/pull/7447
Bug Fixes
- Add health check support for realtime models Here
- Health check error with audio_transcription model https://github.com/BerriAI/litellm/issues/5999