Compiled engines for running Whisper with TRT LLM for much faster inference.
baseten
company
Verified
AI & ML interests
None defined yet.
Recent Activity
View all activity
Collections
1
models
675
baseten/btest-Llama-3.1-8B-Instruct-NVIDIA-H100-80GB-HBM3-v0.17.0-TP2
Updated
•
5
baseten/btest-Llama-3.1-8B-Instruct-NVIDIA-H100-80GB-HBM3-v0.17.0-TP1
Updated
•
3
baseten/btest-TinyLlama-1.1B-Chat-v1.0-NVIDIA-H100-80GB-HBM3-v0.17.0-TP2
Updated
•
4
baseten/btest-TinyLlama-1.1B-Chat-v1.0-NVIDIA-H100-80GB-HBM3-v0.17.0-TP1
Updated
•
5
baseten/v3-nextn-head0
Updated
•
41
baseten/r1-nextn-head0
Updated
•
29
baseten/btest-TinyLlama-1.1B-Chat-v1.0-NVIDIA-H100-80GB-HBM3-v0.16.0-TP1-lookahead
Updated
•
10
baseten/btest-TinyLlama-1.1B-Chat-v1.0-NVIDIA-H100-80GB-HBM3-v0.16.0-TP1
Updated
•
13
baseten/r1-nextn-heads
Updated
•
36
baseten/whisper_trt_large_v3_turbo_NVIDIA_A10G_0_13_0
Updated