deepseek-ai/DeepSeek-V3-Base
Updated
•
11.2k
•
1.22k
aohenduo
chenduo
AI & ML interests
None yet
Recent Activity
liked
a model
14 days ago
deepseek-ai/DeepSeek-V3-Base
liked
a model
20 days ago
recursal/QRWKV6-32B-Instruct-Preview-v0.1
Organizations
None yet
chenduo's activity
liked
a
model
14 days ago
liked
a
model
20 days ago
liked
a
model
2 months ago
Will there be multimodal support?
#10 opened 2 months ago
by
chenduo
liked
a
Space
3 months ago
reacted to
reach-vb's
post with 👍
3 months ago
Post
5473
Multimodal Ichigo Llama 3.1 - Real Time Voice AI 🔥
> WhisperSpeech X Llama 3.1 8B
> Trained on 50K hours of speech (7 languages)
> Continually trained on 45hrs 10x A1000s
> MLS -> WhisperVQ tokens -> Llama 3.1
> Instruction tuned on 1.89M samples
> 70% speech, 20% transcription, 10% text
> Apache 2.0 licensed ⚡
Architecture:
> WhisperSpeech/ VQ for Semantic Tokens
> Llama 3.1 8B Instruct for Text backbone
> Early fusion (Chameleon)
I'm super bullish on HomeBrew/ Jan and early fusion, audio and text, multimodal models!
(P.S. Play with the demo on Hugging Face: jan-hq/Ichigo-llama3.1-s-instruct)
> WhisperSpeech X Llama 3.1 8B
> Trained on 50K hours of speech (7 languages)
> Continually trained on 45hrs 10x A1000s
> MLS -> WhisperVQ tokens -> Llama 3.1
> Instruction tuned on 1.89M samples
> 70% speech, 20% transcription, 10% text
> Apache 2.0 licensed ⚡
Architecture:
> WhisperSpeech/ VQ for Semantic Tokens
> Llama 3.1 8B Instruct for Text backbone
> Early fusion (Chameleon)
I'm super bullish on HomeBrew/ Jan and early fusion, audio and text, multimodal models!
(P.S. Play with the demo on Hugging Face: jan-hq/Ichigo-llama3.1-s-instruct)
reacted to
clem's
post with 👍
6 months ago
Post
2497
This is the week of small AI language models!
- 4 replies
liked
a
model
6 months ago
liked
a
dataset
7 months ago
shape mismatch: value tensor of shape [2320] cannot be broadcast to indexing result of shape [2262]
6
#52 opened 8 months ago
by
yeargun
updated
2
models
7 months ago
updated
a
model
9 months ago
liked
2
models
9 months ago
Quantization error
2
#1 opened 9 months ago
by
chenduo
liked
a
model
9 months ago
liked
a
Space
9 months ago
liked
a
dataset
9 months ago
liked
a
model
10 months ago
