Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models
Paper
•
2411.04996
•
Published
•
51
Victoria Lin
VictoriaLinML
AI & ML interests
None yet
Recent Activity
authored
a paper
4 months ago
Mixture-of-Transformers: A Sparse and Scalable Architecture for
Multi-Modal Foundation Models
commented on
a paper
4 months ago
Mixture-of-Transformers: A Sparse and Scalable Architecture for
Multi-Modal Foundation Models
Organizations
VictoriaLinML's activity
authored
a
paper
4 months ago
upvoted
a
paper
4 months ago
commented
a
paper
4 months ago
commented
a
paper
8 months ago
authored
a
paper
8 months ago
commented
a
paper
8 months ago
upvoted
a
paper
9 months ago
upvoted
a
paper
10 months ago
authored
a
paper
10 months ago
authored
6
papers
about 1 year ago
Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
Paper
•
2403.07816
•
Published
•
41
Instruction-tuned Language Models are Better Knowledge Learners
Paper
•
2402.12847
•
Published
•
26
LEVER: Learning to Verify Language-to-Code Generation with Execution
Paper
•
2302.08468
•
Published
•
1
Efficient Large Scale Language Modeling with Mixtures of Experts
Paper
•
2112.10684
•
Published
•
2
OPT: Open Pre-trained Transformer Language Models
Paper
•
2205.01068
•
Published
•
2
Few-shot Learning with Multilingual Language Models
Paper
•
2112.10668
•
Published
•
1
liked
a
Space
over 1 year ago
authored
3
papers
over 1 year ago
OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of Generalization
Paper
•
2212.12017
•
Published
•
1
Stage-wise Fine-tuning for Graph-to-Text Generation
Paper
•
2105.08021
•
Published
•
1
RA-DIT: Retrieval-Augmented Dual Instruction Tuning
Paper
•
2310.01352
•
Published
•
7