Continual Quantization-Aware Pre-Training: When to transition from 16-bit to 1.58-bit pre-training for BitNet language models?
Paper
•
2502.11895
•
Published
•
2
AI & ML interests
None defined yet.
Recent Activity
Update wiki, wikibooks, wikisource
🚀
1
2
#87 opened 3 days ago
by
kris927b
Add plot displaying dates of files to get an overview of when data is from
#89 opened about 7 hours ago
by
KennethEnevoldsen
Update wiki, wikibooks, wikisource
🚀
1
2
#87 opened 3 days ago
by
kris927b
Add parlspeech
#88 opened 2 days ago
by
KennethEnevoldsen
demo setup
🚀
1
1
#1 opened 2 months ago
by
balsab
lgalke
authored
6
papers
5 days ago
What makes a language easy to deep-learn? Deep neural networks and humans similarly benefit from compositional structure
Paper
•
2302.12239
•
Published
•
1
Dynaword: From One-shot to Continuously Developed Datasets
Paper
•
2508.02271
•
Published
•
13
GenCodeSearchNet: A Benchmark Test Suite for Evaluating Generalization in Programming Language Understanding
Paper
•
2311.09707
•
Published
When are 1.58 bits enough? A Bottom-up Exploration of BitNet Quantization
Paper
•
2411.05882
•
Published
•
1
CBOW Is Not All You Need: Combining CBOW with the Compositional Matrix Space Model
Paper
•
1902.06423
•
Published
Update README.md
🚀
1
1
#86 opened 10 days ago
by
JohanHeinsen
KennethEnevoldsen
updated
a
dataset
7 days ago
Wikipedia Comments
6
#78 opened 28 days ago
by
robvanderg
Update CI
2
#85 opened 12 days ago
by
KennethEnevoldsen
Update CI
2
#85 opened 12 days ago
by
KennethEnevoldsen
kris927b
authored
3
papers
12 days ago
SkillSpan: Hard and Soft Skill Extraction from English Job Postings
Paper
•
2204.12811
•
Published
•
1
Kompetencer: Fine-grained Skill Classification in Danish Job Postings via Distant Supervision and Transfer Learning
Paper
•
2205.01381
•
Published
Dynaword: From One-shot to Continuously Developed Datasets
Paper
•
2508.02271
•
Published
•
13
giannor
authored
a
paper
12 days ago