Finally, a Replacement for BERT: Introducing ModernBERT
•
667
AI & ML interests
None defined yet.
Recent Activity
Articles
Organization Card
Rethink AI for the Enterprise
LightOn Paradigm is the platform for your Generative AI team: 🚀 easy to deploy and serve 🎨 customizable for specific use cases and applications 🔒 respecting the privacy of your data and protecting your intellectual property and know-how
Learn more at lighton.ai 💡 Get in touch if you want the help of a team of experts in Generative AI.
About LightOn
The team at LightOn has been focusing on building and commercializing state-of-the-art Generative AI Foundation Models for its customers since 2020. LightOn has released state-of-the-art language models for French, and for protein modeling, it also participated in the BLOOM project that resulted in the open-source release of a 179B parameters multilingual model.
-
lightonai/Reason-ModernColBERT
Sentence Similarity • 0.1B • Updated • 1.84k • 200 -
lightonai/GTE-ModernColBERT-v1
Sentence Similarity • 0.1B • Updated • 12k • 128 -
lightonai/answerai-colbert-small-v1
Sentence Similarity • 0.0B • Updated • 893 • 3 -
lightonai/colbertv2.0
Sentence Similarity • 0.1B • Updated • 1.76k • 4
Bringing BERT into modernity via both architecture changes and scaling
-
answerdotai/ModernBERT-base
Fill-Mask • 0.1B • Updated • 978k • • 893 -
lightonai/GTE-ModernColBERT-v1
Sentence Similarity • 0.1B • Updated • 12k • 128 -
lightonai/Reason-ModernColBERT
Sentence Similarity • 0.1B • Updated • 1.84k • 200 -
lightonai/modernbert-embed-large
Sentence Similarity • 0.4B • Updated • 87.8k • • 24
-
lightonai/Reason-ModernColBERT
Sentence Similarity • 0.1B • Updated • 1.84k • 200 -
lightonai/GTE-ModernColBERT-v1
Sentence Similarity • 0.1B • Updated • 12k • 128 -
lightonai/answerai-colbert-small-v1
Sentence Similarity • 0.0B • Updated • 893 • 3 -
lightonai/colbertv2.0
Sentence Similarity • 0.1B • Updated • 1.76k • 4
Bringing BERT into modernity via both architecture changes and scaling
-
answerdotai/ModernBERT-base
Fill-Mask • 0.1B • Updated • 978k • • 893 -
lightonai/GTE-ModernColBERT-v1
Sentence Similarity • 0.1B • Updated • 12k • 128 -
lightonai/Reason-ModernColBERT
Sentence Similarity • 0.1B • Updated • 1.84k • 200 -
lightonai/modernbert-embed-large
Sentence Similarity • 0.4B • Updated • 87.8k • • 24
models
24
lightonai/answerai-colbert-small-v1
Sentence Similarity
•
0.0B
•
Updated
•
893
•
3
lightonai/Reason-ModernColBERT
Sentence Similarity
•
0.1B
•
Updated
•
1.84k
•
200
lightonai/MonoQwen2-VL-v0.1
Visual Document Retrieval
•
Updated
•
51.7k
•
40
lightonai/GTE-ModernColBERT-v1
Sentence Similarity
•
0.1B
•
Updated
•
12k
•
128
lightonai/modernbert-embed-large
Sentence Similarity
•
0.4B
•
Updated
•
87.8k
•
•
24
lightonai/colbertv2.0
Sentence Similarity
•
0.1B
•
Updated
•
1.76k
•
4
lightonai/modernbert-embed-large-unsupervised
Sentence Similarity
•
0.4B
•
Updated
•
23
lightonai/pagnol-medium
Text Generation
•
0.4B
•
Updated
•
7
•
1
lightonai/RITA_m
Text Generation
•
0.3B
•
Updated
•
20
lightonai/FlexBert
Updated
datasets
10
lightonai/leetcode_reasonmoderncolbert
Preview
•
Updated
•
388
lightonai/ms-marco-en-bge
Viewer
•
Updated
•
10.5M
•
216
•
6
lightonai/ms-marco-en-bge-gemma
Viewer
•
Updated
•
10.3M
•
355
•
7
lightonai/multimodal_sample_data
Viewer
•
Updated
•
10
•
12
lightonai/qrecc-test
Updated
•
102
lightonai/fc-amf-ocr
Viewer
•
Updated
•
58.6k
•
762
•
19
lightonai/ArabicWeb24
Viewer
•
Updated
•
86.8M
•
206
•
19
lightonai/ms-marco-fr-bge
Viewer
•
Updated
•
9.64M
•
23
lightonai/lighton-ms-marco-mini
Viewer
•
Updated
•
100
•
124
lightonai/SwissProt-EC-leaf
Viewer
•
Updated
•
223k
•
180