open-sci/open-sci-ref-v0.01-0.13b-dclm-300B-4096
0.1B
•
Updated
•
4
AI & ML interests
Researching and building foundation models with improved generalization and reasoning. LAION & friends spin-off for open-sourcing foundation models with strong generalization and reasoning , including datasets necessary for their creation, to serve as common open, reproducible grounds for further research experiments.
Recent Activity
View all activity
open-sci/open-sci-ref-v0.01-0.13b-dclm-300B-4096-lr0.006-2
0.1B
•
Updated
•
4
open-sci/open-sci-ref-v0.01-0.13b-commoncorpus-300B-4096
0.1B
•
Updated
•
5
open-sci/open-sci-ref-v0.01-0.13b-c4-300B-4096-warmup25000
0.1B
•
Updated
•
44
open-sci/open-sci-ref-v0.01-0.13b-c4-300B-4096-warmup25000-lr0.006-2
0.1B
•
Updated
•
5
open-sci/smollm2-1.7b-oh-dcft
Text Generation
•
2B
•
Updated
•
4
open-sci/open-sci-1.7b-nemotron-cc-1T-oh-dcft
Feature Extraction
•
2B
•
Updated
•
9
open-sci/open-sci-ref-v0.01-1.7b-nemotron-cc-hq-1T-4096
2B
•
Updated
•
2