5 43 81

Yu Zhang

yzhangcs

https://yzhang.site

AI & ML interests

None yet

Recent Activity

liked a dataset about 14 hours ago

EleutherAI/proof-pile-2

upvoted a paper about 16 hours ago

OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models

new activity 2 days ago

fla-hub/rwkv7-168M-pile:safetensors metadata is None

View all activity

Organizations

yzhangcs's activity

upvoted a paper about 16 hours ago

OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models

Paper • 2411.04905 • Published Nov 7, 2024 • 114

upvoted a paper 5 days ago

Test-Time Preference Optimization: On-the-Fly Alignment via Iterative Textual Feedback

Paper • 2501.12895 • Published 5 days ago • 48

upvoted a collection 10 days ago

YuLan-Mini

Collection

A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details. • 5 items • Updated 29 days ago • 12

upvoted a paper 14 days ago

Tensor Product Attention Is All You Need

Paper • 2501.06425 • Published 17 days ago • 75

upvoted an article about 1 month ago

Article

Saving Memory Using Padding-Free Transformer Layers during Finetuning

•

Jun 11, 2024

• 15

upvoted a collection about 1 month ago

OLMo 2

Collection

Artifacts for the second set of OLMo models. • 22 items • Updated 21 days ago • 75

upvoted a paper about 1 month ago

Multimodal Latent Language Modeling with Next-Token Diffusion

Paper • 2412.08635 • Published Dec 11, 2024 • 44

upvoted a paper about 2 months ago

Gated Delta Networks: Improving Mamba2 with Delta Rule

Paper • 2412.06464 • Published Dec 9, 2024 • 10

upvoted a paper 2 months ago

RedPajama: an Open Dataset for Training Large Language Models

Paper • 2411.12372 • Published Nov 19, 2024 • 49

upvoted 2 papers 3 months ago

Hierarchically Gated Recurrent Neural Network for Sequence Modeling

Paper • 2311.04823 • Published Nov 8, 2023 • 2

Qwen2-Audio Technical Report

Paper • 2407.10759 • Published Jul 15, 2024 • 56

upvoted a paper 4 months ago

Gated Linear Attention Transformers with Hardware-Efficient Training

Paper • 2312.06635 • Published Dec 11, 2023 • 6

upvoted a collection 5 months ago

GSA

Collection

3 items • Updated 5 days ago • 2

upvoted 2 papers 5 months ago

Gated Slot Attention for Efficient Linear-Time Sequence Modeling

Paper • 2409.07146 • Published Sep 11, 2024 • 20

Power Scheduler: A Batch Size and Token Number Agnostic Learning Rate Scheduler

Paper • 2408.13359 • Published Aug 23, 2024 • 23

upvoted 2 articles 5 months ago

Article

Cosmopedia: how to create large-scale synthetic data for pre-training Large Language Models

Mar 20, 2024

• 74

Article

SmolLM - blazingly fast and remarkably powerful

Jul 16, 2024

• 299

upvoted a paper 6 months ago

Fast Matrix Multiplications for Lookup Table-Quantized LLMs

Paper • 2407.10960 • Published Jul 15, 2024 • 12

upvoted 2 papers 8 months ago

Parallelizing Linear Transformers with the Delta Rule over Sequence Length

Paper • 2406.06484 • Published Jun 10, 2024 • 3

Scalable MatMul-free Language Modeling

Paper • 2406.02528 • Published Jun 4, 2024 • 11