Jeffrey Magder

jmagder's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

upvoted a paper 10 days ago

Why do LLMs attend to the first token?

Paper • 2504.02732 • Published Apr 3 • 2

upvoted a paper about 1 month ago

Accuracy is Not All You Need

Paper • 2407.09141 • Published Jul 12, 2024 • 3

upvoted a paper about 2 months ago

MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attention

Paper • 2506.13585 • Published Jun 16 • 261

upvoted a collection about 2 months ago

Unsloth Dynamic 2.0 Quants

Collection

New 2.0 version of our Dynamic GGUF + Quants. Dynamic 2.0 achieves superior accuracy & SOTA quantization performance. • 43 items • Updated 4 days ago • 189

upvoted 2 papers 2 months ago

Wan: Open and Advanced Large-Scale Video Generative Models

Paper • 2503.20314 • Published Mar 26 • 56

GLaM: Efficient Scaling of Language Models with Mixture-of-Experts

Paper • 2112.06905 • Published Dec 13, 2021 • 2

upvoted an article 3 months ago

view article

Article

The Large Language Model Course

By •

Jan 16

• 199

upvoted a paper 11 months ago

MEDIC: Towards a Comprehensive Framework for Evaluating LLMs in Clinical Applications

Paper • 2409.07314 • Published Sep 11, 2024 • 58

upvoted 12 papers about 1 year ago

Training Compute-Optimal Large Language Models

Paper • 2203.15556 • Published Mar 29, 2022 • 11

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27, 2024 • 624

BitNet: Scaling 1-bit Transformers for Large Language Models

Paper • 2310.11453 • Published Oct 17, 2023 • 104

RoFormer: Enhanced Transformer with Rotary Position Embedding

Paper • 2104.09864 • Published Apr 20, 2021 • 14

LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens

Paper • 2402.13753 • Published Feb 21, 2024 • 117

Efficient Transformers: A Survey

Paper • 2009.06732 • Published Sep 14, 2020 • 1

Attention Is All You Need

Paper • 1706.03762 • Published Jun 12, 2017 • 79

FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awareness

Paper • 2205.14135 • Published May 27, 2022 • 15

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published Apr 22, 2024 • 257

Linformer: Self-Attention with Linear Complexity

Paper • 2006.04768 • Published Jun 8, 2020 • 2

FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioning

Paper • 2307.08691 • Published Jul 17, 2023 • 9

Self-Play Preference Optimization for Language Model Alignment

Paper • 2405.00675 • Published May 1, 2024 • 28