Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

Collections

Discover the best community collections!

Collections including paper arxiv:2412.09871

Papers - Encodings - No Positional Encodings - NoPE

about 16 hours ago

The Impact of Positional Encoding on Length Generalization in Transformers

Paper • 2305.19466 • Published May 31, 2023 • 2
Transformers Can Do Arithmetic with the Right Embeddings

Paper • 2405.17399 • Published May 27 • 52
Teaching Transformers Causal Reasoning through Axiomatic Training

Paper • 2407.07612 • Published Jul 10 • 2
Round and Round We Go! What makes Rotary Positional Encodings useful?

Paper • 2410.06205 • Published Oct 8 • 1

Papers - Encodings - Rotary - RoPE

about 16 hours ago

The Impact of Positional Encoding on Length Generalization in Transformers

Paper • 2305.19466 • Published May 31, 2023 • 2
Qwen2 Technical Report

Paper • 2407.10671 • Published Jul 15 • 160
Round and Round We Go! What makes Rotary Positional Encodings useful?

Paper • 2410.06205 • Published Oct 8 • 1
ThunderKittens: Simple, Fast, and Adorable AI Kernels

Paper • 2410.20399 • Published Oct 27 • 1

Papers - Llama 2

about 16 hours ago

Instruction Tuning with Human Curriculum

Paper • 2310.09518 • Published Oct 14, 2023 • 3
A Thorough Examination of Decoding Methods in the Era of LLMs

Paper • 2402.06925 • Published Feb 10 • 1
Distilling System 2 into System 1

Paper • 2407.06023 • Published Jul 8 • 3
Byte Latent Transformer: Patches Scale Better Than Tokens

Paper • 2412.09871 • Published 13 days ago • 75

Papers - Tokenizers - LLaMA Byte Pair Encoding (BPE)

Orca: Progressive Learning from Complex Explanation Traces of GPT-4

Paper • 2306.02707 • Published Jun 5, 2023 • 46
Byte Latent Transformer: Patches Scale Better Than Tokens

Paper • 2412.09871 • Published 13 days ago • 75

Papers - Multilingual - Benchmarks

about 11 hours ago

HyperCLOVA X Technical Report

Paper • 2404.01954 • Published Apr 2 • 20
ByT5: Towards a token-free future with pre-trained byte-to-byte models

Paper • 2105.13626 • Published May 28, 2021 • 3
Byte Latent Transformer: Patches Scale Better Than Tokens

Paper • 2412.09871 • Published 13 days ago • 75

Papers - Multilingual - Encoders - BPE

about 11 hours ago

Poro 34B and the Blessing of Multilinguality

Paper • 2404.01856 • Published Apr 2 • 13
Byte Latent Transformer: Patches Scale Better Than Tokens

Paper • 2412.09871 • Published 13 days ago • 75

Papers - Embeddings

about 13 hours ago

Gecko: Versatile Text Embeddings Distilled from Large Language Models

Paper • 2403.20327 • Published Mar 29 • 47
Round and Round We Go! What makes Rotary Positional Encodings useful?

Paper • 2410.06205 • Published Oct 8 • 1
Byte Latent Transformer: Patches Scale Better Than Tokens

Paper • 2412.09871 • Published 13 days ago • 75
MrT5: Dynamic Token Merging for Efficient Byte-level Language Models

Paper • 2410.20771 • Published Oct 28 • 3

about 14 hours ago

LIMA: Less Is More for Alignment

Paper • 2305.11206 • Published May 18, 2023 • 21
Garment3DGen: 3D Garment Stylization and Texture Generation

Paper • 2403.18816 • Published Mar 27 • 21
EgoLifter: Open-world 3D Segmentation for Egocentric Perception

Paper • 2403.18118 • Published Mar 26 • 10
The Unreasonable Ineffectiveness of the Deeper Layers

Paper • 2403.17887 • Published Mar 26 • 78

Papers - Attention - Cross

about 17 hours ago

Vid2Robot: End-to-end Video-conditioned Policy Learning with Cross-Attention Transformers

Paper • 2403.12943 • Published Mar 19 • 14
Masked Audio Generation using a Single Non-Autoregressive Transformer

Paper • 2401.04577 • Published Jan 9 • 42
Cross-Attention Makes Inference Cumbersome in Text-to-Image Diffusion Models

Paper • 2404.02747 • Published Apr 3 • 11
InstantStyle: Free Lunch towards Style-Preserving in Text-to-Image Generation

Paper • 2404.02733 • Published Apr 3 • 20

To read... eventually

A collection of papers that i have read or plan to read all in one place. Includes a wide range of topics.

about 2 hours ago

MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training

Paper • 2403.09611 • Published Mar 14 • 125
Evolutionary Optimization of Model Merging Recipes

Paper • 2403.13187 • Published Mar 19 • 50
MobileVLM V2: Faster and Stronger Baseline for Vision Language Model

Paper • 2402.03766 • Published Feb 6 • 12
LLM Agent Operating System

Paper • 2403.16971 • Published Mar 25 • 65

Previous
1
...
5
6
7
8
Next

Company

TOS Privacy About Jobs

Website

Models Datasets Spaces Pricing Docs