9 18 12

Huiqiang Jiang PRO

iofu728

https://www.microsoft.com/en-us/research/people/hjiang/

AI & ML interests

None yet

Recent Activity

updated a dataset about 18 hours ago

microsoft/SCBench

upvoted a paper 5 days ago

Qwen2.5 Technical Report

authored a paper 9 days ago

SCBench: A KV Cache-Centric Analysis of Long-Context Methods

View all activity

Articles

How to Optimize TTFT of 8B LLMs with 1M Tokens to 20s

Jul 21

• 2

Organizations

iofu728's activity

updated a dataset about 18 hours ago

microsoft/SCBench

Viewer • Updated about 18 hours ago • 922 • 647 • 5

upvoted a paper 5 days ago

Qwen2.5 Technical Report

Paper • 2412.15115 • Published 6 days ago • 325

authored a paper 9 days ago

SCBench: A KV Cache-Centric Analysis of Long-Context Methods

Paper • 2412.10319 • Published 12 days ago • 8

upvoted a paper 9 days ago

SCBench: A KV Cache-Centric Analysis of Long-Context Methods

Paper • 2412.10319 • Published 12 days ago • 8

commented a paper 9 days ago

SCBench: A KV Cache-Centric Analysis of Long-Context Methods

Paper • 2412.10319 • Published 12 days ago • 8 •

New activity in microsoft/SCBench 10 days ago

rename

#2 opened 10 days ago by

liyucheng

updated a dataset 12 days ago

MInference/SCBench

Viewer • Updated 12 days ago • 922 • 79

upvoted a paper 12 days ago

Multimodal Latent Language Modeling with Next-Token Diffusion

Paper • 2412.08635 • Published 14 days ago • 41

updated a Space 2 months ago

Running on Zero

🌍

MInference

upvoted a paper 3 months ago

Differential Transformer

Paper • 2410.05258 • Published Oct 7 • 168

upvoted an article 3 months ago

Article

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

Sep 18

• 213

authored a paper 3 months ago

RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval

Paper • 2409.10516 • Published Sep 16 • 39

upvoted a paper 3 months ago

RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval

Paper • 2409.10516 • Published Sep 16 • 39

commented a paper 3 months ago

RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval

Paper • 2409.10516 • Published Sep 16 • 39 •

upvoted a paper 4 months ago

MagicDec: Breaking the Latency-Throughput Tradeoff for Long Context Generation with Speculative Decoding

Paper • 2408.11049 • Published Aug 20 • 12

upvoted an article 4 months ago

Article

A failed experiment: Infini-Attention, and why we should keep trying?

Aug 14

• 53

published an article 5 months ago

Article

How to Optimize TTFT of 8B LLMs with 1M Tokens to 20s

•

Jul 21

• 2

New activity in microsoft/MInference 6 months ago

setup.py error

#1 opened 6 months ago by

NicDev

upvoted 2 articles 6 months ago

Article

RegMix: Data Mixture as Regression for Language Model Pre-training

•

Jul 11

• 10

Article

MInference 1.0: 10x Faster Million Context Inference with a Single GPU

•

Jul 11

• 12