Marc Sun's picture

Marc Sun

marcsun13

·

AI & ML interests

LLM, Quantization, Training, Inference

Recent Activity

upvoted an article 5 days ago

Accelerate ND-Parallel: A Guide to Efficient Multi-GPU Training

new activity 5 days ago

openai/gpt-oss-20b:Don't think this works on 4090 with transformers, for me anyway

published an article 5 days ago

Accelerate ND-Parallel: A Guide to Efficient Multi-GPU Training

View all activity

Organizations

Articles 14

Article

37

Accelerate ND-Parallel: A Guide to Efficient Multi-GPU Training

Article

443

Welcome GPT OSS, the new open-source model family from OpenAI!

View all Articles

spaces 3

Training

Visualize project metrics with real-time updates

Trackio Cv Training

Visualize project metrics with real-time updates

Trackio Fake Training

Visualize project metrics with real-time updates

models 19

marcsun13/Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 4B • Updated Mar 20 • 3

marcsun13/phi-4-bnb-4bit

Text Generation • 8B • Updated Mar 18 • 2

marcsun13/Llama-3.2-1B-bnb-4bit

Text Generation • 0.8B • Updated Mar 18 • 4

marcsun13/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8

2B • Updated Feb 13 • 2

marcsun13/paligemma_vqav2

marcsun13/Meta-Llama-3-8B-torchao-int8_weight_only

Updated Oct 18, 2024 • 6

marcsun13/sft_openassistant-guanaco

Text Generation • 7B • Updated Jul 5, 2024 • 2

marcsun13/gemma-2-27b-it-bnb-colab

Text Generation • 17B • Updated Jul 4, 2024 • 2

marcsun13/gemma-2-9b-it-GPTQ

Text Generation • 2B • Updated Jul 3, 2024 • 1.07k • 3

marcsun13/test_push_checkpoint

Fill-Mask • 0.1B • Updated Jun 28, 2024 • 3

datasets 0

None public yet