Hugging Face's logo
Jerry Zhang's picture
11 3

Jerry Zhang

jerryzh168
medmekk's profile picture clem's profile picture
·

AI & ML interests

None yet

Recent Activity

updated a model 14 days ago
jerryzh168/Phi-4-mini-instruct-int4wo-awq
reacted to cbensimon's post with 🔥 14 days ago
🚀 ZeroGPU now supports PyTorch native quantization via `torchao` While it hasn’t been battle-tested yet, `Int8WeightOnlyConfig` is already working flawlessly in our tests. Let us know if you run into any issues — and we’re excited to see what the community will build! ```python import spaces from diffusers import FluxPipeline from torchao.quantization.quant_api import Int8WeightOnlyConfig, quantize_ pipeline = FluxPipeline.from_pretrained(...).to('cuda') quantize_(pipeline.transformer, Int8WeightOnlyConfig()) # Or any other component(s) @spaces.GPU def generate(prompt: str): return pipeline(prompt).images[0] ```
updated a model 17 days ago
jerryzh168/opt-125m-float8dq-row-0.13-dev
View all activity

Organizations

pytorch's profile picture