README.md

---
license: apache-2.0
language:
- en
base_model:
- genmo/mochi-1-preview
pipeline_tag: text-to-video
tags:
- mochi
- t5
- gguf-comfy
- gguf-node
widget:
- text: >-
    a fox moving quickly in a beautiful winter scenery nature trees sunset
    tracking camera
  output:
    url: samples\ComfyUI_00001_.webp
- text: same prompt as 1st one <metadata inside>
  output:
    url: samples\ComfyUI_00002_.webp
- text: same prompt as 1st one; but with new workflow to bypass oom <metadata inside>
  output:
    url: samples\ComfyUI_00003_.webp
---

# **gguf quantized version of mochi (test pack for gguf-node)**

![screenshot](https://raw.githubusercontent.com/calcuis/comfy/master/mochi.gif)

## **setup (once)**
- drag mochi-q3_k_m.gguf [[4.31GB](https://huggingface.co/calcuis/mochi/blob/main/mochi-q3_k_m.gguf)] to > ./ComfyUI/models/diffusion_models
- drag t5xxl_fp16-q4_0.gguf [[2.9GB](https://huggingface.co/calcuis/mochi/blob/main/t5xxl_fp16-q4_0.gguf)] to > ./ComfyUI/models/text_encoders
- drag mochi_vae_fp8_e4m3fn.safetensors [[460MB](https://huggingface.co/calcuis/mochi/blob/main/mochi_vae_fp8_e4m3fn.safetensors)] to > ./ComfyUI/models/vae

## **run it straight (no installation needed way)**
- run the .bat file in the main directory (assuming you are using the gguf-node pack below)
- drag the workflow json file (below) to > your browser

### **workflow**
- example workflow (with [gguf](https://huggingface.co/calcuis/mochi/blob/main/workflow-mochi-gguf.json) encoder)
- example workflow ([safetensors](https://huggingface.co/calcuis/mochi/blob/main/workflow-mochi-safetensors.json))

### **review**
- revised workflow to bypass oom issue and around 50% faster with the new fp8_e4m3fn file
- t5xxl works fine as text encoder; more quantized versions of t5xxl can be found [here](https://huggingface.co/chatpig/t5xxl/tree/main)
- gguf with pig architecture is working right away; welcome to test

### **reference**
- base model from [genmo](https://huggingface.co/genmo/mochi-1-preview)
- pig architecture from [connector](https://huggingface.co/connector)
- comfyui from [comfyanonymous](https://github.com/comfyanonymous/ComfyUI)
- gguf-node ([pypi](https://pypi.org/project/gguf-node)|[repo](https://github.com/calcuis/gguf)|[pack](https://github.com/calcuis/gguf/releases))

### prompt test#
![screenshot](https://raw.githubusercontent.com/calcuis/comfy/master/mochi.webp)
prompt: "a fox moving quickly in a beautiful winter scenery nature trees sunset tracking camera"

<Gallery />