--- license: apache-2.0 language: - en base_model: - genmo/mochi-1-preview pipeline_tag: text-to-video tags: - mochi - t5 - gguf-comfy - gguf-node widget: - text: >- a fox moving quickly in a beautiful winter scenery nature trees sunset tracking camera output: url: samples\ComfyUI_00001_.webp - text: same prompt as 1st one output: url: samples\ComfyUI_00002_.webp - text: same prompt as 1st one; but with new workflow to bypass oom output: url: samples\ComfyUI_00003_.webp --- # **gguf quantized version of t5xxl encoder with mochi (test pack revised)** ![screenshot](https://raw.githubusercontent.com/calcuis/comfy/master/mochi.gif) ## **setup (once)** - drag mochi_fp8_e4m3fn.safetensors ([10GB](https://huggingface.co/calcuis/mochi/blob/main/mochi_fp8_e4m3fn.safetensors)) to > ./ComfyUI/models/diffusion_models - drag t5xxl_fp16-q4_0.gguf ([2.9GB](https://huggingface.co/calcuis/mochi/blob/main/t5xxl_fp16-q4_0.gguf)) to > ./ComfyUI/models/text_encoders - drag mochi_vae_fp8_e4m3fn.safetensors ([460MB](https://huggingface.co/calcuis/mochi/blob/main/mochi_vae_fp8_e4m3fn.safetensors)) to > ./ComfyUI/models/vae ## **run it straight (no installation needed way)** - run the .bat file in the main directory (assuming you are using the gguf-node pack below) - drag the workflow json file (below) to > your browser ### **workflow** - example workflow (with [gguf](https://huggingface.co/calcuis/mochi/blob/main/workflow-mochi-gguf.json) encoder) - example workflow ([safetensors](https://huggingface.co/calcuis/mochi/blob/main/workflow-mochi-safetensors.json)) ### **review** - revised workflow to bypass oom issue and around 50% faster with the new fp8_e4m3fn file - t5xxl gguf works fine as text encoder - model gguf file might not work; if so, please wait for the code update ### **reference** - base model from [genmo](https://huggingface.co/genmo/mochi-1-preview) - comfyui from [comfyanonymous](https://github.com/comfyanonymous/ComfyUI) - comfyui-gguf [city96](https://github.com/city96/ComfyUI-GGUF) - gguf-comfy [pack](https://github.com/calcuis/gguf-comfy/releases) - gguf-node ([pypi](https://pypi.org/project/gguf-node)|[repo](https://github.com/calcuis/gguf)|[pack](https://github.com/calcuis/gguf/releases)) ### prompt test# ![screenshot](https://raw.githubusercontent.com/calcuis/comfy/master/mochi.webp) prompt: "a fox moving quickly in a beautiful winter scenery nature trees sunset tracking camera"