Text-to-Video
GGUF
English
hyvid
lora
gguf-comfy
gguf-node
hyvid / README.md
calcuis's picture
Update README.md
719bf91 verified
|
raw
history blame
4.9 kB
metadata
license: mit
license_name: tencent-hunyuan-community
license_link: LICENSE
datasets:
  - trojblue/test-HunyuanVideo-anime-images
  - calcuis/anime-descriptor
language:
  - en
base_model:
  - tencent/HunyuanVideo
  - trojblue/HunyuanVideo-lora-AnimeShots
pipeline_tag: text-to-video
tags:
  - hyvid
  - lora
  - gguf-comfy
  - gguf-node
widget:
  - text: >-
      anime style anime girl with massive fennec ears and one big fluffy tail,
      she has blonde long hair blue eyes wearing a maid outfit with a long black
      gold leaf pattern dress, walking slowly to the front with sweetie smile,
      holding a fancy black forest cake with candles on top in the kitchen of an
      old dark Victorian mansion lit by candlelight with a bright window to the
      foggy
    output:
      url: samples\ComfyUI_00007_.webp
  - text: >-
      anime scene of a vibrant carnival with colorful rides, games, and food
      stalls, and a cute anime girl with multicolored hair, holding a melting
      ice-cream, wearing a fluffy white hoodie and blue mini shorts, winking her
      eye, smiling to the camera
    output:
      url: samples\ComfyUI_00002_.webp
  - text: >-
      anime girl with pink twin tails and green eyes, wearing a school uniform,
      holding a stack of books in a bustling library filled with sunlight
      streaming through tall windows
    output:
      url: samples\ComfyUI_00001_.webp
  - text: >-
      anime boy with silver hair and blue eyes, wearing a casual hoodie, sitting
      on a park bench, feeding pigeons with a gentle smile
    output:
      url: samples\ComfyUI_00003_.webp
  - text: >-
      anime style anime girl with massive fennec ears and one big fluffy tail,
      she has blonde long hair blue eyes wearing a maid outfit with a long black
      gold leaf pattern dress, walking slowly to the front with sweetie smile,
      holding a fancy black forest cake with candles on top in the kitchen of an
      old dark Victorian mansion lit by candlelight with a bright window to the
      foggy forest
    output:
      url: samples\ComfyUI_00004_.webp
  - text: >-
      anime style anime girl with massive fennec ears and one big fluffy tail,
      she has blonde hair long hair blue eyes wearing a pink sweater and a long
      blue skirt walking in a beautiful outdoor scenery with snow mountains in
      the background
    output:
      url: samples\ComfyUI_00005_.webp

GGUF quantized and fp8 scaled version of hyvid with lora anime adapter

Prompt
anime style anime girl with massive fennec ears and one big fluffy tail, she has blonde long hair blue eyes wearing a maid outfit with a long black gold leaf pattern dress, walking slowly to the front with sweetie smile, holding a fancy black forest cake with candles on top in the kitchen of an old dark Victorian mansion lit by candlelight with a bright window to the foggy
Prompt
anime scene of a vibrant carnival with colorful rides, games, and food stalls, and a cute anime girl with multicolored hair, holding a melting ice-cream, wearing a fluffy white hoodie and blue mini shorts, winking her eye, smiling to the camera
Prompt
anime girl with pink twin tails and green eyes, wearing a school uniform, holding a stack of books in a bustling library filled with sunlight streaming through tall windows
Prompt
anime boy with silver hair and blue eyes, wearing a casual hoodie, sitting on a park bench, feeding pigeons with a gentle smile
Prompt
anime style anime girl with massive fennec ears and one big fluffy tail, she has blonde long hair blue eyes wearing a maid outfit with a long black gold leaf pattern dress, walking slowly to the front with sweetie smile, holding a fancy black forest cake with candles on top in the kitchen of an old dark Victorian mansion lit by candlelight with a bright window to the foggy forest
Prompt
anime style anime girl with massive fennec ears and one big fluffy tail, she has blonde hair long hair blue eyes wearing a pink sweater and a long blue skirt walking in a beautiful outdoor scenery with snow mountains in the background

screenshot

Setup (once)

  • drag hyvid_lora_adapter.safetensors [323MB] to > ./ComfyUI/models/loras
  • drag hunyuan-video-t2v-720p-q4_0.gguf [7.74GB] to > ./ComfyUI/models/diffusion_models
  • drag llava_llama3-q4_0.gguf [4.68GB] to > ./ComfyUI/models/text_encoders
  • drag clip_l_fp8_e4m3fn.safetensors [123MB] to > ./ComfyUI/models/text_encoders
  • drag hunyuan_video_vae_fp8_e4m3fn.safetensors [247MB] to > ./ComfyUI/models/vae

Run it straight (no installation needed way)

  • run the .bat file in the main directory (assuming you are using the gguf-node pack below)
  • drag the demo clip or the workflow json file (below) to > your browser

Workflows

  • example workflow for gguf (upgrade your node for llava gguf support)
  • example workflow for safetensors (fp8 scaled version [13.2GB] is recommended)

References

Appendices

  • get more test prompt from the training dataset
  • still no ideas? get fresh prompt from our simulator