metadata

license: other
license_name: other
license_link: LICENSE
language:
  - en
base_model:
  - Lightricks/LTX-Video
pipeline_tag: text-to-video
tags:
  - text-to-video
  - image-to-video
  - video-to-video
  - ltx-video
  - ltxv
  - gguf-comfy
  - gguf-node
widget:
  - text: >-
      The turquoise waves crash against the dark, jagged rocks of the shore,
      sending white foam spraying into the air. The scene is dominated by the
      stark contrast between the bright blue water and the dark, almost black
      rocks. The water is a clear, turquoise color, and the waves are capped
      with white foam. The rocks are dark and jagged, and they are covered in
      patches of green moss. The shore is lined with lush green vegetation,
      including trees and bushes. In the background, there are rolling hills
      covered in dense forest. The sky is cloudy, and the light is dim.
    output:
      url: samples\ComfyUI_00003_.webp
  - text: >-
      The camera pans across a cityscape of tall buildings with a circular
      building in the center. The camera moves from left to right, showing the
      tops of the buildings and the circular building in the center. The
      buildings are various shades of gray and white, and the circular building
      has a green roof. The camera angle is high, looking down at the city. The
      lighting is bright, with the sun shining from the upper left, casting
      shadows from the buildings. The scene is computer-generated imagery.
    output:
      url: samples\ComfyUI_00002_.webp
  - text: >-
      Drone view of waves crashing against the rugged cliffs along Big Sur’s
      garay point beach. The crashing blue waters create white-tipped waves,
      while the golden light of the setting sun illuminates the rocky shore. A
      small island with a lighthouse sits in the distance, and green shrubbery
      covers the cliff’s edge. The steep drop from the road down to the beach is
      a dramatic feat, with the cliff’s edges jutting out over the sea. This is
      a view that captures the raw beauty of the coast and the rugged landscape
      of the Pacific Coast Highway.
    output:
      url: samples\ComfyUI_00001_.webp

GGUF quantized and fp8 scaled versions of LTX-Video

setup (once)

drag ltx-video-2b-v0.9.1-q4_0.gguf (1.09GB) to > ./ComfyUI/models/diffusion_models
drag t5xxl_fp8_e4m3fn.safetensors (4.89GB) to > ./ComfyUI/models/text_encoders
drag ltx-video-vae.safetensors (838MB) to > ./ComfyUI/models/vae

run it straight (no installation needed way)

run the .bat file in the main directory (assuming you are using the gguf-comfy pack below)
drag the workflow json file (below) to > your browser

workflow

example workflow for gguf (see demo above)
example workflow for the original safetensors

review

q2_k gguf is super fast but not usable; keep it for testing only
0.9.1_fp8_e4m3fn and 0.9.1-vae_fp8_e4m3fn are not working; but keep them here, see who can figure out how to make them work
by the way, 0.9_fp8_e4m3fn and 0.9-vae_fp8_e4m3fn are working pretty good
mix-and-match possible; you could mix up using the vae(s) available with different model file(s) here; test which combination works better
gguf-node is available (see details here) for running the new features (the point below might not directly related to the model)
you are able to make your own fp8_e4m3fn scaled safetensors and/or convert it to gguf with the new node via comfyui

reference

base model from lightricks
comfyui from comfyanonymous
comfyui-gguf from city96
gguf-comfy pack
gguf-node (pypi|repo|pack)

Prompt
The turquoise waves crash against the dark, jagged rocks of the shore, sending white foam spraying into the air. The scene is dominated by the stark contrast between the bright blue water and the dark, almost black rocks. The water is a clear, turquoise color, and the waves are capped with white foam. The rocks are dark and jagged, and they are covered in patches of green moss. The shore is lined with lush green vegetation, including trees and bushes. In the background, there are rolling hills covered in dense forest. The sky is cloudy, and the light is dim.

Prompt
The camera pans across a cityscape of tall buildings with a circular building in the center. The camera moves from left to right, showing the tops of the buildings and the circular building in the center. The buildings are various shades of gray and white, and the circular building has a green roof. The camera angle is high, looking down at the city. The lighting is bright, with the sun shining from the upper left, casting shadows from the buildings. The scene is computer-generated imagery.

Prompt
Drone view of waves crashing against the rugged cliffs along Big Sur’s garay point beach. The crashing blue waters create white-tipped waves, while the golden light of the setting sun illuminates the rocky shore. A small island with a lighthouse sits in the distance, and green shrubbery covers the cliff’s edge. The steep drop from the road down to the beach is a dramatic feat, with the cliff’s edges jutting out over the sea. This is a view that captures the raw beauty of the coast and the rugged landscape of the Pacific Coast Highway.