Instructions to use RuneXX/LTX-2-Workflows with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LTX.io
How to use RuneXX/LTX-2-Workflows with LTX.io:
# Install the LTX-2 pipelines git clone https://github.com/Lightricks/LTX-2.git cd LTX-2 uv sync --frozen
# Download the weights from this repo, plus the Gemma text encoder hf download RuneXX/LTX-2-Workflows --local-dir models/LTX-2-Workflows hf download google/gemma-3-12b-it-qat-q4_0-unquantized --local-dir models/gemma-3-12b
# Fast pipeline (distilled model, no distilled LoRA needed) uv run python -m ltx_pipelines.distilled \ --distilled-checkpoint-path models/LTX-2-Workflows/<distilled-checkpoint>.safetensors \ --spatial-upsampler-path models/LTX-2-Workflows/<spatial-upsampler>.safetensors \ --gemma-root models/gemma-3-12b \ --prompt "A beautiful sunset over the ocean" \ --output-path output.mp4 # For image-to-video, add: --image path/to/image.jpg 0 0.8# HQ pipeline (two-stage, higher quality) uv run python -m ltx_pipelines.ti2vid_two_stages_hq \ --checkpoint-path models/LTX-2-Workflows/<checkpoint>.safetensors \ --distilled-lora models/LTX-2-Workflows/<distilled-lora>.safetensors 0.8 \ --spatial-upsampler-path models/LTX-2-Workflows/<spatial-upsampler>.safetensors \ --gemma-root models/gemma-3-12b \ --prompt "A beautiful sunset over the ocean" \ --output-path output.mp4 # For image-to-video, add: --image path/to/image.jpg 0 0.8 - Notebooks
- Google Colab
- Kaggle
masked guide frames?
#13
by Soykaf - opened
Asking this here since I really like your workflows and you seem pretty knowledgeable about these things.
Do you know if it's possible to use image masks on guide frames? The goal would be to tell the model "This specific area of this frame needs to look like this". instead of using whole frames as guides. Maybe it's not technically possible, but it would be useful to keep certain areas of the video more coherent while letting the model stay creative in the other parts of the frame.
Not sure, but interesting concept ;-) will try some and see if that could work