Workflow : V2V - Create a new viewpoint angle from any video with CrossView Lora

#190
by RuneXX - opened

V2V - Create a new viewpoint angle from any video with CrossView Lora

Crossview lora from @Cseti acts as a virtual second camera: give it a reference video and a short camera-angle prompt, and it re-renders the same scene from the requested new viewpoint keeping the subject and content, changing where the camera stands.

The lora is at version 0.9 and proof-of concept. Results may vary but feel free to experiment and try it out ;-)

The default in the workflow is set to Distilled model for fast generations.
For better results do change to Dev model, and set the steps in first pass higher (try 15 or so), and CFG to 1,5-3. (easy to change this in the workflow)
Optionally also toggle the "Single Pass" switch at bottom of workflow

Download the lora from here:
https://huggingface.co/Cseti/LTX2.3-22B_IC-LoRA-CrossView-Prompt

Workflow:
https://huggingface.co/RuneXX/LTX-2.3-Workflows/tree/main/Video-2-Video

(also a workflow in the repo of the lora)

He released another version with custom nodes that lets you control the camera across the entire clip! https://huggingface.co/Cseti/LTX2.3-22B_IC-LoRA-CrossView-Warp

He released another version with custom nodes that lets you control the camera across the entire clip! https://huggingface.co/Cseti/LTX2.3-22B_IC-LoRA-CrossView-Warp

Think he is making a new node as well, to make things even easier. Will check it out asap ; -)

Sign up or log in to comment