Pretty new to building workflows:

- Wan 2.2 + VACE fun (its not fun) + depth anything (no posenet or masking).

This one took me a while.. almost broke my monitor in the process.. and had to customize a wanvideowrapper node to get this.

I wanted something that would adhere to a control video but wouldn't overpower the reference image or the diffusion model's creative freedom

I'm trying to solve for memory caps, can only do 4 seconds (1536x904 resolution), even with 96gb of ram.. I'm pretty sure I should definitely be able to get longer? Is there a way to purge vram/ram between high and low noise passes? And lightning loras don't seem to work.. lol not sure..

... if anyone has discord/community to solve this kind of stuff, I would probably be down to join.

  • Looks pretty solid to me. I've also had these issues before, and once you solve them the next issue is getting a longer video. 4/5 seconds just ain't cutting it. I think once AI can squeeze out a really good 30 seconds, we'll be in better shape.

    parent

  • Is there a way to purge vram/ram between high and low noise passes

    Try running comfyui with "python main.py --disable-smart-memory", which tell it not cache the models.

    parent

  • Everyday I pray for a soul to port VACE to 2.2 (NOT VACE Fun)

    I appreciate that somebody made a genuine attempt with VACE Fun... but they should have named it VACE FU

    parent

  • Man if you use something like Daz or iclone they have massive library of objects you could just put in and have full control of AI gen vid. Thats wild.

    Edit:
    Wait I guess Unreal has a huge library as well but something like Daz would make it super easy.

    parent

    For example?

    parent root

  • hey! i have been working on something similar for a client project - always looking for extra help to iterate and explore, feel free to DM me if that sounds interesting!

    parent

  • You will get the best similarity if you use the native resolution of 1280x720 for 16:9, which will allow you to add frames to the processing batch. Also add the flags --cache-none --lowvram --disable-smart-memory

    parent

  • Why not do smaller resolution then upscale? I think yes there are unload model nodes that can do that.

    parent

  • it still wants to drag your character off script at the end there, I hope we can get this fixed

    parent