Black Mixture's Advanced WAN2.1 (Video-to-Video Workflow with Depth Control)

Hey Black Mixture Fam! 👋🏾 Here's our latest ComfyUI workflow featuring advanced Video-to-Video generation with depth map control for unprecedented motion stability and creative control. This workflow builds on our previous WAN2.1 release but takes video generation to the next level.

👉Get more WAN 2.1 workflows here:
https://www.patreon.com/posts/create-amazing-1-124383647

📥 Model Downloads

 Required Models & Installation
Place these files in their respective directories:

⚠️ IMPORTANT: Make sure to use the wan2.1_t2v_1.3B model for this workflow.

🔹 WAN2.1 Diffusion Models (1.3B version)
🔗 https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/tree/main/split_files/diffusion_models
📂 ComfyUI/models/diffusion_models

🔹 Text Encoder Model
🔗 https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/tree/main/split_files/text_encoders
📂 ComfyUI/models/text_encoders

🔹 VAE Model
🔗 https://huggingface.co/Comfy-Org/Wan_2.1_ComfyUI_repackaged/blob/main/split_files/vae/wan_2.1_vae.safetensors
📂 ComfyUI/models/vae

🔹 Wan2.1-1.3b-control-lora-depth (NEW!)
🔗 https://huggingface.co/spacepxl/Wan2.1-control-loras/tree/main/1.3b/depth
📂 ComfyUI/models/lora

✨ Features

• Transform videos with precise control using depth maps

• Apply creative styles while maintaining motion coherence

• Preserve spatial relationships and scene structure from original videos

• Generate motion-consistent results even with dramatic style changes

• Multiple quality settings (Low, Great, Max Quality) │Generation times on RTX 4090 GPU⤵

  • Low (~8 minutes)

  • Great (~15 minutes)

  • Max (~30 minutes)

• Depth-aware motion control options

• Video frame interpolation for smoother results

• Support for various input video format

🎨 Workflow Sections

Each workflow is color-coded for easy navigation:

🟥 STEP 1: LOAD MODELS - Set up required model components
🟨 STEP 2: LOAD VIDEO + PROMPT - Load your source video and add prompts
🟦 STEP 3: VIDEO GENERATION SETTINGS - Configure quality, dimensions, and sampling
🟩 STEP 4: SAVE VIDEO - Save and export your results
🟪 HELP & INFO - Support resources and requirements

🛠️ Additional Settings Explained

• Quality Settings: Choose between 1-LOW (FAST), 2-GREAT (MID), or 3-MAX (SLOW)

• Image Orientation: Select between 1-PORTRAIT or 2-LANDSCAPE

• Video Dimensions: Customize width and height (default: 496×768 for portrait, 768×432 for landscape)

• Upscale Image: Option to enhance resolution

• KSampler Settings: Fine-tune generation parameters with included presets

• Depth Control: Adjust strength_model parameter (default: 1.00) to control depth influence

⚙️ Quick Start

• Update ComfyUI to the latest version

• Download and place all required models in their respective directories:

• Ensure you're using the wan2.1_t2v_1.3B model

• Place the Wan2.1-1.3b-control-lora-depth files in the lora folder (NEW!)

• Install missing custom nodes nodes

• Load your models, video, and prompt

• Configure settings and generate!

🔧 PICK YOUR ADD-ONS

The workflow includes optional add-ons you can enable:

• Save Depth Map Video - Output the generated depth maps

• 2x Video Frame Interpolation - Double your frames for smoother playback

• Patch Super Resolution KL - Enhance resolution quality

💡 Important Notes

• Ensure all models are placed in correct directories

• Update ComfyUI before using these workflows

• Check GPU memory requirements

• Join our Discord for support and updates

• Use short, simple prompts for best results (example from workflow: "A woman walks on a fashion runway wearing a red hoodie and jeans.")

• The "depth_anything" model is included in the workflow (should auto download on first run) for depth map generation

• You can enable optional Video Frame Interpolation for smoother results

• Compatible with both portrait and landscape orientations with preset dimensions

• This workflow is new and highly experimental! Quality improvements will be coming soon so check back here or on our Discord for updates.

Created by Nate Dwarika from The Black Mixture Team

💝 HUGE Thanks to all of our amazing Patreon supporters!