On this page

  • Compare a real result
  • Extract depth on the canvas
  • Recognize the result
  • Interpret the grayscale footage
  • Settings and recovery
  • Boundaries
  1. Home
  2. Academy
  3. Video Depth: Extract Spatial Structure from a Reference Video

Video Depth: Extract Spatial Structure from a Reference Video

Turn a reference clip into grayscale depth footage. Learn how to choose settings, recognize the result node and export it.

Musein Team·2026-11-05
VideoDepthReference

A depth video represents predicted relative distance through a sequence of grayscale frames. Use it to inspect silhouettes, occlusion and perspective changes when preparing spatial references for a creative project.

Compare a real result

The players below show the source and its completed depth output. Playing, pausing, seeking or changing playback speed in either player synchronizes the other. Pause and scrub through the clip to examine contours against the original.

Open the original video · Open the depth result

Both files in this example are 600×400, 24 fps, 141 frames and 5.875 seconds. These measurements describe this sample, rather than a guarantee for every input or output.

Extract depth on the canvas

  1. Upload a video or select an existing video node. Wait for the upload to finish.
  2. Click Extract Depth in the toolbar above the node.
  3. Choose an output resolution. Start with Auto; available choices come from the current model.
  4. Wait for the points estimate, then start processing. No prompt is needed. A single available model is selected automatically; a selector appears when several are available.
  5. A connected result node appears to the right of the original. When processing finishes, preview or download the video.

This walkthrough uses simulated points and local task states. It never submits a real generation or charges points. Its completed state displays the saved sample above: changing resolution in this demo does not re-encode that sample. Actual cost and timing come from the live canvas quote and task.

Recognize the result

The default title starts with Extract Depth ·, followed by the source title. A dedicated icon appears in its upper-left corner and type displays. The original remains on the canvas. Rename the result if useful, follow its connection to the source, and use the existing video playback, preview and download actions.

Interpret the grayscale footage

Check the brightness direction against known near and far objects in the original before comparing movement. Brightness represents predicted depth, not object color, source luminance or an exact distance in meters. Faces and clothing geometry may remain recognizable; depth output is not an anonymization method.

Settings and recovery

Resolution controls output size, not motion strength. Evaluate a short clip with Auto before requesting other sizes. If a quote fails, read the inline message and retry the quote; processing remains unavailable until it succeeds. A failed task can be retried from its result node. The demo includes a simulated failure so you can explore that state safely.

If the toolbar entry is missing, confirm that the video has finished uploading and a depth model is available to your account. For repeated failures, record the clip, settings and error rather than repeatedly submitting the same task.

Boundaries

The current service processes at most 2,400 frames. Test short clips first and do not assume an over-limit output covers an entire long input. Fast movement, occlusion, transparent or reflective surfaces can produce errors. Flicker and scale drift can occur. Depth footage does not provide skeleton keypoints, action labels, camera trajectories or a 3D reconstruction.

Open the canvas

Continue reading

Previous post

Director Workbench: Camera Blocking, Capture Preview, and Send Back

Use the Director 3D node to block actors, preview cameras, review saved frames, and confirm destructive actions before moving references back to the main canvas.

Next post

Video Parameters — Resolution, Duration, Model & More

Configure video generation settings including resolution, duration, audio, model variant, and advanced options.

01

Canvas Quick Start

Learn how to navigate the canvas, use the minimap, add nodes, and connect them into workflows.

02

Node Types Explained

A complete guide to every node type on the canvas and what each one is used for.

03

Node List Navigation

Use the node list to search, filter, rename, and locate nodes in large multi-step canvases.

04

Keyboard Shortcuts Reference

A complete list of keyboard shortcuts to speed up your workflow on the canvas.

05

Node Editing Essentials

Learn how to select, move, copy, delete, and organize nodes efficiently on the canvas.

06

Edit and Crop an Image

Crop, reposition, zoom, and resize an image directly from its canvas node.

07

Prompt Input Panel Guide

How to use the rich text prompt editor, @ mention references, and reference ordering on the canvas.

08

Prompt Mentions

Type @ inside the prompt box to insert numbered references and personal assets as structured mention tokens.

09

Undo and Redo — Snapshot History

How the canvas undo system works, what it tracks, and how to use it effectively.

10

History Browser

Review generated image, video, and audio results by project, then reopen or reuse them without leaving the canvas.

11

Node Preview & Reuse

Open a node result in a larger preview, inspect the prompt and parameters, then download or copy the details for reuse.

12

Aspect Ratio Lock — Canvas-Level Default

Set a default aspect ratio at the canvas level and lock it for all video generations.

13

Character Compliance — Portrait Consistency Check

Verify generated characters match an approved reference portrait for brand and campaign consistency.

14

Virtual Final Cut — Sequence Clip Preview

Combine multiple video clips into a sequential preview that plays one after another.

15

Director Workbench: Camera Blocking, Capture Preview, and Send Back

Use the Director 3D node to block actors, preview cameras, review saved frames, and confirm destructive actions before moving references back to the main canvas.

16

Video Depth: Extract Spatial Structure from a Reference Video

Turn a reference clip into grayscale depth footage. Learn how to choose settings, recognize the result node and export it.

17

Video Parameters — Resolution, Duration, Model & More

Configure video generation settings including resolution, duration, audio, model variant, and advanced options.

18

High Resolution Upscale

Upscale your images 2x or 4x with AI-powered detail enhancement.

19

Inpaint

Paint over areas of an image to regenerate them with new AI-generated content.

20

Erase

Quickly brush away unwanted content and let AI fill the gap automatically.

21

Create Nodes by Uploading Files

Upload a file from the Add Node menu, and the system automatically creates the matching node type.

22

Batch Download Resources

Select multiple nodes on the canvas and download all their resources as a single ZIP file.

23

Outpainting

Expand your image beyond its original borders with AI-generated content.

24

Background Cutout

Remove image backgrounds with one click and generate transparent PNGs.

25

Change Angle

Transform image perspective using 3D camera angle controls powered by AI.

26

Relight

Adjust lighting direction, color temperature, and intensity with real-time 3D preview.

27

Multi-View Grid

Generate a 3x3 storyboard grid with varied camera angles of the same scene.

28

Character Three-View

Generate front, side, and back views of a character with consistent style.

29

Face Three-View

Generate front, side, and back views of a character's face with consistent style.

30

Temporal Frame

Generate consistent video frames before or after a keyframe for animation pipelines.

31

Storyboard 25

Generate a 5x5 movie storyboard grid with consistent characters and mood.

32

Cinematic Relight

Apply auto color grading presets to achieve a one-click cinematic look.

33

Panorama

Extend the current scene image into a complete panoramic environment of the same location for immersive scene work and environment reference.

34

Grid Split

Split an image into a grid of sub-images for storyboard or comic layouts.

35

Rotate & Flip

Rotate and mirror images on the canvas with a live preview before applying.

36

Grid Reorder

Rearrange image cells by swapping their positions in the grid.

37

AI Copilot: How the Right-Side Chat Panel Drives Canvas Work

Use the real ChatPanel preview to understand how Copilot and Video Agent fit into canvas creation.

38

Agentic Pipeline: Automated Multi-Step Generation

Let AI plan and execute multi-step workflows with stage-by-stage review.

39

Batch Confirmation: Review Multiple Generations at Once

When multiple nodes generate simultaneously, review, approve, or reject them all in one place.

40

Team Collaboration

Create teams, switch between team workspaces, manage team points, and use sharing plus ownership transfer for collaboration handoff.

41

Multi-Canvas Management

Create, organize, and switch between multiple canvases in a single project.

42

Lens Combo: Professional Camera Control

Master camera body, lens, focal length, and aperture controls for film-making level shot management.

43

Style Selection

Browse and apply visual style presets for consistent image and video output.

44

Model Parameters & Dynamic Controls

Configure model-specific parameters with a dynamic UI that adapts to the selected model.

45

Node Auto Layout (ELK)

One-click canvas organization using the ELK layout engine. Auto-arrange connected nodes into clean pipelines.

46

Advanced Canvas Operations

Speed up complex workflows with multi-select actions, batch connections, and faster downstream node creation.

47

Alignment Guides

Show horizontal and vertical guides while dragging, then snap a node to nearby edges or centers when alignment is close enough.

48

Asset Management

Create, browse, and reuse assets across canvases. Organize your library by type, project, and date.

49

Asset Library Workflow

Organize reusable results into private or team folders, search quickly, and send saved assets back onto the canvas.

50

Share Canvas

Share canvases with teammates via links, publish as templates, or transfer ownership.

51

Canvas Collaboration

Open a shared canvas in a live review session, see who is in the room, and clone the work into your own workspace when you need to edit.

52

Ownership Transfer

Move projects between personal and team spaces so ownership follows the current collaboration scope.

53

Report Issue: Submit Product Feedback from the User Menu

Open the feedback form from the user profile dropdown to report bugs, attach screenshots, and review what you have already submitted.

54

Canvas Templates

Publish canvases as templates, browse the template library, and apply templates to new projects.

55

Template Browser

Browse template categories, preview a workflow, and apply it to the current canvas without rebuilding the structure manually.

56

Canvas Auto Recovery: Agentic Task Resumption

In-progress agentic generation tasks resume automatically after a page reload.

57

Team Member Quotas

Set monthly point limits for active teammates, review used/limit from the member list, and adjust quota policy without leaving team management.

58

Script Breakdown (Legacy): Review Characters and Scene-Based Shot Tables

Script Breakdown (Legacy) is best for character tables, scene-grouped shot tables, gallery review, and CSV export.

59

Segment Remake: Regenerate Only the Part That Needs Work

Select one or more non-overlapping ranges in a video node, describe each change, and create a new result node.

60

Arena Submission Guide: Register → Create → Submit

Walk through the full arena participation flow: register for an activity, create a project, produce your final cut in workspace, submit it, and browse the public submissions list.

Musein logo with wordmarkMusein logo with wordmark
WorkspaceTVAcademyAffiliate
CLIPricing

Join Discord

Join Discord QR code

Scan the QR code to join the Musein Discord community for updates and creator discussions.

Musein logo with wordmarkMusein logo with wordmark

Musein is the next-generation AI visual creation engine for businesses and creators. From e-commerce ads to cinematic short films and experimental art, Musein helps anyone create professional-grade visuals with AI.

Contact email: [email protected]

Product

  • Workspace
  • TV
  • Pricing

Resources

  • About
  • Blog
  • Affiliate
  • Support

© 2026 Musein All rights reserved.

Privacy PolicyTerms of Service