video_spacetime_cube — VIDEOCUBE cube op

• Data kinds: video → voxel

• Call: import fullseye as fs; fs.ledger.video_spacetime_cube(video, mode: 'str' = 'motion', sigma: 'float' = 1.0, percentile: 'float' = 99.5, floor: 'float' = 0.15) -> 'np.ndarray' (to call the implementation directly, import videocube; videocube.video_spacetime_cube(video, mode: 'str' = 'motion', sigma: 'float' = 1.0, percentile: 'float' = 99.5, floor: 'float' = 0.15) -> 'np.ndarray'; from the registry, opsvideocube.get("video_spacetime_cube"))

Usage

Turns a video (T, H, W) into a space × time cube (T, H, W) float [0, 1] (voxel).

mode="motion": the magnitude of the difference between adjacent frames |I_t − I_{t−1}| is smoothed spatially with a Gaussian of σ = sigma, normalised to 1 at the percentile quantile, values under floor dropped to 0, and stretched to [0, 1] (the first frame is 0; differences from sensor noise sink below the floor). Only moving objects stand out, so it becomes the opacity of vol_render_transfer -- the static background turns transparent and the trajectories emerge (Summagator's transfer function). mode="intensity": brightness normalised to [0, 1] (source of colour, or for laying the background down faintly). mode="dark" / "bright": makes dark / bright places opaque (smoothed with σ, below floor is 0). For viewing not a video but a z stack (serial EM sections: membranes are dark; fluorescence: cells are bright) as the same cube -- just by reading the first axis as depth rather than time, sections (video_cube_cut) and rotation (video_cube_orbit) work with the same ops.

>>> alpha = video_spacetime_cube(clip, "motion")

>>> color = video_spacetime_cube(clip, "intensity")

>>> rgb = vol_render_transfer(alpha, color, yaw=35.0, pitch=25.0)

>>> membranes = video_spacetime_cube(em_stack, "dark", sigma=1.0) # a cube of stacked sections of a fly brain

Detailed usage guide

• videocube family guide

References (sample data, literature)

• Sample-data catalog (download URLs / licences) — 2-D uses skimage.data (BSD/public domain) plus synthetic images; 3-D lists download URLs for real data sources (Stanford, PDS, …).

• Operator provenance and references — the sources of the research/methods this op family came from.

• The canonical algorithm (author, year) and its uses are named in the family usage guide above.

Runnable examples (verified samples that actually call this op)

• poc_video_cube — py -3.11 examples/poc_video_cube.py

Ops the type connects to (they accept voxel as input)

vol_render_transfer

Same category (cube)

video_cube_cut


*Provenance: videocube.py — VIDEOCUBE operator registry. This per-op note is generated by tools/opdocs.py md (do not hand-edit).*

© 2026 Kazufumi Furuse — Fullseye operator documentation. Licensed under Apache-2.0.