tb_lf_epi_slope — 2D typed op

• 数据种类:lightfield → image

• 调用:fullseye.apply(img, "tb_lf_epi_slope", a=0.5, b=0.5)(2-D 的模型是一张图 + 两个标量旋钮 a,b∈[0,1])

• GPU:无(仅 CPU 参考实现)

tb_lf_epi_slope: input → output

*图为在 128×128 合成输入上实际运行的输出。左为输入,右为输出。点云以俯视散点显示(亮度 = z),一维序列为折线,体数据为沿 z 的最大值投影,视频为中间帧,复数图像为幅值;无法成像的返回值直接显示数值。*

*旋钮 a 不改变输出(实测: 0.1 / 0.5 / 0.9 相同)。*

*旋钮 b 不改变输出(实测: 0.1 / 0.5 / 0.9 相同)。*

阶段(前置算子 → 本算子,从左到右):

▸ tb_lf_epi_slope: 处理阶段 (文档网站)

换别的图像(合成场景 / 照片 / 硬币。上排为输入,下排为对应输出。旋钮取默认):

▸ tb_lf_epi_slope: 其他输入图像 (文档网站)

用法

由 EPI 线的方向得到逐像素斜率(结构张量,再用剪切细化)。

> 以下的详细说明为原文 —— 摘要与标题已翻译。

A scene point traces a straight line in the epipolar-plane image (lf_epi), so along that line the intensity is constant:

E_u + s * E_x = 0. Accumulating that constraint over the whole angular grid and a window x window spatial neighbourhood gives the closed-form least-squares slope s = -(J_ux + J_vy) / (J_xx + J_yy) with J_ab = sum(E_a * E_b) — both the horizontal and vertical EPI directions pooled.

Why it is iterated (fixed 2026-11-03). A finite difference across views measures a displacement of s px per view, while a finite difference across pixels measures one of 1 px; for a texture component of angular frequency w the ratio is sin(w s) / sin(w) (the pre-fix central differences), equal to s only at |s| in {0, 1}. That is the classic statement that the structure tensor is accurate only for disparities in a small range around zero (Wanner & Goldluecke, CVPR 2012 and TPAMI 36(3) 2014, who handle larger ranges by shearing the light field). So the estimator shears the field by an integer slope k (integer shifts: no resampling blur), measures the residual r = s - k, sets k <- round(k + r) per pixel and repeats until no pixel changes (at most EPI_MAX_ROUNDS rounds, at most EPI_MAX_SHEARS distinct shears). The residual is measured with a matched discretisation (adjacent-view difference against the mean of the two views' Gaussian derivatives, inner scale EPI_INNER_SIGMA), whose error is O(r^3 w^2) with |r| <= 1/2.

Measured 2026-11-03, median over the interior of single-layer lf_synthesize fields (64x64, edge="wrap"), s in [-3, 3] in steps of 0.25: error <= 0.006 px for 5x5 and 9x9 views, <= 0.007 px for 4x4 (even count) and <= 0.012 px for 3x3 and for a single row of 6 views, at texture sigma 1.0 / 1.5 / 2.0 / 5.0 px, for windows 5 / 9 / 15 (the pre-fix estimator read -1.388 for -1.5 at sigma 2 and 1.46 for 2.0 at sigma 1.5). Integer slopes are exact to 1e-9 on a wrapped field. Valid range: the shear ladder starts at k = 0, so the first pass must see the right sign and a non-vanishing magnitude: that holds for |s| <= 3 at any texture correlation length >= 1 px, and (measured) up to |s| = 8 at sigma >= 2; at sigma 1 it fails beyond |s| = 5 (s = 6 read as 0.25 — the texture is aliased: it moves more than its correlation length several times per view). Near an occlusion boundary the window mixes two slopes (no estimator of a single orientation per window can avoid that). With edge="nearest" input the outer |k|*(N-1)/2 px of the frame see clamped border pixels.

Returns (slope_map, energy): the (H, W) slope map (centre-view coordinates) and the (H, W) gradient energy J_xx + J_yy of the unsheared field (the first pass's denominator). Pixels whose energy is below *min_energy* have no measurable parallax (a flat patch of sky); their slope is set to 0 and their energy reported as-is, so you threshold on energy instead of being handed a plausible-looking number divided by ~0.

Raises ValueError: *lf* not a valid light field, an angular/spatial shape where *neither* EPI direction carries information (the horizontal EPI needs U >= 2 and W >= 2, the vertical needs V >= 2 and H >= 2), an even or non-positive *window*, a non-positive *min_energy*.

Typed bridge of the lightfield op lf_epi_slope into the 2-D evolution registry: the same implementation, called under the op(v, a, b) convention. This op has no tunable parameter; a and b are unused.

参考(示例数据、文献)

• 示例数据目录(下载 URL / 许可证) —— 2-D 用 skimage.data(BSD/公有领域)加合成图,3-D 给出真实数据源(Stanford/PDS 等)的下载 URL。

• 算子来历与参考文献 —— 该算子族所依据的研究/方法出处。

在 Studio 中试试

下面的程序已确认可以运行(与图相同的输入)。在 Studio 帮助中,此块会变成按钮,可当场加载并运行。

img_to_lightfield 0.50 0.50
tb_lf_epi_slope 0.50 0.50

▸ 载入此流水线  ·  载入并运行

可运行的示例(实际调用该算子并已验证的样例)

下面的示例调用的是底层账本算子 lf_epi_slope。此桥接算子只是把同一实现适配为 fn(v, a, b) 约定,行为完全相同(只是调用形式不同)。

• lightfield_depth — py -3.11 examples/lightfield_depth.py

• poc_lightfield_depth — py -3.11 examples/poc_lightfield_depth.py

类型可衔接的下一个算子(可接受 image 作为输入)

identity · gaussian · mean_box · mean_box_wh · bilateral · kuwahara · unsharp · median

同类别(typed)

tb_points_to_voxel · tb_estimate_point_normals · tb_iss_keypoints · tb_project_points · tb_render_point_depth · tb_points_render · tb_statistical_outlier_removal · tb_radius_outlier_removal


*Provenance: ops.py — 2D 算子登记表。本条目由 tools/opdocs.py md 自动生成(请勿手工编辑)。*

© 2026 Kazufumi Furuse — Fullseye operator documentation. Licensed under Apache-2.0.