Locally adaptive luminance and chrominance blending in a multiple imager video system
View Patent ↗A method for blending a left image with a right image along a seam is disclosed. The method comprises selecting collocated pixels from a collocated column of pixels in the left image and the right image; computing differences in the selected collocated pixels; and determining a correction amount to apply to seam pixels along the seam on a row-by-row basis based on the computed differences; and selectively applying the correction amount on a row-by-row basis to a neighborhood of pixels extending transversely across the seam and centered on seam.
1. A computer-implemented method for blending a left image with a right image along a seam, comprising:
selecting collocated pixels from a collocated column of pixels in the left image and the right image;
computing an intensity difference in the selected collocated pixels;
determining an intensity correction amount for each row along the seam based on the computed intensity difference to apply to seam pixels for each row along the seam; wherein the intensity difference is temporally filtered to keep it within a range; and
selectively applying the intensity correction amount on a row-by-row basis to a neighborhood of pixels extending transversely across the seam and centered on the seam, wherein for each row the intensity correction amount is applied with a linear gradient across a selected number of pixels given by a blend width;
the linear gradient is calculated as follows:
P
(
i
,
j
)
=
P
(
i
,
j
{
Δ
(
j
)
-
(
i
-
seam
)
blend
width
,
i
>
seam
AND
i
-
seam
blend
width
<
Δ
(
j
)
-
Δ
(
j
)
+
(
seam
-
i
)
blend
width
,
i
<
seam
AND
seam
-
i
blend
width
<
Δ
(
j
)
for j=1 . . . height; and i=seam±(Δ(j)*blend width).
2. The method of claim 1 , wherein computing the differences comprises computing differences in at least one of luminance and chrominance associated with the selected collocated pixels.
3. The method of claim 1 , wherein determining the correction amount comprises smoothing at least some of the computed differences based on a spatially adjacent correction.
4. The method of claim 1 , wherein determining the correction amount comprises smoothing a least some of the computed differences based on a temporally collocated correction.
5. The method of claim 1 , further comprising feathering the correction amount around pixels determined to be clipped.
6. A system for blending a left image with a right image along a seam, the system configured to:
select collocated pixels from a collocated column of pixels in the left image and the right image;
compute an intensity difference in the selected collocated pixels;
determine an intensity correction amount for each row along the seam based on the computed intensity difference to apply to seam pixels for each row along the seam; wherein the intensity difference is temporally filtered to keep it within a range; and
selectively apply the intensity correction amount on a row-by-row basis to a neighborhood of pixels extending transversely across the seam and centered on the seam, wherein for each row the intensity correction amount is applied with a linear gradient across a selected number of pixels given by a blend width;
the linear gradient is calculated as follows:
P
(
i
,
j
)
=
P
(
i
,
j
{
Δ
(
j
)
-
(
i
-
seam
)
blend
width
,
i
>
seam
AND
i
-
seam
blend
width
<
Δ
(
j
)
-
Δ
(
j
)
+
(
seam
-
i
)
blend
width
,
i
<
seam
AND
seam
-
i
blend
width
<
Δ
(
j
)
for j=1 . . . height; and i=seam±(Δ(j)*blend width).
7. The system of claim 6 , wherein computing the differences comprises computing differences in at least one of luminance and chrominance associated with the selected collocated pixels.
8. The system of claim 6 , wherein determining the correction amount comprises smoothing at least some of the computed differences based on a spatially adjacent correction.
9. The system of claim 6 , wherein determining the correction amount comprises smoothing a least some of the computed differences based on a temporally collocated correction.
10. The system of claim 6 , is further configured to feather the correction amount around pixels determined to be clipped.
11. A non-transitory computer-readable medium having stored thereon a sequence of instructions which when executed by a system causes the system to perform for a method for blending a left image with a right image along a seam, said method, comprising:
selecting collocated pixels from a collocated column of pixels in the left image and the right image;
computing an intensity difference in the selected collocated pixels;
determining an intensity correction amount for each row along the seam based on the computed intensity difference to apply to seam pixels for each row along the seam; wherein the intensity difference is temporally filtered to keep it within a range; and
selectively applying the intensity correction amount on a row-by-row basis to a neighborhood of pixels extending transversely across the seam and centered on the seam, wherein for each row the intensity correction amount is applied with a linear gradient across a selected number of pixels given by a blend width;
the linear gradient is calculated as follows:
P
(
i
,
j
)
=
P
(
i
,
j
{
Δ
(
j
)
-
(
i
-
seam
)
blend
width
,
i
>
seam
AND
i
-
seam
blend
width
<
Δ
(
j
)
-
Δ
(
j
)
+
(
seam
-
i
)
blend
width
,
i
<
seam
AND
seam
-
i
blend
width
<
Δ
(
j
)
for j=1 . . . height; and i=seam±(Δ(j)*blend width).
12. The computer-readable medium of claim 11 , wherein computing the differences comprises computing differences in at least one of luminance and chrominance associated with the selected collocated pixels.
13. The computer-readable medium of claim 11 , wherein determining the correction amount comprises smoothing at least some of the computed differences based on a spatially adjacent correction.
14. The computer-readable medium of claim 11 , wherein determining the correction amount comprises smoothing a least some of the computed differences based on a temporally collocated correction.