Stereo 3D video support in computing devices
View Patent ↗Methods are disclosed for supporting stereo 3D video in computing devices. A computing device can receive stereo 3D video data employing a YUV color space and chroma subsampling, and can generate anaglyph video data therefrom. The anaglyph video data can be generated by unpacking the stereo 3D video data to left and right views and combining the left and right views into a single view via matrix transformation. The combining uses transform matrices that correspond to a video pipeline configuration. The transform matrix coefficients can depend on characteristics of the video pipeline components. Modified transform matrix coefficients can be used in response to changes in the video pipeline configuration. Video encoded in stereo 3D video data can be selected to be displayed in stereo 3D, anaglyph or monoscopic form, depending on user input and/or characteristics of video pipeline components.
1. A method of displaying anaglyph video in place of stereo 3D video, the method comprising:
receiving via a video pipeline, stereo 3D video data employing a YUV color space, wherein the video pipeline comprises a plurality of video pipeline components, wherein the plurality of video pipeline components comprise at least a video processor and a display;
using a computing device, generating anaglyph video data from the stereo 3D video data, the generating comprising:
unpacking the stereo 3D video data to a left view and a right view; and
combining the left view and the right view into a single view, the anaglyph video data comprising the single view, wherein:
the combining uses anaglyph transform matrices that correspond to a configuration of the plurality of video pipeline components associated with the received stereo 3D video data;
coefficients for the anaglyph transform matrices are selected based on one or more configuration characteristics associated with the plurality of video pipeline components, the one or more configuration characteristics including at least one of a chroma sampling scheme and a chroma sampling arrangement, and configuration characteristics of one or more of a video capture device, a display and/or viewing glasses; and
the resulting anaglyph video data has at least a minimum display aperture and a pixel aspect ratio to be displayed on the display; and
displaying video encoded in the stereo 3D video data in anaglyph form.
2. The method of claim 1 , comprising:
adjusting one or both of minimum display aperture and pixel aspect ratio associated with the received stereo 3D video data using the anaglyph transform matrices.
3. The method of claim 1 , wherein the anaglyph transform matrices include anaglyph transform matrix coefficients that depend on characteristics of components within the video pipeline.
4. The method of claim 3 , wherein the video encoded in the stereo 3D video data is displayed on a display and at least one of the anaglyph transform matrix coefficients depend on one or more characteristics of the following: the display, a video capture device used to capture the video encoded in the stereo 3D video data and anaglyph glasses used to view the display.
5. The method of claim 1 , the method further comprising:
receiving one or more modified anaglyph transform matrix coefficients in response to a change in the video pipeline configuration; and
generating the anaglyph video data using the one or more modified anaglyph transform matrix coefficients.
6. The method of claim 5 , wherein the change in the video pipeline configuration comprises a change in a display, a change in a video capture device or a change in anaglyph glasses.
7. The method of claim 5 , further comprising receiving the one or more modified anaglyph transform matrix coefficients from a component of the video pipeline.
8. The method of claim 7 , wherein the one or more modified anaglyph transform matrix coefficients are for use in generating anaglyph video data using a first color space and chroma sampling combination, the method further comprising transforming the one or more modified anaglyph transform matrix coefficients for use in generating anaglyph video data using a second color space and chroma sampling combination.
9. The method of claim 1 , wherein the stereo 3D video data employs 4:2:0 chroma subsampling and the anaglyph video data is generated using the following formula:
(
Y
0
Y
1
Y
2
Y
3
U
V
)
=
ML
(
YL
0
YL
1
YL
2
YL
3
UL
VL
)
+
MR
(
YR
0
YR
1
YR
2
YR
3
UR
LR
)
,
wherein YL0-YL3 are luma samples of the left view, UL and VL are chroma samples of the left view; YR0-YR3 are luma samples of the right view; UR and VR are chroma samples of the right view, Y0-Y3 are luma samples of the anaglyph video data; and U and V are chroma samples of the anaglyph video data; ML and MR are anaglyph transform matrices having the form
Mx
=
(
a
0
0
0
b
c
0
a
0
0
b
c
0
0
a
0
b
c
0
0
0
a
b
c
d
0
d
1
d
2
d
3
e
f
g
0
g
1
g
2
g
3
h
i
)
,
wherein a, b, c, d0-d3, e, f, g0-g3, h and i are anaglyph transform matrix coefficients.
10. The method of claim 1 , wherein the stereo 3D video data is encoded using 4:2:2 chroma subsampling and the anaglyph video data is generated using the following formula:
(
Y
0
Y
1
U
V
)
=
ML
(
YL
0
YL
1
UL
VL
)
+
MR
(
YR
0
YR
1
UR
VR
)
,
wherein YL0 and YL1 are luma samples of the left view, UL and VL are chroma samples of the left view, YR0and YR1 are luma samples of the right view, UR and VR are chroma samples of the right view, Y0 and Y1 are luma samples of the anaglyph video data, U and V are chroma samples of the anaglyph video data; and ML and MR are anaglyph transform matrices having the form:
Mx
=
(
a
0
b
c
0
a
b
c
d
0
d
1
e
f
g
0
g
1
h
i
)
,
wherein a, b, c d0, d1, e, f g0, g1, h and i are anaglyph transform matrix coefficients.
11. A method for selecting a video display format, the method comprising:
receiving via a video pipeline, stereo 3D video data employing a YUV color space at a computing device, wherein the video pipeline comprises a plurality of video pipeline components, wherein the plurality of video pipeline components comprise at least a video processor and a display;
selecting the video display format from at least two of the following formats: stereo 3D video, anaglyph video and monoscopic video, the selecting based on availability of at least one processing resource for processing the received stereo 3D video data into the selected video display format, wherein the availability is determined prior to the processing, and the processing is based on one or more configuration characteristics associated with the plurality of video pipeline components, wherein:
the one or more configuration characteristics including at least one of a chroma sampling scheme and a chroma sampling arrangement, and configuration characteristics of one or more of a video capture device, a display and/or viewing glasses; and
the resulting video data in the selected video display format has at least a minimum display aperture and a pixel aspect ratio to be displayed on the display; and
displaying video encoded in the stereo 3D video data in the selected video display format.
12. The method of claim 11 , wherein the selecting comprises selecting the video display format based on characteristics of components within a video pipeline.
13. The method of claim 11 , wherein the video encoded in the stereo 3D video data is displayed on a display and the selecting comprises selecting the video display format based on characteristics of the display.
14. The method of claim 11 , wherein the selecting comprises selecting the video display format based on whether the computing device is communicatively coupled to 3D viewing glasses.
15. The method of claim 11 , wherein the selected video display format is a first video display format, the method further comprising:
selecting a second video display format that is different from the first video display format; and
displaying the video encoded in the stereo 3D video data in the second video display format.
16. The method of claim 15 , wherein the second video display format is selected automatically in response to a change in the display.
17. The method of claim 11 , further comprising:
if the selected video display format is anaglyph video, converting the stereo 3D video data to anaglyph video data; and
if the selected video display format is monoscopic video, converting the stereo 3D video data to monoscopic video data.
18. The method of claim 11 , further comprising receiving user input indicating a user-selected video display format, wherein the selecting comprises selecting the user-selected video display format as the video display format.
19. One or more computer-readable memory devices or storage devices storing computer-executable instructions for causing a computing device to perform a method, the method comprising:
receiving via a video pipeline, stereo 3D video data employing a YUV color space, wherein the video pipeline comprises a plurality of video pipeline components, wherein the plurality of video pipeline components comprise at least a video processor and a display;
using a computing device, generating anaglyph video data from the stereo 3D video data, the generating comprising:
unpacking the stereo 3D video data to a left view and a right view; and
combining the left view and the right view into a single view, the anaglyph video data comprising the single view, wherein:
the combining uses anaglyph transform matrices that correspond to a configuration of the plurality of video pipeline components associated with the received stereo 3D video data;
coefficients for the anaglyph transform matrices are selected based on one or more configuration characteristics associated with the plurality of video pipeline components, the one or more configuration characteristics including at least one of a chroma sampling scheme and a chroma sampling arrangement, and configuration characteristics of one or more of a video capture device, a display and/or viewing glasses; and
the resulting anaglyph video data has at least a minimum display aperture or a pixel aspect ratio to be displayed on the display; and
displaying video encoded in the stereo 3D video data in anaglyph form.
20. The one or more computer-readable memory devices or storage devices of claim 19 , wherein the stereo 3D video data is encoded using 4:2:0 chroma subsampling and the anaglyph video data is generated using the following formula:
(
Y
0
Y
1
Y
2
Y
3
U
V
)
=
ML
(
YL
0
YL
1
YL
2
YL
3
UL
VL
)
+
MR
(
YR
0
YR
1
YR
2
YR
3
UR
LR
)
,
wherein YL0-YL3 are luma samples of the left view, UL and VL are chroma samples of the left view; YR0-YR3 are luma samples of the right view; UR and VR are chroma samples of the right view, Y0-Y3 are luma samples of the anaglyph video data; and U and V are chroma samples of the anaglyph video data; and ML and MR are anaglyph transform matrices corresponding to a configuration of a video pipeline and have the form:
Mx
=
(
a
0
0
0
b
c
0
a
0
0
b
c
0
0
a
0
b
c
0
0
0
a
b
c
d
0
d
1
d
2
d
3
e
f
g
0
g
1
g
2
g
3
h
i
)
,
wherein a, b, c, d0-d3, e, f, g0-g3, h and i are anaglyph transform matrix coefficients that depend on one or more characteristics of the following: a display, a video capture device and anaglyph glasses used for viewing the display, the method further comprising:
modifying at least one of the anaglyph transform matrix coefficients in response to a change in the video pipeline configuration; and
generating the anaglyph video data using the modified anaglyph transform coefficients.