IP Library › Granted Patent US 12,238,270
Granted Patent B2
US 12,238,270 · App. 17/948,952 · Granted Feb 25, 2025

Multifocal plane based method to produce stereoscopic viewpoints in a DIBR system (MFP-DIBR)

Inventors: Seppo T Valli (Espoo, FI); Pekka K Siltanen (Helsinki, FI)
Assignee: InterDigital VC Holdings, Inc.
H04N13/366G02B27/0093G02B27/0172G02B27/0179G02B30/52H04N13/128H04N13/156H04N13/167H04N13/261H04N13/395G02B2027/0134G02B2027/014G02B2027/0187H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,238,270
App. No.
17/948,952
Granted
Feb 25, 2025
Kind
B2
Abstract

Some embodiments of an example method may include receiving an input image with depth information; mapping the input image to a set of focal plane images; orienting the set of focal plane images using head orientation information to provide stereo disparity between left and right eyes; and displaying the oriented set of focal plane images. Some embodiments of another example method may include: receiving a description of three-dimensional (3D) content; receiving, from a tracker, information indicating motion of a viewer relative to a real-world environment; responsive to receiving the information indicating motion of the viewer, synthesizing motion parallax by altering multi-focal planes of the 3D content; and rendering an image to the multi-focal plane display using the altered multi-focal plane rendering.

Claims (52)

1. A method comprising:

generating a plurality of focal plane images using a description of three-dimensional (3D) content;

receiving motion information,

wherein the motion information comprises information describing motion of a user relative to a real world environment;

shifting one or more focal plane images of the plurality of focal plane images to generate transversal motion parallax in response to the motion information indicating transversal motion of the user;

scaling one or more focal plane images of the plurality of focal plane images to generate axial motion parallax in response to the motion information indicating axial motion of the user; and

rendering a view of the 3D content using the shifted and scaled focal plane images.

2. The method of claim 1 , wherein the motion information is received from a motion sensor attached to a head-worn device of the user.

3. The method of claim 1 , wherein the motion information is received from an external sensor.

4. The method of claim 1 , wherein the motion information comprises information describing motion of a head of the user.

5. The method of claim 1 , wherein scaling the one or more focal plane images of the plurality of focal plane images comprises:

scaling the one or more focal plane images to a larger size in response to motion information indicative of the user moving axially closer to the one or more focal plane images.

6. The method of claim 1 , wherein scaling the one or more focal plane images of the plurality of focal plane images comprises:

scaling the one or more focal plane images to a smaller size in response to motion information indicative of the user moving axially further from the one or more focal plane images.

7. The method of claim 1 , wherein scaling the one or more focal plane images of the plurality of focal plane images comprises scaling the one or more focal plane images using scaling factors which vary based on a relative distance from the focal plane to the user.

8. The method of claim 1 , wherein at least one of the plurality of focal plane images has a zero parallax setting for axial motion of the user.

9. The method of claim 1 , wherein rendering the view of the 3D content comprises:

generating a 2D image view of the 3D content from the shifted and scaled focal plane images; and

displaying the 2D image view using a 2D display.

10. The method of claim 1 , wherein rendering the view of the 3D content comprises displaying the shifted and scaled focal plane images using a Multi Focal Plane (MFP) display.

11. The method of claim 1 , wherein rendering the view of the 3D content comprises:

generating a left eye view and a right eye view from the shifted and scaled focal plane images; and

displaying the left eye view and the right eye view using a stereoscopic display device.

12. The method of claim 1 , wherein generating the plurality of focal plane images comprises:

receiving an input image with depth information;

filtering the input image for low frequency content; and

redistributing the low frequency content from the filtered input image to the plurality of focal plane images.

13. A device comprising:

a processor; and

a memory storing instructions operative, when executed by the processor, to cause the device to:

generate a plurality of focal plane images using a description of three-dimensional (3D) content;

receive motion information,

wherein the motion information comprises information describing motion of a user relative to a real world environment;

shift one or more focal plane images of the plurality of focal plane images to generate transversal motion parallax in response to the motion information indicating transversal motion of the user;

scale one or more focal plane images of the plurality of focal plane images to generate axial motion parallax in response to the motion information indicating axial motion of the user; and

render a view of the 3D content using the shifted and scaled focal plane images.

14. The device of claim 13 , further comprising a motion sensor.

15. The device of claim 13 , wherein the device comprises a Multi Focal Plane (MFP) display configured to render the view of the 3D content.

16. A method comprising:

receiving a description of three-dimensional (3D) content;

forming a plurality of focal plane images for the 3D content based on the description;

receiving, from a motion tracking device, motion information indicating motion of a viewer relative to a real world environment;

synthesizing motion parallax information by modifying one or more focal plane images of the plurality of focal plane images in response to receiving the motion information;

generating left eye imagery and right eye imagery from the one or more modified focal plane images; and

displaying the left eye imagery and the right eye imagery using a stereoscopic display device.

17. The method of claim 16 , wherein synthesizing motion parallax information comprises shifting the one or more focal plane images to generate transversal motion parallax in response to the motion information indicating transverse motion of the viewer.

18. The method of claim 16 , wherein synthesizing motion parallax information comprises scaling the one or more focal plane images to generate axial motion parallax in response to the motion information indicating axial motion of the viewer.

19. The method of claim 16 , wherein the motion tracking device comprises a motion sensor attached to a head-worn device of the viewer.

20. The method of claim 16 , wherein the motion tracking device comprises a motion sensor external to the stereoscopic display device.

21. The method of claim 16 , wherein the motion tracking device comprises a motion sensor attached to the stereoscopic display device.

22. The method of claim 16 , wherein the motion information describes motion of a head of the viewer.

23. The method of claim 16 , wherein the stereoscopic display device comprises a Multi-Focal Plane (MFP) display.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2023
From: PCMS HOLDINGS, INC.
To: INTERDIGITAL VC HOLDINGS, INC.
Reel/Frame 062384/0869 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 14, 2022
From: VALLI, SEPPO T.; SILTANEN, PEKKA K.
To: PCMS HOLDINGS, INC.
Reel/Frame 062086/0922 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 14, 2022
From: TEKNOLOGIAN TUTKIMUSKESKUS VTT OY
To: PCMS HOLDINGS, INC.
Reel/Frame 062125/0047 →
Continuity (3)
Continuation 16981167
Provisional Application 62647568 · Mar 23, 2018
Related Publication 20230027251A1 · Jan 26, 2023
References Cited (208)
US 5793985A · Natarajan · 1998 [cited by applicant]
US 7116324B2 · Kaye · 2006 [cited by applicant]
US 8120547B2 · Seymour · 2012 [cited by applicant]
US 8432434B2 · Veeraraghavan · 2013 [cited by applicant]
US 8576276B2 · Bar-Zeev · 2013 [cited by applicant]
US 8717423B2 · Vesely · 2014 [cited by applicant]
US 8730354B2 · Stafford · 2014 [cited by applicant]
US 9030749B2 · Lescure · 2015 [cited by applicant]
US 9035943B1 · Han · 2015 [cited by applicant]
US 9077986B2 · Singh · 2015 [cited by applicant]
US 9213405B2 · Perez · 2015 [cited by applicant]
US 9223138B2 · Bohn · 2015 [cited by applicant]
US 9362994B2 · Seol · 2016 [cited by applicant]
US 9407904B2 · Sandrew · 2016 [cited by applicant]
US 9437038B1 · Costello · 2016 [cited by applicant]
US 9547174B2 · Gao · 2017 [cited by applicant]
US 9667327B2 · Lee · 2017 [cited by applicant]
US 9804395B2 · Wu · 2017 [cited by applicant]
US 10901291B1 · Sulai · 2021 [cited by applicant]
US 11689709B2 · Valli · 2023 [cited by applicant]
US 20010028516A1 · Noguchi · 2001 [cited by examiner]
US 20020113752A1 · Sullivan · 2002 [cited by applicant]
US 20050190180A1 · Jin · 2005 [cited by applicant]
US 20060007301A1 · Cho · 2006 [cited by examiner]
US 20060088211A1 · Kusakabe · 2006 [cited by applicant]
US 20070183675A1 · Morohashi · 2007 [cited by applicant]
US 20080123738A1 · Katsavounidis · 2008 [cited by applicant]
US 20080252556A1 · Tseng · 2008 [cited by applicant]
US 20090003714A1 · Subramaniam · 2009 [cited by applicant]
US 20090034616A1 · Abe · 2009 [cited by applicant]
US 20090125291A1 · Mohandas · 2009 [cited by applicant]
US 20090245688A1 · Robinson · 2009 [cited by applicant]
US 20100034480A1 · Rao · 2010 [cited by applicant]
US 20100128145A1 · Pitts · 2010 [cited by applicant]
US 20100238366A1 · Chang · 2010 [cited by applicant]
US 20110075257A1 · Hua · 2011 [cited by applicant]
US 20110273466A1 · Francisco · 2011 [cited by applicant]
US 20120084652A1 · Martinez Bauza · 2012 [cited by examiner]
US 20120127062A1 · Bar-Zeev · 2012 [cited by applicant]
US 20120127284A1 · Bar-Zeev · 2012 [cited by applicant]
US 20120128244A1 · Singh · 2012 [cited by applicant]
US 20120200676A1 · Huitema · 2012 [cited by applicant]
US 20120307108A1 · Forutanpour · 2012 [cited by applicant]
US 20130050432A1 · Perez · 2013 [cited by applicant]
US 20130113984A1 · Shimamoto · 2013 [cited by applicant]
US 20130183021A1 · Osman · 2013 [cited by applicant]
US 20140118509A1 · Kroon · 2014 [cited by applicant]
US 20140132724A1 · Choi · 2014 [cited by applicant]
US 20140192281A1 · Smithwick · 2014 [cited by applicant]
US 20140267852A1 · Bluzer · 2014 [cited by applicant]
US 20140292812A1 · Fink · 2014 [cited by applicant]
US 20140307952A1 · Sweeney · 2014 [cited by applicant]
US 20140355707A1 · Kim · 2014 [cited by applicant]
US 20150062370A1 · Shroff · 2015 [cited by applicant]
US 20150098126A1 · Keller · 2015 [cited by applicant]
US 20150145977A1 · Hoffman · 2015 [cited by applicant]
US 20150153559A1 · Sato · 2015 [cited by applicant]
US 20150205135A1 · Border · 2015 [cited by examiner]
US 20150222884A1 · Cheng · 2015 [cited by applicant]
US 20150235467A1 · Schowengerdt · 2015 [cited by applicant]
US 20150243102A1 · Schowengerdt · 2015 [cited by applicant]
US 20150254905A1 · Ramsby · 2015 [cited by examiner]
US 20150277121A1 · Fridental · 2015 [cited by applicant]
US 20150331237A1 · Itani · 2015 [cited by applicant]
US 20150341093A1 · Ji · 2015 [cited by applicant]
US 20150346495A1 · Welch · 2015 [cited by applicant]
US 20160014350A1 · Osman · 2016 [cited by applicant]
US 20160080717A1 · Reiss · 2016 [cited by applicant]
US 20160148416A1 · Wu · 2016 [cited by applicant]
US 20160191893A1 · Gewickey · 2016 [cited by applicant]
US 20160277725A1 · Ellsworth · 2016 [cited by applicant]
US 20160307368A1 · Akeley · 2016 [cited by applicant]
US 20170039686A1 · Miura · 2017 [cited by applicant]
US 20170054967A1 · Zhang · 2017 [cited by applicant]
US 20170085863A1 · Lopez · 2017 [cited by applicant]
US 20170102545A1 · Hua · 2017 [cited by applicant]
US 20170127046A1 · Das · 2017 [cited by applicant]
US 20170181132A1 · Xiao · 2017 [cited by applicant]
US 20170301313A1 · Perreault · 2017 [cited by applicant]
US 20170323485A1 · Samec · 2017 [cited by applicant]
US 20180039084A1 · Schowengerdt · 2018 [cited by applicant]
US 20180048882A1 · Eash · 2018 [cited by applicant]
US 20180075659A1 · Browy · 2018 [cited by applicant]
US 20180095284A1 · Welch · 2018 [cited by applicant]
US 20180098051A1 · Emberger · 2018 [cited by applicant]
US 20180114328A1 · Jin · 2018 [cited by applicant]
US 20180115700A1 · Ryan · 2018 [cited by applicant]
US 20180259743A1 · Sasaki · 2018 [cited by applicant]
US 20190073778A1 · Lee · 2019 [cited by examiner]
US 20190187474A1 · Bhargava · 2019 [cited by applicant]
US 20190339526A1 · Welch · 2019 [cited by applicant]
US 20200007760A1 · Yokokawa · 2020 [cited by applicant]
CA 2950429A1 · 2015 [cited by applicant]
CN 102611909A · 2012 [cited by applicant]
CN 103076156A · 2013 [cited by applicant]
CN 103634588A · 2014 [cited by applicant]
CN 104639930A · 2015 [cited by applicant]
CN 104899870A · 2015 [cited by applicant]
CN 105474622A · 2016 [cited by applicant]
CN 106125246A · 2016 [cited by applicant]
CN 106233189A · 2016 [cited by applicant]
CN 106537219A · 2017 [cited by applicant]
CN 106875436A · 2017 [cited by applicant]
CN 107203045A · 2017 [cited by applicant]
CN 107272199A · 2017 [cited by applicant]
CN 107924104A · 2018 [cited by applicant]
EP 3149939A1 · 2017 [cited by applicant]
JP 2000156876 · 2000 [cited by applicant]
JP 2010217859 · 2010 [cited by applicant]
JP 2017529635 · 2017 [cited by applicant]
JP 2017229037 · 2017 [cited by applicant]
WO 0135154 · 2001 [cited by applicant]
WO 0135154A1 · 2001 [cited by applicant]
WO 2008038205A2 · 2008 [cited by applicant]
WO 2009155688A1 · 2009 [cited by applicant]
WO 2012175939 · 2012 [cited by applicant]
WO 2012175939A1 · 2012 [cited by applicant]
WO 2014119555 · 2014 [cited by applicant]
WO 2015192117A1 · 2015 [cited by applicant]
WO 2016138313A1 · 2016 [cited by applicant]
WO 2017055894A1 · 2017 [cited by applicant]
Ryan, L. “Multiple-focal-planes 3D displays: A practical solution to the vergence-accommodation conflict ?.” In 2012 International Conference on 3D Imaging (IC3D), pp. 1-6. IEEE, 2012 (6 pages). [cited by applicant]
Wang, Z. “Studies on Integral Imaging 3D Display” A dissertation for doctor's degree, University of Science and Technology of China, May 2017 (115 pages). [cited by applicant]
Zhuo, S. et al., “Defocus map estimation from a single image”, Pattern Recognition 44, Mar. 4, 2011, (19 pages). [cited by applicant]
Akeley, K. et al., “A Stereo Display Prototype with Multiple Focal Distances”, ACM Transactions on Graphics (TOG), vol. 23 No. 3, Aug. 2004, pp. 804-813 (10 pages). [cited by applicant]
J. P. Rolland, M. Krueger, and A. Goon (2000), “Multifocal planes head-mounted displays,” Appl. Opt. 39, 3209-3215, 2000, pp. 3209-3215 (7 pages). [cited by applicant]
Liu, S et al., “A systematic method for designing depth-fused multi-focal plane three-dimensional displays”, Optics Express 11562, vol. 18, No. 11, 2010 (12 pages). [cited by applicant]
Watt, S. J., et al., “Real-world stereoscopic performance in multiple-focal-plane displays: How far apart should the image planes be ?.” Stereoscopic Displays and Applications XXIII, vol. 8288, p. 82881E. International … [cited by applicant]
Johnson, P. V. et al., “Dynamic lens and monovision 3D displays to improve viewer comfort”, Optics express, vol. 24 No. 11, 2016 pp. 11808-11827 (20 pages). [cited by applicant]
Narain, R. et al., “Optimal presentation of imagery with focus cues on multi-plane displays.” ACM Transactions on Graphics (TOG) vol. 34, No. 4 Article 59, Aug. 2015 (12 pages). [cited by applicant]
W. Wu et al., “Content-adaptive focus configuration for near-eye multi-focal displays”, Proc. IEEE Int. Conf. Multimedia Expo (ICME), Jul. 2016 (6 pages). [cited by applicant]
Liu, S. et al., “A Novel Prototype for an Optical See-Through Head-Mounted Display with Addressable Focus Cues”, IEEE Transactions on Visualization and Computer Graphics, vol. 16, No. 3, May/Jun. 2010, pp. 381-393 (14 p… [cited by applicant]
Cheng, D. et al., “Design of an optical see-through head-mounted display with a low f-number and large field of view using a freeform prism.” Applied optics vol. 48 No. May 14, 2009 pp. 2655-2668 (14 pages). [cited by applicant]
Xinda Hu (2014), “Development of the Depth-Fused Multi-Focal-Plane Display Technology”, PHD Thesis, University of Arizona, 2014, (130 pages). [cited by applicant]
Hu, X. et al., “Design and assessment of a depth-fused multi-focal-plane display prototype” Journal of Display Technology. vol 10 No. 4, pp. 308-316 (9 pages). [cited by applicant]
Mackenzie, K. et al., “Accommodation to multiple-focal-plane displays: Implications for improving stereoscopic displays and for accommodation control.” Journal of vision 10, No. 8, 2010 (20 pages). [cited by applicant]
Brunet, F. “Contributions to parametric image registration and 3d surface reconstruction.” European Ph. D. in Computer Vision, Universite dAuvergne, Clermont-Ferrand, France, and Technische Universitat Munchen, Germany,… [cited by applicant]
Hu, X. et al., “High-resolution optical see-through multi-focal-plane head-mounted display using freeform optics” Optics Express 13896, vol. 22, No. 11, May 2014 (8 pages). [cited by applicant]
Sheng Liu, et al., “Time-multiplexed dual-focal plane head-mounted display with a liquid lens”, Optics Letters vol. 34, No. 11, Jun. 1, 2009, published on May 21, 2009. [cited by applicant]
Sheng Liu, et al. “An Optical See-Through Head Mounted Display with Addressable Focal Planes”, IEEE International Symposium on Mixed and Augmented Reality Sep. 15-18, 2008, pp. 33-42 (10 pages). [cited by applicant]
Siltanen, Sanni, “Theory and Applications of Marker-Based Augmented Reality”. VTT Science 3, Espoo, (2012), (246 pages). [cited by applicant]
Baker, E. “144Hz Monitor vs 60Hz Monitor—See The Difference” https://www.144hzmonitors.com/other/144hz-monitor-vs-60hz-monitor-see-the-difference (last accessed Nov. 4, 2017). [cited by applicant]
International Search Report and Written Opinion of the International Searching Authority for PCT/US2019/013803 mailed Apr. 18, 2019, (11 pages). [cited by applicant]
International Search Report and Written Opinion of the International Searching Authority for PCT/US2019/023149, mailed Jun. 18, 2019, 10 pages. [cited by applicant]
Lee, Namjeong., et al., “A New Codebook Structure for Enhanced Multi-User MIMO Transmission in mmWave Hybrid-Beamforming System”. IEEE Globecom Workshops (GC Wkshps), (2015), pp. 1-6. [cited by applicant]
International Search Report and Written Opinion of the International Searching Authority for PCT/US2019/040187 mailed Sep. 23, 2019, 12 pages. [cited by applicant]
International Search Report and Written Opinion of the International Searching Authority for PCT/US2019/039746 mailed Oct. 9, 2019, 11 pages. [cited by applicant]
Chang, Jen-Hao, et al., “Towards Multifocal Displays with Dense Focal Stacks”. arxiv.org, Cornell University Library, ACM Transactions on Graphics, vol. 37, No. 6, Art. 198, Nov. 2018, pp. 198:1-198:17. [cited by applicant]
Grubert, J., et al., “A Survey of Calibration Methods for Optical See-Through Head-Mounted Displays”, IEEE Transactions on Visualization and Computer Graphics, Early Access Article available in IEEE Xplore, vol. 13 No. … [cited by applicant]
International Preliminary Report on Patentability for PCT/US2019/040187 dated Jan. 14, 2021 (8 pages). [cited by applicant]
International Preliminary Report on Patentability for PCT/US2019/013803 issued on May 7, 2020, (11 pages). [cited by applicant]
International Preliminary Report on Patentability PCT/US2019/023149 issued on Sep. 29, 2020, 7 pages. [cited by applicant]
International Preliminary Report on Patentability for PCT/US2019/039746 issued on Jan. 12, 2021, 7 pages. [cited by applicant]
Maimone, A. et al., “Computational augmented reality eyeglasses.” In 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), IEEE, 2013. (10 pages). [cited by applicant]
Bos, P. J., et al., “A Simple Method to Reduce Accommodation Fatigue in Virtual Reality and Augmented Reality Displays”, SID 2016, (4 pages). [cited by applicant]
Wilson, A., et al., “Design and prototype of an augmented reality display with per-pixel mutual occlusion capability.” Optics express vol. 25, No. 24, Nov. 2017 pp. 30539-30549 (11 pages). [cited by applicant]
Itoh Y., et al., “Occlusion Leak Compensation for Optical See-Through Displays using a Single-layer Transmissive Spatial Light Modulator”, IEEE Transactions on Visualization and Computer Graphics, vol. 23, No. 11, Nov. … [cited by applicant]
Sukhanov, S. A., “3D content production” St. Petersburg Electrotechnical University, St. Petersburg, Russia, Mar. 12, 2011 https://www.slideshare.net/mikhailvink/sergey-a-sukhanov-3d-content-production last accessed on … [cited by applicant]
Padmanaban, N., et al., “Optimizing virtual reality for all users through gaze-contingent and adaptive focus displays.” Proceedings of the National Academy of Sciences vol. 114 No. 9, Feb. 28, 2017 pp. 2183-2188 (6 page… [cited by applicant]
“VR AR Judder is Visible Latency” https://medium.com/silicon-valley-global-news/vr-ar-judder-is-visible-latency-2631aa393ebf, Apr. 9, 2016 last accessed Dec. 13, 2021 (6 pages). [cited by applicant]
Kiyokawa, K., et al., “An occlusion-capable optical see-through head mount display for supporting co-located collaboration”, ISMAR 2003 (9 pages). [cited by applicant]
Yamaguchi, Y., et al., “See-through integral imaging display with background occlusion capability”, Applied Optics vol. 55, No. 3, Jan. 20, 2016, (6 pages). [cited by applicant]
Jamali, A., et al., “Design of a large aperture tunable refractive Fresnel liquid crystal lens”, Applied Optics, vol. 57, No. 7, 2018, (10 pages). [cited by applicant]
Wikipedia “3D Projection”. Wikipedia article modified on Jul. 11, 2017, available at: https://en.wikipedia.org/w/index.php?title=3D_projection&oldid=790065385 (5 pages). [cited by applicant]
Linwei, Z. et al., “View-spatial-temporal post-refinement for view synthesis in 3D video systems”, Signal Processing: Image Communication 28, 2013, pp. 1342-1357 (16 pages). [cited by applicant]
Xuyuan, X. et al., “Depth map misalignment correction and dilation for DIBR view synthesis”, Signal Processing: Image Communication 28, 2013, pp. 1023-1045 (23 pages). [cited by applicant]
Kristoph F., A 3D-TV Approach Using Depth-Image-Based Rendering (DIBR), Proceedings of VIIP vol. 3 No. Sep. 3, 2003 (6 pages). [cited by applicant]
Hong, H., “Enabling Focus Cues in Head-Mounted Displays”, Proceedings of the IEEE 2017 (18 pages). [cited by applicant]
Kramida, G. et al., “Resolving the Vergence-Accommodation Conflict in Head-Mounted Displays”, IEEE transactions on visualization and computer graphics. 2015 (20 pages). [cited by applicant]
Suyama, S. et al., “Apparent 3-D image perceived from luminance-modulated two 2-D images displayed at different depths”, Vision Research, vol. 44, 2004, pp. 785-793 (9 pages). [cited by applicant]
Lee, C. et al., “View Synthesis using Depth Map for 3D Video”, Asia-Pacific Signal and Information Processing Association, 2009 Annual Summit and Conference, International Organizing Committee, Sapporo, Japan, Oct. 2009… [cited by applicant]
Watt, S. J. et al., “Achieving near-correct focus cues in a 3-D display using multiple image planes”, In Human vision and electronic imaging X, vol. 5666, pp. 393-401. International Society for Optics and Photonics, 200… [cited by applicant]
Shibata, T. et al., “The zone of comfort: Predicting visual discomfort with stereo displays.” Journal of vision 11(8):11, 2011, pp. 1-29 (29 pages). [cited by applicant]
Huang, F. C. et al., “The Light Field Stereoscope—Immersive Computer Graphics via Factored Near-Eye Light Field Displays with Focus Cues” SIGGRAPH emerging technologies, 2015 (12 pages). [cited by applicant]
Pan, H. et al., “3D video disparity scaling for preference and prevention of discomfort.” Stereoscopic Displays and Applications XXII, vol. 7863, International Society for Optics and Photonics, 2011 (8 pages). [cited by applicant]
Zannoli, M. et al., “Blur and the perception of depth at occlusions.” Journal of Vision 16, No. 6 (2016): 17 pp. 1-25 (25 pages). [cited by applicant]
Hong, H., “Advances in Head-Mounted Light-Field Displays for Virtual and Augmented Reality”, Information Display 4/16, SID 2016, pp. 14-21 (8 pages). [cited by applicant]
Liu, S. et al., “A Novel Prototype for an Optical See-Through Head-Mounted Display with Addressable Focus Cues”, IEEE Transactions on Visualization and Computer Graphics, vol. 16, No. 3, May/Jun. 2010, pp. 381-393 (13 p… [cited by applicant]
Lavalle, S. M., et al., “Head tracking for the Oculus Rift.” In 2014 IEEE International Conference on Robotics and Automation (ICRA), IEEE, 2014 (8 pages). [cited by applicant]
Wikipedia, “Multiscopy” last accessed Feb. 1, 2019, available at https://web.archive.org/web/20190201002402/ https://en.wikipedia.org/wiki/Multiscopy (3 pages). [cited by applicant]
Wikipedia, “Light field” last accessed May 29, 2018, available at https://web.archive.org/web/20180529074855/ https://en.wikipedia.org/wiki/Light_field (8 pages). [cited by applicant]
Wikipedia Commons, “File: 2D plus depth.png” last accessed Feb. 22, 2019, available at https://commons.wikimedia.org/w/index.php?curid=5489771 (3 pages). [cited by applicant]
Shibata, T. et al., “Visual discomfort with stereo displays: effects of viewing distance and direction of vergence-accommodation conflict.” In Stereoscopic Displays and Applications XXII, vol. 7863, p. 78630P. Internati… [cited by applicant]
Wikipedia, “Photographic Filter” last accessed on May 3, 2019, available at: https://en.wikipedia.org/wiki/Photographic_filter#Diffusion. [cited by applicant]
“Oculus Rift Vs. HTC Vive Vs. PlayStation VR” http://www.tomshardware.com/reviews/vive-rift-playstation-vr-comparison,4513-3.html. May 16, 2016 last accessed Dec. 13, 2021 (16 pages). [cited by applicant]
“Oculus Rift vs HTC Vive VR headset” http://www.avadirect.com/blog/oculus-rift-vs-htc-vive-vs-rift/ Jan. 26, 2016 last accessed Dec. 13, 2016 (9 pages). [cited by applicant]
List, U. H. “Nonlinear prediction of head movements for helmet-mounted displays” Air Force Human Resources Lab Brooks AFB TX, 1983 (24 pages). [cited by applicant]
NVIDIA Announces GamesWorks VR Branding, Adds Mutli-Res Shading, last accessed Dec. 16, 2017, available at https://web.archive.org/web/20171216213416/https://www.anandtech.com/show/9305/nvidia-announces-gameworks-vr-bra… [cited by applicant]
“Samsung Gear VR Headset Lens Review & QR Code” last accessed Nov. 4, 2017, available at https://web.archive.org/web/20171104201025/http://www.sitesinvr.com/viewer/gearvr/index.html (7 pages). [cited by applicant]
La Rosa, F. et al., “Optical Image Stabilization (OIS).” STMicroelectronics. available online: http://www. st. com/resource/en/white_paper/ois_white_paper. pdf last accessed on Oct. 12, 2017 2015 (26 pages). [cited by applicant]
Aflaki, M., et al. “Rendering stereoscopic video for simultaneous 2D and 3D presentation,” 2013 3DTV Vision Beyond Depth (3DTV-CON), 2013, pp. 1-4. Available online at: https://ieeexplore.ieee.org/document/6676658 (4 pa… [cited by applicant]
Crayola, “Color Alive” Last accessed May 9, 2019, [http://www.crayola.com/splash/products/ColorAlive]. [cited by applicant]
Llull, P., et al. “Design and optimization of a near-eye multifocal display system for augmented reality.” Applied Industrial Optics: Spectroscopy, Imaging and Metrology. Optical Society of America, 2015 (3 pages). [cited by applicant]
Wang, X., “Different multi-focal-plane method” Dec. 8, 2016, available at https://wp.optics.arizona.edu/optomech/wp-content/uploads/sites/53/2016/12/Tutorial_Wang_Xuan.pdf. (8 pages). [cited by applicant]
Wagner, D., et al., “Real-Time Detection and Tracking for Augmented Reality on Mobile Phones”, IEEE Trans. on Visualization and Computer Graphics, vol. 16, No. 3, May/Jun. 2010, pp. 355-368 (14 pages). [cited by applicant]
Crecente, B., “Magic Leap: Founder of Secretive Start-Up Unveils Mixed-Reality Goggles” last accessed Mar. 30, 2018, available at https://web.archive.org/web/20180330030004/https://www.rollingstone.com/glixel/features/l… [cited by applicant]
Tatham, E., “Getting the best of both real and virtual worlds,” Communications of the ACM, vol. 42 No. 9, 1999, pp. 96-98 (3 pages). [cited by applicant]
Itoh, Y., et al., “Semi-parametric color reproduction method for optical see-through head-mounted displays.” IEEE transactions on visualization and computer graphics vol. 21, No. 11, Nov. 2015, pp. 1269-1278 (10 pages). [cited by applicant]
Wang, Y. J., et al., “Augmented reality with image registration, vision correction and sunlight readability via liquid crystal devices.” Scientific reports 7, No. 1, 2017, pp. 1-12 (12 pages). [cited by applicant]
Wikipedia, “Depth of field” last accessed Mar. 8, 2018, available at https://web.archive.org/web/20180308123938/ https://en.wikipedia.org/wiki/Depth_of_field (29 pages). [cited by applicant]
Honnungar, S. et al., “Focal-sweep for Large Aperture Time-of-Flight Cameras”, IEEE International Conference on Image Processing (ICIP), 2016, (5 pages). [cited by applicant]
Narayanan, P. J., et al., “Depth+ Texture Representation for Image Based Rendering.” In Centre for Visual Information Technology, International Institute of Information Technology, 2004 (6 pages). [cited by applicant]
Pertuz, S.et al., “Generation of all-in-focus images by noise-robust selective fusion of limited depth-of-field images.” IEEE Transactions on Image Processing 22, No. 3 (2012, (10 pages). [cited by applicant]
Billiot, B. et al., “3D image acquisition system based on shape from focus technique.” Sensors 13, No. 13, 2013 pp. 5040-5053 (14 pages). [cited by applicant]
Oskiper, T. et al., “Augmented reality binoculars.” IEEE transactions on visualization and computer graphics 21, No. 5, 2015, (10 pages). [cited by applicant]
Balram, N., “Fundamentals of light field imaging and display systems.” Display Week 2016, (210 pages). [cited by applicant]
Liu, S., et al., “3-1: A Multi-plane Volumetric Optical See-through Head Mounted 3D Display.” In SID Symposium Digest of Technical Papers, vol. 47, No. 1, 2016 (3 pages). [cited by applicant]
“Rendering” (https://developer.oculus.com/design/latest/concepts/bp-rendering/ Original date unknown); archived at Wayback Machine (https://web.archive.org/) citing a capture dated Feb. 18, 2018, last visited Apr. 7, 20… [cited by applicant]