IP Library › Granted Patent US 12,614,365
Granted Patent B2
US 12,614,365 · App. 18/498,713 · Granted Apr 28, 2026

Normalizing individual depth perception for VR

Inventors: Koichi Obana (San Mateo, CA); Yuichiro Nakamura (San Mateo, CA); Greg Corson (San Mateo, CA); Jeff Stafford (San Mateo, CA)
Assignee: Sony Interactive Entertainment Inc.
G06T19/20G06T2219/2004G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,614,365
App. No.
18/498,713
Granted
Apr 28, 2026
Kind
B2
Abstract

Techniques are described for determining a user's unique depth perception in viewing virtual objects in virtual reality (VR) to make the VR experience more accurate and immersive for the user. The user can align a virtual image the user sees with a real-world image behind the virtual image to provide input indicating the user's depth perception. Depth perception parameters can then be determined from that for subsequently rendering VR objects to that user.

Claims (32)

1 . An apparatus comprising:

at least one processor configured to perform operations comprising:

presenting, on a display, an image related to determining a user's depth perception;

receiving a user input adjusting an appearance of the image as presented on the display, wherein the user input comprises changing a scale of the image as presented on the display, rotating an orientation of the image as presented on the display, or shifting a virtual position of the image as presented on the display;

based on the user input adjusting the appearance of the image as presented on the display, determining at least one offset for rendering a three-dimensional (3D) object; and

applying the at least one offset to render the 3D object.

2 . The apparatus of claim 1 , wherein the image comprises a virtual grid pattern.

3 . The apparatus of claim 2 , wherein the display is a transparent display that establishes at least part of one wall of four vertical walls of a box.

4 . The apparatus of claim 3 , wherein the box as viewable through the transparent display is white with a black grid pattern.

5 . The apparatus of claim 4 , wherein the virtual grid pattern is white such that input to align the virtual grid pattern with the black grid pattern results in some or all of the black grid pattern disappearing according to a perspective of the user.

6 . The apparatus of claim 3 , wherein the box as viewable through the transparent display is black with a white grid pattern.

7 . The apparatus of claim 6 , wherein the virtual grid pattern is black such that input to align the virtual grid pattern with the white grid pattern results in some or all of the white grid pattern disappearing according to a perspective of the user.

8 . The apparatus of claim 1 , wherein the at least offset comprises an XYZ scale offset, an XZY rotation offset, and an XY shift offset.

9 . The apparatus of claim 1 , wherein the 3D object is rendered on a multi-display assembly that is box-shaped.

10 . The apparatus of claim 9 , comprising the multi-display assembly.

11 . The apparatus of claim 1 , wherein the 3D object is rendered stereoscopically on a head-mounted display (HMD) device configured for virtual reality (VR) presentations.

12 . The apparatus of claim 11 , comprising the HMD device.

13 . An apparatus comprising:

at least one non-transitory computer medium storing instructions executable by at least one processor to perform operations comprising:

presenting, on a display, an image;

receiving a user input adjusting an appearance of the image as presented on the display, wherein the user input comprises changing a scale of the image as presented on the display, rotating an orientation of the image as presented on the display, or shifting a virtual position of the image as presented on the display; and

based on the user input adjusting the appearance of the image as presented on the display, determining at least one parameter for rendering a virtual three-dimensional (3D) object.

14 . The apparatus of claim 13 , the operations further comprising applying the at least one parameter to render the virtual 3D object.

15 . The apparatus of claim 13 , wherein the image comprises one or more virtual lines, wherein the display is a transparent display that establishes at least part of a real-world 3D object, and wherein an inside of the real-world 3D object as viewable through the transparent display has real lines matching the virtual lines for a user to align the real lines with the virtual lines according to the user's individual depth perception.

16 . A method, comprising:

presenting, on a display, an image related to determining a user's depth perception;

receiving a user input adjusting an appearance of the image as presented on the display, wherein the user input comprises changing a scale of the image as presented on the display, rotating an orientation of the image as presented on the display, or shifting a virtual position of the image as presented on the display;

based on the user input adjusting the appearance of the image as presented on the display, determining at least one parameter for rendering a virtual three-dimensional (3D) object; and

rendering the virtual 3D object according to the parameter.

17 . The method of claim 16 , comprising:

identifying at least one aspect related to the user's eyes based on an input from a camera distanced from the user, the input from the camera being different from the user input; and

prior to receiving the user input, presenting the image on the display according to an estimated depth perception parameter for the user, the estimated depth perception parameter determined based on the identification of the at least one aspect.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 13, 2023
From: OBANA, KOICHI; NAKAMURA, YUICHIRO; CORSON, GREG; STAFFORD, JEFF
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 065540/0254 →
Continuity (1)
Related Publication 20250139923A1 · May 1, 2025
References Cited (45)
US 8830225B1 · Karakotsios et al. · 2014 [cited by applicant]
US 9886229B2 · Christmas et al. · 2018 [cited by applicant]
US 10505086B2 · Hsieh et al. · 2019 [cited by applicant]
US 10768421B1 · Rosenberg · 2020 [cited by examiner]
US 11520217B1 · Benedetto · 2022 [cited by applicant]
US 11804162B2 · Byun · 2023 [cited by applicant]
US 12120583B2 · Christmas et al. · 2024 [cited by applicant]
US 20020027608A1 · Johnson et al. · 2002 [cited by applicant]
US 20040085256A1 · Hereld et al. · 2004 [cited by applicant]
US 20050094040A1 · Wang et al. · 2005 [cited by applicant]
US 20080252586A1 · Cheng · 2008 [cited by applicant]
US 20100118006A1 · Kimura · 2010 [cited by applicant]
US 20130021390A1 · Inada · 2013 [cited by applicant]
US 20150061999A1 · Kim et al. · 2015 [cited by applicant]
US 20150269880A1 · Ge et al. · 2015 [cited by applicant]
US 20160094840A1 · Warner · 2016 [cited by examiner]
US 20160162244A1 · Christmas et al. · 2016 [cited by applicant]
US 20160267684A1 · Li et al. · 2016 [cited by applicant]
US 20160267685A1 · Yang et al. · 2016 [cited by applicant]
US 20170242646A1 · Lee et al. · 2017 [cited by applicant]
US 20170310956A1 · Perdices-Gonzalez et al. · 2017 [cited by applicant]
US 20180324396A1 · Ishikawa et al. · 2018 [cited by applicant]
US 20190022539A1 · Kamata et al. · 2019 [cited by applicant]
US 20200128174A1 · Lin et al. · 2020 [cited by applicant]
US 20200211440A1 · Lee et al. · 2020 [cited by applicant]
US 20200225737A1 · Limor et al. · 2020 [cited by applicant]
US 20200400951A1 · Zhang · 2020 [cited by applicant]
US 20220317767A1 · Zhang et al. · 2022 [cited by applicant]
US 20230072188A1 · Gibby · 2023 [cited by examiner]
US 20230247176A1 · Kita · 2023 [cited by applicant]
US 20240069503A1 · Park et al. · 2024 [cited by applicant]
US 20250117077A1 · Obana et al. · 2025 [cited by applicant]
US 20250123787A1 · Obana et al. · 2025 [cited by applicant]
US 20250138315A1 · Obana et al. · 2025 [cited by applicant]
CN 106847172A · 2017 [cited by applicant]
CN 107957010A · 2018 [cited by applicant]
CN 111602100A · 2020 [cited by applicant]
JP H05210166A · 1993 [cited by applicant]
JP 2024173860A · 2024 [cited by applicant]
WO WO2017149254A1 · 2017 [cited by applicant]
Wagemakers et al., Interactive Visual Calibration of Volumetric Head-Tracked 3D Displays, CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems pp. 3943-3953 (Year: 2017). [cited by examiner]
Farard et al., Calibration Methods for Effective Fish Tank VR in Multi-Screen Displays, CHI 2017, May 6-11, 2017, Denver, CO, USA, ACM 978-1-4503-4656-6/17/05. http://dx.doi.org/10.1145/3027063.3052963) (Year: 2017). [cited by examiner]
Zhou et al., Automatic Calibration of a Multiple-Projector Spherical Fish Tank VR Display, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV), Santa Rosa, CA, USA, 2017, pp. 1072-1081, doi: 10.1109/WA… [cited by examiner]
Archive.org screenshot, Amsler grid, Chart 1, https://web.archive.org/web/20220804002026/https://en.wikipedia.org/wiki/Amsler_grid, hereinafter “ARCHIVE_ORG”) (Year: 2022). [cited by examiner]
International Search Report and Written Opinion in International Appln. No. PCT/US2024/050701, mailed on Jan. 15, 2025, 11 pages. [cited by applicant]