IP Library Granted Patent US 12,228,733
Granted Patent B2
US 12,228,733 · App. 17/430,015 · Granted Feb 18, 2025

Head-mounted display and image display method

Inventors: Akio Ohba (Kanagawa, JP); Tetsugo Inada (Tokyo, JP); Yoshinori Ohashi (Tokyo, JP); Kazuyuki Arimatsu (Tokyo, JP)
Assignee: Sony Interactive Entertainment Inc.
G02B27/0172G06T3/00G09G3/20G09G5/00G09G5/36G02B2027/011G02B2027/0116G02B2027/0134G02B2027/0138G02B2027/014
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,228,733
App. No.
17/430,015
Granted
Feb 18, 2025
Kind
B2
Abstract

When a head-mounted display acquires data of a display image generated on the basis of position/posture information of a head of a user at time and given a distortion corresponding to the distortion of an eyepiece lens, the head-mounted display corrects the image on the basis of position/posture information of the head at time t for display. Then, the head-mounted display corrects chromatic aberrations on the basis of actual distortion coefficients of the lens, and outputs the image to a display panel.

Claims (27)

1. A head-mounted display for allowing observation of a display image through an eyepiece lens for enlarging a user's viewing angle, comprising:

an image acquiring section for acquiring data of the display image that is given a reverse distortion to reverse an image distortion caused by the eyepiece lens;

a reprojection section operating to correct chromatic aberration in the reverse distorted display image as a function of a distortion coefficient of the eyepiece lens that is unique to the head-mounted display; and

a display section for outputting the corrected display image, wherein:

the image acquiring section and the reprojection section operate to perform a first correction as an initial step to correct the image distortion, followed by a second correction to separately correct the chromatic aberration in the reverse distorted display image, and

the first correction and the second correction are performed independent of, and a display frame rate is adjusted independently of, the generation of the display image.

2. The head-mounted display according to claim 1 , further comprising:

a position/posture information acquiring section for acquiring information of a position and posture of the head-mounted display;

wherein the reprojection section corrects the display image so as to correspond to the information of the position and posture at the display timing.

3. The head-mounted display according to claim 1 , wherein the reprojection section corrects the distortion given to the display image on a basis of a distortion coefficient of the eyepiece lens mounted in the head-mounted display.

4. The head-mounted display according to claim 3 , wherein the reprojection section acquires a corrective quantity corresponding to the distortion of the eyepiece lens in units of pixels with respect to each of primary colors included in data of the display image, and displaces the pixels by subtracting the corrective quantity given to the display image, thereby correcting the display image per primary color.

5. The head-mounted display according to claim 4 , further comprising:

a distortion parameter storage section for storing a displacement vector map of displacement vectors representing a corrective quantity and a corrective direction corresponding to the distortion of the eyepiece lens, per pixel on an image plane of the display image,

wherein the reprojection section corrects the display image by referring to the displacement vector map.

6. The head-mounted display according to claim 1 , wherein the reprojection section interpolates frames of the display image acquired by the image acquiring section with respect to a time to achieve a predetermined frame rate.

7. An image display method by a head-mounted display for allowing observation of a display image through an eyepiece lens for enlarging a user's viewing angle, comprising:

acquiring data of the display image that is given a reverse distortion to reverse an image distortion caused by the eyepiece lens;

correcting chromatic aberration in the reverse distorted display image as a function of a distortion coefficient of the eyepiece lens that is unique to the head-mounted display; and

outputting the corrected display image, wherein:

the acquiring and the correcting operate to perform a first correction as an initial step to correct the image distortion, followed by a second correction to separately correct the chromatic aberration in the reverse distorted display image, and

the first correction and the second correction are performed independent of, and a display frame rate is adjusted independently of, the generation of the display image.

8. A non-transitory, computer-readable storage medium containing a computer program, which when executed by a computer, included in a head-mounted display, to allow observation of a display image through an eyepiece lens for enlarging a user's viewing angle by carrying out actions, comprising:

acquiring data of the display image that is given a reverse distortion to reverse an image distortion caused by the eyepiece lens;

correcting chromatic aberration in the reverse distorted display image as a function of a distortion coefficient of the eyepiece lens that is unique to the head-mounted display; and

outputting the corrected display image, wherein:

the acquiring and the correcting operate to perform a first correction as an initial step to correct the image distortion, followed by a second correction to separately correct the chromatic aberration in the reverse distorted display image, and

the first correction and the second correction are performed independent of, and a display frame rate is adjusted independently of, the generation of the display image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2021
From: OHBA, AKIO; INADA, TETSUGO; OHASHI, YOSHINORI; ARIMATSU, KAZUYUKI
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 057147/0100 →
Continuity (1)
Related Publication 20220113543A1 · Apr 14, 2022
References Cited (55)
US 5369450A · Haseltine · 1994 [cited by applicant]
US 8373619B2 · Tsujimoto · 2013 [cited by applicant]
US 9489723B2 · Hirota · 2016 [cited by applicant]
US 9628766B2 · Tamayama · 2017 [cited by applicant]
US 9740007B2 · Ikeda · 2017 [cited by applicant]
US 9766458B2 · Ikeda · 2017 [cited by applicant]
US 10152775B1 · Bellows · 2018 [cited by examiner]
US 10156724B2 · Shimazu · 2018 [cited by applicant]
US 10629107B2 · Yamamoto · 2020 [cited by applicant]
US 10755675B2 · Nakata · 2020 [cited by applicant]
US 11194391B2 · Zhang · 2021 [cited by applicant]
US 11297292B2 · Aoyanagi · 2022 [cited by examiner]
US 11960086B2 · Ohba · 2024 [cited by applicant]
US 20100090929A1 · Tsujimoto · 2010 [cited by applicant]
US 20140009368A1 · Hirota · 2014 [cited by applicant]
US 20140078023A1 · Ikeda · 2014 [cited by applicant]
US 20150009416A1 · Tamayama · 2015 [cited by applicant]
US 20150379697A1 · Pohl · 2015 [cited by applicant]
US 20160091720A1 · Stafford · 2016 [cited by applicant]
US 20160252730A1 · Ikeda · 2016 [cited by applicant]
US 20160353094A1 · Rougeaux · 2016 [cited by applicant]
US 20160364904A1 · Parker · 2016 [cited by applicant]
US 20170186231A1 · Petrov · 2017 [cited by examiner]
US 20170329136A1 · Bates · 2017 [cited by applicant]
US 20170340969A1 · Lim · 2017 [cited by applicant]
US 20170351325A1 · Hashimoto · 2017 [cited by applicant]
US 20180074321A1 · Shimazu · 2018 [cited by examiner]
US 20180114298A1 · Malaika · 2018 [cited by applicant]
US 20180315364A1 · Yamamoto · 2018 [cited by applicant]
US 20180322669A1 · Elliott · 2018 [cited by applicant]
US 20190213975A1 · Nakata · 2019 [cited by applicant]
US 20200132996A1 · Yokota · 2020 [cited by applicant]
JP 2010092360A · 2010 [cited by applicant]
JP 2011139158A · 2011 [cited by applicant]
JP 2014013968A · 2014 [cited by applicant]
JP 2016162033A · 2016 [cited by applicant]
JP 2017524278A · 2017 [cited by applicant]
JP 2018005028A · 2018 [cited by applicant]
WO 2013125138A1 · 2013 [cited by applicant]
WO 2013140697A1 · 2013 [cited by applicant]
WO 2016181909A1 · 2016 [cited by applicant]
WO 2017086263A1 · 2017 [cited by applicant]
WO 2018047730A1 · 2018 [cited by applicant]
WO 2019026765A1 · 2019 [cited by applicant]
International Search Report for related PCT Application No. PCT/JP2019/006910, 3 pages, dated May 21, 2019. [cited by applicant]
International Search Report for related PCT Application No. PCT/JP2019/006912, 3 pages, dated Apr. 23, 2019. [cited by applicant]
Extended European Search Report for related EP Application No. 19915895.7, 11 pages, dated Sep. 9, 2022. [cited by applicant]
Extended European Search Report for corresponding EP Application No. 19915966.6, 18 pages, dated Aug. 4, 2022. [cited by applicant]
Decision of Refusal for corresponding JP Application No. 2021-501369, 6 pages, dated Jul. 19, 2022. [cited by applicant]
International Search Report for corresponding PCT Application No. PCT/JP2019/006911, 4 pages, dated May 21, 2019. [cited by applicant]
Notice of Reasons or Refusal for corresponding JP Application No. 2021-501370, 4 pages, dated Apr. 18, 2022. [cited by applicant]
Notice of Reasons or Refusal for related JP Application No. 2021-501369, 8 pages, Apr. 18, 2022. [cited by applicant]
International Preliminary Report on Patentability and Written Opinion for corresponding PCT Application No. PCT/JP2019/006911, 13 pages, dated Sep. 2, 2021. [cited by applicant]
International Preliminary Report on Patentability and Written Opinion for related PCT Application No. PCT/JP2019/006910, 11 pages, dated Sep. 2, 2021. [cited by applicant]
International Preliminary Report on Patentability and Written Opinion for related PCT Application No. PCT/JP2019/006912, 11 pages, dated Sep. 2, 2021. [cited by applicant]