IP Library Granted Patent US 11,354,874
Granted Patent B2
US 11,354,874 · App. 16/979,950 · Granted Jun 7, 2022

Information processing apparatus and information processing method

Inventors: Hiroyuki Aga (Tokyo, JP); Atsushi Ishihara (Kanagawa, JP); Koichi Kawasaki (Tokyo, JP); Mitsuru Nishibe (Chiba, JP)
Assignee: SONY CORPORATION
G06T19/20G02B27/0025G02B27/0172G06F3/011G06T5/006G06T7/75G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,354,874
App. No.
16/979,950
Granted
Jun 7, 2022
Kind
B2
Abstract

Provided is an information processing apparatus, including a control unit that controls a display device to display a first image in a first display region and a second display region, respectively, which are adjacent to each other and have mutually different display timing, so that the first image is superimposed over a real space as seen by a user of the display device, and that controls the display device to transform the first image in the first display region and the first image in the second display region on the basis of changes in position posture information relating to the display device.

Claims (50)

1. An information processing apparatus, comprising:

a control unit configured to:

control a display device to display a first image in a first display region of the display device and a second display region of the display device, respectively, wherein

the first display region is adjacent to the second display region,

a display timing of the first display region is different from a display timing of the second display region,

the first image is superimposed over a real space, and

a boundary between the first display region and the second display region is parallel to a scanning direction of a raster scan; and

control the display device to transform the first image in the first display region and the first image in the second display region based on changes in position posture information associated with the display device, wherein

in distortion correction of the first image based on a shape of the display device, the control unit is further configured to control the display device to maintain continuity between the first image in the first display region and the first image in the second display region based on the changes in the position posture information in a direction perpendicular to the scanning direction.

2. The information processing apparatus according to claim 1 , wherein the first image is an image of a single object.

3. The information processing apparatus according to claim 2 , wherein the image of the single object is divided into the first display region and the second display region.

4. The information processing apparatus according to claim 2 , wherein

the position posture information includes forecasting information associated with forecasting results of position posture of the display device, and

the control unit is further configured to control the display device to transform the first image in the first display region and the first image in the second display region based on the forecasting information.

5. The information processing apparatus according to claim 1 , wherein

the position posture information includes first position posture information, second position posture information, and third position posture information,

the first position posture information is information acquired at a first time point,

the second position posture information is information acquired at a second time point after the first time point,

the third position posture information is information acquired at a third time point after the second time point,

the control unit is further configured to control the display device to display the first image based on the second position posture information and the third position posture information,

the first image is obtained based on transformation of a second image, and

the second image is acquired based on the first position posture information.

6. The information processing apparatus according to claim 5 , wherein

the first image in the first display region is obtained based on transformation of a first part of the second image,

the transformation of the first part of the second image is based on the second position posture information,

the first image in the second display region is obtained based on transformation of a second part of the second image, and

the transformation of the second part of the second image is based on the third position posture information.

7. The information processing apparatus according to claim 6 , wherein the control unit is further configured to control, based on the second position posture information and the third position posture information, a first transformation amount of the second image which corresponds to the first display region and a second transformation amount of the second image which corresponds to the second display region.

8. The information processing apparatus according to claim 7 , wherein the control unit is further configured to render the first transformation amount same as the second transformation amount at the boundary between the first display region and the second display region.

9. The information processing apparatus according to claim 5 , wherein the control unit is further configured to generate the second image in a frame buffer based on the first position posture information.

10. The information processing apparatus according to claim 5 , wherein the control unit is further configured to generate the second image in a frame buffer that has a region larger than a whole display region of the display device which includes the first display region and the second display region.

11. The information processing apparatus according to claim 1 , wherein

when the display device is controlled to display the second display region after the first display region, the control unit is further configured to maintain the continuity based on render of a non-display of at least a part of the first image displayed in the first display region.

12. The information processing apparatus according to claim 1 , wherein the information processing apparatus is an optically transmissive head-mounted display.

13. An information processing method, comprising:

controlling a display device to display a first image in a first display region of the display device and a second display region of the display device, respectively, wherein

the first display region is adjacent to the second display region,

a display timing of the first display region is different from a display timing of the second display region,

the first image is superimposed over a real space, and

a boundary between the first display region and the second display region is parallel to a scanning direction of a raster scan;

controlling the display device to transform the first image in the first display region and the first image in the second display region based on changes in position posture information associated with the display device; and

in distortion correction of the first image based on a shape of the display device, controlling the display device to maintain continuity between the first image in the first display region and the first image in the second display region based on the changes in the position posture information in a direction perpendicular to the scanning direction.

14. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

controlling a display device to display a first image in a first display region of the display device and a second display region of the display device, respectively, wherein

the first display region is adjacent to the second display region,

a display timing of the first display region is different from a display timing of the second display region,

the first image is superimposed over a real space, and

a boundary between the first display region and the second display region is parallel to a scanning direction of a raster scan;

controlling the display device to transform the first image in the first display region and the first image in the second display region based on changes in position posture information associated with the display device; and

in distortion correction of the first image based on a shape of the display device, controlling the display device to maintain continuity between the first image in the first display region and the first image in the second display region based on the changes in the position posture information in a direction perpendicular to the scanning direction.

Assignments (2)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 25, 2021
From: AGA, HIROYUKI; ISHIHARA, ATSUSHI; KAWASAKI, KOICHI; NISHIBE, MITSURU
To: SONY CORPORATION
Reel/Frame 056663/0925 →