IP Library Granted Patent US 11,327,317
Granted Patent B2
US 11,327,317 · App. 16/963,642 · Granted May 10, 2022

Information processing apparatus and information processing method

Inventors: Kazuma Aiki (Tokyo, JP); Ryo Fukazawa (Kanagawa, JP); Jun Kimura (Kanagawa, JP)
Assignee: SONY CORPORATION
G02B27/0172G06T19/006H04N13/344G02B2027/0134G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,327,317
App. No.
16/963,642
Granted
May 10, 2022
Kind
B2
Abstract

[Problem] To provide an information processing apparatus, an information processing method, and a program. [Solution] An information processing apparatus including a display control unit that causes a display unit to display a virtual image in a three-dimensional space. The display control unit causes the display unit to display only one of a left-eye image and a right-eye image corresponding to the virtual image if it is determined that the virtual image is located outside of a predetermined range in a depth direction when viewed from a user of the display unit, and causes the display unit to display the left-eye image and the right-eye image if it is determined that the virtual image is located inside of the predetermined range.

Claims (43)

1. An information processing apparatus, comprising:

a display control unit configured to control a display unit to display a virtual image in a three-dimensional space, wherein the display unit is associated with a head-mounted display; and

a first determination unit configured to determine, based on detection of a user action, that the virtual image is located outside of a first range and at a second range closer than the first range, wherein

the first range and the second range are in a depth direction when viewed from a user of the display unit,

the user action includes an action in which the user faces downward, and

the display control unit is further configured to:

control the display unit to display one of a left-eye image corresponding to the virtual image or a right-eye image corresponding to the virtual image, based on a determination that the virtual image is located outside of the first range and at the second range closer than the first range, and

control the display unit to display the left-eye image and the right-eye image based on a determination that the virtual image is located inside of the first range.

2. The information processing apparatus according to claim 1 , wherein the first range is a range separated by a distance equal to or more than a threshold distance from the user.

3. The information processing apparatus according to claim 2 , wherein the display control unit is further configured to control the display unit to display a stereoscopic image in the first range.

4. The information processing apparatus according to claim 1 , wherein the user action includes an action in which the user moves one of an arm or a hand to inside of a field of view.

5. The information processing apparatus according to claim 4 , wherein the display control unit is further configured to control, based on the detection of the user action, the display unit to display one of the left-eye image or the right-eye image on one of the arm or the hand of the user.

6. The information processing apparatus according to claim 1 , further comprising

a second determination unit configured to determine that the virtual image is located at the second, based on detection of a real object.

7. The information processing apparatus according to claim 1 , wherein the display unit is associated with a virtual image distance.

8. The information processing apparatus according to claim 7 , wherein the first range is based on at least one of a first distance that is smaller than the virtual image distance and a second distance that is larger than the virtual image distance.

9. The information processing apparatus according to claim 8 , wherein a difference between a convergence angle corresponding to the virtual image distance and a convergence angle between the left-eye image and the right-eye image is equal to or smaller than 1 degree and equal to or larger than −1 degree.

10. The information processing apparatus according to claim 7 , wherein the display unit has optical transmissivity.

11. The information processing apparatus according to claim 1 , wherein the three-dimensional space is a real space.

12. The information processing apparatus according to claim 1 , wherein

the display control unit is further configured to determine the one of the left-eye image or the right-eye image, based on user information, and

the user information includes information on a dominant eye.

13. The information processing apparatus according to claim 1 , wherein

the display control unit is further configured to control the display unit to display an alternative image based on the determination that the virtual image is located outside of the first range, and

an amount of information in the alternative image is smaller than an amount of information in the one of the left-eye image or the right-eye image.

14. The information processing apparatus according to claim 1 , wherein

the display unit includes a left-eye display that displays the left-eye image, and a right-eye display that displays the right-eye image, and

the display control unit is further configured to reduce power supply to one of the left-eye display or the right-eye display based on the determination that the virtual image is located outside of the first range.

15. An information processing method, comprising:

controlling, by a processor, a display unit to display a virtual image in a three-dimensional space, wherein the display unit is associated with a head-mounted display;

determining, by the processor, that the virtual image is located outside of a first range and at a second range closer than the first range, wherein

the determination is based on detection of a user action,

the first range and the second range are in a depth direction when viewed from a user of the display unit, and

the user action includes an action in which the user faces downward:

controlling, by the processor, the display unit to display one of a left-eye image corresponding to the virtual image or a right-eye image corresponding to the virtual image, based on a determination that the virtual image is located outside of the first range and at the second range closer than the first range; and

controlling, by the processor, the display unit to display the left-eye image and the right-eye image based on a determination that the virtual image is located inside of the first range.

16. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

controlling a display unit to display a virtual image in a three-dimensional space, wherein the display unit is associated with a head-mounted display;

determining, based on detection of a user action, that the virtual image is located outside of a first range and at a second range closer than the first range, wherein

the first range and the second range are in a depth direction when viewed from a user of the display unit, and

the user action includes an action in which the user faces downward:

controlling the display unit to display one of a left-eye image corresponding to the virtual image or a right-eye image corresponding to the virtual image, based on a determination that the virtual image is located outside of the first range and at the second range closer than the first range; and

controlling the display unit to display the left-eye image and the right-eye image based on a determination that the virtual image is located inside of the first range.

Assignments (3)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY NAME PREVIOUSLY RECORDED AT REEL: 058981 FRAME: 0349. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 6, 2022
From: AIKI, KAZUMA; FUKAZAWA, RYO; KIMURA, JUN
To: SONY CORPORATION
Reel/Frame 059664/0788 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2021
From: AIKI, KAZUMA; FUKAZAWA, RYO; KIMURA, JUN
To: SONY GROUP CORPORATION
Reel/Frame 058981/0349 →