IP Library › Granted Patent US 11,036,351
Granted Patent B2
US 11,036,351 · App. 16/633,711 · Granted Jun 15, 2021

Information processing device and information processing method

Inventors: Ryo Fukazawa (Kanagawa, JP); Akane Kondo (Tokyo, JP); Kei Nitta (Tokyo, JP)
Assignee: SONY CORPORATION
G06F3/04815G02B27/0172G06F3/04845G06T19/006G02B2027/014G02B2027/0138G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,036,351
App. No.
16/633,711
Granted
Jun 15, 2021
Kind
B2
Abstract

The present technique relates to an information processing device, an information processing method, and a program for enabling presentation of information to a user in a more easy-to-understand manner according to the situation. A control section controls an output associated with a position of an object which is disposed in a three-dimensional space, on the basis of user action information indicating a user's action and a position relationship between a display region of a display device and the object. The present technique is applicable to an AR-use display device.

Claims (82)

1. An information processing device, comprising:

a control section configured to:

control a specific output associated with a position of an object, wherein

the object is in a three-dimensional space,

the specific output is controlled based on user action information indicating a user's action, and a position relationship between a display region of a display device and the object, and

the object includes a first virtual object located outside the display region; and

control a first feedback output based on the user action information and a position relationship between the display region and the first virtual object, wherein the first feedback output indicates a position of the first virtual object.

2. The information processing device according to claim 1 , wherein

the object further includes a second virtual object displayed in the display region,

the specific output includes an output, by the display device, of a third virtual object that is different from the second virtual object, and

the control section is further configured to move, based on the user action information and a position relationship between the display region and the second virtual object, the third virtual object from outside the display region to inside the display region.

3. The information processing device according to claim 2 , wherein

the user action information includes information associated with a change in a first distance between the user and the second virtual object being displayed in the display region, and

the control section is further configured to move, based on the change in the first distance, the third virtual object from outside the display region to inside the display region.

4. The information processing device according to claim 2 , wherein

the user action information further includes second information regarding a change in a visual line position of the user with respect to the second virtual object, and

the control section is further configured to move, based on the change in the visual line position, the third virtual object from outside the display region to inside the display region.

5. The information processing device according to claim 1 , wherein

the user action information further includes second information regarding a change in a second distance between the user and the first virtual object, and

the control section is further configured to stepwisely control the first feedback output based on the change in the second distance.

6. The information processing device according to claim 5 , wherein

the control section is further configured to increase the first feedback output.

7. The information processing device according to claim 1 , wherein

the control section is further configured to stepwisely control the first feedback output based on a period of time taken for the user to seek out the first virtual object.

8. The information processing device according to claim 1 , wherein

the control section is further configured to control the first feedback output based on detection of no speech spoken by the user,

the control section is further configured to control a second feedback output based on detection of a speech spoken by the user, and

the second feedback output is smaller than the first feedback output.

9. The information processing device according to claim 1 , wherein

the control section is further configured to control a sound source to stereophonically present the first feedback output,

the sound source is controlled based on a relative position relationship between the user and the first virtual object, and

the control section is further configured to move coordinates of the sound source while the first feedback output is stereophonically presented.

10. The information processing device according to claim 9 , wherein

the control section is further configured to:

control the sound source to stereophonically present the first feedback output; and

change a frequency of the sound source while the first feedback output is stereophonically presented.

11. The information processing device according to claim 1 , wherein

the object further includes a first real object,

the specific output includes a second feedback output indicating a position of the first real object,

the control section is further configured to control the second feedback output based on a position relationship between the first real object and a second real object, and

the second real object is different from the first real object.

12. An information processing method, comprising:

controlling a specific output associated with a position of an object, wherein

the object is in a three-dimensional space,

the specific output is controlled based on each of user action information indicating a user's action and a position relationship between a display region of a display device and the object, and

the object includes a virtual object that is located outside the display region; and

controlling a feedback output based on the user action information and a position relationship between the display region and the virtual object, wherein the feedback output indicates a position of the virtual object.

13. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by an information processing device, cause the information processing device to execute operations, the operations comprising:

controlling a specific output associated with a position of an object, wherein

the object is in a three-dimensional space,

the specific output is controlled based on each of user action information indicating a user's action and a position relationship between a display region of a display device and the object, and

the object includes a virtual object that is located outside the display region; and

controlling a feedback output based on the user action information and a position relationship between the display region and the virtual object, wherein the feedback output indicates a position of the virtual object.

14. An information processing device, comprising:

a control section configured to:

control a display device to change a display of a virtual object associated with a first real object, wherein

the display of the virtual object is changed based on each of a position relationship between the first real object and a second real object and a parameter concerning the second real object,

the second real object is different from the first real object,

the virtual object includes a first virtual object and a second virtual object, and

a shape of the second virtual object is different from a shape of the first virtual object; and

control the display device to display one of the first virtual object or the second virtual object based on the parameter concerning the second real object.

15. The information processing device according to claim 14 , wherein

the parameter represents movement of the second real object that shields the first real object.

16. The information processing device according to claim 14 , wherein the control section is further configured to:

control, based on the second real object is a moving body, the display device to substantially maintain the display of the first virtual object associated with the first real object, and

control, based on the second real object is a non-moving body, the display device to change the display of the first virtual object associated with the first real object to the display of the second virtual object associated with the first real object.

17. The information processing device according to claim 14 , wherein

the parameter represents a size of the second real object that shields the first real object.

18. The information processing device according to claim 14 , wherein the control section is further configured to:

control, based on the first real object that has a first size, the display device to superimpose the first virtual object on the first real object, and

control, based on the first real object that has a second size smaller than the first size, the display device to display the second virtual object, wherein

the display of the second virtual object indicates a position of the first real object, and

the display of the second virtual object is not superimposed on the first real object.

19. An information processing device, comprising:

a control section configured to:

control a specific output associated with a position of an object, wherein

the object is in a three-dimensional space,

the specific output is controlled based on each of user action information indicating a user's action and a position relationship between a display region of a display device and the object, and

the object includes a first real object; and

control a feedback output based on the user action information and a position relationship between the first real object and a second real object, wherein

the feedback output indicates a position of the first real object, and

the second real object is different from the first real object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 7, 2020
From: FUKAZAWA, RYO; KONDO, AKANE; NITTA, KEI
To: SONY CORPORATION
Reel/Frame 052329/0659 →
Priority Claims (1)
JP JP2017-151475 · Aug 4, 2017 · national
Continuity (1)
Related Publication 20200210051A1 · Jul 2, 2020
Cited By (1)
US 12,450,847