IP Library Granted Patent US 11,417,296
Granted Patent B2
US 11,417,296 · App. 16/978,267 · Granted Aug 16, 2022

Information processing device, information processing method, and recording medium

Inventors: Mari Saito (Kanagawa, JP); Tsuyoshi Ishikawa (Kanagawa, JP); Ryo Yokoyama (Tokyo, JP)
Assignee: SONY CORPORATION
G09G5/37G06F3/013H04S7/303G09G2354/00H04S2400/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,417,296
App. No.
16/978,267
Granted
Aug 16, 2022
Kind
B2
Abstract

[Problem] An information processing device, an information processing method, and a recording medium that enable change in display of real space without being noticed by a communicatee are to be proposed. [Solution] An information processing device, including: a determining unit that determines a gazing state or a non-gazing state of a first user present in first real space, for a display object displayed by a display device of the first user, the display object being associated with second real space different from the first real space; and a display control unit that changes appearance of the display object when the gazing state has been changed to the non-gazing state.

Claims (50)

1. An information processing device, comprising:

a determining unit configured to determine one of a gazing state or a non-gazing state of a first user present in a first real space, for a first display object displayed by a display device of the first user,

wherein the first display object is associated with a second real space different from the first real space; and

a display control unit configured to:

control output of an attracting region at a position spaced apart from the first display object, to attract a line of sight of the first user to the attracting region; and

change an appearance of the first display object based on the output of the attracting region and the determination of the non-gazing state.

2. The information processing device according to claim 1 , wherein the display control unit is further configured to gradually change the appearance of the first display object every time the gazing state is changed to the non-gazing state.

3. The information processing device according to claim 1 , wherein the display control unit is further configured to gradually increase, based on an elapse of a specific time, an amount of the change in the appearance of the first display object.

4. The information processing device according to claim 1 , wherein the output of the attracting region includes one of display of an attracting object at the position spaced apart from the first display object or increase in visual attraction of a region spaced apart from the first display object.

5. The information processing device according to claim 1 , further comprising a sound control unit configured to output sound information having a sound image localized at the position spaced apart from the first display object, wherein

the display control unit is further configured to change the appearance of the first display object based on the determination of the non-gazing state for the first display object, and

the change in the appearance of the first display object is subsequent to the output of the sound information.

6. The information processing device according to claim 1 , wherein the determining unit is further configured to determine the one of the gazing state or the non-gazing state of the first user for the first display object, based on one of the line of sight of the first user, an orientation of a face of the first user, or an orientation of a head of the first user.

7. The information processing device according to claim 1 , wherein the change in the appearance of the first display object is difficult to be recognized by the first user.

8. The information processing device according to claim 7 , wherein

the display control unit is further configured to change an appearance of a second display object of a plurality of display objects associated with the second real space,

the first display object has a visual attraction lower than that of the second display object,

the change in the appearance of the second display object is subsequent to the change in the appearance of the first display object, and

the plurality of display objects includes the first display object.

9. The information processing device according to claim 7 , wherein

the display control unit is further configured to change an appearance of a second display object of a plurality of display objects associated with the second real space,

a spatial distance of the first display object from a gaze point of the first user is longer than a spatial distance of the second display object from the gaze point,

the change in the appearance of the second display object is subsequent to the change in the appearance of the first display object, and

the plurality of display objects includes the first display object.

10. The information processing device according to claim 7 , wherein

the first display object corresponds to a second user present in the second real space, and

the display control unit is further configured to change an appearance of a part of the second user different from a face of the second user.

11. The information processing device according to claim 7 , wherein

the first display object is different from a second user present in the second real space, and

the display control unit is further configured to change the appearance of the first display object that is at an end of an angle of view displayed by the display device.

12. The information processing device according to claim 1 , wherein the display control unit is further configured to control an amount of the change based on whether the first display object looks familiar to the first user.

13. The information processing device according to claim 1 , wherein the first display object is a real object imaged in the second real space.

14. The information processing device according to claim 1 , wherein the display control unit is further configured to adjust an amount of the change in the appearance of the first display object based on sensitivity of the first user to change.

15. The information processing device according to claim 13 , wherein in a case where an appearance of the real object is in a state deviated from a given trend, the display control unit is further configured to change the appearance of the first display object such that the changed appearance fulfills the given trend.

16. An information processing method performed by a processor, the information processing method comprising:

determining one of a gazing state or a non-gazing state of a user present in a first real space, for a display object displayed by a display device of the user,

wherein the display object is associated with a second real space different from the first real space;

controlling output of an attracting region at a position spaced apart from the display object, to attract a line of sight of the user to the attracting region; and

changing an appearance of the display object based on the output of the attracting region and the determination of the non-gazing state.

17. A non-transitory computer-readable medium having stored thereon computer-executable instructions, which when executed by a processor, cause the processor to execute operations, the operations comprising:

determining one of a gazing state or a non-gazing state of a user present in a first real space, for a display object displayed by a display device of the user,

wherein the display object is associated with a second real space different from the first real space;

controlling output of an attracting region at a position spaced apart from the display object, to attract a line of sight of the user to the attracting region; and

changing an appearance of the display object based on the output of the attracting region and the determination of the non-gazing state.

18. An information processing device, comprising:

a determining unit configured to determine one of a gazing state or a non-gazing state of a user present in a first real space, for a display object displayed by a display device of the user,

wherein the display object is associated with a second real space different from the first real space;

a sound control unit configured to output sound information having a sound image localized at a position spaced apart from the display object; and

a display control unit configured to change an appearance of the display object based the determination of the non-gazing state for the display object,

wherein the change in the appearance of the display object is subsequent to the output of the sound information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2021
From: SAITO, MARI; ISHIKAWA, TSUYOSHI; YOKOYAMA, RYO
To: SONY CORPORATION
Reel/Frame 056602/0145 →
Priority Claims (1)
JP JP2018-045141 · Mar 13, 2018 · national
Continuity (1)
Related Publication 20200410960A1 · Dec 31, 2020