IP Library Granted Patent US 12,105,869
Granted Patent B2
US 12,105,869 · App. 17/250,621 · Granted Oct 1, 2024

Information processing apparatus and information processing method

Inventors: Kenji Sugihara (Tokyo, JP); Mari Saito (Tokyo, JP)
Assignee: SONY CORPORATION
G06F3/013G06F3/017H04N13/268H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,105,869
App. No.
17/250,621
Granted
Oct 1, 2024
Kind
B2
Abstract

An information processing device according to an embodiment of the present technology includes a movement-information acquisition unit, a gaze-information acquisition unit, and a display control unit. The movement-information acquisition unit acquires movement information about a gesture by a user. The gaze-information acquisition unit acquires information about a gazing point of the user. The display control unit controls a display device on the basis of the movement information. The display control unit causes the display device to display a first virtual object including information relating to a target object in a first region related to the target object, and to vary, on the basis of a position of the gazing point in duration for which the user is making the gesture, how the first virtual object is displayed.

Claims (76)

1. An information processing device, comprising:

a processor configured to:

acquire movement information about a gesture by a user;

acquire information about a gazing point of the user;

control a display device based on the movement information;

cause the display device to display a first virtual object including information relating to a target object in a first region related to the target object, wherein the first region is on the display device;

vary the display of the first virtual object based on a position of the gazing point in duration for which the user makes the gesture;

cause the display device to increase an information amount of the first virtual object based on presence of the gazing point in the first region while the gesture is made by the user, wherein

the increase in the information amount of the first virtual object corresponds to a switch of a texture of the first virtual object from a still image to a moving image, and

the target object is a second virtual object;

cause the display device to display the first virtual object behind the second virtual object as viewable from the user;

cause the display device to display a fourth virtual object behind the second virtual object as viewed from the user; and

move the fourth virtual object to a position where the first virtual object is located until the gesture of the user is started during movement of the first virtual object and the second virtual object in a depth direction if the gazing point of the user does not remain on one of the first virtual object and the second virtual object while the gesture is made by the user.

2. The information processing device according to claim 1 , wherein

the processor is further configured to cause the display device to reduce the information amount of the first virtual object based on presence of the gazing point of the user in a second region while the gesture is made by the user, and

the second region is out of the first region.

3. The information processing device according to claim 2 , wherein the second region excludes the first virtual object.

4. The information processing device according to claim 3 , wherein the second region is a lateral surface of the target object.

5. The information processing device according to claim 4 , wherein

the processor is further configured to cause the display device to display the first virtual object in a manner that, before the gesture is made, at least a part of the lateral surface of the target object is visually recognizable.

6. The information processing device according to claim 3 , wherein the second region is a back surface of the target object.

7. The information processing device according to claim 3 , wherein

the processor is further configured to cause the display device to continuously reduce the information amount of the first virtual object in response to the gesture of the user, and

the information amount of the first virtual object is continuously reduced based on the presence of the gazing point of the user in the second region while the gesture is made by the user.

8. The information processing device according to claim 7 , wherein

the processor is further configured to cause the display device not to display the first virtual object at a time point based on completion of the gesture while the gazing point of the user is maintained in the second region, and

the time point is related to finish of the gesture of the user.

9. The information processing device according to claim 1 , wherein the gesture is a hand gesture to turn the target object.

10. The information processing device according to claim 1 , wherein a relative positional relationship between the target object and a head of the user is varied based on the gesture.

11. The information processing device according to claim 10 , wherein the gesture is a head gesture to vary a position of the head of the user.

12. The information processing device according to claim 1 , wherein the target object is moved based on the gesture.

13. The information processing device according to claim 1 , wherein

the target object is a real object, and

the processor is further configured to cause the display device to display the first virtual object in a manner that a relative positional relationship between a part of the real object and the first virtual object is fixed.

14. The information processing device according to claim 1 , wherein

the processor is further configured to:

cause the display device to display a third virtual object behind the first virtual object as viewable from the user, and

increase an information amount of the third virtual object during movement of the first virtual object and the second virtual object in a depth direction if the gazing point of the user does not remain on one of the first virtual object and the second virtual object while the gesture is made by the user.

15. The information processing device according to claim 1 , wherein the processor is further configured to control the display device so that a part of the first virtual object is covered with a hand of the user before the gesture is made.

16. An information processing method, comprising:

acquiring movement information about a gesture by a user;

acquiring information about a gazing point of the user;

controlling a display device based on the movement information;

controlling the display device to display a first virtual object including information relating to a target object is displayed in a first region related to the target object, wherein the first region is on the display device;

varying the display of the first virtual object based on a position of the gazing point in duration for which the user is making the gesture; and

causing the display device to increase an information amount of the first virtual object based on presence of the gazing point in the first region while the gesture is made by the user, wherein

the increase in the information amount of the first virtual object corresponds to a switch of a texture of the first virtual object from a still image to a moving image, and

the target object is a second virtual object;

causing the display device to display the first virtual object behind the second virtual object as viewable from the user;

causing the display device to display a fourth virtual object behind the second virtual object as viewed from the user; and

moving the fourth virtual object to a position where the first virtual object is located until the gesture of the user is started during movement of the first virtual object and the second virtual object in a depth direction if the gazing point of the user does not remain on one of the first virtual object and the second virtual object while the gesture is made by the user.

17. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by a processor, cause the processor to execute operations, the operations comprising:

acquiring movement information about a gesture by a user;

acquiring information about a gazing point of the user;

controlling a display device based on the movement information;

causing the display device to display a first virtual object including information relating to a target object is displayed in a first region related to the target object, wherein the first region is on the display device;

varying the display of the first virtual object based on a position of the gazing point in duration for which the user is making the gesture; and

causing the display device to increase an information amount of the first virtual object based on presence of the gazing point in the first region while the gesture is made by the user, wherein

the increase in the information amount of the first virtual object corresponds to a switch of a texture of the first virtual object from a still image to a moving image, and

the target object is a second virtual object;

causing the display device to display the first virtual object behind the second virtual object as viewable from the user;

causing the display device to display a fourth virtual object behind the second virtual object as viewed from the user; and

moving the fourth virtual object to a position where the first virtual object is located until the gesture of the user is started during movement of the first virtual object and the second virtual object in a depth direction if the gazing point of the user does not remain on one of the first virtual object and the second virtual object while the gesture is made by the user.

18. An information processing device, comprising:

a processor configured to:

acquire movement information about a gesture by a user;

acquire information about a gazing point of the user;

control a display device based on the movement information;

cause the display device to display a first virtual object including information relating to a target object in a first region related to the target object, wherein the first region is on the display device;

vary the display of the first virtual object based on a position of the gazing point in duration for which the user makes the gesture;

cause the display device to increase an information amount of the first virtual object based on presence of the gazing point in the first region while the gesture is made by the user, wherein

the information amount of the first virtual object corresponds to a resolution of the first virtual object, and

the target object is a second virtual object; and

cause the display device to display the first virtual object behind the second virtual object as viewable from the user;

cause the display device to display a third virtual object behind the first virtual object as viewable from the user; and

increase an information amount of the third virtual object during movement of the first virtual object and the second virtual object in a depth direction if the gazing point of the user does not remain on one of the first virtual object and the second virtual object while the gesture is made by the user.

Assignments (2)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2021
From: SUGIHARA, KENJI; SAITO, MARI
To: SONY CORPORATION
Reel/Frame 055236/0174 →