IP Library Granted Patent US 10,928,919
Granted Patent B2
US 10,928,919 · App. 16/086,702 · Granted Feb 23, 2021

Information processing device and information processing method for virtual objects operability

Inventor: Tsuyoshi Ishikawa (Kanagawa, JP)
Assignee: SONY CORPORATION
G06F3/017G06F3/01G06F3/011G06F3/0481G06F3/04815G06F3/04842
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,928,919
App. No.
16/086,702
Granted
Feb 23, 2021
Kind
B2
Abstract

Provided is an information processing device including: an operation determination unit configured to execute a determination process of determining an operation input of a user with an operating body with respect to a virtual object that is defined in a virtual three-dimensional space and is virtually perceivable by the user. The operation determination unit executes the determination process on a basis of spatial position information of the operating body in a real three-dimensional space and switches the determination process on a basis of information of the operating body.

Claims (55)

1. An information processing device, comprising:

at least one processor configured to:

determine user state information based on information from a plurality of sensors, wherein the user state information corresponds to one of a walking state, a stationary state, or a running state;

switch between execution of:

a first determination process to determine a user input operation, on a virtual object, without correction of a positional relationship between an operating body and the virtual object, wherein

the user input operation is by the operating body,

the operating body is in a real three-dimensional space, and

the virtual object is in a virtual three-dimensional space, and

a second determination process to determine the user input operation, on the virtual object, with the correction of the positional relationship between the operating body and the virtual object, wherein

the switch between the execution of the first determination process and the second determination process is based on spatial position information of the operating body and the determined user state information; and

control execution of a specific process based on the determination of the user input operation.

2. The information processing device according to claim 1 , wherein the at least one processor is further configured to control a display screen to display the virtual object and an image of the operating body, such that the virtual object is visually recognizable.

3. The information processing device according to claim 2 , wherein the at least one processor is further configured to switch between the execution of the first determination process and the second determination process based on motion information of the operating body.

4. The information processing device according to claim 3 , wherein the motion information indicates a movement speed of the operating body.

5. The information processing device according to claim 4 , wherein

the at least one processor is further configured to switch between the execution of the first determination process and the second determination process based on a criterion,

the criterion is based on a first speed value of the movement speed of the operating body and a second speed value of the movement speed of the operating body, and

the first speed value is different from the second speed value.

6. The information processing device according to claim 5 , wherein the criterion is related to a virtual positional relationship between the operating body and the virtual object.

7. The information processing device according to claim 1 , wherein

the at least one processor is further configured to switch between the execution of the first determination process and the second determination process based on a first density value of a plurality of virtual objects and a second density value of the plurality of virtual objects, and

the first density value is different from the second density value.

8. The information processing device according to claim 1 , wherein the at least one processor is further configured to switch between the execution of the first determination process and the second determination process based on specific information of the virtual object.

9. The information processing device according to claim 8 , wherein the specific information of the virtual object is at least one of information representing a position of the virtual object, information representing a state of the virtual object, and information representing a type of the virtual object.

10. The information processing device according to claim 1 , wherein the execution of the first determination process and the second determination process is based on an operation determination area associated with the virtual object.

11. The information processing device according to claim 10 , wherein the operation determination area is visually unrecognizable.

12. The information processing device according to claim 10 , wherein the at least one processor is further configured to control a display screen to display the operation determination area such that the operation determination area is visually recognizable.

13. The information processing device according to claim 1 , wherein

the at least one processor is further configured to control a display screen, to change a display of the virtual object, based on the determination of the user input operation.

14. The information processing device according to claim 13 , wherein the virtual object is a virtual input device.

15. The information processing device according to claim 1 , wherein

the at least one processor is further configured to correct a criterion of the execution of the first determination process and the second determination process, based on a first direction of the user input operation and a second direction of the user input operation,

the second direction is different from the first direction, and

in the second determination process, a degree of correction of the positional relationship in the first direction is different from a degree of correction of the positional relationship in the second direction.

16. The information processing device according to claim 1 , wherein the at least one processor is further configured to switch between the execution of the first determination process and the second determination process with respect to a depth direction of the operating body.

17. An information processing method, comprising:

determining user state information based on information from a plurality of sensors, wherein the user state information corresponds to one of a walking state, a stationary state, or a running state;

switching between execution of:

a first determination process of determining a user input operation, on a virtual object, without correction of a positional relationship between an operating body and the virtual object, wherein

the user input operation is by the operating body,

the operating body is in a real three-dimensional space, and

the virtual object is in a virtual three-dimensional space, and

a second determination process of determining the user input operation, on the virtual object, with the correction of the positional relationship between the operating body and the virtual object, wherein

the switching between the execution of the first determination process and the second determination process is based on spatial position information of the operating body and the determined user state information; and

controlling execution of a specific process based on the determination of the user input operation.

18. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which when executed by a computer, cause the computer to execute operations, the operations comprising:

determining user state information based on information from a plurality of sensors, wherein the user state information corresponds to one of a walking state, a stationary state, or a running state;

switching between execution of:

a first determination process of determining a user input operation, on a virtual object, without correction of a positional relationship between an operating body and the virtual object, wherein

the user input operation is by the operating body,

the operating body is in a real three-dimensional space, and

the virtual object is in a virtual three-dimensional space, and

a second determination process of determining the user input operation, on the virtual object, with the correction of the positional relationship between the operating body and the virtual object, wherein

the switching between the execution of the first determination process and the second determination process is based on spatial position information of the operating body and the determined user state information; and

controlling execution of a specific process based on the determination of the user input operation.

Assignments (2)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 20, 2018
From: ISHIKAWA, TSUYOSHI
To: SONY CORPORATION
Reel/Frame 047114/0760 →