Granted Patent B2

US 12,370,434 · App. 18/390,097 · Granted Jul 29, 2025

Inventor: Yoshinori Ohashi (Tokyo, JP)

A63F13/213A63F13/25A63F13/52A63F13/533A63F13/577G06F3/011G06T19/006G09G5/36A63F2300/1087A63F2300/308A63F2300/643A63F2300/66G06F3/0482G06F3/0484G09G2354/00

Abstract

Claims (50)

1. An information processing device connected to a display device presenting an image of a virtual space to a user, the information processing device comprising:

circuitry configured to

obtain information regarding a position of a fingertip of the user in a real space;

set, within the virtual space, a position and an image of a virtual object superimposed on an image of an object within the real space;

determine contact between the virtual object set within the virtual space and the finger of the user;

recognize a surface of the object within the real space; and

perform processing in which the position of the virtual object is moved to a position based on the surface according to an instruction of the user, wherein

the circuitry is configured to set an icon included in the virtual object in a deformed state when a fingertip of the user is in contact with the icon.

2. The information processing device of claim 1 , wherein

the circuitry is configured to prevent the virtual object from being set further back than the surface of the object.

3. The information processing device of claim 1 , wherein the virtual object has a curved shape.

4. The information processing device of claim 1 , wherein

the circuitry is configured to set the virtual object such that a contour line of the virtual object is displayed in a first color when the circuitry determines that the virtual object and the fingertip of the user are in contact with each other, and the contour line is displayed in a second color when the circuitry determines that no fingertips of the user are in contact with the virtual object.

5. The information processing device of claim 1 , wherein

the circuitry is configured to perform processing in a mode in which the position of the virtual object is moved by an amount of movement within the virtual space, the amount of movement corresponding to an amount of movement of the finger of the user in the real space.

6. The information processing device of claim 1 , wherein

the circuitry is configured to perform processing in a mode in which the position of the virtual object is not moved irrespective of movement of a part of the user in the real space based on an instruction of the user.

7. The information processing device of claim 5 , wherein

the circuitry is configured to perform processing in a plurality of modes and when a predetermined operation is performed in each mode, the circuitry is configured to switch to processing in another mode.

8. The information processing device of claim 1 , wherein the circuitry is configured to:

obtain orientation information indicating whether each finger of the user is showing a back or showing a pad; and

set the virtual object in a partly deformed state such that a part of the virtual object corresponding to a position of a finger showing the back determined to be in contact with the virtual object among the fingers of the user, is located a greater distance away from the user than the position of the finger showing the back.

9. The information processing device of claim 8 , wherein

the virtual object is rendered in a state of being superimposed on a finger showing the pad among the fingers of the user.

10. The information processing device of claim 1 , wherein

the information processing device is a head-mounted display device configured to be worn on the user's head.

11. A method performed by an information processing device, the method comprising:

obtaining information regarding a position of a fingertip of the user in a real space;

setting, within a virtual space, a position and an image of a virtual object superimposed on an image of an object within the real space;

determining contact between the virtual object set within the virtual space and the finger of the user;

recognizing a surface of the object within the real space;

performing processing in which the position of the virtual object is moved to a position based on the surface according to an instruction of the user; and

setting an icon included in the virtual object in a deformed state when a fingertip of the user is in contact with the icon.

12. The method of claim 11 , further comprising:

preventing the virtual object from being set further back than the surface of the object.

13. The method of claim 11 , wherein

the virtual object has a curved shape.

14. The method of claim 11 , further comprising:

moving the position of the virtual object within the virtual space based on an amount of movement of the finger of the user in the real space.

15. A non-transitory computer readable medium having stored thereon a program, which when executed by circuitry, causes the circuitry to:

obtain information regarding a position of a fingertip of the user in a real space;

set, within a virtual space, a position and an image of a virtual object superimposed on an image of an object within the real space;

determine contact between the virtual object set within the virtual space and the finger of the user;

recognize a surface of the object within the real space;

perform processing in which the position of the virtual object is moved to a position based on the surface according to an instruction of the user; and

setting an icon included in the virtual object in a deformed state when a fingertip of the user is in contact with the icon.

16. The non-transitory computer readable medium of claim 15 , wherein the program, when executed by the circuitry, causes the circuitry to:

prevent the virtual object from being set further back than the surface of the object.

17. The non-transitory computer readable medium of claim 11 , wherein

the virtual object has a curved shape.

Assignments (1)

Priority Claims (1)

Continuity (5)

References Cited (55)