IP Library › Granted Patent US 11,896,893
Granted Patent B2
US 11,896,893 · App. 18/114,565 · Granted Feb 13, 2024

Information processing device, control method of information processing device, and program

Inventor: Yoshinori Ohashi (Tokyo, JP)
Assignee: Sony Interactive Entertainment Inc.
A63F13/213A63F13/25A63F13/52A63F13/533A63F13/577G06F3/011G06T19/006G09G5/36A63F2300/1087A63F2300/308A63F2300/643A63F2300/66G06F3/0482G06F3/0484G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,896,893
App. No.
18/114,565
Granted
Feb 13, 2024
Kind
B2
Abstract

An information processing device obtains information regarding the position of each fingertip of a user in a real space, and determines contact between a virtual object set within a virtual space and a finger of the user. The information processing device sets the virtual object in a partly deformed state such that a part of the virtual object, the part corresponding to the position of the finger determined to be in contact with the object among the fingers of the user, is located more to a far side from a user side than the finger, and displays the virtual object having the shape set thereto as an image in the virtual space on a display device.

Claims (58)

1. An information processing device connected to a display device presenting an image of a virtual space to a user, the information processing device comprising:

circuitry configured to

obtain information regarding a position of each fingertip of the user in a real space;

set a position and an image of a virtual object within the virtual space;

determine contact between the virtual object set within the virtual space and a finger of the user;

recognize a flat surface within the real space; and

perform processing in a paste mode in which the position of the virtual object is set at a position pasted to the flat surface according to an instruction of the user.

2. The information processing device according to claim 1 , wherein

the circuitry is configured to set the virtual object in a deformed state when a first hand of the user or a second hand of the user is in contact with the virtual object.

3. The information processing device according to claim 1 , wherein

the circuitry is configured to set the virtual object such that a contour line of the virtual object is displayed in a first color when the circuitry determines that the virtual object and a fingertip of the user are in contact with each other and the contour line is displayed in a second color when the circuitry determines that none of the fingertips of the user is in contact with the virtual object.

4. The information processing device according to claim 1 wherein

the circuitry is configured to perform processing in a movement mode in which the position of the virtual object is moved by an amount of movement within the virtual space, the amount of movement singularly corresponding to an amount of movement of a predetermined part of the user in the real space, according to an instruction of the user,

the predetermined part of the user is a clenched first of the user, and

the processing in the movement mode stops when the clenched first is unclenched.

5. The information processing device according to claim 1 , wherein

the circuitry is configured to perform processing in an aerial mode in which the position of the virtual object is not moved irrespective of movement of a predetermined part of the user in the real space according to an instruction of the user.

6. The information processing device according to claim 4 , wherein

the circuitry is configured to perform processing in a plurality of modes including the movement mode, and, when a predetermined operation is performed in each mode, the circuitry is configured to switch processing in another mode,

the predetermined operation is changing a size of the virtual object, and

a size of a clenched first made by the user singularly determines the size of the virtual object.

7. The information processing device according to claim 1 , wherein the circuitry is configured to:

obtain orientation information indicating whether each finger of the user is showing a back or showing a pad; and

set the virtual object in a partly deformed state such that a part of the virtual object corresponding to a position of a finger showing the back determined to be in contact with the virtual object among the fingers of the user, is located a greater distance away from the user than the position of the finger showing the back.

8. The information processing device according to claim 7 , wherein

the virtual object is further rendered in a state of being superimposed on a finger showing the pad among the fingers of the user.

9. A control method of an information processing device, the control method being performed by using a computer connected to a display device presenting an image of a virtual space to a user, the control method comprising:

obtaining information regarding a position of each fingertip of the user in a real space;

setting a position and an image of a virtual object within the virtual space;

determining contact between the virtual object set within the virtual space and a finger of the user;

recognizing a flat surface within the real space; and

performing processing in a paste mode in which the position of the virtual object is set at a position pasted to the flat surface according to an instruction of the user.

10. A non-transitory computer readable medium having stored thereon a program for a computer connected to a display device presenting an image of a virtual space to a user, the program comprising:

obtaining information regarding a position of each fingertip of the user in a real space;

setting a position and an image of a virtual object within the virtual space;

determining contact between the virtual object set within the virtual space and a finger of the user;

recognizing a flat surface within the real space; and

performing processing in a paste mode in which the position of the virtual object is set at a position pasted to the flat surface according to an instruction of the user.

11. The method of claim 9 , further comprising:

setting the virtual object in a deformed state when a first hand of the user or a second hand of the user is in contact with the virtual object.

12. The method of claim 9 , further comprising:

setting the virtual object such that a contour line of the virtual object is displayed in a first color in a case that the virtual object and a fingertip of the user are in contact with each other and the contour line is displayed in a second color in a case that none of the fingertips of the user is in contact with the virtual object.

13. The method of claim 9 , further comprising:

performing processing in a movement mode in which the position of the virtual object is moved by an amount of movement within the virtual space, the amount of movement singularly corresponding to an amount of movement of a predetermined part of the user in the real space, according to an instruction of the user, wherein

the predetermined part of the user is a clenched first of the user, and

the processing in the movement mode stops when the clenched first is unclenched.

14. The method of claim 9 , further comprising:

performing processing in an aerial mode in which the position of the virtual object is not moved irrespective of movement of a predetermined part of the user in the real space according to an instruction of the user.

15. The method of claim 13 , further comprising:

performing processing in a plurality of modes including the movement mode, and, in a case that a predetermined operation is performed in each mode, switching to processing in another mode, wherein

the predetermined operation is changing a size of the virtual object, and

a size of a clenched first made by the user singularly determines the size of the virtual object.

16. The method of claim 9 , further comprising:

obtaining orientation information indicating whether each finger of the user is showing a back or showing a pad.

17. The method of claim 16 further comprising:

setting the virtual object in a partly deformed state such that a part of the virtual object corresponding to a position of a finger showing the back determined to be in contact with the virtual object among the fingers of the user, is located a greater distance away from the user than the position of the finger showing the back.

18. The method of claim 17 , wherein

the virtual object is further rendered in a state of being superimposed on a finger showing the pad among the fingers of the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2025
From: OHASHI, YOSHINORI
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 071553/0617 →
Priority Claims (1)
JP 2017-090171 · Apr 28, 2017 · national
Continuity (4)
Continuation 17579174 · Jan 19, 2022
Continuation 17323184 · May 18, 2021
Continuation 16605667
Related Publication 20230218983A1 · Jul 13, 2023