IP Library › Granted Patent US 11,617,942
Granted Patent B2
US 11,617,942 · App. 17/579,174 · Granted Apr 4, 2023

Information processing device, control method of information processing device, and program

Inventor: Yoshinori Ohashi (Tokyo, JP)
Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
A63F13/213A63F13/25A63F13/52A63F13/533A63F13/577G06F3/011G06T19/006G09G5/36A63F2300/1087A63F2300/308A63F2300/643A63F2300/66G06F3/0482G06F3/0484G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,617,942
App. No.
17/579,174
Granted
Apr 4, 2023
Kind
B2
Abstract

An information processing device obtains information regarding the position of each fingertip of a user in a real space, and determines contact between a virtual object set within a virtual space and a finger of the user. The information processing device sets the virtual object in a partly deformed state such that a part of the virtual object, the part corresponding to the position of the finger determined to be in contact with the object among the fingers of the user, is located more to a far side from a user side than the finger, and displays the virtual object having the shape set thereto as an image in the virtual space on a display device.

Claims (46)

1. An information processing device connected to a display device presenting an image of a virtual space to a user, the information processing device comprising:

an obtaining section for obtaining information regarding a position of a first hand of the user, a position of each fingertip of the first hand, a position of a second hand of the user, and a position of each fingertip of the second hand in a real space;

an object setting section for setting a position and an image of a virtual object within the virtual space;

a determining section for determining contact between the virtual object set within the virtual space and a first hand of the user or a second hand of the user; and

a shape setting section for setting the virtual object in a deformed state when the first hand or the second hand is in contact with the virtual object;

wherein the object setting section changes a size of the virtual object in response to contact of the first hand or the second hand with the virtual object.

2. The information processing device according to claim 1 ,

wherein the object setting section changes the size of the virtual object when the virtual object is simultaneously grasped by the first hand and the second hand at opposing ends of the virtual object.

3. The information processing device according to claim 1 ,

wherein the object setting section changes the size of the virtual object if the user moves the first hand apart from the second hand while grasping the virtual object.

4. The information processing device according to claim 3 ,

wherein the object setting section enlarges the size of the virtual object by a factor of (L+ΔL)/L, when the distance between both hands is changed from an original distance L by ΔL.

5. The information processing device according to claim 1 ,

wherein the object setting section changes the size of the virtual object when the object is pinched at multiple positions by fingertips of the first hand or fingertips of the second hand.

6. The information processing device according to claim 1 ,

wherein the object setting section moves the position of the virtual object when the user clenches the virtual object with the first hand and moves the first hand in the real space.

7. The information processing device according to claim 1 , wherein

the object setting section manipulates the virtual object by using other virtual object that are different from the virtual object.

8. The information processing device according to claim 7 , wherein

the object setting section manipulates moving of the virtual object by using other virtual object that are different from the virtual object.

9. The information processing device according to claim 1 , wherein

the object setting section arranges a user interface on the virtual object visible in a direction in which the user strokes the virtual object.

10. The information processing device according to claim 9 , wherein

the virtual object is a tubular object that rotates when the user strokes the virtual object.

11. The information processing device according to claim 1 , wherein

the object setting section starts displaying the virtual object according to a predetermined pose of the user's hand or a predetermined state of each finger.

12. The information processing device according to claim 1 , wherein

the object setting section starts displaying the virtual object when the user has been in a predetermined pose of the user's hand or a predetermined state of each finger for a predetermined time.

13. The information processing device according to claim 1 , wherein

the object setting section determines whether the user is clenching the hand or opening the hand as a predetermined pose of the user's hand.

14. The information processing device according to claim 1 , wherein

the object setting section determines whether the user's finger is closed or open as a predetermined state of each finger.

15. The information processing device according to claim 1 , wherein

the object setting section makes the display mode of the virtual object different depending on whether the user's finger is in contact with the virtual object or not.

16. A control method for an information processing device, the method comprising:

obtaining information regarding a position a first hand of the user, a position of each fingertip of the first hand, a position of a second hand of the user, and a position of each fingertip of the second hand in a real space;

setting a position and an image of a virtual object within the virtual space;

determining contact between the virtual object set within the virtual space and the first hand or the second hand of the user;

setting the virtual object in a deformed state when the first hand or the second hand is in contact with the virtual object; and

changing a size of the virtual object in response to contact of the first hand or the second hand with the virtual object.

17. A non-transitory computer readable medium having stored thereon a program for a computer connected to a display device presenting an image of a virtual space to a user, the program comprising:

an obtaining section for obtaining information regarding a position a first hand of the user, a position of each fingertip of the first hand, a position of a second hand of the user, and a position of each fingertip of the second hand in a real space;

an object setting section for setting a position and an image of a virtual object within the virtual space;

a determining section for determining contact between the virtual object set within the virtual space and the first hand or the second hand of the user; and

a shape setting section for setting the virtual object in a deformed state when the first hand or the second hand is in contact with the virtual object;

wherein the object setting section changes a size of the virtual object in response to contact of the first hand or the second hand with the virtual object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2025
From: OHASHI, YOSHINORI
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 071553/0617 →
Priority Claims (1)
JP JP2017-090171 · Apr 28, 2017 · national
Continuity (3)
Continuation 17323184 · May 18, 2021
Continuation 16605667
Related Publication 20220143496A1 · May 12, 2022
Cited By (1)
US 12,229,461