IP Library › Granted Patent US 12,361,660
Granted Patent B2
US 12,361,660 · App. 18/022,407 · Granted Jul 15, 2025

Information processing apparatus, information processing method, and program

Inventors: Jun Kimura (Kanagawa, JP); Tsuyoshi Ishikawa (Kanagawa, JP); Shinichi Kawano (Tokyo, JP); Ikuo Yamano (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G06T19/20G06T7/13G06T7/50G06T7/62G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,361,660
App. No.
18/022,407
Filed
Feb 21, 2023
Granted
Jul 15, 2025
Kind
B2
Examiner
CHEN, BIAO
Art Unit
2611
USPC
345/420
Abstract

Provided are an information processing apparatus, an information processing method, and a program capable of more easily implementing interaction between a virtual object and a palm of a user in a natural expression. The information processing apparatus includes a controller that displays a virtual object on a display unit, in which the controller detects a planar area of a hand from a captured image obtained by capturing an image of a real space, the controller performs control to set a contact determination area for determining contact with the virtual object for the planar area of the hand having been detected, and the contact determination area includes at least one plane portion.

Claims (47)

1. An information processing apparatus comprising:

a controller including circuitry configured to

initiate display of a virtual object on a display unit,

detect a planar area of a hand from a captured image obtained by capturing an image of a real space, and

perform control to set a contact determination area for determining contact with the virtual object for the detected planar area of the hand,

wherein the contact determination area includes at least one plane portion, and

wherein the contact determination area is set based on an angle of at least one finger of a hand.

2. The information processing apparatus according to claim 1 ,

wherein the contact determination area further includes at least one edge portion located at an edge of the at least one plane portion.

3. The information processing apparatus according to claim 2 ,

wherein the circuitry is further configured to calculate a height of the at least one edge portion based on a shape of the hand.

4. The information processing apparatus according to claim 3 ,

wherein the circuit calculates the height of the at least one edge portion based on

an initial value of the height of the at least one edge portion calculated based on a dimension of the hand or a dimension of the virtual object, and

a change in the angle of the at least one finger of the hand.

5. The information processing apparatus according to claim 3 ,

wherein the circuit calculates the height of the at least one edge portion based on the angle of the at least one finger of the hand detected as the shape of the hand.

6. The information processing apparatus according to claim 3 ,

wherein the circuitry calculates the height of the at least one edge portion to 0 in a case where the angle of the at least one finger of the hand falls below a threshold.

7. The information processing apparatus according to claim 3 ,

wherein the controller calculates the height of the at least one edge portion based on a distance between predetermined positions of the at least one finger of the hand.

8. The information processing apparatus according to claim 2 ,

wherein the circuitry is further configured to change a height of the at least one edge portion in accordance with a change in a shape of the at least one finger of the hand.

9. The information processing apparatus according to claim 2 ,

wherein the circuitry is further configured to change a height of the at least one edge portion in accordance with a change in an angle of a wrist connected to the hand.

10. The information processing apparatus according to claim 9 ,

wherein the circuitry changes the height of the at least one edge portion to be 0 in a case where the angle of the wrist exceeds a threshold.

11. The information processing apparatus according to claim 1 ,

wherein the at least one plane portion is set on the detected planar area of the hand.

12. The information processing apparatus according to claim 1 ,

wherein the circuitry is further configured to determine a size of the at least one plane portion based on at least one of a dimension of the hand or a dimension of the virtual object.

13. The information processing apparatus according to claim 12 ,

wherein the circuitry determines the size of the at least one plane portion based on information of a larger one of the dimension of the hand and the dimension of the virtual object.

14. The information processing apparatus according to claim 1 ,

wherein the circuitry is further configured to change a size of the at least one plane portion in accordance with a change in a shape of the hand.

15. An information processing method comprising:

displaying, by a processor, a virtual object on a display unit;

detecting, by the processor, a planar area of a hand from a captured image obtained by capturing an image of a real space; and

performing, by the processor, control to set a contact determination area for determining contact with the virtual object for the detected planar area of the hand,

wherein the contact determination area includes at least one plane portion, and

wherein the contact determination area is set based on an angle of at least one finger of a hand.

16. A non-transitory computer-readable storage medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method, the method comprising:

displaying a virtual object on a display unit;

detecting a planar area of a hand from a captured image obtained by capturing an image of a real space; and

setting a contact determination area for determining contact with the virtual object for the detected planar area of the hand,

wherein the contact determination area includes at least one plane portion, and

wherein the contact determination area is set based on an angle of at least one finger of a hand.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2023
From: KIMURA, JUN; ISHIKAWA, TSUYOSHI; KAWANO, SHINICHI; YAMANO, IKUO
To: SONY GROUP CORPORATION
Reel/Frame 063219/0129 →
Priority Claims (1)
JP 2020-145586 · Aug 31, 2020 · national
Continuity (1)
Related Publication 20230343052A1 · Oct 26, 2023
References Cited (6)
US 20200129850A1 · Ohashi · 2020 [cited by examiner]
US 20200218349A1 · Chu · 2020 [cited by examiner]
WO WO2018034319A1 · 2018 [cited by examiner]
WO WO2018198910A1 · 2018 [cited by applicant]
Bergamasco, et al., A realistic approach for grasping and moving virtual objects, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94), DOI: 10.1109/IROS.1994.407354, ISBN:0-7803-… [cited by examiner]
Nakashima, a machine translated English version of a foreign patent application (WO 2018034319 A1). (Year: 2018). [cited by examiner]