IP Library Granted Patent US 10,990,191
Granted Patent B2
US 10,990,191 · App. 16/801,265 · Granted Apr 27, 2021

Information processing device and method, program and recording medium for identifying a gesture of a person from captured image data

Inventors: Keisuke Yamaoka (Tokyo, JP); Jun Yokono (Tokyo, JP)
Assignee: SONY CORPORATION
G06F3/017A63F13/40G06F3/005G06F3/011G06F3/0304G06K9/00342G06K9/00369H04N5/222H04N5/2224
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,990,191
App. No.
16/801,265
Granted
Apr 27, 2021
Kind
B2
Abstract

An information processing device includes: an outline extraction unit extracting an outline of a subject from a picked-up image of the subject; a characteristic amount extraction unit extracting a characteristic amount, by extracting sample points from points making up the outline, for each of the sample points: an estimation unit estimating a posture of a high degree of matching as a posture of the subject by calculating a degree of the characteristic amount extracted in the characteristic amount extraction unit being matched with each of a plurality of characteristic amounts that are prepared in advance and represent predetermined postures different from each other; and a determination unit determining accuracy of estimation by the estimation unit using a matching cost when the estimation unit carries out the estimation.

Claims (34)

1. An information processing apparatus, comprising:

circuitry configured to:

obtain an image of at least a part of a human subject, the image captured by an imaging device;

estimate, as an estimation result, a posture of the human subject by using characteristic amounts obtained from posture images; and

produce output of joint position data of at least one joint of the human subject, the output representing the posture of the human subject compared with the obtained image, and an estimation accuracy determination corresponding to the estimation result.

2. The information processing apparatus of claim 1 , wherein

the posture images are learned in advance based on sample images.

3. The information processing apparatus of claim 1 , wherein the joint position data includes position information of a coordinate of an image data, and

the position information of the coordinate indicates a two-dimensional coordinate of more than one joint of the human subject.

4. The information processing apparatus of claim 1 , wherein

the joint position data includes a numerical value indicative of a likelihood of the estimation result.

5. The information processing apparatus of claim 1 , wherein

the circuitry is further configured to:

output a plurality of the joint position data for a plurality of estimated positions of a plurality of joints; and

estimate the posture of the human subject based on the output of the plurality of the joint position data, and produce the estimation accuracy determination.

6. The information processing apparatus of claim 1 , wherein the circuitry is further configured to:

overlap a plurality of points indicative of an estimated position of the at least one joint of the human subject on the image and produce a straight line between the plurality of points on the image.

7. The information processing apparatus of claim 1 , wherein

the circuitry is further configured to:

generate an instruction to control a gaming application in accordance with the estimation result.

8. The information processing apparatus of claim 1 , wherein

the circuitry is further configured to:

determine a gesture of the at least one joint of the human subject based on the estimation result.

9. The information processing apparatus of claim 1 , wherein

the circuitry is further configured to:

match a characteristic amount feature of the obtained image and a posture model image.

10. The information processing apparatus of claim 1 , wherein

the circuitry is further configured to:

estimate the estimation result based on a distance between the captured image and a posture model image.

11. The information processing apparatus of claim 1 , wherein

the estimation accuracy determination includes a result of at least one of positive or negative.

12. The information processing apparatus of claim 1 , wherein

the estimation accuracy determination includes a result of at least one a result deemed a good result or a result deemed a not-good result.

13. The information processing apparatus of claim 1 , wherein an estimation accuracy determination includes a result of a flag representing the accuracy information.

Priority Claims (1)
JP 2009-018179 · Jan 29, 2009 · national
Continuity (6)
Continuation 16278836 · Feb 19, 2019
Continuation 15923975 · Mar 16, 2018
Continuation 15174585 · Jun 6, 2016
Continuation 13756977 · Feb 1, 2013
Continuation 12688665 · Jan 15, 2010
Related Publication 20200192489A1 · Jun 18, 2020