IP Library Granted Patent US 9,697,610
Granted Patent B2
US 9,697,610 · App. 14/993,429 · Granted Jul 4, 2017

Information processing device and information processing method

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,697,610
App. No.
14/993,429
Granted
Jul 4, 2017
Kind
B2
Abstract

An information processing device includes: a shape modeling section detecting, from frames of an image captured from a movie of a target object, an image frame representing the target object captured from a predetermined direction, the shape modeling section acquiring a shape model of the target object based on a target object figure in the detected image frame; an information processing section determining a posture of the target object detected from the captured image based on the shape model, the information processing section performing information processing on a result of the determination; and an output data transmitting section outputting to an output device the data output as a result of the information processing. The shape modeling section generates data denoting presentation information indicating how an ongoing processing by the shape modeling section is progressing. The output data transmitting section transmits the data denoting the presentation information to the output device.

Claims (33)

1. An information processing device comprising:

a shape modeling section configured such that, from a plurality of frames of an image captured from a movie of a target object, the shape modeling section detects an image frame representing the target object captured from a predetermined direction, the shape modeling section acquiring a shape model of the target object based on a target object figure in the detected image frame;

an information processing section configured to determine a posture of the target object detected from the captured image based on the shape model, the information processing section performing information processing at least on a result of the determination; and

an output data transmitting section configured to output to an output device the data to be output as a result of the information processing;

wherein the shape modeling section generates data denoting presentation information indicative of how an ongoing processing performed by the shape modeling section is progressing; and

the output data transmitting section further transmits the data denoting the presentation information to the output device,

wherein the shape modeling section detects from the captured image frame an image of a plurality of light-emitting markers attached to the target object to find the number of the captured light-emitting markers, and determines based on the number whether the image frame represents the target object captured from the predetermined direction.

2. The information processing device according to claim 1 , wherein the shape modeling section performs a process of acquiring the shape model in parallel with the information processing performed by the information processing section, the shape modeling section including, in the presentation information, information indicating a part of the information processing which is not executable because of the shape model being incomplete.

3. The information processing device according to claim 1 , wherein the shape modeling section performs a process of acquiring the shape model in parallel with the information processing performed by the information processing section and, when predicting that part of the information processing not executable because of the shape model being incomplete is about to start, includes information indicating that the processing is not executable in the presentation information.

4. The information processing device according to claim 1 , wherein the shape modeling section includes, in the presentation information, information indicating how either a first processing step or a second processing step currently executed is progressing, the first processing step being a step in which the image frame captured of the target object in the predetermined direction is detected, the second processing step being a step in which the shape model of the target object is acquired based on the target object figure in the image frame.

5. The information processing device according to claim 1 , wherein, if a light-emitting body other than the light-emitting markers is detected from the captured image frame, the shape modeling section controls light emission of the light-emitting markers so that the light-emitting markers emits light in a manner different from that of the light-emitting body.

6. An information processing method comprising:

acquiring data of an image captured from a movie of a target object from an imaging device so as to detect, from a plurality of frames of the captured image, an image frame representing the target object captured from a predetermined direction;

acquiring a shape model of the target object based on a target object figure in the detected image frame;

determining, in parallel with the acquiring of the shape model, a posture of the target object detected from the captured image based on the shape model so as to perform information processing at least on a result of the determination; and

transmitting to an output device the data to be output as a result of the information processing;

wherein detecting the image frame and the step of acquiring the shape model each include the step of generating data denoting presentation information indicative of how the ongoing processing is progressing; and

transmitting the data includes the step of transmitting the data denoting the presentation information to the output device,

wherein the presentation information includes information indicating a part of the information processing which is not executable because of the shape model being incomplete.

7. A non-transitory computer-readable recording medium recording a computer program for causing a computer to realize functions of:

detecting, from a plurality of frames of an image captured from a movie of a target object, an image frame representing the target object captured from a predetermined direction so as to acquire a shape model of the target object based on a target object figure in the detected image frame;

determining, in parallel with the acquiring of the shape model, a posture of the target object detected from the captured image based on the shape model so as to perform information processing at least on a result of the determination; and

transmitting to an output device the data to be output as a result of the information processing;

wherein the function of acquiring the shape model generates data denoting presentation information indicative of how the ongoing processing is progressing; and

the function of transmitting the data transmits the data denoting the presentation information to the output device,

wherein, when predicting that a part of the information processing not executable because of the shape model being incomplete is about to start, the presentation information includes information indicating that the processing is not executable.

8. An information processing device comprising:

a shape modeling section configured such that, from a plurality of frames of an image captured from a movie of a target object, the shape modeling section detects an image frame representing the target object captured from a predetermined direction, the shape modeling section acquiring a shape model of the target object based on a target object figure in the detected image frame;

an information processing section configured to determine a posture of the target object detected from the captured image based on the shape model, the information processing section performing information processing at least on a result of the determination; and

an output data transmitting section configured to output to an output device the data to be output as a result of the information processing;

wherein the shape modeling section generates data denoting presentation information indicative of how an ongoing processing performed by the shape modeling section is progressing;

the output data transmitting section further transmits the data denoting the presentation information to the output device, and

in performing a process of detecting the image frame captured of the target object in the predetermined direction, the shape modeling section includes in the presentation information an instruction prompting a user to orient the target object in the predetermined direction.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 6, 2017
From: SONY CORPORATION
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 043761/0975 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2017
From: SONY INTERACTIVE ENTERTAINMENT INC.
To: SONY CORPORATION
Reel/Frame 041523/0916 →
CHANGE OF NAME Recorded Mar 7, 2017
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 041482/0740 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2016
From: IKENOUE, SHOICHI; HORI, SHOTARO
To: SONY COMPUTER ENTERTAINMENT INC.
Reel/Frame 037465/0528 →