IP Library Granted Patent US 9,717,987
Granted Patent B2
US 9,717,987 · App. 14/351,274 · Granted Aug 1, 2017

Individual discrimination device and individual discrimination method

Inventors: Akihiko Sugawara (Kanagawa, JP); Akio Ohba (Kanagawa, JP); Toshiyuki Hiroi (Saitama, JP)
Assignees: Sony Corporation; Sony Interactive Entertainment Inc.
A63F13/213A61B5/0077A61B5/117A61B5/7246A63F13/212G06F3/011G06F3/017G06F3/0304G06K9/00362G06K9/00496G06T7/0016A61B5/024A61B5/1102A61B5/113A63F2300/1093A63F2300/6045A63F2300/69G06F2203/011G06K9/00771G06K9/342G06K9/6212G06K2009/00939
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,717,987
App. No.
14/351,274
Granted
Aug 1, 2017
Kind
B2
Abstract

A frame storage stores an image obtained by imaging a region of at least part of the body of a user. A vital sign signal detector detects a signal sequence of a vital sign that cyclically varies from plural imaged regions of the body of the user by using captured images of a predetermined number of frames stored in the frame storage. A correlation calculator obtains the correlation between the signal sequences of the vital sign detected from the respective imaged regions of the body. An identity determining section determines whether or not the respective imaged regions of the body belong to the same user based on the correlation between the signal sequences of the vital sign detected from the respective imaged regions of the body.

Claims (43)

1. An individual discrimination device comprising:

a storage that stores an image obtained by imaging a region of at least part of a body of a user playing a video game;

a vital sign signal detector that detects a signal sequence, of a detected vital sign that cyclically varies, from a plurality of imaged regions of the body of the user by using captured images of a predetermined number of frames stored in the storage;

a sensor input section that receives input of a signal sequence of a sensed vital sign that cyclically varies from at least one of a sensor mounted in a controller operated by the user and a wearable sensor worn by the user;

a correlation calculator that obtains a correlation between the signal sequences of the detected vital sign detected from the imaged regions of the body and obtains a correlation between the signal sequence of the sensed vital sign obtained by the sensor input section and at least one of the signal sequences of the detected vital sign detected from the imaged regions of the body;

an identity determining section that determines, based on the correlation between the signal sequences of the detected vital sign detected from the imaged regions of the body, that the imaged regions of the body belong to a same user and that determines, based on the correlation between the signal sequence of the sensed vital sign obtained by the sensor input section and at least one of the signal sequences of the detected vital sign detected from the imaged regions of the body, that the imaged regions of the body belong to at least one of the operator of the controller and the wearer of the sensor; and

an individual information management section that feeds back to a progression of the game at least one characteristic of the user, the characteristic being based on the detected signal sequence.

2. The individual discrimination device according to claim 1 , wherein the vital sign signal detector detects the signal sequence of the vital sign that cyclically varies by sensing change in vibration or a light absorption characteristic of skin in the imaged region of the body in the captured images of the predetermined number of frames.

3. The individual discrimination device according to claim 1 , wherein:

the vital sign is a heartbeat, and

the identity determining section determines that the imaged regions of the body belong to the same user based on a correlation between detected signal sequences of the heartbeat.

4. The individual discrimination device according to claim 1 , further comprising: a display section that carries out a same highlighting for a plurality of imaged regions of a body determined to belong to the same user.

5. The individual discrimination device according to claim 1 , wherein:

the vital sign signal detector detects the signal sequence of the vital sign that cyclically varies from each of a first body imaged region imaged by a first imager and a second body imaged region imaged by a second imager,

the correlation calculator obtains a correlation between the signal sequences of the vital sign detected from the first body imaged region and the second body imaged region, and

the identity determining section determines that the first body imaged region and the second body imaged region belong to the same user based on the correlation between the signal sequences of the vital sign detected from the first body imaged region and the second body imaged region.

6. The individual discrimination device of claim 1 , wherein:

the storage stores a plurality of images, each image being obtained by imaging one or more user body regions;

the vital sign detector divides each imaged region into a plurality of small regions, each of the small regions presenting a respective signal sequence, of a vital sign that cyclically varies, and detects the respective signal sequences of each of the small regions;

the correlation obtained by the correlation calculator is a correlation between the signal sequences detected from the small regions; and

the identity determining section determines that certain imaged regions belong to the same user based on the correlation.

7. An individual discrimination method comprising:

a vital sign signal detection step of detecting a signal sequence of a detected vital sign that cyclically varies from a plurality of imaged regions of a body of a user playing a video game by using and referring to captured images of a predetermined number of frames from a memory that stores an image obtained by imaging a region of at least part of the body of the user;

a sensor input step of receiving input of a signal sequence of a sensed vital sign that cyclically varies from at least one of a sensor mounted in a controller operated by the user and a wearable sensor worn by the user;

a correlation calculation step of obtaining a correlation between the signal sequences of the detected vital sign detected from the imaged regions of the body and obtaining a correlation between the signal sequence of the sensed vital sign obtained during the sensor input step and at least one of the signal sequences of the detected vital sign detected from the imaged regions of the body;

an identity determination step of determining, based on the correlation between the signal sequences of the detected vital sign detected from the imaged regions of the body, that the imaged regions of the body belong to a same user and determining, based on the correlation between the signal sequence of the sensed vital sign obtained during the sensor input step and at least one of the signal sequences of the detected vital sign detected from the imaged regions of the body, that the imaged regions of the body belong to at least one of the operator of the controller and the wearer of the sensor; and

an individual information management step of feeding back to a progression of the game at least one characteristic of the user, the characteristic being based on the detected signal sequence.

8. The individual discrimination method of claim 7 , wherein:

the memory stores a plurality of images, each image being obtained by imaging one or more user body regions;

the vital sign detection step includes dividing each imaged region into a plurality of small regions, each of the small regions presenting a respective signal sequence, of a vital sign that cyclically varies, and includes detecting the respective signal sequences of each of the small regions;

the correlation obtained in the correlation calculation step is a correlation between the signal sequences detected from the small regions; and

the identity determination step includes determining that certain imaged regions belong to the same user based on the correlation.

9. A non-transitory computer-readable medium encoded with a data structure for causing a computer to carry out:

a vital sign signal detection step of detecting a signal sequence of a detected vital sign that cyclically varies from a plurality of imaged regions of a body of a user playing a video game by using and referring to captured images of a predetermined number of frames from a memory that stores an image obtained by imaging a region of at least part of the body of the user;

a sensor input step of receiving input of a signal sequence of a sensed vital sign that cyclically varies from at least one of a sensor mounted in a controller operated by the user and a wearable sensor worn by the user;

a correlation calculation step of obtaining a correlation between the signal sequences of the detected vital sign detected from the imaged regions of the body and obtaining a correlation between the signal sequence of the sensed vital sign obtained during the sensor input step and at least one of the signal sequences of the detected vital sign detected from the imaged regions of the body;

an identity determination step of determining, based on the correlation between the signal sequences of the detected vital sign detected from the imaged regions of the body, that the imaged regions of the body belong to a same user and determining, based on the correlation between the signal sequence of the sensed vital sign obtained during the sensor input step and at least one of the signal sequences of the detected vital sign detected from the imaged regions of the body, that the imaged regions of the body belong to at least one of the operator of the controller and the wearer of the sensor; and

an individual information management step of feeding back to a progression of the game at least one characteristic of the user, the characteristic being based on the detected signal sequence.

10. The non-transitory computer-readable medium of claim 9 , wherein:

the memory stores a plurality of images, each image being obtained by imaging one or more user body regions;

the vital sign detection step includes dividing each imaged region into a plurality of small regions, each of the small regions presenting a respective signal sequence, of a vital sign that cyclically varies, and includes detecting the respective signal sequences of each of the small regions;

the correlation obtained in the correlation calculation step is a correlation between the signal sequences detected from the small regions; and

the identity determination step includes determining that certain imaged regions belong to the same user based on the correlation.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 28, 2017
From: SONY CORPORATION
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 044236/0018 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2017
From: SONY INTERACTIVE ENTERTAINMENT INC.
To: SONY CORPORATION
Reel/Frame 042415/0157 →
CHANGE OF NAME Recorded May 17, 2017
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 042415/0161 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2014
From: SUGAWARA, AKIHIKO; OHBA, AKIO; HIROI, TOSHIYUKI
To: SONY COMPUTER ENTERTAINMENT INC.
Reel/Frame 032656/0046 →
Priority Claims (1)
JP 2011-235327 · Oct 26, 2011 · national
Continuity (1)
Related Publication 20140254902A1 · Sep 11, 2014