IP Library Granted Patent US 10,478,079
Granted Patent B2
US 10,478,079 · App. 15/580,925 · Granted Nov 19, 2019

Pulse estimation device, pulse estimation system, and pulse estimation method

Inventors: Tadanori Tezuka (Fukuoka, JP); Tsuyoshi Nakamura (Fukuoka, JP); Masatoshi Matsuo (Fukuoka, JP)
Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
A61B5/02427G06T7/11G06T7/174H04N5/23296H04N5/232127H04N5/232939A61B2562/0233A61B2576/00G06T2207/10016G06T2207/10024G06T2207/30004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,478,079
App. No.
15/580,925
Granted
Nov 19, 2019
Kind
B2
Abstract

A pulse can be stably estimated based on an image data suitable for extracting a pulse signal. A pulse estimation device includes image input portion ( 21 ) to which time-sequential captured images including at least a portion of subject H as an object are input from camera ( 2 ); region extractor ( 22 ) that extracts a skin-color region from each of the captured images; zoom commander ( 28 ) that transmits a zoom command to camera ( 2 ) that has imaged the captured images or a user of camera ( 2 ) in order to adjust a size of the skin-color region; and pulse estimator ( 23 ) that estimates a pulse of subject H based on the skin-color region of the captured images obtained by imaging with camera ( 2 ), after the zoom command is transmitted.

Claims (74)

1. A pulse estimation device that estimates a pulse of a subject from information obtained without contact with the subject, the pulse estimation device comprising:

a processor;

a memory including instructions that, when executed by the processor, cause the processor to perform operations including:

inputting time-sequential captured images including at least a portion of the subject as an object from a camera;

extracting a skin-color region from each of the captured images;

transmitting a zoom command to the camera that has imaged the captured images or a user of the camera in order to adjust a size of the skin-color region; and

estimating the pulse of the subject based on the skin-color region of the captured images obtained by imaging with the camera, after the zoom command is transmitted,

wherein the operations further include estimating the pulse of the subject based on the captured images before the zoom command is transmitted, and determining whether or not the estimated pulse is stable, and

in a case where the estimated pulse is not stable, transmitting the zoom command.

2. The pulse estimation device of claim 1 , wherein the operations further include:

determining whether or not the size of the skin-color region satisfies a preset reference range, and

in a case that the size of the skin-color region does not satisfy the preset reference range, transmitting the zoom command to the camera or the user of the camera.

3. The pulse estimation device of claim 2 , wherein the operations further include:

determining the size of the skin-color region based on a number of pixels constituting the skin-color region of the captured image; and

determining whether or not the size of the skin-color region satisfies the preset reference range based on the number of pixels.

4. The pulse estimation device of claim 2 , wherein the operations further include:

changing the preset reference range according to a performance of an image sensor of the camera.

5. The pulse estimation device of claim 2 , wherein the operations further include:

changing the preset reference range according to an exposure condition of the camera.

6. The pulse estimation device of claim 1 , wherein the operations further include:

extracting a face region of the subject from each of the captured images as the skin-color region.

7. The pulse estimation device of claim 1 , further comprising:

a display that displays a command for adjusting the size of the skin-color region to the user based on the zoom command to the user.

8. A pulse estimation system comprising:

the pulse estimation device of claim 1 ; and

the camera that performs a predetermined zoom operation based on the zoom command.

9. A pulse estimation method of estimating a pulse of a subject from information obtained without contact with the subject, the pulse estimation method comprising:

inputting time-sequential captured images including at least a portion of the subject as an object from a camera;

extracting a skin-color region from each of the captured images;

transmitting a zoom command to the camera that has imaged the captured images or a user of the camera in order to change a size of the skin-color region such that the size of the skin-color region satisfies a preset reference range; and

estimating the pulse of the subject based on the skin-color region of the captured images obtained by imaging with the camera, after the zoom command is transmitted,

wherein the pulse estimation method further comprises:

estimating the pulse of the subject based on the captured images before the zoom command is transmitted, and determining whether or not the estimated pulse is stable, and

in a case where the estimated pulse is not stable, transmitting the zoom command.

10. A pulse estimation device that estimates a pulse of a subject from information obtained without contact with the subject, the pulse estimation device comprising:

a processor;

a memory including instructions that, when executed by the processor, cause the processor to perform operations including:

inputting time-sequential captured images including at least a portion of the subject as an object from a camera;

extracting a skin-color region from each of the captured images;

transmitting a zoom command to the camera that has imaged the captured images or a user of the camera in order to adjust a size of the skin-color region; and

estimating the pulse of the subject based on the skin-color region of the captured images obtained by imaging with the camera, after the zoom command is transmitted,

wherein the operations further include determining whether or not the size of the skin-color region satisfies a preset reference range,

in a case that the size of the skin-color region does not satisfy the preset reference range, transmitting the zoom command to the camera or the user of the camera, and

the operations even further include:

determining the size of the skin-color region based on a number of pixels constituting the skin-color region of the captured image; and

determining whether or not the size of the skin-color region satisfies the preset reference range based on the number of pixels.

11. A pulse estimation method of estimating a pulse of a subject from information obtained without contact with the subject, the pulse estimation method comprising:

inputting time-sequential captured images including at least a portion of the subject as an object from a camera;

extracting a skin-color region from each of the captured images;

transmitting a zoom command to the camera that has imaged the captured images or a user of the camera in order to change a size of the skin-color region such that the size of the skin-color region satisfies a preset reference range; and

estimating the pulse of the subject based on the skin-color region of the captured images obtained by imaging with the camera, after the zoom command is transmitted,

wherein the pulse estimation method further comprises determining whether or not the size of the skin-color region satisfies a preset reference range,

in a case that the size of the skin-color region does not satisfy the preset reference range, transmitting the zoom command to the camera or the user of the camera, and

the pulse estimation method even further comprises:

determining the size of the skin-color region based on a number of pixels constituting the skin-color region of the captured image; and

determining whether or not the size of the skin-color region satisfies the preset reference range based on the number of pixels.

12. A pulse estimation device that estimates a pulse of a subject from information obtained without contact with the subject, the pulse estimation device comprising:

a processor;

a memory including instructions that, when executed by the processor, cause the processor to perform operations including:

inputting time-sequential captured images including at least a portion of the subject as an object from a camera;

extracting a skin-color region from each of the captured images;

transmitting a zoom command to the camera that has imaged the captured images or a user of the camera in order to adjust a size of the skin-color region; and

estimating the pulse of the subject based on the skin-color region of the captured images obtained by imaging with the camera, after the zoom command is transmitted,

wherein the operations further include determining whether or not the size of the skin-color region satisfies a preset reference range,

in a case that the size of the skin-color region does not satisfy the preset reference range, transmitting the zoom command to the camera or the user of the camera, and

the operations even further include changing the preset reference range according to a performance of an image sensor of the camera.

13. A pulse estimation method of estimating a pulse of a subject from information obtained without contact with the subject, the pulse estimation method comprising:

inputting time-sequential captured images including at least a portion of the subject as an object from a camera;

extracting a skin-color region from each of the captured images;

transmitting a zoom command to the camera that has imaged the captured images or a user of the camera in order to change a size of the skin-color region such that the size of the skin-color region satisfies a preset reference range; and

estimating a pulse of the subject based on the skin-color region of the captured images obtained by imaging with the camera, after the zoom command is transmitted,

wherein the pulse estimation method further comprises determining whether or not the size of the skin-color region satisfies a preset reference range,

in a case that the size of the skin-color region does not satisfy the preset reference range, transmitting the zoom command to the camera or the user of the camera, and

the pulse estimation method even further comprises changing the preset reference range according to a performance of an image sensor of the camera.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2018
From: TEZUKA, TADANORI; NAKAMURA, TSUYOSHI; MATSUO, MASATOSHI
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 044971/0374 →
Priority Claims (1)
JP 2015-120333 · Jun 15, 2015 · national
Continuity (1)
Related Publication 20180310844A1 · Nov 1, 2018