IP Library Granted Patent US 11,398,112
Granted Patent B2
US 11,398,112 · App. 16/652,447 · Granted Jul 26, 2022

Pulse wave detection device, vehicle device, and pulse wave detection program

Inventors: Michael Jones (Tokyo, JP); Atsushi Sato (Tokyo, JP)
Assignee: AISIN CORPORATION
G06V40/166B60R11/04G06V40/10G06V40/169B60R2300/8006G06V40/15G06V2201/03
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,398,112
App. No.
16/652,447
Granted
Jul 26, 2022
Kind
B2
Abstract

A pulse wave detection device detects the face from a frame image and corrects the brightness of the face in accordance with the size of the face surface to appropriately detect a pulse wave even if brightness is changed due to movement of a subject with respect to lighting. The brightness of the face depends on the distance between the lighting and the face, and this is equal to indirect measurement of the distance from the lighting to the face using the size of the face. As described above, a pulse wave detecting device estimates/measures a pulse rate of the subject from a brightness signal after intensity of the brightness of the face photographed on the frame image is corrected using the size of the face, by using the correlation between the size of the face of the subject on the frame image and the brightness of the face.

Claims (33)

1. A pulse wave detection, device comprising:

a processor programmed to:

receive videos obtained by photographing a body surface of a subject;

obtain a region where the body surface is photographed from the received videos;

determine a brightness of the obtained region;

correct the determined brightness by using a correlation between (i) a relative rearward position of the body surface and a relative forward position of the body surface, and (ii) the determined brightness of the region, the relative forward position of the body surface is defined by a same portion body surface of the subject moving forward in the received video relative to the rearward position of the body surface; and

detect a pulse wave of the subject based on a change in the corrected brightness of the region.

2. The pulse wave detection device according to claim 1 , wherein:

the body surface is a face, and

the processor obtains a face region as the region.

3. The pulse wave detection device according to claim 2 , further comprising:

a light configured to illuminate the face with infrared light; and

a video camera configured to capture a video of the face illuminated by the infrared light, wherein

the processor receives the videos from the video camera.

4. The pulse wave detection device according to claim 3 , wherein the processor is programmed to:

obtain environmental luminance; and

activate lighting by the light and video photography by the video camera when the obtained environmental luminance falls below a predetermined value.

5. The pulse wave detection device according to claim 4 , wherein the processor is programmed to:

detect the pulse wave when the environmental luminance is at a predetermined value or more, and

activate the lighting by the light and the photography of videos by the video camera after the detecting of the pulse wave is stopped when the obtained environmental luminance falls below the predetermined value.

6. The pulse wave detection device according to claim 2 , wherein the processor determines the rearward position and the forward position of the face from a size of the face region.

7. The pulse wave detection device according to claim 2 , wherein the processor is programmed to:

determine a face detection region that is larger than the face and includes the face, and

obtain the face region by using the brightness distribution in the determined face detection region.

8. The pulse wave detection device according to claim 2 , wherein when the determined face region has a closed region not included in the face region, the processor includes the closed region when determining a size of the face region.

9. A vehicle device comprising:

the pulse wave detection device according to claim 1 .

10. A non-transitory computer readable storage medium storing a pulse wave detection program, which when executed, causes a computer to perform:

receiving videos obtained by photographing a body surface of a subject;

obtaining a region where the body surface is photographed from the received videos;

determining a brightness of the obtained region;

correcting the determined brightness by using a correlation between (i) a relative rearward position of the body surface and a relative forward position of the body surface, and (ii) the determined brightness of the region, the relative forward position of the body surface is defined by a same portion body surface of the subject moving forward in the received video relative to the rearward position of the body surface; and

detecting a pulse wave of the subject based on a change in the corrected brightness of the region.

Assignments (2)
MERGER Recorded Dec 13, 2021
From: EQUOS RESEARCH CO., LTD.
To: AISIN CORPORATION
Reel/Frame 058488/0277 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 31, 2020
From: JONES, MICHAEL; SATO, ATSUSHI
To: EQUOS RESEARCH CO., LTD.
Reel/Frame 052269/0932 →
Priority Claims (1)
JP JP2018-167724 · Sep 7, 2018 · national
Continuity (1)
Related Publication 20200285832A1 · Sep 10, 2020