IP Library Granted Patent US 12,639,914
Granted Patent B2
US 12,639,914 · App. 18/257,127 · Granted May 26, 2026

Pulse detection device and pulse detection method

Inventor: Akihiko Sugawara (Kanagawa, JP)
Assignee: Sony Interactive Entertainment Inc.
G06V10/751A61B5/02444G06V10/56
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,639,914
App. No.
18/257,127
Granted
May 26, 2026
Kind
B2
Abstract

A frame storage section stores captured images of a predetermined number of frames depicting a region including the skin of a user. A pixel value acquisition section divides the captured images into a plurality of blocks and acquires the pixel values in each block. A pixel exclusion section narrows down target pixels in each block by excluding pixels that have a green value equal to or smaller than a predetermined threshold in a case where pixel colors of each block are represented by RGB. A brightness change compensation section compensates for brightness changes by dividing the average of green values by the average of red or blue values in a case where the colors of the target pixels in each block are represented by RGB. A pulse detection section detects a pulse from temporal changes in target pixel values in each block.

Claims (48)

1 . A pulse detection device comprising:

a storage section that stores captured images of a predetermined number of frames depicting a region including skin of a user;

a pixel value acquisition section that divides the captured images into a plurality of blocks and acquires pixel values in each block;

a pixel exclusion section that narrows down target pixels in each block by excluding pixels that have a green value equal to or smaller than a first predetermined threshold and pixels that have a red value equal to or greater than a second predetermined threshold in a case where pixel colors of each block are represented by RGB, wherein the second predetermined threshold is greater than the first predetermined threshold; and

a pulse detection section that detects a pulse from temporal changes in target pixel values in each block.

2 . The pulse detection device according to claim 1 , wherein, when the pixel colors of each block are represented by a hue, the pixel exclusion section narrows down the target pixels in each block by further excluding pixels having a hue within a predetermined range.

3 . The pulse detection device according to claim 1 , further comprising:

a brightness change compensation section that compensates for brightness changes by dividing an average of green values by an average of red or blue values in a case where the colors of the target pixels in each block are represented by RGB, wherein the pulse detection section detects a pulse from temporal changes in the pixel values in each block after brightness change compensation.

4 . The pulse detection device according to claim 3 , wherein the brightness change compensation section compensates for brightness changes by dividing the average of green values by a sum of the average of red values and the average of blue values in the case where the pixel colors of each block are represented by RGB.

5 . A pulse detection device comprising:

a storage section that stores captured images of a predetermined number of frames depicting a region including skin of a user;

a pixel value acquisition section that divides the captured images into a plurality of blocks and acquires pixel values in each block;

a brightness change compensation section that compensates for brightness changes by dividing an average of green values by a sum of an average of red values and an average of blue values in a case where the pixel colors of each block are represented by RGB; and

a pulse detection section that detects a pulse from temporal changes in the pixel values in each block after brightness change compensation.

6 . A pulse detection method comprising:

dividing captured images of a predetermined number of frames depicting a region including skin of a user into a plurality of blocks and acquiring pixel values in each block;

narrowing down target pixels in each block by excluding pixels that have a green value equal to or smaller than a first predetermined threshold and pixels that have a red value equal to or greater than a second predetermined threshold in a case where pixel colors of each block are represented by RGB, wherein the second predetermined threshold is greater than the first predetermined threshold; and

detecting a pulse from temporal changes in target pixel values in each block.

7 . A non-transitory, computer-readable storage medium containing a computer program, which when executed by a computer, causes the computer to implement a pulse detection method by carrying out actions, comprising:

dividing captured images of a predetermined number of frames depicting a region including skin of a user into a plurality of blocks and acquiring pixel values in each block;

narrowing down target pixels in each block by excluding pixels that have a green value equal to or smaller than a first predetermined threshold and pixels that have a red value equal to or greater than a second predetermined threshold in a case where pixel colors of each block are represented by RGB, wherein the second predetermined threshold is greater than the first predetermined threshold; and

detecting a pulse from temporal changes in target pixel values in each block.

8 . The pulse detection device of claim 1 , further comprising:

a time-series pixel array acquisition section configured to acquire a time-series pixel array comprising the pixel values in each block.

9 . The pulse detection device of claim 8 , wherein the time-series pixel array acquisition section is configured to perform low-pass filtering on the time-series pixel array to acquire a temporarily smoothed time-series pixel array.

10 . The pulse detection device of claim 8 , further comprising:

a pulse data array acquisition section configured to perform high-pass filtering (HPF) on the time-series pixel array.

11 . The pulse detection method of claim 6 , further comprising:

wherein, when the pixel colors of each block are represented by a hue, narrowing down the target pixels in each block by further excluding pixels having a hue within a predetermined range.

12 . The pulse detection method of claim 6 , further comprising:

compensating for brightness changes by dividing an average of green values by an average of red or blue values in a case where the colors of the target pixels in each block are represented by RGB; and

detecting a pulse from temporal changes in the pixel values in each block after brightness change compensation.

13 . The pulse detection method of claim 12 , further comprising:

compensating for brightness changes by dividing the average of green values by a sum of the average of red values and the average of blue values in the case where the pixel colors of each block are represented by RGB.

14 . The pulse detection method of claim 6 , further comprising:

acquiring a time-series pixel array comprising the pixel values in each block.

15 . The pulse detection method of claim 14 , further comprising:

performing low-pass filtering on the time-series pixel array to acquire a temporarily smoothed time-series pixel array.

16 . The pulse detection method of claim 14 , further comprising:

performing high-pass filtering (HPF) on the time-series pixel array.

17 . The non-transitory, computer-readable storage medium of claim 7 , wherein the actions further comprise:

when the pixel colors of each block are represented by a hue, narrowing down the target pixels in each block by further excluding pixels having a hue within a predetermined range.

18 . The non-transitory, computer-readable storage medium of claim 7 , wherein the actions further comprise:

compensating for brightness changes by dividing an average of green values by an average of red or blue values in a case where the colors of the target pixels in each block are represented by RGB; and

detecting a pulse from temporal changes in the pixel values in each block after brightness change compensation.

19 . The non-transitory, computer-readable storage medium of claim 18 , wherein compensating for the brightness changes comprises dividing the average of green values by a sum of the average of red values and the average of blue values in the case where the pixel colors of each block are represented by RGB.

20 . The non-transitory, computer-readable storage medium of claim 7 , wherein the actions further comprise:

acquiring a time-series pixel array comprising the pixel values in each block.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 13, 2023
From: SUGAWARA, AKIHIKO
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 063930/0671 →
Continuity (1)
Related Publication 20240029396A1 · Jan 25, 2024
References Cited (12)
US 8666116B2 · Kirenko · 2014 [cited by applicant]
US 11445921B2 · Yoshizawa · 2022 [cited by applicant]
US 20100067002A1 · Ishii · 2010 [cited by examiner]
US 20120195486A1 · Kirenko · 2012 [cited by applicant]
US 20170163953A1 · Wang · 2017 [cited by examiner]
US 20170238842A1 · Jacquel · 2017 [cited by examiner]
US 20180042486A1 · Yoshizawa · 2018 [cited by applicant]
US 20200268281A1 · Jacquel · 2020 [cited by examiner]
JP 2005218507A · 2005 [cited by applicant]
JP 2013506523A · 2013 [cited by applicant]
JP 2016190022A · 2016 [cited by applicant]
International Search Report for corresponding PCT Application No. PCT/JP2020/048931, 4 pages, dated Mar. 9, 2021. [cited by applicant]