IP Library Patent Application 17969530
Patent Application
App. No. 17/969,530

METHODS AND APPARATUS TO MEASURE FACIAL ATTENTION

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
17/969,530
Abstract

Methods, apparatus, systems, and articles of manufacture to measure facial attention are disclosed. An example apparatus includes at least one memory, machine readable instructions, and processor circuitry to at least one of instantiate or execute the machine readable instructions to identify facial landmarks from input image data, the facial landmarks corresponding to coordinates of landmarks of a face detected in the input image data, determine a first distance between a first facial landmark of the facial landmarks and a second facial landmark of the facial landmarks, determine a second distance between the first facial landmark and a third facial landmark of the facial landmarks, and compare a quotient of the first distance and the second distance to a threshold to determine an attentiveness metric.

Claims (73)

1 . An apparatus to comprising:

at least one memory;

machine readable instructions; and

processor circuitry to at least one of instantiate or execute the machine readable instructions to:

identify facial landmarks from input image data, the facial landmarks corresponding to coordinates of landmarks of a face detected in the input image data;

determine a first distance between a first facial landmark of the facial landmarks and a second facial landmark of the facial landmarks;

determine a second distance between the first facial landmark and a third facial landmark of the facial landmarks; and

compare a quotient of the first distance and the second distance to a threshold to determine an attentiveness metric.

2 . The apparatus of claim 1 , wherein the processor circuitry is to:

determine that no facial landmarks were identified;

in response to no facial landmarks being identified, instruct an image capturing device to adjust a configuration of the image capturing device; and

obtain adjusted input image data from the image capturing device.

3 . The apparatus of claim 1 , wherein the quotient is a first quotient, the threshold is a first threshold, and the processor circuitry is to:

determine the first quotient satisfies the first threshold; and

compare a second quotient of a third distance and a fourth distance to a second threshold to determine the attentiveness metric, the third distance between the first facial landmark and a fourth facial landmark of the facial landmarks, the fourth distance between the first facial landmark and a fifth facial landmark of the facial landmarks.

4 . The apparatus of claim 3 , wherein the processor circuitry is to, in response to the second quotient not satisfying the threshold, identify that the face is distracted.

5 . The apparatus of claim 1 , wherein the processor circuitry is to:

determine an area of the face;

determine a first normalized distance based on a square root of the area of the face and the first distance; and

determine a second normalized distance based on the square root of the area of the face and the second distance.

6 . The apparatus of claim 1 , wherein the processor circuitry is to track the attentiveness metric of the face over a period of time using centroid tracking.

7 . The apparatus of claim 1 , wherein the input image data includes a first image and a second image, the face is a first face detected in the first image, the attentiveness metric is a first attentiveness metric associated with the first face in the first image, the threshold is a first threshold, and the processor circuitry is to:

obtain a first set of bounding box coordinates bounding the first face in the first image and a second set of bounding box coordinates bounding a second face detected in the second image;

determine a first center coordinate of the first set of bounding box coordinates;

assign an object identifier to the first center coordinate;

determine a second center coordinate of the second set of bounding box coordinates;

compare a third distance between the first center coordinate and the second center coordinate to a second threshold to determine whether the second center coordinate is associated with the first center coordinate;

in response to the third distance satisfying the second threshold, assign the object identifier to the second center coordinate to identify the second face as corresponding to the first face; and

determine a second attentiveness metric associated with the second face in the second image.

8 . The apparatus of claim 7 , wherein the processor circuitry is to:

in response to the third distance not satisfying the second threshold, assign a unique object identifier to the second center coordinate, the unique object identifier identify the second face is different from the first face; and

determine a third attentiveness metric associated with the second face in the second image.

9 . The apparatus of claim 1 , wherein the threshold is indicative of a maximum amount of deviation from a neutral face before the face is identified as distracted.

10 . A non-transitory machine readable storage medium comprising instructions that, when executed, cause processor circuitry to at least:

identify facial landmarks from input image data, the facial landmarks corresponding to coordinates of landmarks of a face detected in the input image data;

determine a first distance between a first facial landmark of the facial landmarks and a second facial landmark of the facial landmarks;

determine a second distance between the first facial landmark and a third facial landmark of the facial landmarks; and

compare a quotient of the first distance and the second distance to a threshold to determine an attentiveness metric.

11 . The non-transitory computer-readable medium of claim 10 , wherein the instructions, when executed, cause the machine to:

determine that no facial landmarks were identified;

in response to no facial landmarks being identified, instruct an image capturing device to adjust a configuration of the image capturing device; and

obtain adjusted input image data from the image capturing device.

12 . The non-transitory computer-readable medium of claim 10 , wherein the quotient is a first quotient, the threshold is a first threshold and the instructions, when executed, cause the machine to:

determine the first quotient satisfies the first threshold; and

compare a second quotient of a third distance and a fourth distance to a second threshold to determine the attentiveness metric, the third distance between the first facial landmark and a fourth facial landmark of the facial landmarks, the fourth distance between the first facial landmark and a fifth facial landmark of the facial landmarks.

13 . The non-transitory computer-readable medium of claim 12 , wherein the instructions, when executed, cause the machine to, in response to the second quotient not satisfying the threshold, identify that the face is distracted.

14 . The non-transitory computer-readable medium of claim 10 , wherein the instructions, when executed, cause the machine to:

determine an area of the face;

determine a first normalized distance based on a square root of the area of the face and the first distance; and

determine a second normalized distance based on the square root of the area of the face and the second distance.

15 . The non-transitory computer-readable medium of claim 10 , wherein the instructions, when executed, cause the machine to track the attentiveness metric of the face over a period of time using centroid tracking.

16 . The non-transitory computer-readable medium of claim 10 , wherein the input image data includes a first image and a second image, the face is a first face detected in the first image, the attentiveness metric is a first attentiveness metric associated with the first face in the first image, the threshold is a first threshold, and the instructions, when executed, cause the machine to:

obtain a first set of bounding box coordinates bounding the first face in the first image and a second set of bounding box coordinates bounding a second face detected in the second image;

determine a first center coordinate of the first set of bounding box coordinates;

assign an object identifier to the first center coordinate;

determine a second center coordinate of the second set of bounding box coordinates;

compare a third distance between the first center coordinate and the second center coordinate to a second threshold to determine whether the second center coordinate is associated with the first center coordinate;

in response to the third distance satisfying the second threshold, assign the object identifier to the second center coordinate to identify the second face as corresponding to the first face; and

determine a second attentiveness metric associated with the second face in the second image.

17 . The non-transitory computer-readable medium of claim 16 , wherein the instructions, when executed, cause the machine to:

in response to the third distance not satisfying the second threshold, assign a unique object identifier to the second center coordinate, the unique object identifier identify the second face is different from the first face; and

determine a third attentiveness metric associated with the second face in the second image.

18 . The non-transitory computer-readable medium of claim 10 , wherein the threshold is indicative of a maximum amount of deviation from a neutral face before the face is identified as distracted.

19 . A method comprising:

identifying, by executing an instruction with programmable circuitry, facial landmarks from input image data, the facial landmarks corresponding to coordinates of landmarks of a face detected in the input image data;

determining, by executing an instruction with the programmable circuitry, a first distance between a first facial landmark of the facial landmarks and a second facial landmark of the facial landmarks;

determining, by executing an instruction with the programmable circuitry, a second distance between the first facial landmark and a third facial landmark of the facial landmarks; and

comparing, by executing an instruction with the programmable circuitry, a quotient of the first distance and the second distance to a threshold to determine an attentiveness metric.

20 . The method of claim 19 , further including:

determining that no facial landmarks were identified;

in response to no facial landmarks being identified, instructing an image capturing device to adjust a configuration of the image capturing device; and

obtaining adjusted input image data from the image capturing device.

21 - 27 . (canceled)

Assignments (3)
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →