IP Library Granted Patent US 8,764,652
Granted Patent B2
US 8,764,652 · App. 11/845,993 · Granted Jul 1, 2014

Method and system for measuring and ranking an “engagement” response to audiovisual or interactive media, products, or activities using physiological signals

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,764,652
App. No.
11/845,993
Granted
Jul 1, 2014
Kind
B2
Abstract

A system and method for calculating an engagement value by quantifying an amount that a user is acting without thinking considering brainwaves and a heart rate can be used to compare media based on an individual or a group of individuals. Events of the media can be contrasted and compared by the engagement value as well. Statistical measurements may be taken to improve media.

Claims (77)

1. A method for rating media, the method comprising:

obtaining a first signal from a brain of an individual produced substantially while the individual is exposed to the media;

obtaining a second signal from a heart of the individual produced substantially concurrently with the first signal from the brain;

decomposing the first signal and the second signal into a frequency domain;

calculating with a processor, an engagement value based on a first mathematical relationship between (1) a first frequency and (2) a second frequency from the frequency domain of the first signal and a second mathematical relationship between (1) a third frequency from the frequency domain of the second signal and (2) a result of the first mathematical relationship;

comparing the engagement value with a reference value to determine a difference; and

rating the media based on the difference between the engagement value and the reference value.

2. The method of claim 1 , wherein at least one of the first frequency and the second frequency includes one or more of an alpha frequency or a theta frequency.

3. The method of claim 1 , wherein the engagement value is associated with an event in the media.

4. The method of claim 1 , wherein the second signal is sampled via a photoplethysmograph attached to a head of the individual.

5. The method of claim 1 , wherein multiple engagement values from multiple individuals associated with an event in the media are aggregated to form an engagement response to the event.

6. The method of claim 1 , wherein multiple engagement values from multiple individuals are included in a summated response vector identifying the number of persons that responded with engagement to the media.

7. The method of claim 1 , wherein the decomposing is accomplished using a Fast Fourier transform or a wavelet analysis.

8. The method of claim 7 , wherein the wavelet analysis is accomplished using a wavelet selected from a Mexican hat wavelet, a morlet wavelet, a daubechies wavelet, a beta wavelet, and a coiflet wavelet.

9. The method of claim 1 , further comprising calculating a derivative of the engagement value representing a change in engagement over time.

10. The method of claim 2 , wherein the engagement value is determined by calculating [heart rate/50]−[(theta−alpha)/(theta+alpha)].

11. The method of claim 1 , wherein a length of each heart beat is monitored.

12. The method of claim 1 wherein the first signal includes an alpha frequency, a beta frequency, a delta frequency, a theta frequency and a total EEG power, the second signal includes a heart rate, and the engagement value is calculated by contrasting the heart rate with one or more of:

θ−α,

θ,

θ/α,

Δ/α,

β/α, or

total EEG power/α.

13. The method of claim 1 wherein the first signal includes an alpha frequency, a beta frequency, a delta frequency, a theta frequency and a total EEG power, the second signal includes a heart beat, and the engagement value is calculated by contrasting a length of the heart beat with one or more of:

α,

α/θ,

α/β,

α/Δ,

α/total EEG power, or

(α−θ)/(α+θ).

14. The method of claim 1 , wherein the media includes one or more of a television broadcast, a video game, an audiovisual advertisement, a board game, a card game, a live action event, a print advertisement or a web advertisement.

15. The method of claim 1 , further comprising:

identifying a point in time corresponding to the engagement value;

identifying an event of the media occurring substantially concurrently with the point in time;

correlating the engagement value with the event; and

aligning the engagement value to the media.

16. A tangible machine readable storage medium comprising machine readable instructions which, when read, cause a machine to at least:

decompose a first signal from a brain of an individual and a second signal from a heart of the individual into a frequency domain, the first and second signal produced substantially concurrently and while the individual is exposed to media;

calculate an engagement value based on: (1) a first mathematical relationship between (a) a first frequency and (b) a second frequency from the frequency domain of the first signal and (2) a second mathematical relationship between (a) a third frequency from the frequency domain of the second signal and (b) a result of the first mathematical relationship;

compare the engagement value with a reference value to determine a difference; and

rate the media based on the difference between the engagement value and the reference value.

17. The medium of claim 16 , wherein at least one of the first frequency and the second frequency includes one or more of an alpha frequency or a theta frequency.

18. The medium of claim 16 , wherein the first signal includes an alpha frequency, a beta frequency, a delta frequency, a theta frequency and a total EEG power, the second signal includes a heart beat, and the engagement value is calculated by contrasting a length of the heart beat with one or more of:

α,

α/θ,

α/β,

α/Δ,

α/total EEG power, or

(α−θ)/(α+θ), wherein α, β, Δ, & θ are each found in the first signal.

19. The medium of claim 16 , wherein the decomposing of the first signal and the second signal comprises using one or more of a fast Fourier transform or a wavelet analysis.

20. The medium of claim 16 , wherein the media includes one or more of a television program, a video game, an audiovisual advertisement, a board game, a card game, a live action event, a print advertisement or a web advertisement.

21. The medium of claim 16 , wherein the machine is further caused to:

align the signal relative to the media;

create a first aligned engagement value corresponding to a first event based on the alignment; and

compare the first aligned engagement value with a second aligned engagement value corresponding to a second event in time.

22. A system for rating media, the system comprising:

a data collector to obtain a first signal from a brain of an individual produced substantially while the individual is exposed to the media and a second signal from a heart of the individual produced substantially while the individual is exposed to the media; and

a processor to:

decompose the first signal and the second signal into a frequency domain;

calculate an engagement value based on a first mathematical relationship between (1) a first frequency and (2) a second frequency from the frequency domain of the first signal and a second mathematical relationship between (1) a third frequency from the frequency domain of the second signal and (2) a result of the first mathematical relationship;

compare the engagement value with a reference value to determine a difference; and

rate the media based on the difference between the engagement value and the reference.

23. The system of claim 22 , wherein the data collector comprises one or more sensors included in an integrated sensor headset to measure a signal from the individual stimulated by the media.

24. The method of claim 1 , wherein the reference value is determined by a developer of the media.

25. The method of claim 1 , wherein the reference value is an average of a plurality of previously calculated engagement values for the media.

26. The method of claim 1 , wherein the first mathematical relationship includes a ratio of (1) a first difference between the second frequency and the first frequency to (2) a sum of the first frequency and the second frequency.

27. The method of claim 26 , wherein the second mathematical relationship includes a second difference between the third frequency and the result of the first mathematical relationship.

28. The method of claim 27 , wherein the second mathematical relationship includes a percentage of the third frequency.

29. The method of claim 3 , wherein the event is classified as a specific type of event using a mathematical transform to compare the event with one or more other events.

30. The method of claim 29 , wherein the mathematical transform includes using an average.

31. The method of claim 29 , wherein the mathematical transform includes a first order derivative.

32. The method of claim 29 , wherein the mathematical transform includes a second order derivative.

33. The method of claim 29 , wherein the mathematical transform includes a polynomial approximation.

34. The method of claim 29 , wherein the mathematical transform includes a standard deviation from a mean.

35. The method of claim 29 , wherein the mathematical transform includes a standard deviation of derivatives from a mean.

36. The method of claim 29 , wherein the mathematical transform includes vectors and a positive derivative vector indicates an exciting type of event and a negative derivative vector indicates an unexciting type of event.

Assignments (9)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 037172 / FRAME 0415) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 061750/0221 →
SECURITY INTEREST Recorded Mar 25, 2021
From: NIELSEN CONSUMER LLC; BYZZER INC.
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
Reel/Frame 055742/0719 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Mar 10, 2021
From: CITIBANK, N.A.
To: NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN CONSUMER LLC
Reel/Frame 055557/0949 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2021
From: THE NIELSEN COMPANY (US), LLC
To: NIELSEN CONSUMER LLC
Reel/Frame 055236/0963 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL IP SECURITY AGREEMENT Recorded Nov 30, 2015
From: THE NIELSEN COMPANY ((US), LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT FOR THE FIRST LIEN SECURED PARTIES
Reel/Frame 037172/0415 →