IP Library Granted Patent US 10,881,348
Granted Patent B2
US 10,881,348 · App. 15/400,287 · Granted Jan 5, 2021

System and method for gathering and analyzing biometric user feedback for use in social media and advertising applications

Inventors: Brian Levine (Needham, MA); Carl Marci (Boston, MA); Ravi Kanth V. Kothuri (Nashua, NH)
Assignee: The Nielsen Company (US), LLC
A61B5/486A61B3/112A61B3/113A61B5/0077A61B5/02055A61B5/0476A61B5/0488A61B5/165G06N20/00G06Q50/01G09B19/00G09B25/00A61B5/02405A61B5/0533A61B5/0816A61B5/11A61B2503/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,881,348
App. No.
15/400,287
Granted
Jan 5, 2021
Kind
B2
Abstract

Systems and methods for measuring biologically and behaviorally based responses to social media, locations, or experiences and providing instant and continuous feedback in response thereto are disclosed. An example system includes a first sensor to determine an emotional response of a user exposed to a social media application, a second sensor to determine a current activity of the user, and a third sensor to determine an environment of the user. The example system also establishes a priority schedule based on the emotional response, the current activity, and the environment. The system also correlates, based on the priority schedule, an advertisement with at least one of the emotional response, activity, or the environment. In addition, the example system presents the advertisement based on the priority schedule and the correlation of the advertisement with the at least one of the activity, the environment, or the emotional response.

Claims (61)

1. A system comprising:

a mobile device configured to access a social media application or internet-accessible application, the mobile device including:

a first sensor; and

a second sensor;

a case for the mobile device;

a third sensor in or on the case, the third sensor configured to measure a biometric response of a user of the mobile device while exposed to the social media application or internet-accessible application;

memory including instructions; and

a processor configured to execute the instructions to:

determine a first activity of the user involving the mobile device based on input from the first sensor;

determine a location of the user based on input from the second sensor, and determine a second activity of the user associated with the location of the user;

determine an emotional response of the user based on the biometric response;

establish a priority of the first activity of the user involving the mobile device over the second activity of the user associated with the location of the user;

determine an action to be performed with the social media application or internet-accessible application based on the priority and the emotional response;

perform, via the social media application or internet-accessible application, the action;

select an advertisement based on the first activity of the user involving the mobile device; and

present, via the mobile device, the advertisement to the user.

2. The system as defined in claim 1 , wherein the first sensor includes at least one of an accelerometer, a magnetometer, or a gyroscope, and wherein the processor is configured to determine the first activity of the user based on motion data of the mobile device.

3. The system as defined in claim 1 , wherein the third sensor includes at least one of a galvanic skin response sensor, a heart rate sensor, a temperature sensor, an electroencephalographic sensor, or an electromyographic sensor.

4. The system as defined in claim 1 , wherein at least one of the first sensor or the second sensor includes an image capturing device configured to capture an image or a video, wherein the processor is configured to perform image recognition on the image or the video to determine at least one of the first activity of the user or the second activity of the user.

5. The system as defined in claim 1 , wherein the second sensor includes a global positioning system (GPS) receiver.

6. The system as defined in claim 1 , further including an affinity button operable by the user, the affinity button configured to initiate a training period in which the processor is to present a list of potential activities in which the user is involved and the user is to select an intended activity from the list of potential activities corresponding to an activity in which the user is engaged.

7. The system as defined in claim 6 , wherein the processor is configured to establish the priority based on the intended activity selected by the user.

8. The system as defined in claim 1 , wherein the priority is at least partially based on data from a prior emotional response and an activity associated with the prior emotional response.

9. A method comprising:

determining, via a processor, a first activity of a user involving a mobile device based on input from a first sensor of the mobile device, the mobile device configured to access a social media application or internet-accessible application;

determining, via the processor, a location of the user based on input from a second sensor of the mobile device;

determining, via the processor, a second activity of the user associated with the location of the user;

measuring, via a third sensor of a wristband carrying the mobile device, a biometric response of the user while exposed to the social media application or internet-accessible application;

determining, via the processor, an emotional response of the user based on the biometric response;

establishing, via the processor, a priority of the first activity of the user involving the mobile device over the second activity of the user associated with the location of the user;

determining, via the processor, an action to be performed with the social media application or internet-accessible application based on the priority and the emotional response;

performing, via the processor, the action on the social media application or internet-accessible application;

selecting, via the processor, an advertisement based on the first activity of the user involving the mobile device; and

presenting, via the processor, the advertisement to the user on the mobile device.

10. The method as defined in claim 9 , wherein the first sensor includes at least one of an accelerometer, a magnetometer, or a gyroscope, and wherein the input from the first sensor includes motion data of the mobile device.

11. The method as defined in claim 9 , wherein the third sensor includes at least one of a galvanic skin response sensor, a heart rate sensor, a temperature sensor, an electroencephalographic sensor, or an electromyographic sensor.

12. The method as defined in claim 9 , wherein at least one of the first sensor or the second sensor includes an image capturing device, further including capturing, via the image capturing device, an image or a video representing a view of the user, the user, or a combination thereof, wherein the image or the video is used to determine the first activity of the user or the second activity of the user.

13. The method as defined in claim 12 , further including performing image recognition on the image or the video.

14. The method as defined in claim 13 , wherein performing image recognition on the image or the video includes performing facial recognition.

15. The method as defined in claim 9 , further including:

sensing operation of an affinity button by the user;

initiating a training period in which the processor is to present a list of potential activities in which the user is involved and the user is to select an intended activity from the list of potential activities corresponding to an activity in which the user is engaged; and

establishing the priority based on the intended activity selected by the user.

16. A tangible computer readable storage medium comprising instructions that, when executed, causes a processor of a mobile device to at least:

determine, based on a biometric response measured by a first sensor of a case on the mobile device, an emotional response of a user exposed to a social media application or internet-accessible application on the mobile device;

determine, via input from a second sensor of the mobile device, a first activity of the user involving the mobile device;

determine, via input from a third sensor of the mobile device, a location of the user;

determine a second activity of the user associated with the location of the user;

establish a priority of the first activity of the user involving the mobile device over the second activity of the user associated with the location of the user;

determine an action to be performed with the social media application or internet-accessible application based on the priority and the emotional response;

perform, via the social media application or internet-accessible application, the action;

select an advertisement based on the first activity of the user involving the mobile device; and

present, via the mobile device, the advertisement to the user.

17. The tangible computer readable storage medium of claim 16 , wherein the instructions, when executed, cause the processor to determine the first activity of the user based on motion data of the mobile device.

18. The tangible computer readable storage medium of claim 16 , wherein at least one of the second sensor or the third sensor includes an image capturing device, and wherein the instructions, when executed, further cause the processor to capture, via the image capturing device, an image or a video, wherein the instructions further cause the processor to perform image recognition on the image or the video to determine at least one of the first activity of the user or the second activity of the user.

19. The tangible computer readable storage medium of claim 18 , wherein the instructions, when executed, further cause the processor to perform facial recognition of the image or the video.

20. The tangible computer readable storage medium of claim 16 , wherein the first sensor is at least one of a galvanic skin response sensor, a heart rate sensor, a temperature sensor, an electroencephalographic sensor, or an electromyographic sensor.

21. The tangible computer readable storage medium of claim 16 , wherein the instructions, when executed, further cause the processor to:

sense operation of an affinity button by the user;

initiate a training period and present, via the mobile device, a list of potential activities in which the user is involved, the user is to select an intended activity from the list of potential activities corresponding to an activity in which the user is engaged; and

establish the priority based on the intended activity selected by the user.

Assignments (9)
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
SECURITY INTEREST Recorded Mar 25, 2021
From: NIELSEN CONSUMER LLC; BYZZER INC.
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT AND COLLATERAL AGENT
Reel/Frame 055742/0719 →
PARTIAL RELEASE OF SECURITY INTEREST Recorded Mar 10, 2021
From: CITIBANK, N.A.
To: NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN CONSUMER LLC
Reel/Frame 055557/0949 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2021
From: THE NIELSEN COMPANY (US), LLC
To: NIELSEN CONSUMER LLC
Reel/Frame 055249/0645 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2017
From: LEVINE, BRIAN; MARCI, CARL; KOTHURI, RAVI KANTH V.
To: INNERSCOPE RESEARCH, INC.
Reel/Frame 042509/0969 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2017
From: INNERSCOPE RESEARCH, INC.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 042438/0592 →
Continuity (3)
Continuation 13779497 · Feb 27, 2013
Provisional Application 61603528 · Feb 27, 2012
Related Publication 20170112431A1 · Apr 27, 2017