IP Library Granted Patent US 10,075,767
Granted Patent B2
US 10,075,767 · App. 15/376,515 · Granted Sep 11, 2018

Broadcast content view analysis based on ambient audio recording

Inventors: Aliasgar Mumtaz Husain (Milpitas, CA); Yali Xu (Seattle, WA)
Assignee: Facebook, Inc.
H04N21/44218H04H60/66H04N21/25883H04N21/25891H04N21/4394
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,075,767
App. No.
15/376,515
Granted
Sep 11, 2018
Kind
B2
Abstract

An online system analyzes broadcast content viewed by individuals in a household. Each individual in the household is associated with a client device on which a software application module is executed. When the software application module detects one or more broadcasting signals of a content item broadcasted to the household, the software application module records the ambient audio, including audio from the broadcasting device. The software application module sends an identifier of the individual associated with the client device, an ambient audio fingerprint derived from the recorded ambient audio, and time information for the recorded ambient audio to the online system. The online system, based on the ambient audio data, identifies the corresponding individual and content item and logs an impression for the content item upon determination that there was an impression of the identified content item by the identified individual.

Claims (63)

1. A computer implemented method comprising:

receiving, by an online system from a client device, a data set comprising an identifier of an individual associated with the client device, an ambient audio fingerprint representing ambient audio captured by the client device during a broadcast by a household device in a vicinity of the client device, and time information indicating a length of time of the ambient audio captured by the client device;

identifying a user profile associated with the online system based on the identifier of the individual received from the client device;

identifying a content item associated with the broadcast based on the ambient audio fingerprint;

determining that there was an impression of the identified content item by the identified user associated with the client device in response to the length of time of the ambient audio exceeding a detection threshold;

logging the impression of the identified content item in association with the user profile in a data store of the online system;

determining if impression data in the data store exceeds a threshold impression value; and

responsive to determining that the impression data in the data store exceeds the threshold impression value, sending an instruction to a content provider to increase broadcasting frequency of the content item on the household device.

2. The method of claim 1 , wherein the audio feature is high frequency sound that is inaudible to human being and is located at the beginning of the recorded ambient audio.

3. The method of claim 1 , further comprising:

updating the user profile based on the logged impression for the individual identified in the data set.

4. The method of claim 1 , further comprising:

applying the impression associated with the individual to derive information describing the individual's interest in content items;

selecting one or more content items for the individual based on the analysis of the impression; and

presenting the selected content items to the individual.

5. The method of claim 1 , further comprising:

aggregating the impression associated with the individual with impressions of one or more other users of the online system; and

selecting one or more content items for the individual based on the aggregation of the impression; and

providing, by the online system, the selected one or more content items for display to the client device associated with the user.

6. The method of claim 5 , wherein aggregating the impression comprises:

identifying the one or more other users of the online system, wherein the one or more other users are connected with the individual in the online system.

7. The method of claim 5 , wherein aggregating the impression comprises:

identifying the one or more other users of the online system, wherein the user profiles of the one or more other users at least in part match the user profile of the individual.

8. The method of claim 1 , further comprising:

applying the impression associated with the individual to derive information describing attribution of the content item based on the analysis, wherein the attribution of the content items indicates whether the individual is interested in the content item.

9. A computer program product comprising a non-transitory computer readable storage medium having instructions encoded thereon that, when executed by a processor, cause the processor to perform steps including:

receiving, by an online system from a client device, a data set comprising an identifier of an individual associated with the client device, an ambient audio fingerprint representing ambient audio captured by the client device during a broadcast by a household device in a vicinity of the client device, and time information indicating a length of time of the ambient audio captured by the client device;

identifying a user profile associated with the online system based on the identifier of the individual received from the client device;

identifying a content item associated with the broadcast based on the ambient audio fingerprint;

determining that there was an impression of the identified content item by the identified user associated with the client device in response to the length of time of the ambient audio exceeding a detection threshold;

logging the impression of the identified content item in association with the user profile in a data store of the online system;

determining if impression data in the data store exceeds a threshold impression value; and

responsive to determining that the impression data in the data store exceeds the threshold impression value, sending an instruction to a content provider to increase broadcasting frequency of the content item on the household device.

10. The computer program product of claim 9 , wherein the audio feature is high frequency sound that is inaudible to human being and is located at the beginning of the recorded ambient audio.

11. The computer program product of claim 9 , further comprising instructions for:

updating the user profile based on the logged impression for the individual identified in the data set.

12. The computer program product of claim 9 , further comprising instructions for:

applying the impression associated with the individual to derive information describing the individual's interest in content items;

selecting one or more content items for the individual based on the analysis of the impression; and

presenting the selected content items to the individual.

13. The computer program product of claim 9 , further comprising instructions for:

aggregating the impression associated with the individual with impressions of one or more other users of the online system; and

selecting one or more content items for the individual based on the aggregation of the impression; and

providing, by the online system, the selected one or more content items for display to the client device associated with the user.

14. The computer program product of claim 13 , wherein aggregating the impression comprises:

identifying the one or more other users of the online system, wherein the one or more other users are connected with the individual in the online system.

15. The computer program product of claim 13 , wherein aggregating the impression comprises:

identifying the one or more other users of the online system, wherein the user profiles of the one or more other users at least in part match the user profile of the individual.

16. The computer program product of claim 9 , further comprising instructions for:

applying the impression associated with the individual to derive information describing attribution of the content item based on the analysis, wherein the attribution of the content items indicates whether the individual is interested in the content item.

17. A computer system comprising:

a processor; and

a non-transitory computer readable storage medium having instructions encoded thereon that, when executed by a processor, cause the processor to perform steps including:

receiving, by an online system from a client device, a data set comprising an identifier of an individual associated with the client device, an ambient audio fingerprint representing ambient audio captured by the client device during a broadcast by a household device in a vicinity of the client device, and time information indicating a length of time of the ambient audio captured by the client device;

identifying a user profile associated with the online system based on the identifier of the individual received from the client device;

identifying a content item associated with the broadcast based on the ambient audio fingerprint;

determining that there was an impression of the identified content item by the identified user associated with the client device in response to the length of time of the ambient audio exceeding a detection threshold;

logging the impression of the identified content item in association with the user profile in a data store of the online system;

determining if impression data in the data store exceeds a threshold impression value; and

responsive to determining that the impression data in the data store exceeds the threshold impression value, sending an instruction to a content provider to increase broadcasting frequency of the content item on the household device.

18. The computer system of claim 17 , wherein the audio feature is high frequency sound that is inaudible to human being and is located at the beginning of the recorded ambient audio.

19. The computer system of claim 17 , further comprising instructions for:

updating the user profile based on the logged impression for the individual identified in the data set.

Assignments (2)
CHANGE OF NAME Recorded Nov 18, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058897/0824 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2016
From: HUSAIN, ALIASGAR MUMTAZ; XU, YALI
To: FACEBOOK, INC.
Reel/Frame 040695/0727 →
Continuity (1)
Related Publication 20180167677A1 · Jun 14, 2018