IP Library Granted Patent US 8,943,526
Granted Patent B2
US 8,943,526 · App. 13/866,699 · Granted Jan 27, 2015

Estimating engagement of consumers of presented content

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,943,526
App. No.
13/866,699
Granted
Jan 27, 2015
Kind
B2
Abstract

Technologies described herein relate to estimating engagement of a person with respect to content being presented to the person. A sensor outputs a stream of data relating to the person as the person is consuming the content. At least one feature is extracted from the stream of data, and a level of engagement of the person is estimated based at least in part upon the at least one feature. A computing function is performed based upon the estimated level of engagement of the person.

Claims (35)

1. A computer-executable method, comprising:

receiving a stream of data output by a sensor, the stream of data relating to a person who is being presented with viewable content;

extracting a feature of the person from the stream of data;

computing a value that is indicative of engagement of the person with respect to the viewable content as the viewable content is being presented to the person, the computing of the value based at least in part upon the feature of the person extracted from the stream of data, wherein the computing of the value that is indicative of the engagement of the person comprises:

analyzing the feature of the person over a predefined time window, wherein the feature is subject to alteration; and

computing the value that is indicative of the engagement of the person based upon the analyzing of the feature of the person over the predefined time window; and

responsive to computing the value, performing at least one processing function based at least in part upon the value that is indicative of the engagement of the person, the performing of the at least one processing function undertaken by a computer processor.

2. The computer-executable method of claim 1 , wherein the stream of data is a video stream output by a video camera, and wherein the feature of the person extracted from the video stream is a facial feature.

3. The computer-executable method of claim 1 , wherein the stream of data is a video stream output by a video camera, and wherein the feature of the person extracted from the video stream is a pose of the head of the person.

4. The computer-executable method of claim 1 , wherein the viewable content is one of a movie, a television program, a video, a song, or an advertisement.

5. The computer-executable method of claim 1 , wherein the at least one processing function comprises:

selecting an advertisement from a plurality of potential advertisements based upon the value that is indicative of the engagement of the person; and

causing the advertisement selected from the plurality of potential advertisements to be presented to the person.

6. The computer-executable method of claim 1 , wherein computing the value that is indicative of the engagement of the person comprises classifying the engagement of the person into one of a plurality of predefined levels of engagement.

7. The computer-executable method of claim 1 configured for execution in a video game console.

8. The computer-executable method of claim 1 , wherein the at least one processing function comprises outputting a recommendation to the person as to other content predicted to be of interest to the person.

9. The computer-executable method of claim 1 , wherein the at least one processing function comprises determining an instance in time to present an advertisement to the person.

10. The computer-executable method of claim 1 , wherein the viewable content is an advertisement, and wherein the at least one processing function comprises selecting a price to charge an advertiser of the advertisement from amongst a plurality of potential prices based at least in part upon the value that is indicative of the engagement of the person with respect to the advertisement.

11. The computer-executable method of claim 1 , wherein the feature extracted from the stream of data relates to a skeletal pose of the person.

12. A computing device, comprising:

a receiver component that is configured to receive a stream of data from a sensor, the stream of data relating to a person being presented with content;

a feature extractor component that is configured to extract a feature of the person from the stream of data in real-time;

an engagement estimator component that is configured to estimate a level of engagement of the person with respect to the content being presented to the person based at least in part upon the feature extracted from the stream of data by the feature extractor component over a predefined window of time, wherein the computing device is configured to perform at least one computing function based upon the level of engagement estimated by the engagement estimator component.

13. The computing device of claim 12 being a gaming console, and the sensor being at least one of a video camera or a depth sensor.

14. The computing device of claim 12 , further comprising a recommender component that is configured to perform the at least one computing function, the at least one computing function comprising output of a recommendation as to other content predicted to be of interest to the person based upon the level of engagement of the person with respect to the content being presented to the person estimated by the engagement estimator component.

15. The computing device of claim 12 , further comprising an advertisement selector component that is configured to perform the at least one computing function, the at least one computing function comprising presentment of an advertisement to the person based upon the level of engagement of the person with respect to the content being presented to the person estimated by the engagement estimator component.

16. The computing device of claim 12 , wherein the sensor is a video camera, the feature extractor component configured to extract, in real-time, a plurality of features, the plurality of features comprising: face distances, head pose, and head roll of the person in video data captured by the video camera, and the engagement estimator component configured to estimate the level of engagement of the person based upon the plurality of features.

17. The computing device of claim 12 , wherein the content being presented to the person is one of a television program, a film, or an advertisement.

18. The computing device of claim 12 , wherein the engagement estimator component is configured to output real-time feedback as to the level of engagement of the person to a provider of the content, the content being a speech or lecture.

19. A computer-readable storage medium comprising instructions that, when executed by a processor, cause the processor to perform acts comprising:

receiving, from a video camera, a video feed directed at a person while the person is viewing media content;

extracting, in real-time, a plurality of features of the person from the video feed, the plurality of features comprising face distances identified in the video feed;

estimating a level of engagement of the person with respect to the media content based upon the plurality of features extracted from the video feed over a predefined window of time, the level of engagement being one of a plurality of predefined levels of engagement; and

updating the media content being viewed by the person based upon the level of engagement of the person estimated with respect to the media content.

20. The computing device of claim 12 , the engagement estimator component further configured to estimate the level of engagement of the person with respect to the content being presented to the person based upon the content being presented to the person.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 14, 2016
From: MICROSOFT TECHNOLOGY LICENSING, LLC
To: ZHIGU HOLDINGS LIMITED
Reel/Frame 040354/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2014
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 034544/0541 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2013
From: RIVERA, JAVIER HERNANDEZ; LIU, ZICHENG; HULTEN, GEOFF; CONRAD, MICHAEL; KRUM, KYLE; DEBARR, DAVID; ZHANG, ZHENGYOU
To: MICROSOFT CORPORATION
Reel/Frame 030273/0921 →