IP Library Granted Patent US 10,210,462
Granted Patent B2
US 10,210,462 · App. 14/552,001 · Granted Feb 19, 2019

Video content analysis for automatic demographics recognition of users and videos

Inventors: Juan Carlos Niebles Duque (Barranquilla, CO); Hrishikesh Aradhye (Santa Clara, CA); Luciano Sbaiz (Zurich, CH); Jay Yagnik (Mountain View, CA); Reto Strobl (Walenstadt, CH)
Assignee: Google LLC
G06N99/005G06F17/30781G06K9/00744H04L65/4084H04N21/23418H04N21/252H04N21/25883H04N21/25891
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,210,462
App. No.
14/552,001
Filed
Nov 24, 2014
Granted
Feb 19, 2019
Kind
B2
Art Unit
2123
USPC
706/15
Abstract

A demographics analysis trains classifier models for predicting demographic attribute values of videos and users not already having known demographics. In one embodiment, the demographics analysis system trains classifier models for predicting demographics of videos using video features such as demographics of video uploaders, textual metadata, and/or audiovisual content of videos. In one embodiment, the demographics analysis system trains classifier models for predicting demographics of users (e.g., anonymous users) using user features based on prior video viewing periods of users. For example, viewing-period based user features can include individual viewing period statistics such as total videos viewed. Further, the viewing-period based features can include distributions of values over the viewing period, such as distributions in demographic attribute values of video uploaders, and/or distributions of viewings over hours of the day, days of the week, and the like.

Claims (62)

1. A computer-implemented method of using a video classifier model that correlates demographic information with characteristics of video content to recommend videos, the method comprising:

accessing, using a hardware processor, a set of videos from a digital video repository;

for a given demographic attribute value of a demographic attribute, and for each video in the set of videos from the digital video repository, identifying, using the hardware processor, viewers of the video that have the demographic attribute value from a view log;

forming, using the hardware processor, a positive training set for the demographic attribute value by selecting videos in the set of videos from the digital video repository having a percentage of viewers that exceeds a threshold percentage value with the demographic attribute value and forming a negative training set for the demographic attribute value by selecting a subset of remaining videos from the digital video repository that are not included in the positive training set;

determining, using the hardware processor, for videos in the positive training set, features comprising demographic attribute values of uploaders of the videos in the positive training set;

training, using the hardware processor, the video classifier model for the demographic attribute value using the determined features of the videos of the positive training set;

determining, using the hardware processor, whether a given video is associated with the demographic attribute value by applying the trained video classifier model to the given video;

generating, using the hardware processor, a list of recommended videos for a viewer having the demographic attribute value, wherein the list of recommended videos includes the given video that was determined by the application of the trained video classifier model to be associated with the demographic attribute value; and

in response to detecting one or more viewers of the digital video repository that have the demographic attribute value, causing, using the hardware processor, the list of recommended videos to be presented to the one or more viewers.

2. The computer-implemented method of claim 1 , further comprising:

for a new video for which a value of the demographic attribute is not already known, determining features comprising a demographic attribute value of an uploader of the new video;

determining whether the new video has the demographic attribute value by applying the video classifier model for the demographic attribute value to the determined features.

3. The computer-implemented method of claim 1 , wherein identifying viewers of the video that have the demographic attribute value comprises identifying the demographic attribute value in user profiles of the viewers.

4. The computer-implemented method of claim 1 , further comprising training a video classifier model for each of a plurality of other demographic attribute values of the demographic attribute.

5. The computer-implemented method of claim 4 , further comprising:

for a new video for which the values of the demographic attribute are not already known:

determining features of the new video, the features comprising a demographic attribute value of an uploader of the new video; and

for each value of the other demographic attribute values of the demographic attribute:

obtaining a score by applying the video classifier model for the value to the determined features of the new video.

6. The computer-implemented method of claim 5 , further comprising forming a demographic distribution for the demographic attribute using the obtained scores.

7. The computer-implemented method of claim 5 , further comprising:

sorting the scores into an order; and

using the order to identify values of the demographic attribute to which the new video most strongly appeals.

8. A computer-readable storage medium storing instructions executable by a computer processor, the instructions comprising:

instructions for accessing a set of videos from a digital video repository;

instructions for, for a given demographic attribute value of a demographic attribute, and for each video in the set of videos from the digital video repository, identifying viewers of the video that have the demographic attribute value from a view log;

instructions for forming a positive training set for the demographic attribute value by selecting videos in the set of videos from the digital video repository having a percentage of viewers that exceeds a threshold percentage value with the demographic attribute value and forming a negative training set for the demographic attribute value by selecting a subset of remaining videos from the digital video repository that are not included in the positive training set;

instructions for determining, for videos in the positive training set, features comprising: demographic attribute values of uploaders of the videos in the positive training set, and content features derived from audiovisual content of the videos in the positive training set;

instructions for training the video classifier model for the demographic attribute value using the determined features of the videos in the positive training set;

instructions for determining whether a given video is associated with the demographic attribute value by applying the trained video classifier model to the given video;

instructions for generating a list of recommended videos for a viewer having the demographic attribute value, wherein the list of recommended videos includes the given video that was determined by the application of the trained video classifier model to be associated with the demographic attribute value; and

instructions for causing the list of recommended videos to be presented to one or more viewers in response to detecting the one or more viewers of the digital video repository that have the demographic attribute value.

9. The computer-readable storage medium of claim 8 , further comprising:

for a new video for which a value of the demographic attribute is not already known, determining features comprising a demographic attribute value of an uploader of the new video;

determining whether the new video has the demographic attribute value by applying the video classifier model for the demographic attribute value to the determined features.

10. The computer-readable storage medium of claim 8 , wherein identifying viewers of the video that have the demographic attribute value comprises identifying the demographic attribute value in user profiles of the viewers.

11. The computer-readable storage medium of claim 8 , further comprising training a video classifier model for each of a plurality of other demographic attribute values of the demographic attribute.

12. The computer-readable storage medium of claim 11 , further comprising:

for a new video for which the values of the demographic attribute are not already known:

determining features of the new video, the features comprising a demographic attribute value of an uploader of the new video; and

for each value of the other demographic attribute values of the demographic attribute:

obtaining a score by applying the video classifier model for the value to the determined features of the new video.

13. The computer-readable storage medium of claim 12 , further comprising forming a demographic distribution for the demographic attribute using the obtained scores.

14. The computer-readable storage medium of claim 12 , further comprising:

sorting the scores into an order; and

using the order to identify values of the demographic attribute to which the new video most strongly appeals.

15. A computer system comprising:

a computer processor; and

a computer-readable storage medium having instructions executable by the computer processor, the instructions comprising:

instructions for accessing a set of videos from a digital video repository;

instructions for, for a given demographic attribute value of a demographic attribute, and for each video in the set of videos from the digital video repository, identifying viewers of the video that have the demographic attribute value from a view log;

instructions for forming a positive training set for the demographic attribute value by selecting videos in the set of videos from the digital video repository having a percentage of viewers that exceeds a threshold percentage value with the demographic attribute value and forming a negative training set for the demographic attribute value by selecting a subset of remaining videos from the digital video repository that are not included in the positive training set;

instructions for determining, for videos in the positive training set, features comprising: demographic attribute values of uploaders of the videos in the positive training set, and content features derived from audiovisual content of the videos in the positive training set;

instructions for training the video classifier model for the demographic attribute value using the determined features of the videos in the positive training set;

instructions for determining whether a given video is associated with the demographic attribute value by applying the trained video classifier model to the given video;

instructions for generating a list of recommended videos for a viewer having the demographic attribute value, wherein the list of recommended videos includes the given video that was determined by the application of the trained video classifier model to be associated with the demographic attribute value; and

instructions for causing the list of recommended videos to be presented to one or more viewers in response to detecting the one or more viewers of the digital video repository that have the demographic attribute value.

16. The computer-readable storage medium of claim 8 , further comprising:

for a new video for which a value of the demographic attribute is not already known, determining features comprising a demographic attribute value of an uploader of the new video;

determining whether the new video has the demographic attribute value by applying the video classifier model for the demographic attribute value to the determined features.

17. The computer-readable storage medium of claim 8 , wherein identifying viewers of the video that have the demographic attribute value comprises identifying the demographic attribute value in user profiles of the viewers.

18. The computer-readable storage medium of claim 8 , further comprising training a video classifier model for each of a plurality of other demographic attribute values of the demographic attribute.

Assignments (2)
CHANGE OF NAME Recorded Oct 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044129/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 22, 2015
From: DUQUE, JUAN CARLOS NIEBLES; ARADHYE, HRISHI BALKRISHNA; SBAIZ, LUCIANO; YAGNIK, JAY N.; STROBL, RETO
To: GOOGLE INC.
Reel/Frame 035473/0025 →
Continuity (3)
Division 13294156 · Nov 10, 2011
Provisional Application 61412709 · Nov 11, 2010
Related Publication 20150081604A1 · Mar 19, 2015