IP Library Granted Patent US 9,747,497
Granted Patent B1
US 9,747,497 · App. 12/386,655 · Granted Aug 29, 2017

Method and system for rating in-store media elements

Inventors: Rajeev Sharma (State College, PA); Varij Saurabh (State College, PA); Namsoon Jung (State College, PA)
Assignee: VideoMining Corporation
G06K9/00369G06K9/00771
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,747,497
App. No.
12/386,655
Granted
Aug 29, 2017
Kind
B1
Abstract

The present invention is a method and system for rating in-store media elements based on the measurement for behavior patterns and demographics of the audience in the vicinity of the media element, where a plurality of input images of the audience are captured by at least a means for capturing images in the vicinity of the media element. The input images are processed by automated video analytic algorithms in order to measure the behavior patterns and demographics of each person in the audience tied to the media element. The measurements for the behavior patterns and demographics of the audience from the target media elements are aggregated. A set of ratings for the media element is calculated based on the measurements. The measured media elements are sampled, and the audience measurement for the sample is extrapolated to other media elements for in-store locations or for a group of stores. The ratings are converted into a standardized output. The standardized output facilitates comparisons among a plurality of media elements. The rating can be used to plan media types in the media element for reaching targeted demographics.

Claims (49)

1. A method for rating an in-store media element based on automatic measurements for behavior patterns and demographics of the people in the vicinity of the media element,

by providing at least a time server, wherein the time server generates time-stamped measurements in accordance with behavior analysis, segmentation, impression analysis, and emotion change measurements, and a video processing unit, wherein the video processing unit comprises at least a sensor for capturing images and a server, wherein the video processing unit converts video into audience data and, wherein video comprises image data, audience data comprises numerical data including behavior, demographics, impression, and emotion data, and wherein behavior data comprises a time duration of a person standing in front of the media element, impression data comprises the number of viewers for the media element, and emotion data comprises a persuasiveness metric, and wherein the video processing unit rates the media element by the steps of:

a) capturing a plurality of input images of the people by at least a sensor for capturing images in the vicinity of the media element wherein the images comprise a top-down view or a frontal view of the people,

b) processing the plurality of input images in order to measure the behavior patterns and demographics of each person tied to the media element by executing computer vision algorithms on the plurality of input images, (to generate a numerical metric, or other some functional element)

c) processing a path analysis of each person among the people for the behavior analysis by applying a computer vision technology based tracking algorithm to the plurality of input images, wherein attributes of the path analysis comprise information for initial point and destination, global trip, time, and average velocity,

d) measuring impression levels by detecting an act of viewing the media element by the people in a zone of influence of the media element,

e) aggregating the measurements for the behavior patterns and demographics of the people, and

f) calculating a set of standardized ratings for the media element based on the measurements,

wherein a media element is a space or hardware that holds various types of media,

wherein the behavior patterns comprise traffic count, impression, and impact to audience, and

wherein the demographics comprise age range, gender, and ethnicity.

2. The method according to claim 1 , wherein the method further comprises a step of ranking relative effectiveness of different marketing tactics based on the audience measurements to the media types in the media element wherein the effectiveness comprises the average impression duration for the media types.

3. The method according to claim 1 , wherein the method further comprises a step of synchronizing a play log of digital contents with the measurements for the behavior patterns and demographics of the people, and ranking the synchronized digital contents based on their performance.

4. The method according to claim 1 , wherein the method further comprises a step of sampling media elements in a group of stores,

wherein sites with similar media element types are clustered together, and

wherein the automatic measurements for the behavior patterns and demographics of the people for the sample are extrapolated to other media elements within the same media element type category.

5. The method according to claim 1 , wherein the method further comprises a step of organizing the ratings according to automatic segmentation of people, including the demographics of the people and trip types,

wherein the trip types comprise stock-up, fill-in, quick trip, and occasion-based.

6. The method according to claim 1 , wherein the method further comprises a step of measuring opportunity to see, gross rating points, targeted rating points, return on investment, unique audience, frequency, and reach based on the measurements for the behavior patterns and demographics of the people.

7. The method according to claim 1 , wherein the method further comprises a step of converting the ratings into a standardized output,

wherein a rule application logic module normalizes variance of the ratings within a predefined threshold.

8. The method according to claim 1 , wherein the method further comprises a step of utilizing a rule application logic module for analyzing the aggregated measurements,

wherein the rule application logic module applies a first set of criteria to a preliminary data in the aggregated measurements and a second set of criteria to a next level of data,

whereby the rule application logic module enables the adjustment in the analysis of information to be done in a structured and dynamic way.

9. The method according to claim 1 , wherein the method further comprises a step of producing metrics and measuring datasets for the metrics,

wherein the metrics comprise attraction index, engagement index, and conversion index, and

wherein the datasets comprise total traffic exposed to the campaign, total reach achieved, conversion ratio, and total engagement duration of all of the viewers, based on the automatic measurements for the behavior patterns and demographics of the people.

10. The method according to claim 1 , wherein the method further comprises a step of detecting the emotional changes of the audience in response to the media types in the media element,

wherein an average of the emotional changes to the media element is considered as an unified emotional response to the media element, and

wherein the emotional changes are aggregated with the measurements for the behavior patterns and demographics of the people to calculate the set of ratings for the media element.

11. An apparatus for rating an in-store media element based on automatic measurements for behavior patterns and demographics of the people in the vicinity of the media element,

by providing at least a time server, wherein the time server generates time-stamped measurements in accordance with behavior analysis, segmentation, impression analysis, and emotion change measurements, and a video processing unit, wherein the video processing unit comprises at least a sensor for capturing images and a server, wherein the video processing unit converts video into audience data and, wherein video comprises image data, audience data comprises numerical data including behavior, demographics, impression, and emotion data, and wherein behavior data comprises a time duration of a person standing in front of the media element, impression data comprises the number of viewers for the media element, and emotion data comprises a persuasiveness metric, and wherein the video processing unit rates the media element by the steps of:

a) capturing a plurality of input images of the people by at least a sensor for capturing images in the vicinity of the media element wherein the images comprise a top-down view or a frontal view of the people,

b) processing the plurality of input images in order to measure the behavior patterns and demographics of each person tied to the media element by executing computer vision algorithms on the plurality of input images, (to generate a numerical metric, or other some functional element)

c) processing a path analysis of each person among the people for the behavior analysis by applying a computer vision technology based tracking algorithm to the plurality of input images, wherein attributes of the path analysis comprise information for initial point and destination, global trip, time, and average velocity,

d) measuring impression levels by detecting an act of viewing the media element by the people in a zone of influence of the media element,

e) aggregating the measurements for the behavior patterns and demographics of the people, and

f) calculating a set of standardized ratings for the media element based on the measurements,

wherein a media element is a space or hardware that holds various types of media,

wherein the behavior patterns comprise traffic count, impression, and impact to audience, and

wherein the demographics comprise age range, gender, and ethnicity.

12. The apparatus according to claim 11 , wherein the apparatus further comprises means for ranking relative effectiveness of different marketing tactics based on the audience measurements to the media types in the media element wherein the effectiveness comprises the average impression duration for the media types.

13. The apparatus according to claim 11 , wherein the apparatus further comprises means for synchronizing a play log of digital contents with the measurements for the behavior patterns and demographics of the people, and ranking the synchronized digital contents based on their performance.

14. The apparatus according to claim 11 , wherein the apparatus further comprises means measuring opportunity to see, gross rating points, targeted rating points, return on investment, unique audience, frequency, and reach based on the measurements for the behavior patterns and demographics of the people.

15. The apparatus according to claim 11 , wherein the apparatus further comprises means for sampling media elements in a group of stores,

wherein sites with similar media element types are clustered together, and

wherein the automatic measurements for the behavior patterns and demographics of the people for the sample are extrapolated to other media elements within the same media element type category.

16. The apparatus according to claim 11 , wherein the apparatus further comprises means for organizing the ratings according to segments of people, including the demographics of the people and trip types,

wherein the trip types comprise stock-up, fill-in, quick trip, and occasion-based.

Assignments (17)
RELEASE OF SECURITY INTEREST Recorded Oct 5, 2023
From: VIDEOMINING CORPORATION; VIDEOMINING, LLC
To: WHITE OAK YIELD SPECTRUM PARALELL FUND, LP; WHITE OAK YIELD SPECTRUM REVOLVER FUND SCSP
Reel/Frame 065156/0157 →
RELEASE OF SECURITY INTEREST Recorded Sep 8, 2023
From: ENTERPRISE BANK
To: VIDEOMINING CORPORATION; VIDEOMINING, LLC FKA VMC ACQ., LLC
Reel/Frame 064842/0066 →
CHANGE OF NAME Recorded Feb 7, 2022
From: VMC ACQ., LLC
To: VIDEOMINING, LLC
Reel/Frame 058959/0406 →
CHANGE OF NAME Recorded Feb 7, 2022
From: VMC ACQ., LLC
To: VIDEOMINING, LLC
Reel/Frame 058957/0067 →
CHANGE OF NAME Recorded Feb 7, 2022
From: VMC ACQ., LLC
To: VIDEOMINING, LLC
Reel/Frame 058959/0397 →
CHANGE OF NAME Recorded Feb 1, 2022
From: VMC ACQ., LLC
To: VIDEOMINING, LLC
Reel/Frame 058922/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 21, 2021
From: VIDEOMINING CORPORATION
To: VMC ACQ., LLC
Reel/Frame 058552/0034 →
SECURITY INTEREST Recorded Dec 20, 2021
From: VIDEOMINING CORPORATION; VMC ACQ., LLC
To: ENTERPRISE BANK
Reel/Frame 058430/0273 →
SECURITY INTEREST Recorded Aug 3, 2017
From: VIDEOMINING CORPORATION
To: FEDERAL NATIONAL PAYABLES, INC. D/B/A/ FEDERAL NATIONAL COMMERCIAL CREDIT
Reel/Frame 043430/0818 →
RELEASE OF SECURITY INTEREST Recorded Jan 25, 2017
From: AMERISERV FINANCIAL BANK
To: VIDEOMINING CORPORATION
Reel/Frame 041082/0041 →
SECURITY INTEREST Recorded Jan 13, 2017
From: VIDEOMINING CORPORATION
To: ENTERPRISE BANK
Reel/Frame 040964/0888 →
SECURITY INTEREST Recorded May 31, 2016
From: VIDEOMINING CORPORATION
To: AMERISERV FINANCIAL BANK
Reel/Frame 038751/0889 →
RELEASE OF SECURITY INTEREST Recorded Feb 26, 2015
From: PARMER, GEORGE A.
To: VIDEO MINING CORPORATION
Reel/Frame 035039/0159 →
RELEASE OF SECURITY INTEREST Recorded Feb 26, 2015
From: PARMER, GEORGE A.; PEARSON, CHARLES C., JR; WEIDNER, DEAN A.; STRUTHERS, RICHARD K.; SEIG TRUST #1; PAPSON, MICHAEL G.; MESSIAH COLLEGE; BRENNER A/K/A MICHAEL BRENNAN, MICHAEL A.; BENTZ, RICHARD E.; AGAMEMNON HOLDINGS; SCHIANO, ANTHONY J.; POOLE, ROBERT E.
To: VIDEO MINING CORPORATION
Reel/Frame 035039/0632 →
SECURITY INTEREST Recorded Oct 1, 2014
From: VIDEOMINING CORPORATION
To: STRUTHERS, RICHARD K.; SEIG TRUST #1 (PHILIP H. SEIG, TRUSTEE); SCHIANO, ANTHONY J.; PAPSON, MICHAEL G.; MESSIAH COLLEGE; BENTZ, RICHARD E.; WEIDNER, DEAN A.; POOLE, ROBERT E.; PARMER, GEORGE A.; PEARSON, CHARLES C., JR; BRENNAN, MICHAEL; AGAMEMNON HOLDINGS
Reel/Frame 033860/0257 →
SECURITY INTEREST Recorded Feb 28, 2014
From: VIDEOMINING CORPORATION
To: PARMER, GEORGE A
Reel/Frame 032373/0073 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 15, 2010
From: SHARMA, RAJEEV; SAURABH, VARIJ; JUNG, NAMSOON
To: VIDEOMINING CORPORATION
Reel/Frame 024078/0394 →