IP Library Granted Patent US 10,049,265
Granted Patent B2
US 10,049,265 · App. 15/355,596 · Granted Aug 14, 2018

Methods and apparatus to monitor environments

Inventors: Morris Lee (Palm Harbor, FL); Alejandro Terrazas (Santa Cruz, CA)
Assignee: The Nielsen Company (US), LLC
G06K9/00362G01B11/254G06F3/0304G06K9/00771G06K9/2036G06T7/0075G06T7/593H04H60/66H04N13/026H04N21/44218
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,049,265
App. No.
15/355,596
Granted
Aug 14, 2018
Kind
B2
Abstract

Methods and apparatus to monitor environments are disclosed. An example method includes triggering a two-dimensional recognition analysis, in connection with a first frame of data, on two-dimensional data points representative of an object detected in an environment, the triggering based on satisfying a first trigger event, the first trigger event one of (1) a distance between the object and a sensor of the environment satisfying a threshold distance, or (2) elapsing of a time interval. In response to determining that the object is recognized as a person in the first frame, triggering the two-dimensional recognition analysis in connection with a second frame, the second frame subsequent to the first frame, the two-dimensional recognition analysis of the second frame performed on two-dimensional data points representative of a location in the second frame corresponding to the location of the person in the first frame.

Claims (30)

1. An audience measurement device, comprising:

memory to store a first frame of data and a second frame of data; and

a first data analyzer to:

trigger a two-dimensional recognition analysis, in connection with the first frame of data, on two-dimensional data points representative of an object detected in an environment, the trigger based on satisfying a first trigger event, the first trigger event being one of (1) a distance between the object and a sensor of the environment satisfying a threshold distance, or (2) elapsing of a time interval; and

in response to determining that the object is recognized as a person in the first frame, trigger the two-dimensional recognition analysis in connection with the second frame, the second frame subsequent to the first frame, the two-dimensional recognition analysis of the second frame performed on two-dimensional data points representative of a location in the second frame corresponding to the location of the person in the first frame, the first data analyzer implemented via a logic circuit.

2. The audience measurement device as defined in claim 1 , further including:

a depth sensor to capture three-dimensional data points using electromagnetic beams projected in a pattern; and

a camera to capture the two-dimensional data points.

3. The audience measurement device as defined in claim 2 , further including a depth filter to analyze a plurality of the three-dimensional data points to determine the distance between the object and the sensor.

4. The audience measurement device as defined in claim 1 , further including a body counter to calculate a people count using results of the two-dimensional recognition analyses.

5. The audience measurement device as defined in claim 1 , wherein the first data analyzer limits the two-dimensional recognition analysis to a portion of the second frame corresponding to a shape surrounding the location in the second frame.

6. The audience measurement device as defined in claim 1 , wherein the first data analyzer is not to trigger the two-dimensional recognition analysis in connection with the second frame in response to determining that the object is not recognized as a person in the first frame.

7. The audience measurement device as defined in claim 1 , further including a second data analyzer to, when the first trigger event is not satisfied, execute a three-dimensional recognition analysis on three-dimensional data points representative of the object detected in the environment.

8. A method, comprising:

triggering, by executing an instruction with a processor, a two-dimensional recognition analysis, in connection with a first frame of data, on two-dimensional data points representative of an object detected in an environment, the triggering based on satisfying a first trigger event, the first trigger event being one of (1) a distance between the object and a sensor of the environment satisfying a threshold distance, or (2) elapsing of a time interval; and

in response to determining that the object is recognized as a person in the first frame, triggering, by executing an instruction with the processor, the two-dimensional recognition analysis in connection with a second frame subsequent to the first frame, the two-dimensional recognition analysis of the second frame performed on two-dimensional data points representative of a location in the second frame corresponding to the location of the person in the first frame.

9. The method as defined in claim 8 , further including capturing three-dimensional data points using electromagnetic beams projected in a pattern, and capturing the two-dimensional data points with a camera.

10. The method as defined in claim 9 , further including analyzing a plurality of the three-dimensional data points to determine the distance between the object and the sensor.

11. The method device as defined in claim 8 , further including calculating a people count using results of the two-dimensional recognition analyses.

12. The method as defined in claim 8 , wherein the two-dimensional recognition analysis of the second frame is limited to a portion of the second frame corresponding to a shape surrounding the location in the second frame.

13. The method as defined in claim 8 , further including, in response to determining that the object is not recognized as a person in the first frame, not triggering the two-dimensional recognition analysis in connection with the second frame.

14. The method as defined in claim 8 , further including when the first trigger event is not satisfied, executing a three-dimensional recognition analysis on three-dimensional data points representative of the object detected in the environment.

15. A tangible machine readable storage medium comprising instructions that, when executed, cause a machine to at least:

trigger a two-dimensional recognition analysis, in connection with a first frame of data, on two-dimensional data points representative of an object detected in an environment, the triggering based on satisfying a first trigger event, the first trigger event being one of (1) a distance between the object and a sensor of the environment satisfying a threshold distance, or (2) elapsing of a time interval; and

in response to determining that the object is recognized as a person in the first frame, trigger the two-dimensional recognition analysis in connection with a second frame subsequent to the first frame, the two-dimensional recognition analysis of the second frame performed on two-dimensional data points representative of a location in the second frame corresponding to the location of the person in the first frame.

16. The tangible machine readable storage medium as defined in claim 15 , wherein the instructions further cause the machine to obtain three-dimensional data points captured using electromagnetic beams projected in a pattern, wherein the two-dimensional data points are captured with a camera.

17. The tangible machine readable storage medium as defined in claim 16 , wherein the instructions further cause the machine to analyze a plurality of the three-dimensional data points to determine the distance between the object and the sensor.

18. The method as defined in claim 15 , wherein the instructions further cause the machine to limit the two-dimensional recognition analysis to a portion of the second frame corresponding to a shape and surrounding the location in the second frame.

19. The method as defined in claim 15 , wherein the instructions further cause the machine to not trigger the two-dimensional recognition analysis in connection with the second frame in response to determining that the object is not recognized as a person in the first frame.

20. The method as defined in claim 15 , wherein when the first trigger event is not satisfied, the instructions further cause the machine to execute a three-dimensional recognition analysis on three-dimensional data points representative of the object detected in the environment.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2016
From: LEE, MORRIS; TERRAZAS, ALEJANDRO
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 040492/0979 →
Continuity (3)
Continuation 14669798 · Mar 26, 2015
Division 13708698 · Dec 7, 2012
Related Publication 20170068851A1 · Mar 9, 2017