IP Library Granted Patent US 9,092,675
Granted Patent B2
US 9,092,675 · App. 13/434,337 · Granted Jul 28, 2015

Methods and apparatus to count people in images

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,092,675
App. No.
13/434,337
Granted
Jul 28, 2015
Kind
B2
Abstract

Methods and apparatus to count people in images are disclosed. An example method includes dividing a frame of image data into a plurality of segments; calculating first fluctuation factors for the respective segments; calculating a second fluctuation factor for the frame; and identifying ones of the segments having a first fluctuation factor greater than the second fluctuation factor as active segments.

Claims (38)

1. A method, comprising:

dividing a first frame of image data into a plurality of segments;

calculating, with a processor, first fluctuation factors for respective ones of the segments, the first fluctuation factors respectively representative of changes in the respective segments from a second frame of image data to the first frame of image data;

calculating, with the processor, a second fluctuation factor for the first frame;

before performing object detection on the first frame:

identifying ones of the plurality of segments of the first frame having a first fluctuation factor greater than the second fluctuation factor as active segments for the first frame; and

linking, with the processor, adjacent ones of the active segments of the first frame to form a region of interest in the first frame; and

performing, with the processor, the object detection on the region of interest.

2. A method as defined in claim 1 , wherein the adjacent ones of the active segments are adjacent within a margin of error.

3. A method as defined in claim 1 , further comprising not performing the object detection on areas of the first frame outside the region of interest.

4. A method as defined in claim 1 , wherein the linking of the adjacent ones of the active segments comprises forming a shape that includes the adjacent ones of the active segments.

5. A method as defined in claim 1 , wherein the second fluctuation factor is calculated by selecting a set of pixels from the image data of the first frame and averaging fluctuation characteristics of the selected pixels.

6. A method as defined in claim 1 , wherein the first and second fluctuation factors are root mean square values based on pixel intensities.

7. A method as defined in claim 1 , wherein the second fluctuation factor is representative of a collective change across multiple ones of the segments over time.

8. A tangible computer readable storage medium comprising instructions that, when executed, cause a machine to at least:

divide a first frame of image data into a plurality of segments;

calculate first fluctuation factors for respective ones of the segments, the first fluctuation factors respectively indicative of fluctuations of the respective segments from a second frame of image data to the first frame;

calculate a second fluctuation factor for the first frame;

before performing object detection on the first frame:

identify ones of the plurality of segments of the first frame having a first fluctuation factor greater than the second fluctuation factor as active segments for the first frame; and

link a first one of the active segments of the first frame and a second one of the active segments of the first frame adjacent the first active segment to form a region of interest in the first frame; and

perform the object detection on the region of interest.

9. A tangible computer readable storage medium as defined in claim 8 , wherein the first and second ones of the active segments are adjacent within a margin of error.

10. A tangible computer readable storage medium as defined in claim 8 , wherein the instructions, when executed, cause the machine to perform the object detection on the region of interest and not perform the object detection on areas of the first frame not in the region of interest.

11. A tangible computer readable storage medium as defined in claim 8 , wherein the linking of the first and second ones of the active segments comprises forming a shape that includes the first and second ones of the active segments.

12. A tangible computer readable storage medium as defined in claim 8 , wherein the instructions, when executed, cause the machine to calculate the second fluctuation factor by selecting a set of pixels from the image data of the first frame and averaging fluctuation characteristics of the selected pixels.

13. A tangible computer readable storage medium as defined in claim 8 , wherein the second fluctuation factor is representative of a collective change across multiple ones of the segments over time.

14. An apparatus, comprising:

a segmenter to divide first and second frames of image data into a plurality of segments;

a fluctuation calculator to respectively determine a first fluctuation factor for respective ones of the segments, the first fluctuation factors representing changes across the first frame and the second frame, the first and second frames captured at different times, the fluctuation calculator to determine a collective fluctuation factor for the first frame, the collective fluctuation factor indicative of a collective fluctuation of the first frame across the different times;

a comparator to, before performance of object detection on the first frame, mark ones of the segments of the first frame having a corresponding one of the first fluctuation factors greater than the collective fluctuation factor as active segments for the first frame; and

a linker to, before performance of the object detection on the first frame, combine adjacent ones of the active segments of the first frame to form a region of interest of the first frame; and

an object detector to perform the object detection on the region of interest of the first frame.

15. An apparatus as defined in claim 14 , wherein the adjacent ones of the active segments are adjacent within a margin of error.

16. An apparatus as defined in claim 14 , wherein the object detector comprises face detection logic, the face detection logic to operate on the region of interest but not on portions of the first frame outside the region of interest.

17. An apparatus as defined in claim 14 , wherein the linker is to link the adjacent ones of the active segments by forming a shape that includes the adjacent ones of the segments.

18. An apparatus as defined in claim 14 , wherein the fluctuation calculator is to calculate the collective fluctuation factor by selecting a random set of pixels from the image data of the first frame and averaging fluctuation characteristics of the randomly selected set of pixels.

19. An apparatus as defined in claim 14 , wherein the first fluctuation factors and the collective fluctuation factor are root mean square values based on pixel intensities.

Assignments (9)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
RELEASE (REEL 037172 / FRAME 0415) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 061750/0221 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL IP SECURITY AGREEMENT Recorded Nov 30, 2015
From: THE NIELSEN COMPANY ((US), LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT FOR THE FIRST LIEN SECURED PARTIES
Reel/Frame 037172/0415 →