IP Library Granted Patent US 7,466,844
Granted Patent B2
US 7,466,844 · App. 11/548,578 · Granted Dec 16, 2008

Methods and apparatus to count people appearing in an image

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,466,844
App. No.
11/548,578
Granted
Dec 16, 2008
Kind
B2
Abstract

Methods and apparatus to count people appearing in an image are disclosed. One disclosed method reduces objects appearing in a series of images to one or more blobs; for each individual image in a set of the images of the series of images, represents the one or more blobs in the individual image by one or more symbols in a histogram; and analyzes the symbols appearing in the histogram to count the people in the image.

Claims (33)

1. A method of counting people appearing in a digital image comprising:

reducing objects appearing in a series of images to one or more blobs, each of the blobs corresponding to a respective center of motion of a corresponding one of the objects;

for each individual image in a set of the images of the series of images, representing the one or more blobs in the individual image by one or more symbols in a histogram; and

analyzing the symbols appearing in the histogram to count the people in the digital image.

2. A method as defined in claim 1 wherein reducing the objects appearing in the series of images to one or more blobs comprises creating the one or more blobs using a convex hull program.

3. A method as defined in claim 1 further comprising, if no symbols are added to a third symbol appearing in the histogram during a period in which a number of images are analyzed, removing the third symbol from the histogram.

4. A method as defined in claim 3 wherein analyzing the symbols appearing in the histogram to count the people in the digital image comprises, counting the symbols appearing in the histogram having a size greater than a threshold.

5. A method as defined in claim 1 wherein the series of images comprises a series of amalgamated images.

6. A method as defined in claim 5 wherein the series of amalgamated images are derived from a series of difference images, the series of difference images being derived from a sequence of original images including the digital image.

7. An apparatus to count people appearing in a digital image comprising:

a processor;

a memory storing computer readable instructions which, when executed, cause the processor to:

reduce objects appearing in a series of images to one or more blobs, each of the blobs corresponding to a respective center of motion of a corresponding one of the objects;

for each individual image in a set of the images of the series of images, represent the one or more blobs in the individual image by one or more symbols in a histogram; and

analyze the symbols appearing in the histogram to count the people in the image.

8. An apparatus as defined in claim 7 wherein the processor reduces the objects appearing in the series of images to one or more blobs by creating the one or more blobs using a convex hull program.

9. An apparatus as defined in claim 7 wherein, if no symbols are added to a third symbol appearing in the histogram during a period in which a number of images are analyzed, the processor removes the third symbol from the histogram.

10. An apparatus as defined in claim 9 wherein the processor analyzes the symbols appearing in the histogram to count the people in the digital image by counting the symbols appearing in the histogram having a size greater than a threshold.

11. An apparatus as defined in claim 7 wherein the series of images comprises a series of amalgamated images.

12. An apparatus as defined in claim 11 wherein the series of amalgamated images are derived from a series of difference images, the series of difference images being derived from a sequence of original images including the digital image.

13. A method of counting people appearing in a series of digital images comprising:

forming difference images by computing differences between sequential pairs of the digital images in the series of digital images, the difference images being indicative of motion;

combining a first set of the difference images into a first amalgamated image;

combining a second set of the difference images into a second amalgamated image;

reducing a first object appearing in the first amalgamated image to a first blob;

representing the first blob in the first amalgamated image by a first symbol in a histogram;

reducing a second object appearing in the second amalgamated image to a second blob;

representing the second blob in the second amalgamated image by adding a second symbol to the histogram; and

analyzing the histogram to count the people appearing in the series of images.

14. A method as defined in claim 13 wherein reducing the first object appearing in the first amalgamated image to the first blob comprises creating the first blob using a convex hull program.

15. A method as defined in claim 13 further comprising, if no symbols are added to the first symbol during a predetermined time period, removing the first symbol from the histogram.

16. A method as defined in claim 13 , wherein representing the second blob in the second amalgamated image by adding the second symbol to the histogram comprises adding the second symbol to the first symbol in the histogram if the first and second symbols correspond to a same center of gravity.

17. A method as defined in claim 16 wherein analyzing the histogram to count the people comprises, counting any symbols appearing in the histogram having a size greater than a threshold.

Assignments (11)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
RELEASE (REEL 037172 / FRAME 0415) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 061750/0221 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL IP SECURITY AGREEMENT Recorded Nov 30, 2015
From: THE NIELSEN COMPANY ((US), LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT FOR THE FIRST LIEN SECURED PARTIES
Reel/Frame 037172/0415 →
MERGER Recorded Jun 29, 2009
From: NIELSEN MEDIA RESEARCH, LLC (FORMERLY KNOWN AS NIELSEN MEDIA RESEARCH, INC.) A CORP. OF DELAWARE
To: NIELSEN COMPANY (US), LLC, THE, A DELAWARE LIMITED LIABILITY COMPANY
Reel/Frame 022892/0578 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 22, 2007
From: RAMASWAMY, ARUN; NELSON, DANIEL J.; SRINIVASAN, VENUGOPAL
To: NIELSEN MEDIA RESEARCH, INC.
Reel/Frame 018978/0102 →