IP Library Granted Patent US 9,639,531
Granted Patent B2
US 9,639,531 · App. 12/100,264 · Granted May 2, 2017

Methods and apparatus to play and control playing of media in a web page

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,639,531
App. No.
12/100,264
Granted
May 2, 2017
Kind
B2
Abstract

Methods and apparatus to play and control playing of media content in a web page are disclosed. In one example, a method of monitoring media content in a web page loads a web page containing a media player and media content, processes an image of the web page to determine a control associated with the media player, and monitors the media content based on the control.

Claims (87)

1. A method of monitoring media in a web page, the method comprising:

loading, by executing an instruction with a processor, a web page to a user device;

generating, by executing the instruction with the processor, successive images of the web page as displayed on the user device;

detecting, by executing the instruction with the processor, based on the successive images, a media player contained in the web page, a media content area associated with the media player for displaying the media, and a media control associated with the media player;

comparing, by executing the instruction with the processor, the successive images to detect changes between the successive images indicative of motion in the media content area;

analyzing, by executing the instruction with the processor, the successive images to determine a state of the media player;

determining, by executing the instruction with the processor, whether the media player is playing the media based on the detected motion and the determined state of the media player;

commanding, by executing the instruction with the processor, without user intervention, the media player to play the media when the media player is not playing the media;

generating, by executing the instruction with the processor, based on first media information of the media displayed in the media content area, when the media is playing at a first time, a digital signature of the media;

determining, by executing the instruction with the processor, based on the successive images, whether the media is finished playing;

updating, by executing the instruction with the processor, based on second media information of the media displayed in the media content area, the generated digital signature when the media is not finished playing at a second time later than the first time; and

comparing, by executing the instruction with the processor, the generated digital signature with a database of digital signatures to specifically identify the media when the media is finished playing.

2. The method as defined in claim 1 , further including locating, based on the successive images, the media player in the web page.

3. The method as defined in claim 1 , wherein the state of the media player is paused media.

4. The method as defined in claim 1 , wherein the state of the media player is data buffering the media.

5. The method as defined in claim 1 , wherein the state of the media player is a media player error.

6. The method as defined in claim 1 , wherein determining, by executing the instruction with the processor, whether the media player is playing the media based on the detected motion and the determined state of the media player includes processing the successive images to

locate at least an area in the media player that includes a first symbol; and

determine whether the area previously included a second symbol.

7. A method of monitoring media in a web page, the method comprising:

loading, by executing an instruction with a processor, the web page to a user device;

generating, by executing the instruction with the processor, successive images of the web page as presented on the user device;

analyzing, by executing the instruction with the processor, the successive images using an image processing technique to:

detect a media player contained in the web page, a media content area associated with the media player for displaying the media, and a media control associated with the media player,

detect changes between the successive images indicative of motion in the media content area,

determine a state of the media player,

determine, based on the detected motion and the determined state of the media player, whether the media player is playing media,

command, without user intervention, the media player to play the media when the media player is not playing the media,

generate, based on first media information of the media displayed in the media content area, when the media is playing at a first time, a digital signature of the media;

determine whether the media is finished playing, and

update the generated digital signature, based on second media information of the media displayed in the media content area, when the media is not finished playing at a second time later than the first time; and

comparing, by executing the instruction with the processor, the generated digital signature with a database of reference digital signatures to specifically identify the media when the media is finished playing.

8. The method as defined in claim 7 , wherein the image processing technique includes edge detection.

9. The method as defined in claim 7 , wherein the media control includes one of a play button, a pause button, a stop button, a play/stop button, a play/pause button, a volume control, a progress bar, a media display size control, a fast forward button, a rewind button, a time elapsed indicator, a countdown indicator, or a time elapsed/total time indicator.

10. The method as defined in claim 1 , wherein the media includes at least one of audio or video.

11. The method as defined in claim 7 , wherein the state of the media player is pausing the media.

12. The method as defined in claim 1 , wherein the state of the media player is data buffering the media.

13. An apparatus to monitor media in a web page, comprising:

an image generator to generate successive images of a web page as presented on a user device;

an image analyzer to compare the successive images to:

detect a media player contained in the web page,

detect a media control associated with the media player,

detect a media content area associated with the media player for displaying the media,

detect changes between the successive images indicative of motion in the media content area,

determine a state of the media player,

determine whether the media player is playing the media based on the detected changes and the determined state,

command, without user intervention, the media player to play the media when the media player is not playing the media, and

determine whether the media is finished playing;

a signature generator to, when the media is not finished playing:

receive first media information of the media displayed in the media content area from the image analyzer;

generate a digital signature of the media, based on the received first media information, when the media is playing at a first time; and

update the generated digital signature, based on received second media information of the media displayed in the media content area, when the media is playing at a second time later than the first time; and

a media identifier to, when the media is finished playing to:

receive the generated digital signature from the signature generator,

compare the generated digital signature to a database of reference digital signatures corresponding to a library of reference media, and

identify the media, at least one of the image generator, the image analyzer, the signature generator, or the media identifier implemented using a processor.

14. The apparatus as defined in claim 13 , further including a web browser to load the web page.

15. The apparatus as defined in claim 13 , wherein the media control includes one of a play button, a pause button, a stop button, a play/stop button, a play/pause button, a volume control, a progress bar, a media display size control, a fast forward button, a rewind button, a time elapsed indicator, a countdown indicator, or a time elapsed/total time indicator.

16. The apparatus as defined in claim 13 , wherein the state of the media player includes one of paused media, stopped media, data buffering media, or a media player error.

17. A computer readable storage disc or storage device, excluding propagating signals, comprising machine readable instructions which, when executed, cause a machine to at least:

load a web page to a user device;

generate successive images of the web page as presented on the user device;

analyze the successive images using an image processing technique to:

detect a media player contained in the web page, a media content area associated with the media player for displaying the media, and a media control associated with the media player,

detect changes between the successive images indicative of motion in the media content area,

determine a state of the media player,

determine, based on the detected motion and the determined state, whether the media player is playing media,

command, without user intervention, the media player to play the media when the media player is not playing the media,

generate, based on first media information of the media displayed in the media content area, a digital signature of the media when the media is playing at a first time;

determine whether the media is finished playing, and

update the generated digital signature of the media, based on second media information of the media displayed in the media content area, when the media is not finished playing at a second time later than the first time; and

compare the generated digital signature with a database of reference signatures to identify the media when the media is finished playing.

18. The computer readable storage disc or storage device as defined in claim 17 , wherein the machine readable instructions further cause the machine to analyze the successive images to determine a location of the media player on the web page.

19. The computer readable storage disc or storage device as defined in claim 17 , wherein the database of reference signatures corresponds to a library of reference media.

20. The computer readable storage disc or storage device as defined in claim 17 , wherein the state of the media player includes one of pausing the media, stopping the media, data buffering the media, or a media player error.

21. The computer readable storage disc or storage device as defined in claim 17 , wherein the media control includes one of a play button, a pause button, a stop button, a play/stop button, a play/pause button, a volume control, a progress bar, a media display size control, a fast forward button, a rewind button, a time elapsed indicator, a countdown indicator, or a time elapsed/total time indicator.

22. The computer readable storage disc or storage device as defined in claim 17 , wherein the media includes at least one of audio or video.

23. The computer readable storage disc or storage device as defined in claim 17 , wherein the image processing technique includes successively comparing a first image, a second image, and a third image.

24. The computer readable storage disc or storage device as defined in claim 17 , wherein the machine readable instructions further cause the machine to generate the successive images at a rate substantially equal to a refresh rate of a display of the machine.

25. A method of monitoring media in a web page, comprising:

loading, by executing an instruction with a processor, a web page to a user device;

generating, by executing the instruction with the processor, successive images of the web page as presented on the user device;

analyzing, by executing the instruction with the processor, the successive images using an image processing technique to detect a media player contained in the web page, detect a media content area associated with the media player for displaying the media, detect a media control associated with the media player, detect changes between the successive images indicative of motion in the media content area, determine a state of the media player, determine whether the media player is playing media based on the detected motion and the determined state, command the media player to play the media when the media player is not playing the media without user intervention, and determine whether the media is finished playing;

generating, by executing the instruction with the processor, a digital signature of the media, based on first media information of the media displayed in the media content area, when the media is playing at a first time;

updating, by executing the instruction with the processor, the generated digital signature, based on second media information of the media displayed in the media content area, when the media is not finished playing at a second time later than the first time; and

identifying, by executing the instruction with the processor, the media by comparing the generated digital signature to a database of reference signatures when the media is finished playing.

26. The method as defined in claim 25 , wherein analyzing the successive images to determine whether the media player is playing the media includes locating at least an area of the media player that includes a play/pause button and determining whether the area includes a first symbol instead of a second symbol.

Assignments (9)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
RELEASE (REEL 037172 / FRAME 0415) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 061750/0221 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL IP SECURITY AGREEMENT Recorded Nov 30, 2015
From: THE NIELSEN COMPANY ((US), LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT FOR THE FIRST LIEN SECURED PARTIES
Reel/Frame 037172/0415 →