IP Library Granted Patent US 11,354,354
Granted Patent B2
US 11,354,354 · App. 16/698,899 · Granted Jun 7, 2022

Methods and apparatus to identify media

Inventors: Robert Coover (Orinda, CA); Matthew James Wilkinson (Emeryville, CA); Jeffrey Scott (Berkeley, CA); Yongju Hong (Seoul, KR)
Assignee: Gracenote, Inc.
G06F16/683G06F16/632G06F16/634G06F16/65G06F16/685G06F16/686G06K9/6201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,354,354
App. No.
16/698,899
Granted
Jun 7, 2022
Kind
B2
Abstract

Methods, apparatus, systems and articles of manufacture are disclosed to identify media. An example method includes: in response to a query, generating an adjusted sample media fingerprint by applying an adjustment to a sample media fingerprint; comparing the adjusted sample media fingerprint to a reference media fingerprint; and in response to the adjusted sample media fingerprint matching the reference media fingerprint, transmitting information associated with the reference media fingerprint and the adjustment.

Claims (90)

1. A non-transitory computer readable storage medium comprising instructions which, when executed, cause one or more processors to at least:

in response to a query including a pitch shift value corresponding to a suspected alteration to an audio signal associated with a sample media fingerprint:

determine whether the pitch shift value increases a pitch of the audio signal;

in response to the pitch shift value increasing the pitch of the audio signal, decrease one or more bin values associated with the sample media fingerprint based on the pitch shift value;

in response to the pitch shift value decreasing the pitch of the audio signal, increase the one or more bin values associated with the sample media fingerprint based on the pitch shift value; and

generate an adjusted sample media fingerprint;

compare the adjusted sample media fingerprint to a reference media fingerprint; and

in response to the adjusted sample media fingerprint matching the reference media fingerprint, cause transmission of information associated with the reference media fingerprint and whether the one or more bin values were increased or decreased.

2. The non-transitory computer readable storage medium of claim 1 wherein the suspected alteration to the audio signal is a first suspected alteration, and the query includes at least one of (1) a time shift value or (2) a resample ratio, the time shift value and the resample ratio corresponding to at least a second suspected alteration to the audio signal associated with the sample media fingerprint.

3. The non-transitory computer readable storage medium of claim 2 , wherein the adjusted sample media fingerprint is a first adjusted sample media fingerprint, and the instructions, when executed, cause the one or more processors to, when the query includes the time shift value and the resample ratio:

generate a second adjusted sample media fingerprint by applying the time shift value to the sample media fingerprint;

generate a third adjusted sample media fingerprint by applying the resample ratio to the sample media fingerprint; and

compare the second adjusted sample media fingerprint and the third adjusted sample media fingerprint to the reference media fingerprint.

4. The non-transitory computer readable storage medium of claim 2 , wherein the adjusted sample media fingerprint is a first adjusted sample media fingerprint, and the instructions, when executed, cause the one or more processors to:

when the query includes the resample ratio, select the resample ratio;

generate a pitch shifted sample media fingerprint by applying the resample ratio to the sample media fingerprint; and

generate a second adjusted sample media fingerprint by applying the resample ratio to the pitch shifted sample media fingerprint.

5. The non-transitory computer readable storage medium of claim 1 , wherein information associated with the reference media fingerprint identifies at least one of a title of a song associated with the reference media fingerprint or an artist of the song associated with the reference media fingerprint.

6. A non-transitory computer readable storage medium comprising instructions which, when executed, cause one or more processors to at least:

in response to a query including a time shift value corresponding to a suspected alteration to an audio signal associated with a sample media fingerprint:

determine whether the time shift value increases a playback speed of the audio signal;

in response to the time shift value increasing the playback speed of the audio signal, add a first frame to the sample media fingerprint at a position in the sample media fingerprint that corresponds to the time shift value;

in response to the time shift value decreasing the playback speed of the audio signal, delete a second frame of the sample media fingerprint at the position in the sample media fingerprint that corresponds to the time shift value; and

generate an adjusted sample media fingerprint;

compare the adjusted sample media fingerprint to a reference media fingerprint; and

in response to the adjusted sample media fingerprint matching the reference media fingerprint, cause transmission of information associated with the reference media fingerprint and whether the first frame was added or the second frame was deleted.

7. The non-transitory computer readable storage medium of claim 6 , wherein the adjusted sample media fingerprint is a first adjusted sample media fingerprint, and the instructions, when executed, cause the one or more processors to, when the query includes a resample ratio:

generate a second adjusted sample media fingerprint by applying the time shift value to the sample media fingerprint;

generate a third adjusted sample media fingerprint by applying the resample ratio to the sample media fingerprint; and

compare the second adjusted sample media fingerprint and the third adjusted sample media fingerprint to the reference media fingerprint.

8. An apparatus comprising:

a fingerprint speed tuner to, in response to a query including a time shift value corresponding to a suspected alteration to an audio signal associated with a sample media fingerprint:

determine whether the time shift value increases a playback speed of the audio signal;

in response to the time shift value increasing the playback speed of the audio signal, add a first frame to the sample media fingerprint at a position in the sample media fingerprint that corresponds to the time shift value;

in response to the time shift value decreasing the playback speed of the audio signal, delete a second frame of the sample media fingerprint at the position in the sample media fingerprint that corresponds to the time shift value; and

generate an adjusted sample media fingerprint

a comparator to compare the adjusted sample media fingerprint to a reference media fingerprint; and

a network interface to, in response to the adjusted sample media fingerprint matching the reference media fingerprint, transmit information associated with the reference media fingerprint and whether the first frame was added or the second frame was deleted, at least one of the fingerprint speed tuner, the comparator, or the network interfacing including a hardware circuit.

9. The apparatus of claim 8 , wherein the adjusted sample media fingerprint is a first adjusted sample media fingerprint:

the fingerprint speed tuner is to, when the query includes a resample ratio:

generate a second adjusted sample media fingerprint by applying the time shift value to the sample media fingerprint;

generate a third adjusted sample media fingerprint by applying the resample ratio to the sample media fingerprint; and

the comparator is to compare the second adjusted sample media fingerprint and the third adjusted sample media fingerprint to the reference media fingerprint.

10. An apparatus comprising:

a fingerprint pitch tuner to, in response to a query including a pitch shift value corresponding to a suspected alteration to an audio signal associated with a sample media fingerprint:

determine whether the pitch shift value increases a pitch of the audio signal;

in response to the pitch shift value increasing the pitch of the audio signal, decrease one or more bin values associated with the sample media fingerprint based on the pitch shift value;

in response to the pitch shift value decreasing the pitch of the audio signal, increase the one or more bin values associated with the sample media fingerprint based on the pitch shift value; and

generate an adjusted sample media fingerprint

a comparator to compare the adjusted sample media fingerprint to a reference media fingerprint; and

a network interface to, in response to the adjusted sample media fingerprint matching the reference media fingerprint, transmit information associated with the reference media fingerprint and whether the one or more bin values were increased or decreased, at least one of the fingerprint pitch tuner, the comparator, or the network interfacing including a hardware circuit.

11. The apparatus of claim 10 , wherein the suspected alteration to the audio signal is a first suspected alteration, and the query includes at least one of (1) a time shift value or (2) a resample ratio, the time shift value and the resample ratio corresponding to at least a second suspected alteration to the audio signal associated with the sample media fingerprint.

12. The apparatus of claim 11 , wherein the adjusted sample media fingerprint is a first adjusted sample media fingerprint, and the apparatus further includes:

a fingerprint speed tuner to generate a second adjusted sample media fingerprint by applying the time shift value to the sample media fingerprint;

at least one of the fingerprint pitch tuner or the fingerprint speed tuner to generate a third adjusted sample media fingerprint by applying the resample ratio to the sample media fingerprint; and

the comparator to compare the second adjusted sample media fingerprint and the third adjusted sample media fingerprint to the reference media fingerprint.

13. The apparatus of claim 11 , wherein the adjusted sample media fingerprint is a first adjusted sample media fingerprint, and the apparatus further includes a fingerprint speed tuner including:

the network interface is to, when the query includes the resample ratio, select the resample ratio;

the fingerprint pitch tuner is to generate a pitch shifted sample media fingerprint by applying the resample ratio to the sample media fingerprint; and

the fingerprint speed tuner is to generate a second adjusted sample media fingerprint by applying the resample ratio to the pitch shifted sample media fingerprint.

14. The apparatus of claim 10 , wherein information associated with the reference media fingerprint identifies at least one of a title of a song associated with the reference media fingerprint or an artist of the song associated with the reference media fingerprint.

15. A method comprising:

in response to a query including a pitch shift value corresponding to a suspected alteration to an audio signal associated with a sample media fingerprint:

determining whether the pitch shift value increases a pitch of the audio signal;

in response to the pitch shift value increasing the pitch of the audio signal, decreasing one or more bin values associated with the sample media fingerprint based on the pitch shift value;

in response to the pitch shift value decreasing the pitch of the audio signal, increasing the one or more bin values associated with the sample media fingerprint based on the pitch shift value; and

generating an adjusted sample media fingerprint;

comparing the adjusted sample media fingerprint to a reference media fingerprint; and

in response to the adjusted sample media fingerprint matching the reference media fingerprint, transmitting information associated with the reference media fingerprint and whether the one or more bin values were increased or decreased.

16. The method of claim 15 , wherein the suspected alteration to the audio signal is a first suspected alteration, and the query includes at least one of (1) a time shift value or (2) a resample ratio, the time shift value and the resample ratio corresponding to at least a second suspected alteration to the audio signal associated with the sample media fingerprint.

17. The method of claim 16 , wherein the adjusted sample media fingerprint is a first adjusted sample media fingerprint, and the method further includes:

generating a second adjusted sample media fingerprint by applying the time shift value to the sample media fingerprint;

generating a third adjusted sample media fingerprint by applying the resample ratio to the sample media fingerprint; and

comparing the second adjusted sample media fingerprint and the third adjusted sample media fingerprint to the reference media fingerprint.

18. The method of claim 16 , wherein the adjusted sample media fingerprint is a first adjusted sample media fingerprint, and the method further includes:

when the query includes the resample ratio, selecting the resample ratio;

generating a pitch shifted sample media fingerprint by applying the resample ratio to the sample media fingerprint; and

generating a second adjusted sample media fingerprint by applying the resample ratio to the pitch shifted sample media fingerprint.

19. A method comprising:

in response to a query including a time shift value corresponding to a suspected alteration to an audio signal associated with a sample media fingerprint:

determining whether the time shift value increases a playback speed of the audio signal;

in response to the time shift value increasing the playback speed of the audio signal, adding a first frame to the sample media fingerprint at a position in the sample media fingerprint that corresponds to the time shift value;

in response to the time shift value decreasing the playback speed of the audio signal, deleting a second frame of the sample media fingerprint at the position in the sample media fingerprint that corresponds to the time shift value; and

generating an adjusted sample media fingerprint;

comparing the adjusted sample media fingerprint to a reference media fingerprint; and

in response to the adjusted sample media fingerprint matching the reference media fingerprint, transmitting information associated with the reference media fingerprint and whether the first frame was added or the second frame was deleted.

20. The method of claim 19 , wherein the adjusted sample media fingerprint is a first adjusted sample media fingerprint, and the method further includes, when the query includes a resample ratio:

generating a second adjusted sample media fingerprint by applying the time shift value to the sample media fingerprint;

generating a third adjusted sample media fingerprint by applying the resample ratio to the sample media fingerprint; and

comparing the second adjusted sample media fingerprint and the third adjusted sample media fingerprint to the reference media fingerprint.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2020
From: COOVER, ROBERT; WILKINSON, MATTHEW JAMES; SCOTT, JEFFREY; HONG, YONGJU
To: GRACENOTE, INC.
Reel/Frame 051815/0983 →