IP Library Granted Patent US 10,216,369
Granted Patent B2
US 10,216,369 · App. 15/587,808 · Granted Feb 26, 2019

Perceptual characteristic similarity for item replacement in media content

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,216,369
App. No.
15/587,808
Granted
Feb 26, 2019
Kind
B2
Abstract

Systems and techniques for employing perceptual characteristic similarity for item replacement in media content are presented. The system can include an identification component, a matching component and a replacement component. The identification component identifies at least a portion of an item in a media file. The matching component determines a replacement item from a set of candidate items based on a comparison between perceptual characteristics associated with the item and corresponding perceptual characteristics associated with the set of candidate items. The replacement component replaces the item in the media file with at least a portion of the replacement item.

Claims (34)

1. A system for replacing content items, the system comprising:

a hardware processor that is programmed to:

receive, at a server from a user device, a media file;

identify at least a portion of an item in the media file;

determine, by the server, a replacement item from a set of candidate items stored on the server based on a comparison of timbre characteristics and tempo characteristics between the item in the media file and each candidate item in the set of candidate items, wherein the timbre characteristics of the item in the media file and each candidate item in the set of candidate items is determined using frequency coefficients of corresponding audio content of the item in the media file and each candidate item in the set of candidate items and wherein the tempo characteristics of the item in the media file and each candidate item in the set of candidate items is determined using auditory image information associated with the item in the media file and each candidate item in the set of candidate items; and

generate a modified media file by replacing the item in the media file with at least a portion of the replacement item.

2. The system of claim 1 , wherein identifying the at least a portion of the item in the media file comprises determining that the item is associated with a copyright claim.

3. The system of claim 2 , wherein the hardware processor is further programmed to cause a user interface that indicates that the item is associated with the copyright claim to be presented on the user device.

4. The system of claim 1 , wherein the hardware processor is further programmed to:

cause a user interface that indicates a subset of the set of candidate items to be presented on the user device; and

receive, from the user device via the user interface, a selection of one of the subset of the set of candidate items.

5. The system of claim 1 , wherein the replacement item is not associated with a copyright claim.

6. A method for replacing content items, the method comprising:

receiving, at a server from a user device, a media file;

identifying at least a portion of an item in the media file;

determining, by the server, a replacement item from a set of candidate items stored on the server based on a comparison of timbre characteristics and tempo characteristics between the item in the media file and each candidate item in the set of candidate items, wherein the timbre characteristics of the item in the media file and each candidate item in the set of candidate items is determined using frequency coefficients of corresponding audio content of the item in the media file and each candidate item in the set of candidate items and wherein the tempo characteristics of the item in the media file and each candidate item in the set of candidate items is determined using auditory image information associated with the item in the media file and each candidate item in the set of candidate items; and

generating a modified media file by replacing the item in the media file with at least a portion of the replacement item.

7. The method of claim 6 , wherein identifying the at least a portion of the item in the media file comprises determining that the item is associated with a copyright claim.

8. The method of claim 7 , further comprising causing a user interface that indicates that the item is associated with the copyright claim to be presented on the user device.

9. The method of claim 6 , further comprising:

causing a user interface that indicates a subset of the set of candidate items to be presented on the user device; and

receiving, from the user device via the user interface, a selection of one of the subset of the set of candidate items.

10. The method of claim 6 , wherein the replacement item is not associated with a copyright claim.

11. A non-transitory computer-readable medium containing computer executable instructions, that, when executed by a processor, cause the processor to perform a method for replacing content items, the method comprising:

receiving, at a server from a user device, a media file;

identifying at least a portion of an item in the media file;

determining, by the server, a replacement item from a set of candidate items stored on the server based on a comparison of timbre characteristics and tempo characteristics between the item in the media file and each candidate item in the set of candidate items, wherein the timbre characteristics of the item in the media file and each candidate item in the set of candidate items is determined using frequency coefficients of corresponding audio content of the item in the media file and each candidate item in the set of candidate items and wherein the tempo characteristics of the item in the media file and each candidate item in the set of candidate items is determined using auditory image information associated with the item in the media file and each candidate item in the set of candidate items; and

generating a modified media file by replacing the item in the media file with at least a portion of the replacement item.

12. The non-transitory computer-readable medium of claim 11 , wherein identifying the at least a portion of the item in the media file comprises determining that the item is associated with a copyright claim.

13. The non-transitory computer-readable medium of claim 12 , wherein the method further comprises causing a user interface that indicates that the item is associated with the copyright claim to be presented on the user device.

14. The non-transitory computer-readable medium of claim 11 , wherein the method further comprises:

causing a user interface that indicates a subset of the set of candidate items to be presented on the user device; and

receiving, from the user device via the user interface, a selection of one of the subset of the set of candidate items.

15. The non-transitory computer-readable medium of claim 11 , wherein the replacement item is not associated with a copyright claim.

Assignments (1)
CHANGE OF NAME Recorded Dec 5, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044695/0115 →