IP Library › Granted Patent US 10,015,463
Granted Patent B2
US 10,015,463 · App. 13/621,747 · Granted Jul 3, 2018

Logging events in media files including frame matching

Inventors: Jason Brahms (Culver City, CA); Oleksandr Zhukov (Kiev, UA); Oleg Sharov (Kiev, UA)
Assignees: SONY CORPORATION; SONY PICTURES TECHNOLOGIES, INC.
H04N9/8227G06F17/30058G06F17/3082G06F17/30091G06F17/30277H04N21/4143H04N21/47H04N21/8173H04N21/8543G06F3/04842
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,015,463
App. No.
13/621,747
Granted
Jul 3, 2018
Kind
B2
Abstract

Comparing images, including: selecting a target image; selecting one or more search images; comparing the target image to a negative image corresponding to each search image to generate an image comparison score for each search image; and identifying the search image with the best image comparison score. Keywords include logging events and frame matching.

Claims (53)

1. A method for comparing images with images from a plurality of video files, comprising:

selecting a sequence of target images, wherein each target image of the sequence of target images includes a plurality of pixel values;

selecting a sequence of search images from the plurality of video files, wherein each search image of the sequence of search images includes a plurality of pixel values;

comparing each pixel value of each target image to each corresponding pixel value of a negative image associated with each search image to generate a pixel comparison score for each pixel of each search image,

wherein each pixel value of the negative image is a reverse of a corresponding pixel value of each search image associated with the negative image;

combining pixel comparison scores for all pixels of each target image to generate an image comparison score for each search image;

identifying a search image from the sequence of search images taken from each video file of the plurality of video files with a highest image comparison score; and

replacing the identified search image from each video file with a target image of the sequence of target images corresponding to the identified search image from each video file.

2. The method of claim 1 , wherein the sequence of search images corresponds to frames of each video file of the plurality of video files.

3. The method of claim 2 , wherein the frames of each video file form a movie.

4. The method of claim 1 , wherein comparing each pixel value of each target image to each corresponding pixel value of the negative image comprises determining an absolute value difference between each pixel value of each target image and each pixel value of the negative image.

5. The method of claim 1 , wherein comparing each pixel value of each target image to each corresponding pixel value of the negative image comprises:

combining each pixel value of each target image and each corresponding pixel value of the negative image;

comparing each combined pixel value with a desired value to generate the pixel comparison score for each pixel in each target image.

6. The method of claim 1 , further comprising

selecting at least one additional target image and comparing each of the at least one additional target image to the sequence of search images from the plurality of video files.

7. The method of claim 6 , wherein the at least one additional target image corresponds to a clip of each video file.

8. The method of claim 1 , wherein the image comparison score indicates a level of similarity between each target image and each search image.

9. The method of claim 1 , wherein selecting the sequence of target images comprises

selecting the sequence of target images from a single video file.

10. The method of claim 1 , wherein selecting the sequence of target images comprises

selecting the sequence of target images from multiple video files.

11. The method of claim 1 , further comprising:

storing the sequence of target images into an insert file;

generating a table of references to guide playback between the video file and the insert file.

12. A non-transitory tangible storage medium storing a computer program for comparing images with images from a plurality of video files, the computer program comprising executable instructions that cause a computer to:

select a sequence of target images, wherein each target image of the sequence of target images includes a plurality of pixel values;

select a sequence of search images from the plurality of video files, wherein each search image of the sequence of search images includes a plurality of pixel values;

compare each pixel value of each target image to each corresponding pixel value of a negative image associated with each search image to generate a pixel comparison score for each pixel of each search image,

wherein each pixel value of the negative image is a reverse of a corresponding pixel value of each search image associated with the negative image;

combine pixel comparison scores for all pixels of each target image to generate an image comparison score for each search image;

identify a search image from the sequence of search images taken from each video file of the plurality of video files with a highest image comparison score; and

replace the identified search image from each video file with a target image of the sequence of target images corresponding to the identified search image from each video file.

13. The non-transitory tangible storage medium of claim 12 , wherein executable instructions that cause a computer to compare each pixel value of each target image to each corresponding pixel value of the negative image comprises executable instructions that cause a computer to

determine an absolute value difference between each pixel value of each target image and each pixel value of the negative image.

14. The non-transitory tangible storage medium of claim 12 , wherein executable instructions that cause a computer to compare each pixel value of each target image to each corresponding pixel value of the negative image comprises executable instructions that cause a computer to

combine each pixel value of each target image and each corresponding pixel value of the negative image;

compare each combined pixel value with a desired value to generate the pixel comparison score for each pixel in each target image.

15. The non-transitory tangible storage medium of claim 12 , further comprising executable instructions that cause a computer to

select at least one additional target image and compare each of the at least one additional target image to the sequence of search images from the plurality of video files.

16. A non-transitory tangible storage medium storing a computer program for comparing images, the computer program comprising executable instructions that cause a computer to:

select a sequence of target images, wherein each target image of the sequence of target images includes a plurality of pixel values;

select a sequence of search images from a plurality of video files, wherein each search image of the sequence of search images includes a plurality of pixel values;

compare each target image to a negative image corresponding to each search image of the sequence of search images from the plurality of video files,

wherein the negative image corresponding to each search image comprises an inversion of the corresponding search image with colors for all pixels in each search image reversed;

generate an image comparison score for each search image taken from each video file of the plurality of video files by comparing each target image to each corresponding negative image of each search image;

replace at least one search image of the sequence of search images from each video file with at least one corresponding target image of the sequence of target images; and

generate a cut list which identifies a list of edits that were made to each search image to create the sequence of target images using the image comparison score.

17. The non-transitory tangible storage medium of claim 16 , wherein the executable instructions that cause the computer to generate a cut list comprises executable instructions that cause the computer to

group together sequential frames of each search image from each video file.

18. The non-transitory tangible storage medium of claim 16 , wherein the executable instructions that cause the computer to compare each target image to the negative image corresponding to each search image comprises executable instructions that cause the computer to:

compare each pixel value of each target image to each corresponding pixel value of the negative image corresponding to each search image to generate a pixel comparison score for each pixel of each search image; and

combine pixel comparison scores for all pixels of each target image to generate the image comparison score for each search image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2013
From: BRAHMS, JASON; ZHUKOV, OLEKSANDR; SHAROV, OLEG
To: SONY CORPORATION; SONY PICTURES TECHNOLOGIES, INC.
Reel/Frame 029886/0427 →
Continuity (6)
Continuation In Part PCTUS2012020220 · Jan 4, 2012
Continuation 13026134 · Feb 11, 2011
Provisional Application 61429720 · Jan 4, 2011
Provisional Application 61534275 · Sep 13, 2011
Provisional Application 61624123 · Apr 13, 2012
Related Publication 20130086051A1 · Apr 4, 2013
Cited By (1)
US 12,499,909