IP Library Granted Patent US 8,068,682
Granted Patent B2
US 8,068,682 · App. 11/909,810 · Granted Nov 29, 2011

Generating output pixels of an output image from one or more input images using a set of motion vectors having a sub-pixel accuracy

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,068,682
App. No.
11/909,810
Granted
Nov 29, 2011
Kind
B2
Abstract

An image processing apparatus in which output pixels of an output image are generated from one or more input images using motion vectors having a sub-pixel accuracy. A motion vector allocator allocates motion vectors in the pixels, and compares a current output pixel with test image areas pointed to by motion vectors in the pixels to detect a most suitable motion vector for the current output pixel. A pixel generator operates in a first mode if the output pixel is within a threshold displacement from an image region having substantially different motion characteristics to those of that output pixel, and in a second mode otherwise. The pixel generator includes a spatial filter generating an output pixel value at a required pixel position to a sub-pixel accuracy.

Claims (20)

1. An image processing apparatus in which output pixels of an output image are generated from one or more input images using a set of motion vectors having a sub-pixel accuracy, the apparatus comprising:

a processor configured to:

allocate motion vectors in the set to pixels of the output image, the motion vector allocator being arranged to compare a current output pixel with test image areas pointed to by motion vectors in the set to detect a most suitable motion vector for the current output pixel; and

generate the output pixels, the processor operating in a first mode if the output pixel is within a threshold displacement from an image region having substantially different motion characteristics to those of that output pixel, and in a second mode otherwise, by applying a first spatial filter for generating an output pixel value at a required pixel position to a sub-pixel accuracy;

in which:

in the first mode, the first spatial filter is applied to a group of pixel values derived from the input image(s) such that the group does not extend into an image area having different motion characteristics to those of the output pixel by re-using pixel values from an image area having the same motion characteristics as those of the output pixel, so that at least one such pixel value is applied to more than one non-zero filter tap of the first spatial filter; and

in the second mode, the first spatial filter is applied to a group of pixel values derived from the input image(s), there being one such pixel value for each non-zero filter tap.

2. The image processing apparatus according to claim 1 , in which:

the processor is configured to apply a second spatial filter for comparing the current output pixel and a test image area to a sub-pixel accuracy; and

the second spatial filter has fewer filter taps than the first spatial filter.

3. The image processing apparatus according to claim 1 , in which an output image is derived from at least two input images.

4. The image processing apparatus according to claim 1 , in which the input images are images of an input video signal and the output image is an image of an output video signal.

5. The image processing apparatus according to claim 1 , the apparatus being a scan conversion apparatus.

6. An image processing method in which output pixels of an output image are generated from one or more input images using a set of motion vectors having a sub-pixel accuracy, the method comprising:

allocating motion vectors in the set to pixels of the output image by comparing a current output pixel with test image areas pointed to by motion vectors in the set to detect a most suitable motion vector for the current output pixel; and

generating the output pixels in a first mode if the output pixel is within a threshold displacement from an image region having substantially different motion characteristics to those of that output pixel, and in a second mode otherwise, by applying a spatial filter to generate an output pixel value at a required pixel position to a sub-pixel accuracy;

in which:

in the first mode the spatial filter is applied to a group of pixel values derived from the input image(s) such that the group does not extend into an image area having substantially different motion characteristics, to those of the output pixel by re-using pixel values from an image area having the same motion characteristics as those of the output pixel, so that at least one such pixel value is applied to more than one non-zero filter tap of the spatial filter; and

in the second mode the spatial filter is applied to a group of pixel values derived from the input image(s), there being one such pixel value for each non-zero filter tap.

7. A non-transitory computer-readable medium including computer software having program code which, when executed by a computer, is arranged to cause the computer to carry out a method according to claim 6 .

Assignments (3)
MERGER Recorded Mar 13, 2020
From: SONY EUROPE LIMITED
To: SONY EUROPE B.V.
Reel/Frame 052162/0623 →
CHANGE OF NAME Recorded Mar 11, 2020
From: SONY UNITED KINGDOM LIMITED
To: SONY EUROPE LIMITED
Reel/Frame 052085/0444 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2007
From: LIVING, JONATHAN
To: SONY UNITED KINGDOM LIMITED
Reel/Frame 019887/0902 →