IP Library › Granted Patent US 8,553,940
Granted Patent B2
US 8,553,940 · App. 13/500,203 · Granted Oct 8, 2013

Formation of a time-varying signal representative of at least variations in a value based on pixel values

Inventors: Ihor Olehovych Kirenko (Eindhoven, NL); Vincent Jeanne (Eindhoven, NL); Gerard De Haan (Eindhoven, NL)
Assignee: Koninklijke Philips N.V.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,553,940
App. No.
13/500,203
Granted
Oct 8, 2013
Kind
B2
Abstract

A method of forming a time-varying signal representative of at least variations in a value based on pixel values from a sequence of images, the signal corresponding in length to the sequence of images, the method includes acts of obtaining the sequence of images. A plurality of groups of sub-sets of pixel values are formed by selecting a sub-set of at least one pixel value from each of at least two images defining an interval to form a group of associated sub-sets. For any pair of groups with only sub-sets from the same images, the sub-sets from more than one image are different. Groups of sub-sets are selected to form the signal in accordance with at least one selection criterion. The selected groups of sub-sets cover different intervals, shorter than a length of the sequence.

Claims (35)

1. A method of forming a time-varying signal representative of at least variations in a value based on pixels and corresponding pixel values from a sequence of images, the signal corresponding in length to the sequence of images, the method comprising acts of:

obtaining the sequence of images;

forming a plurality of groups of sub-sets of pixels and corresponding pixel values by selecting a sub-set of at least one pixel and corresponding pixel value from each of at least two images defining an interval to form a group of associated sub-sets,

wherein, for any pair of groups with only sub-sets from the same images, the sub-sets from more than one image are different pixels; and

selecting groups of sub-sets to form the signal in accordance with at least one selection criterion,

wherein the selected groups of sub-sets cover different intervals, shorter than a length of the sequence.

2. The method according to claim 1 , wherein the groups are formed by selecting a first sub-set of at least one pixel value from a first image at least based on one of the obtained sequence of images and locating a similar sub-set in each of at least one further image at least based on a respective one of the obtained sequence of images.

3. The method according to claim 1 , wherein a similar sub-set in at least one of the further images is found by obtaining a predicted motion vector and modifying the predicted motion vector to select candidate sub-sets for evaluation against at least one similarity criterion.

4. The method according to claim 1 , wherein forming the groups includes selecting sub-sets from only limited regions of interest in each of a sequence of at least two images at least based on respective images of the obtained sequence of images.

5. A machine-readable non-transitory medium including a set of instructions configured to cause a system having information processing capability to perform a method according to claim 1 .

6. The method according to claim 1 , wherein groups are formed by laying a grid over at least a region of each of a plurality of images at least based on the obtained images to obtain spatio-temporal volumes of pixel values, each comprising pixel values of each image within a corresponding spatial aperture defined by the grid.

7. The method according to claim 6 , including, for each group, analyzing at least one sub-set of pixel values defined by the spatial aperture to determine whether it represents a part of a surface of a certain type.

8. A method of forming a time-varying signal representative of at least variations in a value based on pixel values from a sequence of images, the signal corresponding in length to the sequence of images, the method comprising acts of:

obtaining the sequence of images;

forming a plurality of groups of sub-sets of pixel values by selecting a sub-set of at least one pixel value from each of at least two images defining an interval to form a group of associated sub-sets,

wherein, for any pair of groups with only sub-sets from the same images, the sub-sets from more than one image are different; and

selecting groups of sub-sets to form the signal in accordance with at least one selection criterion, wherein the selected groups of sub-sets cover different intervals, shorter than a length of the sequence and groups are formed by obtaining spatio-temporal volumes of pixel values from a sequence of images at least based on the obtained sequence of images, each volume comprising pixel values within a spatial aperture from each image within an interval of the sequence, the method including using one of a different aperture and a different interval length for groups defined on different intervals of the sequence.

9. The method according to claim 8 , wherein a different interval length is used for groups defined on different intervals of the sequence.

10. A method of forming a time-varying signal representative of at least variations in a value based on pixel values from a sequence of images, the signal corresponding in length to the sequence of images, the method comprising acts of:

obtaining the sequence of images;

forming a plurality of groups of sub-sets of pixel values by selecting a sub-set of at least one pixel value from each of at least two images defining an interval to form a group of associated sub-sets,

wherein, for any pair of groups with only sub-sets from the same images, the sub-sets from more than one image are different; and

selecting groups of sub-sets to form the signal in accordance with at least one selection criterion, wherein groups are formed by obtaining spatio-temporal volumes of pixel values from a sequence of images at least based on the obtained sequence of images, each volume comprising pixel values within a spatial aperture from each image within an interval of the sequence, wherein evaluation of the at least one selection criterion includes at least one of determining a measure of spatial uniformity and determining a measure of temporal uniformity.

11. A method of forming a time-varying signal representative of at least variations in a value based on pixel values from a sequence of images, the signal corresponding in length to the sequence of images, the method comprising acts of:

obtaining the sequence of images;

forming a plurality of groups of sub-sets of pixel values by selecting a sub-set of at least one pixel value from each of at least two images defining an interval to form a group of associated sub-sets,

wherein, for any pair of groups with only sub-sets from the same images, the sub-sets from more than one image are different; and

selecting groups of sub-sets to form the signal in accordance with at least one selection criterion, wherein groups are formed by obtaining spatio-temporal volumes of pixel values from a sequence of images at least based on the obtained sequence of images, each volume comprising pixel values within a spatial aperture from each image within an interval of the sequence, and the method further includes extracting a signal section from each selected group by combining multiple pixel values from each aperture into a value.

12. The method according to claim 11 , wherein the time-varying signal is formed by a fusion operation taking the signal sections as input, and wherein the signal sections participate in the fusion operation with different weightings determining an extent to which they affect the time-varying signal.

13. A system for forming a time-varying signal representative of at least variations in a value based on pixels and corresponding pixel values from a sequence of images, the signal corresponding in length to the sequence of images, the system comprising:

a processor configured to:

produce an interface for obtaining the sequence of images;

form a plurality of groups of sub-sets of pixels and corresponding pixel values by selecting a sub-set of at least one pixel and corresponding pixel value from each of at least two images defining an interval to form a group of associated sub-sets, such that images are covered by at least two intervals; and

select groups of sub-sets to form the signal in accordance with at least one selection criterion,

wherein the selected groups of sub-sets cover different pixels and intervals, shorter than a length of the sequence.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2012
From: KIRENKO, IHOR OLEHOVYCH; JEANNE, VINCENT; DE HAAN, GERARD
To: KONINKLIJKE PHILIPS ELECTRONICS N.V.
Reel/Frame 027988/0834 →
Priority Claims (1)
EP 09172343 · Oct 6, 2009 · regional
Continuity (1)
Related Publication 20120195469A1 · Aug 2, 2012