IP Library Granted Patent US 9,805,475
Granted Patent B2
US 9,805,475 · App. 13/607,173 · Granted Oct 31, 2017

Eulerian motion modulation

Inventors: Michael Rubinstein (Somerville, MA); Neal Wadhwa (Cambridge, MA); Frederic Durand (Boston, MA); William T. Freeman (Acton, MA); Hao-yu Wu (Cambridge, MA); Eugene Inghaw Shih (Brookline, MA); John V. Guttag (Lexington, MA)
Assignees: Massachusetts Institute of Technology; Quanta Computer Inc.
G06T7/207G06T7/262G06T2207/10024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,805,475
App. No.
13/607,173
Granted
Oct 31, 2017
Kind
B2
Abstract

In one embodiment, a method of amplifying temporal variation in at least two images includes converting two or more images to a transform representation. The method further includes, for each spatial position within the two or more images, examining a plurality of coefficient values. The method additionally includes calculating a first vector based on the plurality of coefficient values. The first vector can represent change from a first image to a second image of the at least two images describing deformation. The method also includes modifying the first vector to create a second vector. The method further includes calculating a second plurality of coefficients based on the second vector.

Claims (17)

1. A method of amplifying temporal variation in at least two images, the method comprising:

for each particular pixel of the at least two images, detecting a temporal variation of the particular pixel of the at least two images by applying a bandpass filter configured to analyze frequencies over time, the resulting detected temporal variation of the particular pixel between the two images being below a particular threshold; and

amplifying the detected temporal variation of each particular pixel; and

providing at least two modulated images by adding the amplified temporal variation to the at least two images by synthesizing the modulated images, for an amplification factor α, according to ƒ(x+(1+α)δ(t)), δ(t) being a displacement function.

2. The method of claim 1 , wherein detecting the temporal variation employs temporal processing.

3. The method of claim 1 , wherein detecting the temporal variation employs spatial processing, the spatial processing removing noise.

4. A system for amplifying temporal variation in at least two images, the system comprising:

a pixel examination module configured to, for each particular pixel of the at least two images, detect a temporal variation of the particular pixel of the at least two images by applying a bandpass filter configured to analyze frequencies over time, the resulting detected temporal variation of the particular pixel between the two images being below a particular threshold; and

a signal processing module configured to:

amplify the detected temporal variation of each particular pixel, and

provide at least two modulated images by adding the amplified temporal variation to the at least two images by synthesizing the modulated images, for an amplification factor α, according to ƒ(x+(1+α)δ(t)), δ(t)being a displacement function.

5. The system of claim 4 , wherein the pixel examination module is further configured to detect temporal variation by employing temporal processing.

6. The system of claim 4 , wherein the pixel examination module is further configured to employ spatial processing, the spatial processing removing noise.

7. The method of claim 1 , wherein applying the bandpass filter further includes, for each pixel value, analyzing a one-dimensional (1D) image intensity profile.

8. The method of claim 7 , wherein the 1D image intensity profile is based on a function ƒ(x+δ(t)), where δ(t) is a displacement function.

9. The system of claim 4 , wherein the pixel examination module is further configured to, for each pixel value, analyzing a one-dimensional (1D) image intensity profile.

10. The system of claim 9 , wherein the 1D image intensity profile is based on a function ƒ(x+δ(t)), where δ(t) is a displacement function.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 24, 2014
From: RUBINSTEIN, MICHAEL; WADHWA, NEAL; DURAND, FREDERIC; FREEMAN, WILLIAM T.; WU, HAO-YU; GUTTAG, JOHN V.
To: MASSACHUSETTS INSTITUTE OF TECHNOLOGY
Reel/Frame 034033/0126 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 3, 2014
From: SHIH, EUGENE INGHAW
To: QUANTA COMPUTER INC.
Reel/Frame 033658/0515 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 6, 2012
From: RUBINSTEIN, MICHAEL; WADHWA, NEAL; DURAND, FREDO; FREEMAN, WILLIAM T.
To: MASSACHUSETTS INSTITUTE OF TECHNOLOGY
Reel/Frame 029250/0153 →
Continuity (1)
Related Publication 20140072228A1 · Mar 13, 2014