IP Library Granted Patent US 8,503,790
Granted Patent B2
US 8,503,790 · App. 12/801,666 · Granted Aug 6, 2013

Image-processing method, image-processing program and image-processing device for processing time-lapse image

Inventors: Kei Ito (Okegawa, JP); Masafumi Mimura (Ageo, JP)
Assignee: Nikon Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,503,790
App. No.
12/801,666
Granted
Aug 6, 2013
Kind
B2
Abstract

An image-processing method for processing a time lapse image includes acquiring a first image obtained by capturing an image of an object located within a field of view using an imaging device and a second image obtained by capturing an image of the object located within the field of view using the imaging device after a predetermined time period has elapsed, calculating a positional correction value for a positional shift between the first image and the second image, by using a correlation function weighted according to an image feature of each of the objects included in the first image and the second image, and performing, based on the calculated positional correction value, a positional correction between the first image and the second image. The time lapse image is generated using the first image and the second image on which the positional correction has been performed.

Claims (37)

1. An image-processing method for processing a time-lapse image, comprising:

acquiring a first image obtained by using an imaging device to capture an image of a plurality of objects located within a field of view, and a second image obtained by using the imaging device to capture an image of the objects located within the field of view after a predetermined time period has elapsed;

calculating, executed by a processor, a positional correction value to be used for a relative shift in the position in which the first image and the second image are captured by using a correlation function weighted according to an image feature of each of the objects included in the first image and the second image; and

performing a positional correction between the first image and the second image based on the positional correction value, and generating a time-lapse image.

2. The image-processing method for processing a time-lapse image according to claim 1 , wherein the image feature is a feature based on an external profile of each of the objects.

3. The image-processing method for processing a time-lapse image according to claim 1 , wherein the image feature is a feature based on a texture of each of the objects.

4. An image-processing program on a non-transitory computer readable medium for processing a time-lapse image, comprising the steps of:

acquiring a first image obtained by using an imaging device to capture an image of a plurality of objects located within a field of view and a second image obtained by using the imaging device to capture an image of the plurality of objects located within the field of view after a predetermined time period has elapsed;

calculating a positional correlation value to be used for a relative shift in the position in which the first image and the second image are captured by using a correlation function weighted according to an image feature of each of the objects included in the first image and the second image;

performing a positional correction between the first image and the second image based on the calculated positional correction value; and

generating a time-lapse image using the first image and the second image between which the positional correction has been performed.

5. The image-processing program for processing a time-lapse image according to claim 4 , wherein the image feature is a feature based on an external profile of each of the objects.

6. The image-processing program for processing a time-lapse image according to claim 4 , wherein the image feature is a feature based on a texture of each of the objects.

7. The image-processing program for processing a time-lapse image according to claim 4 , wherein

the image feature comprises a plurality of types of features configured and stored in advance,

the image-processing program has a mode selection step for selecting the type of feature, and

the image-processing program calculates the shift amount using a weight correlation function that corresponds to the feature selected in the mode selection step.

8. An image-processing device for processing a time-lapse image, comprising:

an imaging device capturing an image of a plurality of objects;

an image analyzing part analyzing, from a first image and a second image captured by the imaging device at a predetermined time interval, an image feature of each of the objects included in each of the images;

a positional correction value calculating part calculating a positional correction value to be used for a relative shift in the position in which the first image and the second image are captured, using a correlation function weighted according to the analyzed image feature of each of the objects; and

an inter-image alignment part performing, based on the positional correction value calculated by the positional correction value calculating part, a positional correction between the first image and the second image, wherein

a time-lapse image is generated using the first image and the second image between which the positional correction has been performed by the inter-image alignment part.

9. The image-processing device for processing a time-lapse image according to claim 8 , wherein the image feature is a feature based on an external profile of each of the objects.

10. The image-processing device for processing a time-lapse image according to claim 8 , wherein the image feature is a feature based on a texture of each of the objects.

11. The image-processing device for processing a time-lapse image according to claim 8 , further comprising:

a feature memory part storing a plurality of types of features configured in advance with regards to the image feature; and

mode selection means for selecting the feature type configured in the feature memory part, wherein

the positional correction value calculating part calculates the positional correction value using a weight correlation function that corresponds to the feature selected in the mode selection means.

12. An observation system comprising:

an observation unit to observe a plurality of objects; and

an image-processing device to process a time-lapse image, comprising:

an imaging device capturing an image of the plurality of objects;

an image analyzing part analyzing, from a first image and a second image captured by the imaging device at a predetermined time interval, an image feature of each of the objects included in each of the images;

a positional correction value calculating part calculating a positional correction value to be used for a relative shift in the position in which the first image and the second image are captured, using a correlation function weighted according to the analyzed image feature of each of the objects; and

an inter-image alignment part performing, based on the positional correction value calculated by the positional correction value calculating part, a positional correction between the first image and the second image, wherein

a time-lapse image is generated using the first image and the second image between which the positional correction has been performed by the inter-image alignment part.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 18, 2010
From: ITO, KEI; MIMURA, MASAFUMI
To: NIKON CORPORATION
Reel/Frame 024609/0118 →
Priority Claims (1)
JP 2007-328471 · Dec 20, 2007 · national
Continuity (2)
Continuation PCTJP2008073039 · Dec 18, 2008
Related Publication 20100260422A1 · Oct 14, 2010