IP Library Granted Patent US 9,137,459
Granted Patent B2
US 9,137,459 · App. 14/528,601 · Granted Sep 15, 2015

Image processing device, display device, image processing method, and computer-readable recording medium for generating composite image data

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,137,459
App. No.
14/528,601
Filed
Oct 30, 2014
Granted
Sep 15, 2015
Kind
B2
Art Unit
2662
USPC
348/218.1
Abstract

An image processing device includes: a determination unit that determines, based on a plurality of pieces of image data which is generated by continuously taking images of an area of field of view and input from an imaging unit provided outside the image processing device, whether the area of field of view of the imaging unit has been changed; an image composition unit that superimposes overlapping areas of imaging regions of a plurality of images corresponding to the plurality of pieces of image data along a direction in which the area of field of view of the imaging unit has been changed, to generate composite image data when the area of field of view of the imaging unit has been changed; and a display control unit that causes a display unit provided outside the imaging processing device to display a composite image corresponding to the generated composite image data.

Claims (45)

1. An image processing device comprising:

a determination unit configured to determine, based on a plurality of pieces of image data which is generated by continuously taking images of a specified area of field of view and input from an imaging unit provided outside the image processing device, whether the area of field of view of the imaging unit has been changed;

an image composition unit configured to superimpose overlapping areas of imaging regions of a plurality of images corresponding to the plurality of pieces of image data along a direction in which the area of field of view of the imaging unit has been changed, to generate composite image data when the determination unit determines that the area of field of view of the imaging unit has been changed; and

a display control unit configured to cause a display unit provided outside the imaging processing device to display a composite image corresponding to the composite image data generated by the image composition unit, wherein

when the determination unit determines that the area of field of view of the imaging unit has not been changed after the composite image data is generated, the image composition unit combines images corresponding to the plurality of pieces of image data generated by the imaging unit immediately after determination by the determination unit, in a latest image area corresponding to a latest plurality of pieces of image data which is combined into the composite image data, to update the composite image data, and

the display control unit gradually reduces an aspect ratio or a display area of the composite image, and causes the display unit to display the composite image.

2. The image processing device according to claim 1 , wherein when the determination unit determines that the area of field of view of the imaging unit has not been changed, the display control unit gradually eliminates an area of the composite image corresponding to older image data among the plurality of pieces of image data combined by the image composition unit, with elapse of time, and causes the display unit to display the composite image.

3. The image processing device according to claim 1 , the determination unit determines whether the area of field of view of the imaging unit has been changed, based on a rate of change in imaging regions of two images corresponding to two pieces of image data.

4. The image processing device according to claim 1 , further comprising an acceleration detection unit configured to detect acceleration of the image processing device, wherein

the determination unit determines whether the area of field of view of the imaging unit has been changed, based on a change in the acceleration detected by the acceleration detection unit.

5. A display device comprising:

the image processing device according to claim 1 ;

the imaging unit; and

the display unit.

6. An image processing method executed by an image processing device, the method comprising:

determining, based on a plurality of pieces of image data which is generated by continuously taking images of a specified area of field of view and input from an imaging unit provided outside the image processing device, whether the area of field of view of the imaging unit has been changed;

superimposing overlapping areas of imaging regions of a plurality of images corresponding to the plurality of pieces of image data along a direction in which the area of field of view of the imaging unit has been changed, to generate composite image data when it is determined that the area of field of view of the imaging unit has been changed;

causing a display unit provided outside the imaging processing device to display a composite image corresponding to the composite image data, wherein

when it is determined that the area of field of view of the imaging unit has not been changed after the composite image data is generated, images corresponding to the plurality of pieces of image data generated by the imaging unit immediately after determination are combined in a latest image area corresponding to a latest plurality of pieces of image data which is combined into the composite image data, to update the composite image data,

gradually reducing an aspect ratio or a display area of the composite image; and

causing the display unit to display the composite image.

7. A non-transitory computer-readable recording medium with an executable program stored thereon, the program instructing an image processing device to perform:

determining, based on a plurality of pieces of image data which is generated by continuously taking images of a specified area of field of view and input from an imaging unit provided outside the image processing device, whether the area of field of view of the imaging unit has been changed;

superimposing overlapping areas of imaging regions of a plurality of images corresponding to the plurality of pieces of image data along a direction in which the area of field of view of the imaging unit has been changed, to generate composite image data when it is determined that the area of field of view of the imaging unit has been changed;

causing a display unit provided outside the imaging processing device to display a composite image corresponding to the composite image data, wherein

when it is determined that the area of field of view of the imaging unit has not been changed after the composite image data is generated, images corresponding to the plurality of pieces of image data generated by the imaging unit immediately after determination are combined in a latest image area corresponding to a latest plurality of pieces of image data which is combined into the composite image data, to update the composite image data,

gradually reducing an aspect ratio or a display area of the composite image; and

causing the display unit to display the composite image.

8. An image processing method executed by an image processing device, the method comprising:

determining, based on a plurality of pieces of image data which is generated by continuously taking images of a specified area of field of view and input from an imaging unit provided outside the image processing device, whether the area of field of view of the imaging unit has been changed;

superimposing overlapping areas of imaging regions of a plurality of images corresponding to the plurality of pieces of image data along a direction in which the area of field of view of the imaging unit has been changed, to generate composite image data when it is determined that the area of field of view of the imaging unit has been changed;

causing a display unit provided outside the imaging processing device to display a composite image corresponding to the composite image data generated by the image composition unit; and

responsive to a determination that the area of field of view of the imaging unit has not been changed, gradually eliminating an area of the composite image corresponding to older image data among the plurality of pieces of image data combined by the image composition unit, with elapse of time, and causing the display unit to display the composite image,

wherein when it is determined that the area of field of view of the imaging unit has not been changed after the composite image data is generated, images corresponding to the plurality of pieces of image data generated by the imaging unit immediately after determination are combined in a latest image area corresponding to a latest plurality of pieces of image data which is combined into the composite image data, to update the composite image data.

9. An image processing method executed by an image processing device, the method comprising:

determining, based on a plurality of pieces of image data which is generated by continuously taking images of a specified area of field of view and input from an imaging unit provided outside the image processing device, whether the area of field of view of the imaging unit has been changed based on a rate of change in imaging regions of two images corresponding to two pieces of image data;

superimposing overlapping areas of imaging regions of a plurality of images corresponding to the plurality of pieces of image data along a direction in which the area of field of view of the imaging unit has been changed, to generate composite image data when it is determined that the area of field of view of the imaging unit has been changed; and

causing a display unit provided outside the imaging processing device to display a composite image corresponding to the composite image data generated by the image composition unit,

wherein when it is determined that the area of field of view of the imaging unit has not been changed after the composite image data is generated, images corresponding to the plurality of pieces of image data generated by the imaging unit immediately after determination are combined in a latest image area corresponding to a latest plurality of pieces of image data which is combined into the composite image data, to update the composite image data.

10. An image processing method executed by an image processing device, the method comprising:

detecting acceleration of the image processing device;

determining, based on a plurality of pieces of image data which is generated by continuously taking images of a specified area of field of view and input from an imaging unit provided outside the image processing device, whether the area of field of view of the imaging unit has been changed based on a change in the acceleration detected by the acceleration detection unit;

superimposing overlapping areas of imaging regions of a plurality of images corresponding to the plurality of pieces of image data along a direction in which the area of field of view of the imaging unit has been changed, to generate composite image data when it is determined that the area of field of view of the imaging unit has been changed; and

causing a display unit provided outside the imaging processing device to display a composite image corresponding to the composite image data generated by the image composition unit,

wherein when it is determined that the area of field of view of the imaging unit has not been changed after the composite image data is generated, images corresponding to the plurality of pieces of image data generated by the imaging unit immediately after determination are combined in a latest image area corresponding to a latest plurality of pieces of image data which is combined into the composite image data, to update the composite image data.