IP Library › Granted Patent US 9,269,124
Granted Patent B2
US 9,269,124 · App. 14/366,005 · Granted Feb 23, 2016

Image processing device, image processing method, program for image processing device, recording medium, and image display device

Inventors: Takuya Yagi (Tokyo, JP); Kyoji Yoshino (Tokyo, JP); Koji Inagaki (Tokyo, JP)
Assignee: DAI NIPPON PRINTING CO., LTD.
G06T3/0018G06T3/0062H04N1/3878H04N5/217H04N5/2259
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,269,124
App. No.
14/366,005
Granted
Feb 23, 2016
Kind
B2
Abstract

A distorted image (S) is acquired through a photographing operation using a wide-angle lens or an omnidirectional mirror. A cutting reference point (P) for cutting a partial cut region from the distorted image is set. The cut region is set according to the cutting reference point. An eye vector (n) corresponding to the cutting reference point is set with a photographing viewpoint of the distorted image as a base point. The cut region is shifted by a predetermined distance from the cutting reference point. The shifted cut region is transformed through image transformation to transform the distorted image into a planar regular image (T′) according to the eye vector. The shifted cut region (E′) is transformed.

Claims (68)

1. An image processing device comprising:

a distorted image acquiring unit that acquires a distorted image through a photographing operation using a wide-angle lens or an omnidirectional mirror;

a cutting reference point setting unit that sets a cutting reference point for cutting a partial cut region from the distorted image;

a cut region setting unit that sets the cut region according to the cutting reference point;

an eye vector setting unit that sets an eye vector corresponding to the cutting reference point, with a photographing viewpoint of the distorted image as a base point;

an offset unit that shifts the cut region by a predetermined distance from the cutting reference point; and

an image transforming unit that transforms the shifted cut region through image transformation to transform the distorted image into a planar regular image according to the eye vector.

2. The image processing device according to claim 1 , further comprising:

a virtual spherical surface setting unit that sets a virtual spherical surface with the center of the distorted image as a center, wherein the eye vector setting unit sets an eye vector facing an intersection between the virtual spherical surface and a straight line orthogonal to a plane including the distorted image and passing through the cutting reference point from the center of the virtual spherical surface.

3. The image processing device according to claim 1 , wherein

the eye vector setting unit receives a parameter to specify the eye vector and sets the eye vector,

the cut region setting unit sets a region of the planar regular image corresponding to the cut region within a surface orthogonal to the eye vector at an intersection therebetween in the direction of the eye vector,

the offset unit shifts the set region of the planar regular image within the surface orthogonal to the eye vector, and

the image transforming unit finds a pixel value of the distorted image corresponding to each point of the shifted region of the planar regular image according to the eye vector, and sets the found pixel value of the distorted image to a pixel value of the planar regular image.

4. The image processing device according to claim 3 , wherein

the surface orthogonal to the eye vector comprises a surface of a cylinder.

5. The image processing device according to claim 1 , wherein

the eye vector setting unit sets a plurality of eye vectors,

the cut region setting unit sets a cut region according to each of the eye vectors,

the image transforming unit transforms the cut region into a planar regular image, and

the planar regular image found by the image transforming unit is displayed on a single displaying unit.

6. An image processing method, which is performed by an image processing device to process an image, the image processing method comprising:

a step of acquiring a distorted image through a photographing operation using a wide-angle lens or an omnidirectional mirror;

a step of setting a cutting reference point for cutting a partial cut region from the distorted image;

a step of setting the cut region according to the cutting reference point;

a step of setting an eye vector corresponding to the cutting reference point, with a photographing viewpoint of the distorted image as a base point;

a step of shifting the cut region by a predetermined distance from the cutting reference point; and

a step of transforming the shifted cut region through image transformation to transform the distorted image into a planar regular image according to the eye vector.

7. A non-transitory recording medium having stored therein a computer-readable program for an image processing device, which causes a computer to function as:

a distorted image acquiring unit that acquires a distorted image through a photographing operation using a wide-angle lens or an omnidirectional mirror;

a cutting reference point setting unit that sets a cutting reference point for cutting a partial cut region from the distorted image;

a cut region setting unit that sets the cut region according to the cutting reference point;

an eye vector setting unit that sets an eye vector corresponding to the cutting reference point, with a photographing viewpoint of the distorted image as a base point;

an offset unit that shifts the cut region by a predetermined distance from the cutting reference point; and

an image transforming unit that transforms the shifted cut region through image transformation to transform the distorted image into a planar regular image according to the eye vector.

8. An image display device comprising:

a distorted image acquiring unit that acquires a distorted image through a photographing operation using a wide-angle lens or an omnidirectional mirror;

a cutting reference point setting unit that sets a cutting reference point for cutting a partial cut region from the distorted image;

a cut region setting unit that sets the cut region according to the cutting reference point;

an eye vector setting unit that sets an eye vector corresponding to the cutting reference point, with a photographing viewpoint of the distorted image as a base point;

an offset unit that shifts the cut region by a predetermined distance from the cutting reference point;

an image transforming unit that transforms the shifted cut region through image transformation to transform the distorted image into a planar regular image according to the eye vector; and

a displaying unit that displays the planar regular image acquired through the image transforming unit.

9. The image processing device according to claim 2 , wherein

the eye vector setting unit receives a parameter to specify the eye vector and sets the eye vector,

the cut region setting unit sets a region of the planar regular image corresponding to the cut region within a surface orthogonal to the eye vector at an intersection therebetween in the direction of the eye vector,

the offset unit shifts the set region of the planar regular image within the surface orthogonal to the eye vector, and

the image transforming unit finds a pixel value of the distorted image corresponding to each point of the shifted region of the planar regular image according to the eye vector, and sets the found pixel value of the distorted image to a pixel value of the planar regular image.

10. The image processing device according to any one of claim 2 , wherein

the eye vector setting unit sets a plurality of eye vectors,

the cut region setting unit sets a cut region according to each of the eye vectors,

the image transforming unit transforms the cut region into a planar regular image, and

the planar regular image found by the image transforming unit is displayed on a single displaying unit.

11. The image processing device according to any one of claim 3 , wherein

the eye vector setting unit sets a plurality of eye vectors,

the cut region setting unit sets a cut region according to each of the eye vectors,

the image transforming unit transforms the cut region into a planar regular image, and

the planar regular image found by the image transforming unit is displayed on a single displaying unit.

12. The image processing device according to any one of claim 4 , wherein

the eye vector setting unit sets a plurality of eye vectors,

the cut region setting unit sets a cut region according to each of the eye vectors,

the image transforming unit transforms the cut region into a planar regular image, and

the planar regular image found by the image transforming unit is displayed on a single displaying unit.

13. The image processing device according to any one of claim 9 , wherein

the eye vector setting unit sets a plurality of eye vectors,

the cut region setting unit sets a cut region according to each of the eye vectors,

the image transforming unit transforms the cut region into a planar regular image, and

the planar regular image found by the image transforming unit is displayed on a single displaying unit.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 17, 2014
From: YAGI, TAKUYA; YOSHINO, KYOJI; INAGAKI, KOJI
To: DAI NIPPON PRINTING CO., LTD.
Reel/Frame 033114/0532 →
Priority Claims (1)
JP 2011-277449 · Dec 19, 2011 · national
Continuity (1)
Related Publication 20140314336A1 · Oct 23, 2014