IP Library › Granted Patent US 7,511,731
Granted Patent B2
US 7,511,731 · App. 10/901,179 · Granted Mar 31, 2009

Image photographing apparatus and image processing method

Assignee: Canon Kabushiki Kaisha
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,511,731
App. No.
10/901,179
Granted
Mar 31, 2009
Kind
B2
Abstract

In an image generation apparatus capable of generating an image of an arbitrary view point, to enable a user to easily set a view point position of a reconstructed image in an actual space, there are provided an image photographing means for photographing an image; a position/orientation measurement means for measuring position and orientation when photographing the image; a reconstruction view point position setting means for setting a view point position of a reconstruction image; and a reconstruction means for reconstructing an image according to the view point position set by the reconstruction view point position setting means, by using beam information included in the image photographed by the image photographing means.

Claims (25)

1. An image photographing apparatus comprising:

an image photographing unit adapted to photograph an image;

a position/orientation measurement unit adapted to measure position and orientation of said image photographing unit;

a reconstruction viewpoint position and orientation setting unit adapted to set a viewpoint position and orientation of a reconstruction image based on the position and orientation measured by said position/orientation measurement unit;

a reconstruction unit adapted to reconstruct an image according to the viewpoint position set by said reconstruction viewpoint position and orientation setting unit, by using beam information included in the image photographed by said image photographing unit; and

a display adapted to display the photographed image,

wherein said reconstruction viewpoint position and orientation setting unit superposes a first optical axis that passes through a reconstruction viewpoint position at a time when said image photographing apparatus is disposed at a first point, on the photographed image displayed on said display at a time when said image photographing apparatus is disposed at a second point, and superposes a mark indicating a second optical axis at the second point on the photographed image,

said reconstruction viewpoint position and orientation setting unit setting the reconstruction viewpoint position of the reconstruction image by using a first measurement position and orientation measured at the first point by said position/orientation measurement unit and a second measurement position and orientation measured at the second point by said position/orientation measurement unit, and

said reconstruction viewpoint position and orientation setting unit setting the orientation of the reconstruction image according to a user's instruction.

2. An image processing method comprising:

an image input step of inputting an image photographed by a photographing unit;

a position/orientation information input step of inputting a measured result of the position and orientation of the photographing unit;

a reconstruction viewpoint position and orientation setting step of setting a viewpoint position and orientation of a reconstruction image based on the measured position and orientation inputted by said position/orientation information input step according to a user instruction;

a reconstruction step of reconstructing an image according to the viewpoint position set in said reconstruction viewpoint position and orientation setting step, by using beam information included in the image photographed by the image photographing unit; and

displaying the photo graphed image,

wherein said reconstruction viewpoint position and orientation setting step superposes a first optical axis that passes through a reconstruction viewpoint position at a time when the photographing unit is disposed at a first point, on the photographed image displayed in said displaying step at a time when the photographing unit is disposed at a second point, and superposes a mark indicating a second optical axis at the second point on the photographed image,

said reconstruction viewpoint position and orientation setting step setting the viewpoint position of the reconstruction image by using a first measurement position and orientation measured at the first point and input by said position/orientation information input step and a second measurement position and orientation measured at the second point and input by said position/orientation information input step.

3. A computer-readable storage medium which stores a computer program for instructing a computer to perform an image processing method comprising:

an image input step of inputting an image photographed by a photographing unit;

a position/orientation information input step of inputting a measured result of the position and orientation of the photographing unit;

a reconstruction view point position and orientation setting step of setting a viewpoint position and orientation of a reconstruction image based on the measured position and orientation input by said position/orientation information input step;

a reconstruction step of reconstructing an image according to the viewpoint position set in said reconstruction viewpoint position and orientation setting step, by using beam information included in the image photographed by the image photographing unit; and displaying the photographed image,

wherein said reconstruction viewpoint position and orientation setting step superposes a first optical axis that passes through the reconstruction viewpoint position at a time when the photographing unit is disposed at a first point, on the photographed image displayed in said displaying step at a time when the photographing unit is disposed at a second point, and superposes a mark indicating a second optical axis at the second point on the photographed image,

said reconstruction viewpoint position and orientation setting step setting the viewpoint position of the reconstruction image by using a first measurement position and orientation measured at the first point and input by said position/orientation information input step and a second measurement position and orientation measured at the second point and input by said position/orientation information input step, and

said reconstruction viewpoint position and orientation setting step setting the orientation of the reconstruction image according to a user's instruction.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2004
From: KATAYAMA, AKIHIRO; YAMANAKA, KUNIYASU; HIROTA, MAKOTO
To: CANON KABUSHIKI KAISHA
Reel/Frame 015983/0887 →
Priority Claims (1)
JP 2003-204671 · Jul 31, 2003 · national
Continuity (1)
Related Publication 20050046702A1 · Mar 3, 2005