IP Library Granted Patent US 9,412,204
Granted Patent B2
US 9,412,204 · App. 14/175,854 · Granted Aug 9, 2016

Virtual image generating apparatus, virtual image generating method, and recording medium storing virtual image generating program

Inventors: Takako Hanai (Tachikawa, JP); Osamu Nonaka (Sagamihara, JP)
Assignee: OLYMPUS CORPORATION
G06T19/006G06T3/0056G06T11/60H04N7/18H04N21/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,412,204
App. No.
14/175,854
Granted
Aug 9, 2016
Kind
B2
Abstract

An image generation apparatus, system, and method that include an image recording unit that records at least one image containing photography position information corresponding to a photography position of the image, an input unit for selecting a selected image from the at least one image recorded in the image recording unit, a map-image unit that acquires at least one map image corresponding to the photography position information of the selected image, a direction detection unit that detects a photography direction of the selected image from the photography position information and acquires at least one surrounding map image viewable from the photography position when the selected image was recorded, and a virtual image generation unit that generates at least one virtual image of a scene viewable from the photography position when the selected image was recorded based on the photography position information and the at least one surrounding map image.

Claims (35)

1. An image generation apparatus comprising:

an image recording unit that records at least one image containing photography position information corresponding to a photography position of the at least one image;

an input unit for selecting a selected image from the at least one image recorded in the image recording unit;

a map-image unit that acquires at least one map image corresponding to the photography position information of the selected image;

a direction detection unit that detects a photography direction of the selected image from the photography position information and acquires at least one surrounding map image viewable from the photography position when the selected image was recorded; and

a virtual image generation unit that generates at least one virtual image of a scene viewable from the photography position when the selected image was recorded based on the photography position information and the at least one surrounding map image.

2. The image generation apparatus of claim 1 further comprising an output unit that outputs the virtual image to a display.

3. The image generation apparatus of claim 1 , wherein the photography position information comprises latitude and longitude information corresponding to the photography position.

4. The image generation apparatus of claim 1 , wherein the photography position comprises a date and time that the at least one image is recorded.

5. The image generation apparatus of claim 4 , wherein the map-image unit acquires map images consist with the date and time that the selected image is recorded.

6. The image generation apparatus of claim 1 , wherein the map-image unit comprises an era-classified map database.

7. The image generation apparatus according to claim 1 , wherein the direction detection unit detects a direction that is opposite to the photography direction of the selected image and the virtual image generation unit generates a virtual image showing a scene in a direction opposite to the photography direction of the selected image.

8. The image generation apparatus according to claim 7 , further comprising a photographer image recording unit that records an image related to a photographer of the selected image, and the virtual image generation unit includes an image synthesis unit that generates a virtual image showing the scene in the direction opposite to the photography direction synthesized with the image related to the photographer of the selected image.

9. The image generation apparatus according to claim 1 , further comprising a photographer image recording unit that records an image related to a photographer of the selected image, and the virtual image generation unit includes an image synthesis unit that synthesizes the virtual image with the image related to the photographer of the selected image.

10. The image generation apparatus according to claim 1 , wherein the direction detection detects a scene from the map image that is most similar to the selected image when it detects the photography direction of the selected image.

11. The virtual image generation apparatus according to claim 1 , wherein the at least one surrounding map image comprises map images along a 360 degree view point from the photography position.

12. An image generation system comprising:

an image database comprising at least one recorded image containing photography position information corresponding to a photography position and date and time that the recorded image is recorded by an imaging device;

an input unit for selecting a selected image from the at least one recorded image;

a map-image database that stores at least one map image corresponding to the photography position information of the selected image;

a direction detection unit that detects a photography direction of the selected image from the photography position information and acquires at least one surrounding map image viewable from the photography position when the selected image was recorded; and

a virtual image generation unit that generates at least one virtual image in any direction viewable from the photography position when the selected image was recorded based on the photography position information and the at least one surrounding map image.

13. The image generation system of claim 12 further comprising an output unit that outputs the virtual image to a display.

14. The image generation system of claim 12 , wherein the photography position information comprises latitude and longitude information corresponding to the photography position.

15. The image generation system of claim 14 , wherein the map-image database stores map images consist with the date and time that the selected image is recorded.

16. The image generation apparatus of claim 12 , wherein the map-image database comprises an era-classified map database.

17. The image generation system according to claim 12 , further comprising:

a character image database configured to store a character image related to a person; and

a synthesis unit configured to synthesize the character image with the virtual image.

18. An image generation method comprising:

recording at least one image containing photography position information corresponding to a photography position when the image was recorded;

selecting a selected image from the at least one image;

acquiring at least one map image corresponding to the photography position information contained in the selected image;

acquiring at least one surrounding scene viewable from the photography position consistent with a date and time that the selected image was recorded; and

generating at least one virtual image of the surrounding scene viewable from the photography position when the selected image was recorded.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2021
From: OLYMPUS CORPORATION
To: OM DIGITAL SOLUTIONS CORPORATION
Reel/Frame 058901/0912 →
MERGER Recorded Aug 5, 2015
From: OLYMPUS IMAGING CORP.
To: OLYMPUS CORPORATION
Reel/Frame 036279/0239 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 24, 2014
From: HANAI, TAKAKO; NONAKA, OSAMU
To: OLYMPUS IMAGING CORP.
Reel/Frame 032277/0655 →
Priority Claims (2)
JP 2008-25429 · Feb 5, 2008 · national
JP 2008-35219 · Feb 15, 2008 · national
Continuity (2)
Continuation 12364574 · Feb 3, 2009
Related Publication 20140168416A1 · Jun 19, 2014