IP Library › Granted Patent US 10,681,269
Granted Patent B2
US 10,681,269 · App. 15/425,279 · Granted Jun 9, 2020

Computer-readable recording medium, information processing method, and information processing apparatus

Inventors: Manabu Nakao (Kunitachi, JP); Moyuru Yamada (Machida, JP); Yoshiro Hada (Atsugi, JP)
Assignee: FUJITSU LIMITED
H04N5/23238G06K9/00637G06K9/209G06K9/4671G06T3/4038G06T5/006G06T7/60G06T7/74G06T7/80G06T7/97G06T15/04G06T19/20H04N5/2258G06T2207/10032G06T2207/20212G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,681,269
App. No.
15/425,279
Granted
Jun 9, 2020
Kind
B2
Abstract

A non-transitory computer-readable recording medium stores therein an information processing program that causes a computer to execute a process including: acquiring images photographed with a first angle of view and a second angle of view wider than the first angle of view; specifying a position and an attitude of a camera that photographed the image photographed with the first angle of view based on the image photographed with the second angle of view; stitching a plurality of images photographed with the first angle of view to generate a panoramic image; correcting the position on the generated panoramic image, of the image photographed with the first angle of view based on the specified position and attitude of the camera; and mapping the panoramic image to a three-dimensional model by texture mapping based on the corrected position.

Claims (35)

1. A non-transitory computer-readable recording medium having stored therein an information processing program that causes a computer to execute a process comprising:

acquiring a plurality of high-definition images photographed multiple times by a first camera with a first angle of view and wide-viewing-angle images photographed by a second camera that is an omnidirectional camera with a second angle of view wider than the first angle of view;

specifying a position and an attitude of the first camera that photographed the images photographed with the first angle of view based on the images photographed with the second angle of view by the second camera;

stitching the plurality of images photographed with the first angle of view to generate a panoramic image;

comparing central coordinates on the panoramic image, of the images photographed with the first angle of view, included in the panoramic image to extract the central coordinates of the images photographed with the first angle of view, positioned at edges of the panoramic image as reference points and correcting positions of the extracted reference points; and

mapping the panoramic image to a three-dimensional model by texture mapping based on the corrected position.

2. The non-transitory computer-readable recording medium according to claim 1 , wherein

the specifying involves extracting feature points of the image photographed with the second angle of view and assigning reliability based on the extracted feature points to the specified position and attitude of the first camera, and

the central coordinates of the images photographed with the first angle of view are extracted based on the assigned reliability.

3. The non-transitory computer-readable recording medium according to claim 1 , wherein

the correcting involves extracting central coordinates of the images photographed with the first angle of view, positioned at four corners of the panoramic image as reference points and correcting positions of the extracted reference points.

4. An information processing method implemented by a computer, the information processing method comprising:

acquiring a plurality of high-definition images photographed multiple times by a first camera with a first angle of view and wide-viewing-angle images photographed by a second camera that is an omnidirectional camera with a second angle of view wider than the first angle of view, using a processor;

specifying a position and an attitude of the first camera that photographed the images photographed with the first angle of view based on the images photographed with the second angle of view, using the processor;

stitching the plurality of images photographed with the first angle of view to generate a panoramic image, using the processor;

comparing central coordinates on the panoramic image, of the images photographed with the first angle of view, included in the panoramic image to extract the central coordinates of the images photographed with the first angle of view, positioned at edges of the panoramic image as reference points and correcting positions of the extracted reference points, using the processor; and

mapping the panoramic image to a three-dimensional model by texture mapping based on the corrected position, using the processor.

5. The information processing method according to claim 4 , wherein

the specifying involves extracting feature points of the image photographed with the second angle of view and assigning reliability based on the extracted feature points to the specified position and attitude of the first camera, and

the central coordinates of the images photographed with the first angle of view are extracted based on the assigned reliability.

6. The information processing method according to claim 4 , wherein

the correcting involves extracting central coordinates of the images photographed with the first angle of view, positioned at four corners of the panoramic image as reference points and correcting positions of the extracted reference points.

7. An information processing apparatus comprising:

a memory; and

a processor coupled to the memory, wherein the processor executes a process comprising:

acquiring a plurality of high-definition images photographed multiple times by a first camera with a first angle of view and wide-viewing-angle images photographed by a second camera that is an omnidirectional camera with a second angle of view wider than the first angle of view;

specifying a position and an attitude of the first camera that photographed the images photographed with the first angle of view based on the images photographed with the second angle of view;

stitching the plurality of images photographed with the first angle of view to generate a panoramic image;

comparing central coordinates on the panoramic image, of the images photographed with the first angle of view, included in the panoramic image to extract the central coordinates of the images photographed with the first angle of view, positioned at edges of the panoramic image as reference points and correcting positions of the extracted reference points; and

mapping the panoramic image to a three-dimensional model by texture mapping based on the corrected position of the image photographed with the first angle of view.

8. The information processing apparatus according to claim 7 , wherein

the specifying involves extracting feature points of the image photographed with the second angle of view and assigns reliability based on the extracted feature points to the specified position and attitude of the first camera, and

the central coordinates of the images photographed with the first angle of view are extracted based on the assigned reliability.

9. The information processing apparatus according to claim 7 , wherein

the correcting involves extracting central coordinates of the images photographed with the first angle of view, positioned at four corners of the panoramic image as reference points and corrects positions of the extracted reference points.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2017
From: NAKAO, MANABU; YAMADA, MOYURU; HADA, YOSHIRO
To: FUJITSU LIMITED
Reel/Frame 041215/0194 →
Priority Claims (1)
JP 2016-072795 · Mar 31, 2016 · national
Continuity (1)
Related Publication 20170289447A1 · Oct 5, 2017
Cited By (1)
US 12,394,092