IP Library › Granted Patent US 10,620,693
Granted Patent B2
US 10,620,693 · App. 15/438,380 · Granted Apr 14, 2020

Apparatus and method for displaying image in virtual space

Inventors: Yasumi Tanaka (Funabashi, JP); Sho Matsuda (Yokosuka, JP)
Assignee: CANON KABUSHIKI KAISHA
G06F3/011G06K9/00671
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,620,693
App. No.
15/438,380
Granted
Apr 14, 2020
Kind
B2
Abstract

An information processing apparatus includes a viewpoint information acquisition unit that acquires viewpoint information concerning a viewer, a data input unit that inputs virtual space data, a specifying unit that specifies a virtual reference surface corresponding to a real reference surface in the virtual space data, a determination unit that determines positional relationship between the virtual reference surface and the real reference surface, a correction unit that corrects the virtual space data based on the positional relationship, and a generation unit that generates a display image based on the corrected virtual space data and the viewpoint information.

Claims (44)

1. An information processing apparatus comprising:

one or more processors; and

one or more memories storing instructions, when executed by the one or more processors, causing the information processing apparatus to:

acquire viewpoint information concerning a viewer;

input virtual space data;

specify a virtual reference surface corresponding to a real reference surface in the virtual space data;

determine positional relationship between the virtual reference surface and the real reference surface;

correct the virtual space data based on the positional relationship; generate a display image based on the corrected virtual space data and the viewpoint information;

present a plurality of candidates of the reference surface in the virtual space on a display which the viewer is able to see;

present real space information indicating each of the plurality of candidates of the reference surface on the display which the viewer is able to see; and

select, as the reference surface in the virtual space, a candidate selected from the plurality of candidates on the basis of instruction of the viewer.

2. The information processing apparatus according to claim 1 , when executed by the one or more processors, further causing the information processing apparatus to:

extract at least one bottom surface from the virtual space data; and

select, from the extracted at least one bottom surface, a bottom surface as the reference surface in the virtual space.

3. The information processing apparatus according to claim 2 , wherein, based on a distance between the real reference surface and the extracted at least one bottom surface, the bottom surface as the reference surface in the virtual space is selected.

4. The information processing apparatus according to claim 2 , wherein, based on number of vertices of each of the extracted at least one bottom surface, the bottom surface as the reference surface in the virtual space is selected.

5. The information processing apparatus according to claim 2 , wherein, based on an area of each of the extracted at least one bottom surface, the bottom surface as the reference surface in the virtual space is selected.

6. The information processing apparatus according to claim 2 , wherein a surface with a normal line extending vertically upward as the bottom surface is extracted.

7. The information processing apparatus according to claim 6 , wherein, as the bottom surface, a surface with the normal line extending vertically upward and having a distance longer or equal to a predetermined length from a closest one of surfaces with the normal line extending vertically downward is extracted.

8. The information processing apparatus according to claim 1 , wherein the viewpoint information based on an image captured is acquired.

9. The information processing apparatus according to claim 1 , wherein the viewpoint information includes a position of a viewpoint of the viewer.

10. The information processing apparatus according to claim 1 , wherein the viewpoint information includes an orientation of a viewpoint of the viewer.

11. The information processing apparatus according to claim 1 , wherein the reference surface is a floor surface.

12. The information processing apparatus according to claim 1 , wherein data on the virtual space based on a distance between the reference surface in the virtual space and the reference surface in the real space is shifted.

13. The information processing apparatus according to claim 1 , when executed by the one or more processors, further causing the information processing apparatus to input a captured image in the real space, and

wherein the display image by combining the corrected virtual space data and the captured image in the real space is generated.

14. An information processing method comprising:

acquiring viewpoint information concerning a viewer;

inputting virtual space data; specifying a virtual reference surface corresponding to a real reference surface in the virtual space data;

determining positional relationship between the virtual reference surface and the real reference surface;

correcting the virtual space data based on the positional relationship; generating a display image based on the corrected virtual space data and the viewpoint information;

presenting a plurality of candidates of the reference surface in the virtual space on a display which the viewer is able to see;

presenting real space information indicating each of the plurality of candidates of the reference surface on the display which the viewer is able to see; and

selecting, as the reference surface in the virtual space, a candidate selected from the plurality of candidates on the basis of instruction of the viewer.

15. A non-transitory computer-readable storage medium storing computer-executable instructions for causing a computer to implement an information processing method, the information processing method comprising:

acquiring viewpoint information concerning a viewer;

inputting virtual space data;

specifying a virtual reference surface corresponding to a real reference surface in the virtual space data;

determining positional relationship between the virtual reference surface and the real reference surface;

correcting the virtual space data based on the positional relationship;

generating a display image based on the corrected virtual space data and the viewpoint information;

presenting a plurality of candidates of the reference surface in the virtual space on a display which the viewer is able to see;

presenting real space information indicating each of the plurality of candidates of the reference surface on the display which the viewer is able to see; and

selecting, as the reference surface in the virtual space, a candidate selected from the plurality of candidates on the basis of instruction of the viewer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2017
From: TANAKA, YASUMI; MATSUDA, SHO
To: CANON KABUSHIKI KAISHA
Reel/Frame 042311/0897 →
Priority Claims (1)
JP 2016-032477 · Feb 23, 2016 · national
Continuity (1)
Related Publication 20170243401A1 · Aug 24, 2017