IP Library › Granted Patent US 10,062,211
Granted Patent B2
US 10,062,211 · App. 14/270,749 · Granted Aug 28, 2018

Computer-readable recording medium recording information processing program, information processing apparatus, information processing system, and information processing method

Inventors: Takeshi Hayakawa (Kyoto, JP); Naoki Koga (Kyoto, JP)
Assignee: Nintendo Co., Ltd.
G06T19/006G06K9/6217
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,062,211
App. No.
14/270,749
Granted
Aug 28, 2018
Kind
B2
Abstract

An example information processing system includes: a computer; an imaging device; a display device; and a first and a second feature placed in a real space. The computer includes: an image acquiring unit that acquires an image of the real space; a feature detecting unit that detects the first feature and the second feature from the image; a changing unit that changes an association of the first feature with a virtual objects by adding a virtual object associated with the second feature, and an generating unit that generates an image of a virtual space in which the virtual object associated with the first feature is placed at a position based on the first feature; and a display controlling unit that displays an image on the display device.

Claims (59)

1. A non-transitory computer-readable recording medium recording an information processing program causing a computer to perform operations comprising:

acquiring a first captured image of a real space captured by an imaging device;

detecting a first marker and a second marker in the captured image of the real space;

in response to the detecting,

identifying, in a memory, a second association associating the second marker with a virtual object, wherein the second association is previously stored in the memory;

making a first association of the virtual object, associated in the memory with the second marker by the identified second association, with the first marker; and

storing the first association in the memory;

generating, when the first marker is detected in a second captured image of the real space captured by the imaging device, an image of a virtual space in which the virtual object associated with the first marker is placed on a basis of the first marker based on the first association in the memory regardless of whether the second marker is detected in the second captured image or not;

causing a display controller to display a composite image on a display device such that the image of the virtual space is visually recognizable while being superimposed on the second captured image; and

when the first marker is not detected for a predetermined period of time, resetting the association of the first marker with the virtual object.

2. The non-transitory computer-readable recording medium recording an information processing program, according to claim 1 , wherein the information processing program causes the computer to,

when the detection of the first marker is continued while the second marker is not detected anymore, maintain the association of the first marker with the virtual object.

3. The non-transitory computer-readable recording medium recording an information processing program, according to claim 1 , wherein the information processing program causes the computer to,

when the detection of the second marker is suspended and then restarted, associate the virtual object associated with the second marker with the first marker.

4. The non-transitory computer-readable recording medium recording an information processing program, according to claim 1 , wherein the information processing program causes the computer to,

while the detection of the second marker is continued, add, in a predetermined cycle, the virtual object associated with the second marker to the virtual object associated with the first marker.

5. The non-transitory computer-readable recording medium recording an information processing program, according to claim 1 , wherein the information processing program causes the computer to,

delete the association between the second marker and the virtual object after associating the virtual object associated with the second marker with the first marker.

6. The non-transitory computer-readable recording medium recording an information processing program, according to claim 1 , the information processing program further causing the computer to

set such a motion that a virtual object newly associated with the first marker moves to a predetermined position corresponding to the first marker.

7. The non-transitory computer-readable recording medium recording an information processing program, according to claim 1 , wherein the information processing program causes the computer to,

change the association of the first marker with one or more virtual objects by adding the virtual object associated with the second marker to

a first virtual object associated in advance with the first marker, and

place the first virtual object and the virtual object in the virtual space on the basis of the first marker.

8. An information processing apparatus comprising at least one processor configured to:

acquire a first captured image of a real space captured by an imaging device;

detect a first marker and a second marker in the captured image of the real space;

in response to the detecting,

identify, in a memory, a second association associating the second marker with a virtual object, wherein the second association is previously stored in the memory;

make a first association of the virtual object, associated in the memory with the second marker by the identified second association, with the first marker; and

store the first association in the memory;

generate, when the first marker is detected in a second captured image of the real space captured by the imaging device, an image of a virtual space in which the virtual object associated with the first marker is placed on a basis of the first marker based on the first association in the memory regardless of whether the second marker is detected in the second captured image or not;

display a composite image on a display device such that the image of the virtual space is visually recognizable while being superimposed on the second captured image; and

when the first marker is not detected for a predetermined period of time, reset the association of the first marker with the virtual object.

9. An information processing system comprising:

a computer;

an imaging device;

a display device; and

a first marker and a second marker placed in a real space, wherein

the computer includes at least one processor configured to perform operations comprising:

acquiring a first captured image of the real space captured by the imaging device;

detecting a first marker and a second marker in the captured image of the real space;

in response to the detecting,

identifying, in a memory, a second association associating the second marker with a virtual object, wherein the second association is previously stored in the memory;

making a first association of the virtual object, associated in the memory with the second marker by the identified second association, with the first marker; and

storing the first association in the memory;

generating, when the first marker is detected in a second captured image of the real space captured by the imaging device, an image of a virtual space in which the virtual object associated with the first marker is placed on a basis of the first marker based on the first association in the memory regardless of whether the second marker is detected in the second captured image or not;

displaying a composite image on the display device such that the image of the virtual space is visually recognizable while being superimposed on the second captured image; and,

when the first marker is not detected for a predetermined period of time, reset the association of the first marker with the virtual object.

10. An information processing method comprising:

acquiring, by a computer, a first captured image of a real space captured by an imaging device;

detecting, by the computer, a first marker and a second marker in the captured image of the real space;

in response to the detecting,

identifying, in a memory, a second association associating the second marker with a virtual object, wherein the second association is previously stored in the memory;

making a first association of a virtual object, associated in the memory with the second marker by the identified second association, with the first marker; and

storing the first association in the memory;

generating, by the computer when the first marker is detected in a second captured image of the real space captured by the imaging device, an image of a virtual space in which the virtual object associated with the first marker is placed on a basis of the first marker based on the first association in the memory regardless of whether the second marker is detected in the second captured image or not;

displaying, by the computer, a composite image on a display device such that the image of the virtual space is visually recognizable while being superimposed on the second captured image; and

when the first marker is not detected for a predetermined period of time, reset the association of the first marker with the virtual object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2014
From: HAYAKAWA, TAKESHI; KOGA, NAOKI
To: NINTENDO CO., LTD.
Reel/Frame 032831/0059 →
Priority Claims (1)
JP 2013-217638 · Oct 18, 2013 · national
Continuity (1)
Related Publication 20150109336A1 · Apr 23, 2015