IP Library Granted Patent US 9,921,052
Granted Patent B2
US 9,921,052 · App. 14/491,064 · Granted Mar 20, 2018

Information processing device and information processing method

Inventor: Shoichi Ikenoue (Tokyo, JP)
Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
G01B11/14A63F13/06A63F13/213A63F13/422A63F13/428A63F13/655G06F3/017G06F3/0325G06K9/00288G06K9/2063G06T7/20G06T7/593G06T7/73H04N7/18G06T2207/10016G06T2207/10021G06T2207/10024G06T2207/20076G06T2207/30201G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,921,052
App. No.
14/491,064
Granted
Mar 20, 2018
Kind
B2
Abstract

An information processing device includes an image acquirer that acquires a shot image of an object having a marker, a marker detector that detects an image of the marker from the shot image, and an information processing section that executes information processing based on a detection result by the marker detector. The marker detector identifies the image of the marker among color regions that are extracted from the shot image and have predetermined colors based on the positional relationship between a region that is assumed when one color region of the color regions extracted is a marker and is covered by an image of an object having the marker and another color region extracted.

Claims (48)

1. An information processing device comprising:

an image acquirer configured to acquire a shot image of a plurality of input devices,

wherein each input devices has a marker comprising a light source, and wherein each marker has a predetermined same shape and a different color assigned to the light source by the information processing device prior to detection of the marker by the information processing device;

a marker detector configured to detect an image of each of the markers from the shot image; and

an information processing section configured to execute information processing based on a detection result by the marker detector,

wherein the marker detector identifies the image of each of the markers by:

for each of the different known colors of the markers,

extracting one or more regions from the shot image having each color;

sorting the extracted regions, for each of the different colors of the markers, in decreasing order of area;

eliminating any extracted regions not having the predetermined same shape; and

identifying the image of each of the markers using a remaining largest region of each of the different known colors.

2. The information processing device according to claim 1 , wherein the marker detector acquires a distance of each input device from a camera using a relative size of the images of the markers.

3. The information processing device according to claim 1 , wherein the marker detector further eliminates any extracted regions not located within a predetermined distance of a detected body part of a person holding the input device in the shot image.

4. The information processing device according to claim 2 , wherein the marker detector acquires distance of a person who is holding each input device from the camera and estimates the distance of the input device held by the person using the acquired distance of the person.

5. An information processing method comprising:

acquiring, by an information processing device a shot image of an input device having a marker from a camera,

storing the shot image in a memory,

wherein the marker has a known shape and a known color assigned to the marker by the information processing device, and

wherein the marker comprises a light source;

detecting an image of the marker from the shot image read out from the memory; and

executing information processing based on a detection result,

wherein the detection of an image of the marker includes:

extracting all regions in the shot image having the known color;

sorting the extracted region in decreasing order of area;

eliminating any extracted regions not having the predetermined same shape; and

identifying the image of the marker using a remaining largest region.

6. A non-transitory computer-readable recording medium in which a computer program is recorded, the computer program for a computer including:

acquiring a shot image of an input device having a marker,

wherein the marker comprises a light source,

and storing the shot image in a memory

wherein the marker has a known shape and a color which is assigned to the light source by the computer;

detecting an image of the marker from the shot image read out from the memory; and

executing information processing based on a detection result,

wherein the detection of an image of the marker includes:

extracting all regions in the shot image having the known color;

sorting the extracted region in decreasing order of area;

eliminating any extracted regions not having the predetermined same shape; and

identifying the image of the marker using a remaining largest region.

7. A non-transitory computer-readable recording medium in which a computer program is recorded, the computer program for a computer including:

acquiring a shot image of an input device having a marker and storing the shot image in a memory

wherein the marker has a known shape and a known color;

detecting an image of the marker from the shot image read out from the memory; and

executing information processing based on a detection result,

wherein the detection of an image of the marker includes:

extracting all regions in the shot image having the known color;

sorting the extracted region in decreasing order of area;

eliminating any extracted regions not having a) the predetermined same shape and b) completely surrounded by a region of black pixels; and

identifying the image of the marker using a remaining largest region.

Assignments (2)
CHANGE OF NAME Recorded Nov 22, 2017
From: SONY COMPUTER ENTERTAINMENT INC.
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 044197/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2014
From: IKENOUE, SHOICHI
To: SONY COMPUTER ENTERTAINMENT INC.
Reel/Frame 033777/0125 →
Priority Claims (1)
JP 2013-228137 · Nov 1, 2013 · national
Continuity (1)
Related Publication 20150124084A1 · May 7, 2015