IP Library › Granted Patent US 11,663,737
Granted Patent B2
US 11,663,737 · App. 16/850,339 · Granted May 30, 2023

Information processing apparatus and representative coordinate derivation method

Inventors: Kenzo Nishikawa (Tokyo, JP); Takanori Minamino (Kanagawa, JP)
Assignee: SONY INTERACTIVE ENTERTAINMENT INC.
G06T7/74G06T7/66A63F13/211A63F13/213A63F13/23A63F2300/105A63F2300/1025A63F2300/1093G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,663,737
App. No.
16/850,339
Granted
May 30, 2023
Kind
B2
Abstract

An information processing apparatus includes a captured image acquisition unit that acquires an image captured by imaging a device including plural markers. A marker image coordinate specification unit specifies a representative coordinate of each marker image from the captured image, and a position and posture derivation unit derives position information and posture information of the device using the representative coordinates of the marker images. The marker image coordinate specification unit specifies a first boundary box surrounding a region within which pixels having a first luminance or more continuously appear, specifies a second boundary box surrounding a region within which pixels having a second luminance or more continuously appear in the first boundary box, the second luminance being higher than the first luminance, and derives a representative coordinate of each marker image based on pixels in the first or second boundary box in response to the number of specified second boundary boxes.

Claims (27)

1. An information processing apparatus comprising:

a captured image acquisition unit configured to acquire an image captured by imaging a device that includes a plurality of markers; and

an estimation processing unit configured to estimate position information and posture information of the device on a basis of marker images in the captured image, wherein

the estimation processing unit includes

a marker image coordinate specification unit configured to specify a representative coordinate of each of the marker images from the captured image, and

a position and posture derivation unit configured to derive the position information and the posture information of the device using the representative coordinates of the marker images, and wherein

the marker image coordinate specification unit includes

a first boundary box specification unit configured to specify a first boundary box surrounding a region within which pixels having a luminance equal to or higher than a first luminance continuously appear,

a second boundary box specification unit configured to specify at least one second boundary box surrounding a region within which pixels having a luminance equal to or higher than a second luminance continuously appear in the first boundary box, the second luminance being higher than the first luminance,

wherein the at least one second boundary box is contained within the first boundary box, and

a representative coordinate derivation unit configured to derive the representative coordinate of each of the marker images on a basis of pixels in the first boundary box or the second boundary box in response to the number of second boundary boxes specified by the second boundary box specification unit.

2. The information processing apparatus according to claim 1 , wherein the representative coordinate derivation unit derives the representative coordinate of each of the marker images on a basis of pixels having a luminance equal to or higher than a third luminance within the first boundary box or the at least one second boundary box.

3. The information processing apparatus according to claim 1 , wherein the representative coordinate is a gravity center coordinate.

4. The information processing apparatus according to claim 1 , wherein, where the second boundary box specification unit specifies only the at least one second boundary box, the representative coordinate derivation unit derives a representative coordinate of one marker image on a basis of pixels in the first boundary box, and

where the second boundary box specification unit specifies two or more second boundary boxes, the representative coordinate derivation unit derives representative coordinates of two or more marker images on a basis of pixels in the second boundary boxes.

5. The information processing apparatus according to claim 1 , wherein, where a ratio between an average luminance in the first boundary box and an average luminance in a predetermined region on an outside of the first boundary box is lower than a predetermined value, the first boundary box specification unit discards the first boundary box.

6. The information processing apparatus according to claim 1 , wherein, where a ratio between an average luminance in the second boundary box and an average luminance in a predetermined region on an outside of the at least one second boundary box is lower than a predetermined value, the second boundary box specification unit discards the second boundary box.

7. A representative coordinate derivation method for deriving a representative coordinate of a marker image included in a captured image, comprising:

specifying a first boundary box surrounding a region within which pixels having a luminance equal to or higher than a first luminance continuously appear;

specifying a second boundary box surrounding a region within which pixels having a luminance equal to or higher than a second luminance continuously appear in the first boundary box, the second luminance being higher than the first luminance,

wherein the second boundary box is contained within the first boundary box; and

deriving the representative coordinate of the marker image on a basis of pixels in the first boundary box or the second boundary box in response to the number of specified second boundary boxes.

8. A non-transitory computer readable medium having stored thereon a program for a computer, performing a process, comprising:

specifying a first boundary box surrounding a region within which pixels having a luminance equal to or higher than a first luminance continuously appear in a captured image;

specifying a second boundary box surrounding a region within which pixels having a luminance equal to or higher than a second luminance continuously appear in the first boundary box, the second luminance being higher than the first luminance,

wherein the second boundary box is contained within the first boundary box; and

deriving a representative coordinate of a marker image on a basis of pixels in the first boundary box or the second boundary box in response to the number of specified second boundary boxes.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2020
From: NISHIKAWA, KENZO; MINAMINO, TAKANORI
To: SONY INTERACTIVE ENTERTAINMENT INC.
Reel/Frame 052416/0853 →
Priority Claims (1)
JP JP2019-083060 · Apr 24, 2019 · national
Continuity (1)
Related Publication 20200342624A1 · Oct 29, 2020