IP Library Granted Patent US 10,783,654
Granted Patent B2
US 10,783,654 · App. 16/066,366 · Granted Sep 22, 2020

Information processing apparatus, information processing method, and recording medium

Inventor: Shingo Tsurumi (Saitama, JP)
Assignee: Sony Corporation
G06T7/62G01B11/002G01B11/02G01B11/026G02B27/0172G06T1/00G06T7/50G06T7/60G06T7/70G06T19/00G06T19/006G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,783,654
App. No.
16/066,366
Granted
Sep 22, 2020
Kind
B2
Abstract

An information processing apparatus includes an acquisition section that acquires an image of a real object in a real space captured by a predetermined imaging section, and a measurement result of a distance to the real object by a predetermined distance measuring section, and an estimation section that estimates a size of the real object in the real space on the basis of a size of the real object in the image and the measurement result of the distance, and by comparing the estimation result of the size to a plurality of preset size candidates, specifies the size of the real object in the real space.

Claims (52)

1. An information processing apparatus, comprising:

an acquisition section configured to acquire an image of a real object in a real space and a measurement result of a distance between the information processing apparatus and the real object, wherein

an imaging section captures the image of the real object, and

a distance measuring section measures the distance between the information processing apparatus and the real object; and

an estimation section configured to:

estimate a size of the real object based on a size of the real object in the image and the measurement result of the distance,

specify the size of the real object based on a comparison of an estimation result of the size to a plurality of size candidates; and

control an execution time of a first process related to the estimation of the size of the real object in the real space based on the measurement result of the distance.

2. The information processing apparatus according to claim 1 , further comprising a recognition section configured to:

estimate a positional relationship between the real object and the imaging section based on the specified size of the real object; and

recognize at least one of a position of the imaging section or a direction of the imaging section based on the estimation result.

3. The information processing apparatus according to claim 2 , wherein the recognition section is further configured to correct a recognition result of at least one of the position of the imaging section or the direction of the imaging section based on the estimation result of the positional relationship between the real object and the imaging section.

4. The information processing apparatus according to claim 2 , comprising a display control section configured to:

control a display of a virtual object, wherein the virtual object is superimposed onto the real space; and

control at least one of a display position of the virtual object or a display size of the virtual object based on the recognition of at least one of the position of the imaging section or the direction of the imaging section.

5. The information processing apparatus according to claim 1 , wherein the estimation section is further configured to correct the measurement result of the distance based on the specified size of the real object.

6. The information processing apparatus according to claim 1 , wherein

the acquisition section is further configured to acquire the image of the real object that includes a specific marker, and

the estimation section is further configured to estimate the size of the real object based on a size of the marker in the image and the measurement result of the distance.

7. The information processing apparatus according to claim 1 , wherein

the estimation section is further configured to execute a second process related to the estimation of the size of the real object based on the acquisition of the image that includes the real object.

8. The information processing apparatus according to claim 1 , wherein the estimation section is further configured to:

estimate a change in at least one of a position of the imaging section or a direction of the imaging section based on a detection result of a specific detection section; and

control an execution timing of a third process related to the estimation of the size of the real object based on the estimation result.

9. The information processing apparatus according to claim 8 , wherein

the estimation section is further configured to execute the third process based on a prediction that indicates the real object is inside an angle of view of the imaging section, and

the prediction is based on the estimation result of the change in at least one of the position of the imaging section or the direction of the imaging section.

10. The information processing apparatus according to claim 1 , wherein the estimation section is further configured to execute the first process related to the estimation of the size of the real object in the real space based on the measurement result of the distance that is equal to or greater than a threshold value.

11. An information processing method, comprising:

acquiring, by a processor, an image of a real object in a real space and a measurement result of a distance between an information processing apparatus and the real object, wherein

an imaging section captures the image of the real object, and

a distance measuring sections measures the distance between the information processing apparatus and the real object;

estimating, by the processor, a size of the real object in the real space based on a size of the real object in the image and the measurement result of the distance;

specifying the size of the real object based on a comparison of an estimation result of the size to a plurality of size candidates; and

controlling an execution time of a process related to the estimation of the size of the real object in the real space based on the measurement result of the distance.

12. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by a processor, cause the processor to execute operations, the operations comprising:

acquiring an image of a real object in a real space and a measurement result of a distance between an information processing apparatus and the real object, wherein

an imaging section captures the image of the real object, and

a distance measuring section measures the distance between the information processing apparatus and the real object;

estimating a size of the real object based on a size of the real object in the image and the measurement result of the distance;

specifying the size of the real object based on a comparison of an estimation result of the size to a plurality of size candidates; and

controlling an execution time of a process related to the estimation of the size of the real object in the real space based on the measurement result of the distance.

13. An information processing apparatus, comprising:

an acquisition section configured to acquire an image of a real object in a real space and a measurement result of a distance between the information processing apparatus and the real object, wherein

an imaging section captures the image of the real object, and

a distance measuring section measures the distance between the information processing apparatus and the real object;

an estimation section configured to:

estimate a size of the real object based on a size of the real object in the image and the measurement result of the distance; and

specify the size of the real object based on a comparison of an estimation result of the size to a plurality of size candidates; and

a recognition section configured to:

estimate a positional relationship between the real object and the imaging section based on the specified size of the real object; and

recognize at least one of a position of the imaging section or a direction of the imaging section based on the estimation result.

Assignments (2)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 27, 2018
From: TSURUMI, SHINGO
To: SONY CORPORATION
Reel/Frame 046212/0267 →