IP Library Granted Patent US 10,169,880
Granted Patent B2
US 10,169,880 · App. 15/324,067 · Granted Jan 1, 2019

Information processing apparatus, information processing method, and program

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,169,880
App. No.
15/324,067
Granted
Jan 1, 2019
Kind
B2
Abstract

There is provided an information processing apparatus that self position estimation with high robustness is possible, the information processing apparatus including: a tracking unit, a region estimation unit, and an estimation processing unit. The tracking unit that acquires an image captured by an image capture unit disposed at a moving object, and corresponds characteristic points included in the image captured before movement and the image captured after the movement, the moving object moving accompanying a rotation motion. The region estimation unit that acquires information about the movement, and estimates regions where two-dimensional positions of the characteristic points are less changed viewed from the moving object before and after the movement of the moving object on the basis of the information. The estimation processing unit that performs self position estimation of the moving object using the characteristic points within the regions corresponded by the tracking unit.

Claims (61)

1. An information processing apparatus, comprising:

a tracking unit that acquires an image captured by an image capture unit disposed at a moving object, and corresponds characteristic points included in the image captured before movement and the image captured after the movement, the moving object moving accompanying a rotation motion;

a region estimation unit that acquires information about the movement, and estimates regions where two-dimensional positions of the characteristic points are less changed viewed from the moving object before and after the movement of the moving object on the basis of the information; and

an estimation processing unit that performs self position estimation of the moving object using the characteristic points within the regions corresponded by the tracking unit,

wherein the tracking unit, the image capture unit, the region estimation unit, and the estimation processing unit are each implemented via at least one processor.

2. The information processing apparatus according to claim 1 , wherein

the region estimation unit calculates a rotation axis of the rotation motion, and estimates the regions using the rotation axis.

3. The information processing apparatus according to claim 2 , wherein

the image capture unit includes a plurality of camera mechanisms having optical axes that are mutually not in parallel,

the region estimation unit selects the camera mechanism having the optical axis where the angle between the rotation axis and the optical axis is smallest among the plurality of camera mechanisms, and

the estimation processing unit performs the self position estimation of the moving object using the characteristic points included in the image captured by the camera mechanism selected by the region estimation unit.

4. The information processing apparatus according to claim 3 , further comprising:

a data generation unit that extracts the characteristic points included in the image captured by the camera mechanism selected by the region estimation unit from the characteristic points corresponded by the tracking unit, wherein

the estimation processing unit performs the self position estimation of the moving object using the characteristic points extracted by the data generation unit,

wherein the data generation unit is implemented via at least one processor.

5. The information processing apparatus according to claim 3 , wherein

the tracking unit corresponds the characteristic points included in the image captured by the camera mechanism selected by the region estimation unit.

6. The information processing apparatus according to claim 2 , wherein

the region estimation unit estimates the regions such that the rotation axis passes through the regions.

7. The information processing apparatus according to claim 6 , wherein

the image capture unit has a viewing angle of 90° or more.

8. The information processing apparatus according to claim 6 , further comprising:

a data generation unit that limits a processing region of the image within the regions, wherein

the estimation processing unit performs the self position estimation of the moving object using the characteristic points included in the processing region,

wherein the data generation unit is implemented via at least one processor.

9. The information processing apparatus according to claim 8 , wherein

the data generation unit extracts the characteristic points included in the processing region from the characteristic points corresponded by the tracking unit, and

the estimation processing unit performs the self position estimation of the moving object using the characteristic points extracted by the data generation unit.

10. The information processing apparatus according to claim 8 , wherein

the tracking unit corresponds the characteristic points included in the processing region.

11. The information processing apparatus according to claim 8 , wherein

the region estimation unit enlarges the processing region, when the angular velocity of the rotation motion is great.

12. The information processing apparatus according to claim 8 , wherein

the region estimation unit enlarges the processing region, when the movement accompanies a translation motion.

13. The information processing apparatus according to claim 1 , wherein

the tracking unit sets tracking scores that show a degree of coincidence for the characteristic points in the image captured before the movement and the image captured after the movement for the every corresponded characteristic points, and

the estimation processing unit performs the self position estimation of the moving object using the characteristic points having the high tracking scores.

14. The information processing apparatus according to claim 13 , wherein

the tracking unit sets high the tracking scores of the characteristic points within a central region of at least one of the image captured before the movement and the image captured after the movement.

15. The information processing apparatus according to claim 1 , wherein

the information is generated using at least one of a gyro sensor, a geomagnetic sensor, an acceleration sensor, a sound source direction estimation device and Wi-Fi.

16. The information processing apparatus according to claim 1 , further comprising:

a monitoring unit that monitors the moving object by the information, wherein

the estimation processing unit performs self position estimation of the moving object independent of the self position estimation on the basis of the result of the monitoring by the monitoring unit,

wherein the monitoring unit is implemented via at least one processor.

17. The information processing apparatus according to claim 16 , wherein

the monitoring unit estimates a motion model of the moving object, and

the estimation processing unit performs the self position estimation of the moving object using the motion model estimated by the monitoring unit.

18. The information processing apparatus according to claim 1 , further comprising:

a head mount display having the image capture unit and a detection unit being capable of generating the information, the head mount display being configured to be mountable to a head of a user as the moving object,

wherein the detection unit is implemented via at least one processor.

19. An information processing method, comprising:

capturing an image by an image capture unit, wherein the image capture unit is implemented via at least one processor and disposed at a moving object that moves accompanying a rotation motion;

corresponding characteristic points included in the image captured before movement and the image captured after the movement;

generating information about the movement;

estimating regions where two-dimensional positions of the characteristic points are less changed viewed from the moving object before and after the movement of the moving object on the basis of the information; and

performing self position estimation of the moving object using the corresponded characteristic points within the regions.

20. A non-transitory computer-readable medium having embodied thereon a program, which when executed by one or more processors of an information processing apparatus causes the information processing apparatus to execute a method, the method comprising:

acquiring an image captured by an image capture unit, wherein the image capture unit is implemented via at least one processor and disposed at a moving object, and corresponding characteristic points included in the image captured before movement and the image captured after the movement, the moving object moving accompanying a rotation motion;

acquiring information about the movement, and estimating regions where two-dimensional positions of the characteristic points are less changed viewed from the moving object before and after the movement of the moving object on the basis of the information; and

performing self position estimation of the moving object using the corresponded characteristic points within the regions.

Assignments (2)
CHANGE OF NAME Recorded Dec 17, 2025
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 073986/0571 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 5, 2017
From: HOMMA, SHUNICHI; KAINO, AKIHIKO; KASHITANI, TATSUKI; FUKUCHI, MASAKI
To: SONY CORPORATION
Reel/Frame 041261/0474 →