IP Library › Granted Patent US 11,989,910
Granted Patent B2
US 11,989,910 · App. 17/614,177 · Granted May 21, 2024

Moving body and position estimation method

Inventors: Yuya Yamaguchi (Tokyo, JP); Makoto Daniel Tokunaga (Tokyo, JP)
Assignee: SONY GROUP CORPORATION
G06T7/74G06T7/529G06T7/593H04N13/204H04N13/296H04N23/69G01C21/1656G06T2207/10032G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,989,910
App. No.
17/614,177
Granted
May 21, 2024
Kind
B2
Abstract

The present disclosure relates to a moving body, a position estimation method, and a program capable of achieving high accuracy of self-position estimation. An imaging control unit sets a zoom parameter of an imaging unit having a zoom lens according to at least any one of an altitude or a moving speed of its own machine, and a self-position estimation unit estimates a self-position on the basis of an image captured by the imaging unit in which the zoom parameter is set. Technology according to the present disclosure can be applied to, for example, a moving body such as a drone.

Claims (50)

1. A moving body, comprising:

an imaging unit that includes a zoom lens;

an imaging control unit configured to:

set a zoom parameter of the imaging unit based on at least one of an altitude or a moving speed of the moving body; and

adjust the zoom parameter based on an index value of disparity of a plurality of feature points on an image captured by the imaging unit, wherein the zoom parameter is adjusted so that an average value of the disparity of the plurality of feature points becomes a value within a specific range; and

a self-position estimation unit configured to estimate a position of the moving body based on the image captured by the imaging unit in which the zoom parameter is set.

2. The moving body according to claim 1 ,

wherein the imaging control unit is further configured to change the zoom parameter so that a viewing angle decreases as the altitude of the moving body increases.

3. The moving body according to claim 1 ,

wherein the imaging control unit is further configured to adjust the zoom parameter so that a viewing angle increases as the moving speed of the moving body increases.

4. The moving body according to claim 1 ,

wherein the imaging control unit is further configured to adjust the zoom parameter so that a representative value of the disparity of the plurality of feature points becomes a value within the specific range.

5. The moving body according to claim 1 , wherein

the imaging unit includes a monocular camera, and

the imaging control unit is further configured to adjust the zoom parameter based on an index value between different frames.

6. The moving body according to claim 1 , wherein

the imaging unit includes a stereo camera, and

the imaging control unit is further configured to adjust the zoom parameter based on an index value between stereo images.

7. The moving body according to claim 1 , wherein the imaging control unit is further configured to adjust the zoom parameter based on an overlap ratio between frames of the image captured by the imaging unit.

8. The moving body according to claim 7 ,

wherein the imaging control unit is further configured to adjust the zoom parameter so as to increase a viewing angle in a case where the overlap ratio is equal to or less than a specific threshold value.

9. The moving body according to claim 7 ,

wherein the overlap ratio is expressed by using a number of pixels of a texture region matched between the frames.

10. The moving body according to claim 7 ,

wherein the overlap ratio is expressed by using a number of feature points matched between the frames.

11. The moving body according to claim 1 , further comprising:

a positioning device different from the imaging unit,

wherein the self-position estimation unit is further configured to estimate the position based on a positioning result obtained by the positioning device while the zoom parameter changes.

12. The moving body according to claim 11 ,

wherein the self-position estimation unit is further configured to estimate the position by integrating self-position estimation results using positioning results obtained by a plurality of positioning devices.

13. The moving body according to claim 1 ,

wherein the zoom parameter includes a drive control value of the zoom lens.

14. The moving body according to claim 1 ,

wherein the zoom parameter includes an internal parameter and an external parameter of the imaging unit.

15. The moving body according to claim 14 ,

wherein the internal parameter includes a distortion coefficient of the zoom lens.

16. A position estimation method, comprising:

setting a zoom parameter of an imaging unit based on at least one of an altitude or a moving speed of a moving body including the imaging unit having a zoom lens;

adjusting the zoom parameter based on an index value of disparity of a plurality of feature points on an image captured by the imaging unit, wherein the zoom parameter is adjusted so that an average value of the disparity of the plurality of feature points becomes a value within a specific range; and

estimating a position of the moving body based on the image captured by the imaging unit in which the zoom parameter is set.

17. A non-transitory computer readable medium having stored thereon computer-executable instructions, which when executed by a computer, cause the computer to execute operations, the operations comprising:

setting a zoom parameter of an imaging unit based on at least one of an altitude or a moving speed of a moving body including the imaging unit having a zoom lens;

adjusting the zoom parameter based on an index value of disparity of a plurality of feature points on an image captured by the imaging unit, wherein the zoom parameter is adjusted so that an average value of the disparity of the feature points becomes a value within a specific range; and

estimating a position of the moving body based on the image captured by the imaging unit in which the zoom parameter is set.

18. A moving body, comprising:

an imaging unit that includes a zoom lens;

an imaging control unit configured to:

set a zoom parameter of the imaging unit based on at least one of an altitude or a moving speed of the moving body; and

adjust the zoom parameter based on an overlap ratio between frames of an image captured by the imaging unit; and

a self-position estimation unit configured to estimate a position of the moving body based on the image captured by the imaging unit in which the zoom parameter is set.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2021
From: YAMAGUCHI, YUYA; TOKUNAGA, MAKOTO DANIEL
To: SONY GROUP CORPORATION
Reel/Frame 058486/0255 →
Priority Claims (1)
JP 2019-105206 · Jun 5, 2019 · national
Continuity (1)
Related Publication 20220222851A1 · Jul 14, 2022