IP Library › Granted Patent US 12,602,053
Granted Patent B2
US 12,602,053 · App. 18/265,475 · Granted Apr 14, 2026

Information processing apparatus, moving body control system, control method, and non-transitory computer-readable medium

Inventor: Takayuki Suzuki (Tokyo, JP)
Assignee: NEC CORPORATION
G05D1/2435G06T7/70G06T15/00G05D2111/10G06T2207/30244G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,602,053
App. No.
18/265,475
Granted
Apr 14, 2026
Kind
B2
Abstract

The information processing apparatus includes an extraction unit configured to extract at least one first photographed image, the first photographed image being similar to a second photographed image which is photographed by using a second photographing apparatus mounted on a moving apparatus, the moving apparatus being moving in a predetermined region, from a plurality of first photographed images which are photographed by using a first photographing apparatus for creating a three-dimensional image of the predetermined region, an estimation unit configured to estimate a first photographing orientation of the first photographing apparatus, the first photographing apparatus photographing the first photographed image which is extracted, and a second photographing orientation of the second photographing apparatus at a time when the second photographed image is photographed, and a control unit configured to control an action of the moving apparatus based on the first photographing orientation and the second photographing orientation.

Claims (26)

1 . An information processing apparatus comprising:

at least one memory storing instructions, and

at least one processor configured to execute the instructions to;

extract at least one first photographed image, the first photographed image being similar to a second photographed image which is photographed by using a second photographing apparatus mounted on a moving apparatus, the moving apparatus being moving in a predetermined region, from a plurality of first photographed images which are photographed by using a first photographing apparatus for creating a three-dimensional image of the predetermined region;

estimate a first photographing orientation of the first photographing apparatus, the first photographing apparatus photographing the first photographed image which is extracted, and a second photographing orientation of the second photographing apparatus at a time when the second photographed image is photographed; and

control an action of the moving apparatus based on the first photographing orientation and the second photographing orientation, wherein

the first photographing orientation is a first angle of a photographing direction of the first photographing apparatus with respect to a specific direction, and the second photographing orientation is a second angle of a photographing direction of the second photographing apparatus with respect to the specific direction, and

the at least one processor is further configured to execute the instructions to decrease a speed of the moving apparatus in a case where a difference between the first angle and the second angle is greater than a threshold value defined in advance.

2 . The information processing apparatus according to claim 1 , wherein the at least one processor is further configured to execute the instructions to

change a speed of the moving apparatus based on the first photographing orientation and the second photographing orientation.

3 . The information processing apparatus according to claim 1 , wherein the at least one processor is further configured to execute the instructions to

increase the speed of the moving apparatus in a case where the difference between the first angle and the second angle is smaller than a threshold value defined in advance.

4 . The information processing apparatus according to claim 1 ,

wherein the three-dimensional image is generated by using SfM (structure from motion).

5 . A control method executed in an information processing apparatus, the control method comprising:

extracting at least one first photographed image, the first photographed image being similar to a second photographed image which is photographed by using a second photographing apparatus mounted on a moving apparatus, the moving apparatus being moving in a predetermined region, from a plurality of first photographed images which are photographed by using a first photographing apparatus for creating a three-dimensional image of the predetermined region;

estimating a first photographing orientation of the first photographing apparatus, the first photographing apparatus photographing the first photographed image which is extracted, and a second photographing orientation of the second photographing apparatus at a time when the second photographed image is photographed; and

controlling an action of the moving apparatus based on the first photographing orientation and the second photographing orientation, wherein

the first photographing orientation is a first angle of a photographing direction of the first photographing apparatus with respect to a specific direction, and the second photographing orientation is a second angle of a photographing direction of the second photographing apparatus with respect to the specific direction, and

in controlling the action of the moving apparatus, a speed of the moving apparatus is decreased in a case where a difference between the first angle and the second angle is greater than a threshold value defined in advance.

6 . A non-transitory computer-readable medium storing a program, the program causing a computer to execute:

extracting at least one first photographed image, the first photographed image being similar to a second photographed image which is photographed by using a second photographing apparatus mounted on a moving apparatus, the moving apparatus being moving in a predetermined region, from a plurality of first photographed images which are photographed by using a first photographing apparatus for creating a three-dimensional image of the predetermined region;

estimating a first photographing orientation of the first photographing apparatus, the first photographing apparatus photographing the first photographed image which is extracted, and a second photographing orientation of the second photographing apparatus at a time when the second photographed image is photographed; and

controlling an action of the moving apparatus based on the first photographing orientation and the second photographing orientation, wherein

the first photographing orientation is a first angle of a photographing direction of the first photographing apparatus with respect to a specific direction, and the second photographing orientation is a second angle of a photographing direction of the second photographing apparatus with respect to the specific direction, and

in controlling the action of the moving apparatus, a speed of the moving apparatus is decreased in a case where a difference between the first angle and the second angle is greater than a threshold value defined in advance.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 6, 2023
From: SUZUKI, TAKAYUKI
To: NEC CORPORATION
Reel/Frame 063863/0955 →
Continuity (1)
Related Publication 20240118707A1 · Apr 11, 2024
References Cited (28)
US 20110243455A1 · Miyajima · 2011 [cited by applicant]
US 20160078288A1 · Takatani · 2016 [cited by examiner]
US 20170291491A1 · Kamitani et al. · 2017 [cited by applicant]
US 20170291492A1 · Kamitani et al. · 2017 [cited by applicant]
US 20170292596A1 · Kamitani et al. · 2017 [cited by applicant]
US 20200341470A1 · Maeda et al. · 2020 [cited by applicant]
US 20210350576A1 · Jiang · 2021 [cited by examiner]
US 20220333927A1 · Rosenblum · 2022 [cited by examiner]
US 20230068001A1 · Ali · 2023 [cited by examiner]
US 20250067572A1 · Taieb · 2025 [cited by examiner]
JP 2006003263A · 2006 [cited by applicant]
JP 2009149194A · 2009 [cited by applicant]
JP 2011215973A · 2011 [cited by applicant]
JP 2015036840A · 2015 [cited by applicant]
JP 2016061604A · 2016 [cited by applicant]
JP 2017107425A · 2017 [cited by applicant]
JP 2017187136A · 2017 [cited by applicant]
JP 2019125345A · 2019 [cited by applicant]
JP 2019132664A · 2019 [cited by applicant]
JP 2019159520A · 2019 [cited by applicant]
JP 2020166702A · 2020 [cited by applicant]
WO 2013069147A1 · 2013 [cited by applicant]
WO 2019026761A1 · 2019 [cited by applicant]
WO 2019176083A1 · 2019 [cited by applicant]
JP Office Action for JP Application No. 2022-569348, mailed on Aug. 6, 2024 with English Translation. [cited by applicant]
International Search Report for PCT Application No. PCT/JP2020/046632, mailed on Mar. 16, 2021. [cited by applicant]
JP Office Action for JP Application No. 2022-569348, mailed on Feb. 4, 2025 with English Translation. [cited by applicant]
JP Official Communication for JP Application No. 2022-569348, mailed on Jun. 24, 2025 with English Translation. [cited by applicant]