IP Library › Granted Patent US 12,399,012
Granted Patent B2
US 12,399,012 · App. 17/178,090 · Granted Aug 26, 2025

Information processing device, information processing method, and storage medium

Inventor: Shinji Ohira (Tokyo, JP)
Assignee: Canon Kabushiki Kaisha
G01C21/20G01C25/00G07C5/0816
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,399,012
App. No.
17/178,090
Granted
Aug 26, 2025
Kind
B2
Abstract

Based on expected position information on a vehicle obtained based on input information input from a sensor when the vehicle makes a predetermined movement with a position/orientation of the sensor maintained relative to the vehicle, and position information on the vehicle estimated based on input information input from the sensor after the vehicle makes the predetermined movement, information related to a change of the position/orientation of the sensor relative to the vehicle after the vehicle makes the predetermined movement, from a held position/orientation, is output.

Claims (41)

1. A device comprising: at least one processor; and

a memory coupled to the at least one processor, the memory having instructions that, when executed by the processor, causes the at least one processor to function as:

an estimation unit configured to estimate, when a vehicle provided with a sensor makes a predetermined movement, first position information indicating positions of the vehicle based on input information of the sensor and an orientation of the sensor relative to the vehicle; and

an acquisition unit configured to acquire second position information indicating expected positions of the vehicle corresponding to the predetermined movement while maintaining an original orientation of the sensor relative to the vehicle held by a holding unit;

an output unit configured to output an amount of change between the orientation of the sensor relative to the vehicle when the vehicle has performed the predetermined movement and the original orientation, based on the first position information and the second position information,

wherein a control is performed to cause the orientation of the sensor to change by the amount of change.

2. The device according to claim 1 , wherein the output unit outputs output information indicating a difference in the position of the vehicle based on the first position information and the second position information.

3. The device according to claim 1 , wherein the output unit outputs output information indicating that the orientation of the sensor relative to the vehicle is the predetermined orientation of the sensor relative to the vehicle, when a difference in the position of the vehicle based on the first position information and the second position information is smaller than a predetermined threshold.

4. The device according to claim 1 , wherein the output unit outputs output information indicating that the orientation of the sensor relative to the vehicle is not the predetermined orientation of the sensor relative to the vehicle, when a difference in the position of the vehicle based on the first position information and the second position information is equal to or greater than a predetermined threshold.

5. The device according to claim 1 , wherein the output unit outputs, to a display device, output information indicating that the orientation of the sensor relative to the vehicle is not the predetermined orientation of the sensor relative to the vehicle, when a difference in the position of the vehicle based on the first position information and the second position information is equal to or greater than a predetermined threshold.

6. The device according to claim 1 , wherein the output unit outputs output information to make a display device display the position of the vehicle indicated by the first or the second position information, when a difference in the position of the vehicle based on the first position information and the second position information is equal to or greater than a predetermined threshold.

7. The device according to claim 1 , wherein the output unit outputs, to an audio output device, output information indicating that the orientation of the sensor relative to the vehicle is not the predetermined orientation of the sensor relative to the vehicle, when a difference in the position of the vehicle based on the first position information and the second position information is equal to or greater than a predetermined threshold.

8. The device according to claim 1 , wherein the output unit outputs, to a projection device or a display device, output information indicating the orientation of the sensor corresponding to the predetermined orientation of the sensor relative to the vehicle, when a difference in the position of the vehicle based on the first position information and the second position information is larger than a predetermined value.

9. The device according to claim 1 , wherein the output unit outputs output information differing depending on a magnitude of a difference in the position of the vehicle based on the first position information and the second position information based on a plurality of thresholds.

10. The device according to claim 8 , wherein the output unit outputs output information to a first output device when the difference in the position of the vehicle based on the first position information and the second position information is larger than a first threshold, and outputs the output information to a second output device when the difference in the position of the vehicle between the first position information and the second position information is larger than a second threshold that is smaller than the first threshold.

11. The device according to claim 1 ,

wherein the predetermined movement is a movement of the vehicle moving straight by a predetermined distance, and

wherein the output unit outputs output information indicating a change in an orientation of the sensor based on a difference in the position of the vehicle based on the first position information and the second position information.

12. The device according to claim 1 ,

wherein the predetermined movement is a movement of the vehicle turning by a predetermined angle, and

wherein the output unit outputs output information indicating a change in a position of the sensor based on a difference in the position of the vehicle based on the first position information and the second position information.

13. The device according to claim 1 , wherein the at least one processor further functions as an update unit configured to update the orientation of the sensor relative to the vehicle based on output information, when a difference in the position of the vehicle based on the first position information and the second position information is larger than a predetermined threshold.

14. The device according to claim 1 ,

wherein the at least one processor further functions as a measurement unit configured to measure a position of the sensor from the input information, based on map information obtained by measuring a movement route of the vehicle in advance, and

wherein the estimation unit estimates the position of the vehicle by converting the measured position or orientation of the sensor, based on the predetermined orientation of the sensor relative to the vehicle.

15. The device according to claim 1 , wherein the sensor is an image capturing device that captures an image of an object in an environment.

16. The device according to claim 1 , wherein the sensor is a range sensor that measures a distance between an object in an environment and the sensor.

17. A method comprising:

estimating, when a vehicle provided with a sensor makes a predetermined movement, first position information indicating positions of the vehicle based on input information of the sensor and an orientation of the sensor relative to the vehicle; and

acquiring second position information indicating expected positions of the vehicle corresponding to the predetermined movement while maintaining an original orientation of the sensor relative to the vehicle held by a holding unit;

outputting an amount of change in a between the orientation of the sensor relative to the vehicle when the vehicle has performed the predetermined movement and the original orientation, based on the first position information and the second position information,

wherein a control is performed to cause the sensor to change by the amount of change.

18. A-non-transitory computer-readable storage medium storing a computer executable program for causing a computer to perform a method, the method comprising:

estimating, when a vehicle provided with a sensor makes a predetermined movement, first position information indicating positions of the vehicle based on input information of the sensor and an orientation of the sensor relative to the vehicle; and

acquiring second position information indicating expected positions of the vehicle corresponding to the predetermined movement while maintaining an original orientation of the sensor relative to the vehicle held by a holding unit;

outputting an amount of change between the orientation of the sensor relative to the vehicle when the vehicle has performed the predetermined movement and the original orientation, based on the first position information and the second position information,

wherein a control is performed to cause the sensor to change by the amount of change.

19. The device according to claim 1 ,

wherein the at least one processor further functions as an acquisition unit configure to acquire the second position information indicating a trail of the vehicle corresponding to the predetermined movement, and

wherein the output unit outputs the vehicle based on the second position information acquired by the acquisition unit.

20. The device according to claim 1 , wherein the first position information indicates a trail of the amount of change from the predetermined orientation of the sensor based on the sensor information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 1, 2021
From: OHIRA, SHINJI
To: CANON KABUSHIKI KAISHA
Reel/Frame 056740/0059 →
Priority Claims (2)
JP 2020-027743 · Feb 21, 2020 · national
JP 2020-204117 · Dec 9, 2020 · national
Continuity (1)
Related Publication 20210262804A1 · Aug 26, 2021
References Cited (46)
US 9726754B2 · Massanell · 2017 [cited by examiner]
US 10088553B2 · Zeng · 2018 [cited by examiner]
US 10723281B1 · Briggs · 2020 [cited by examiner]
US 10788316B1 · Kalscheur · 2020 [cited by examiner]
US 10948569B2 · Zhou · 2021 [cited by examiner]
US 11119190B2 · Morinaga · 2021 [cited by examiner]
US 20080201033A1 · DeMersseman · 2008 [cited by examiner]
US 20140347486A1 · Okouneva · 2014 [cited by examiner]
US 20150025771A1 · Seo · 2015 [cited by examiner]
US 20150049193A1 · Gupta · 2015 [cited by examiner]
US 20150145965A1 · Livyatan · 2015 [cited by examiner]
US 20150276923A1 · Song · 2015 [cited by examiner]
US 20160037032A1 · Iwama · 2016 [cited by examiner]
US 20160209211A1 · Song · 2016 [cited by examiner]
US 20160236619A1 · Tanaka · 2016 [cited by examiner]
US 20160349062A1 · Campan · 2016 [cited by examiner]
US 20170103546A1 · Wang · 2017 [cited by examiner]
US 20170132808A1 · Heinonen · 2017 [cited by examiner]
US 20170146667A1 · Medagoda · 2017 [cited by examiner]
US 20170309042A1 · Tanaka · 2017 [cited by examiner]
US 20180282977A1 · Hiromatsu · 2018 [cited by examiner]
US 20190049566A1 · Adams · 2019 [cited by examiner]
US 20190118712A1 · Shigemura · 2019 [cited by examiner]
US 20190206060A1 · Matsumoto · 2019 [cited by examiner]
US 20200011969A1 · Noro · 2020 [cited by examiner]
US 20200019160A1 · McArthur · 2020 [cited by examiner]
US 20200056909A1 · Datta Gupta · 2020 [cited by examiner]
US 20200094677A1 · Hao · 2020 [cited by examiner]
US 20200200566A1 · Kim · 2020 [cited by examiner]
US 20200200870A1 · Nemati · 2020 [cited by examiner]
US 20200209369A1 · Koch · 2020 [cited by examiner]
US 20200380795A1 · Melen · 2020 [cited by examiner]
US 20210011483A1 · Li · 2021 [cited by examiner]
US 20210041875A1 · Nishiyama · 2021 [cited by examiner]
US 20210140795A1 · Jozsa · 2021 [cited by examiner]
US 20210156711A1 · Flade · 2021 [cited by examiner]
US 20210215505A1 · Castorena Martinez · 2021 [cited by examiner]
US 20210255211A1 · Szilágyi · 2021 [cited by examiner]
US 20210405641A1 · Agon · 2021 [cited by examiner]
US 20220172487A1 · Ewert · 2022 [cited by examiner]
US 20220365193A1 · Wetoschkin · 2022 [cited by examiner]
US 20230010175A1 · Kato · 2023 [cited by examiner]
JP 2009279677A · 2009 [cited by applicant]
JP 2019205066A · 2018 [cited by examiner]
JP 2019070983A · 2019 [cited by applicant]
Machine translation for JP2019205066A , Ohira Masakazu, May 23, 2018. [cited by examiner]