IP Library › Granted Patent US 12,747,565
Granted Patent B2
US 12,747,565 · App. 18/872,283 · Granted Sep 29, 2026

System and program

Inventor: Hayami Kawate (Atsugi, JP)
Assignee: Sony Olympus Medical Solutions Inc.
E02F9/264G05D1/622G06T7/60G05D2105/05G05D2111/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,747,565
App. No.
18/872,283
Granted
Sep 29, 2026
Kind
B2
Abstract

A system detects a traveling obstacle region that is a region that obstructs traveling of a work machine. The system includes a region angle detector, a region height detector, an angle obstacle region detector, a height obstacle region detector, and a traveling obstacle region detector. The region angle detector detects an angle of a traveling surface based on a distance image around the work machine. The region height detector detects height of the traveling surface based on the distance image. The angle obstacle region detector detects an angle obstacle region that is an obstacle region based on the detected angle. The height obstacle region detector detects a height obstacle region that is an obstacle region based on the detected height. The traveling obstacle region detector detects a traveling obstacle region based on the detected angle obstacle region and the detected height obstacle region.

Claims (33)

1 . A system that detects a traveling obstacle region that is a region that obstructs traveling of a work machine, the system comprising:

processing circuitry configured to

detect an angle of a traveling surface based on a distance image around the work machine;

detect a height of the traveling surface based on the distance image;

detect an angle obstacle region that is an obstacle region based on the detected angle;

detect a height obstacle region that is an obstacle region based on the detected height;

detect a traveling obstacle region based on the detected angle obstacle region and the detected height obstacle region,

wherein the processing circuitry is further configured to detect the traveling obstacle region by excluding a region having a predetermined height in the detected angle obstacle region and by excluding a region having a predetermined width in the detected height obstacle region; and

output the detected traveling obstacle region to an external device, the detected traveling obstacle region being a region that obstructs traveling of the work machine; and

control the work machine based on the detected traveling obstacle region.

2 . The system according to claim 1 , wherein the processing circuitry is further configured to

detect the angle obstacle region based on a threshold of the angle.

3 . The system according to claim 2 , wherein processing circuitry is further configured to

detect the angle obstacle region based on the threshold adjusted according to information concerning the work machine.

4 . The system according to claim 2 , wherein processing circuitry is further configured to

detect the angle obstacle region based on the threshold adjusted according to information concerning a surrounding environment.

5 . The system according to claim 1 , wherein the processing circuitry is further configured to

detect the height obstacle region based on a threshold of the height.

6 . The system according to claim 1 , wherein the processing circuitry is further configured to

detect an object placed on the traveling surface, and

detect a region of the detected object as the traveling obstacle region.

7 . The system according to claim 1 , wherein the processing circuitry is further configured to

detect an occlusion region that is a region where the angle and the height on the traveling surface cannot be detected, and

detect the detected occlusion region as the traveling obstacle region.

8 . A non-transitory computer-readable storage medium storing computer-readable instructions for detecting a traveling obstacle region that is a region that obstructs traveling of a work machine thereon which, when executed by a computer, cause the computer to perform a method, the method comprising:

detecting an angle of a traveling surface based on a distance image around the work machine;

detecting height of the traveling surface based on the distance image;

detecting an angle obstacle region that is an obstacle region based on the detected angle;

detecting a height obstacle region that is an obstacle region based on the detected height; and

detecting the traveling obstacle region based on the detected angle obstacle region and the detected height obstacle region;

wherein the detected traveling obstacle region, excluding a region having a predetermined height in the detected angle obstacle region and excluding a region having a predetermined width in the detected height obstacle region; and

outputting the detected traveling obstacle region to an external device, the detected traveling obstacle region being a region that obstructs traveling of the work machine; and

controlling the work machine based on the detected traveling obstacle region.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 6, 2024
From: KAWATE, HAYAMI
To: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
Reel/Frame 069504/0734 →
Priority Claims (1)
JP 2022-107769 · Jul 4, 2022 · national
Continuity (1)
Related Publication 20250361698A1 · Nov 27, 2025
References Cited (75)
US 3716833A · Roth · 1973 [cited by examiner]
US 4954962A · Evans, Jr. · 1990 [cited by examiner]
US 5040116A · Evans, Jr. · 1991 [cited by examiner]
US 5555018A · von Braun · 1996 [cited by examiner]
US 5587929A · League · 1996 [cited by examiner]
US 6055042A · Sarangapani · 2000 [cited by examiner]
US 6268803B1 · Gunderson · 2001 [cited by examiner]
US 8170787B2 · Coats · 2012 [cited by examiner]
US 8280621B2 · Edwards · 2012 [cited by examiner]
US 8688332B2 · Reiners · 2014 [cited by examiner]
US 9291709B2 · Mitsuta · 2016 [cited by examiner]
US 9928648B2 · Ambrus · 2018 [cited by examiner]
US 10037613B1 · Becker · 2018 [cited by examiner]
US 10613218B2 · Ichinose · 2020 [cited by examiner]
US 10909411B2 · Sano · 2021 [cited by examiner]
US 10976438B2 · Tasaki · 2021 [cited by examiner]
US 11037320B1 · Ebrahimi Afrouzi · 2021 [cited by examiner]
US 11348269B1 · Ebrahimi Afrouzi · 2022 [cited by examiner]
US 11530119B2 · Kosaka · 2022 [cited by examiner]
US 20010018640A1 · Matsunaga · 2001 [cited by examiner]
US 20020075180A1 · Sakai · 2002 [cited by examiner]
US 20050073433A1 · Gunderson · 2005 [cited by examiner]
US 20080071475A1 · Takaoka · 2008 [cited by examiner]
US 20080266167A1 · Baumann · 2008 [cited by examiner]
US 20100076708A1 · Hukkeri · 2010 [cited by examiner]
US 20120271504A1 · Reiners · 2012 [cited by examiner]
US 20130282224A1 · Yazaki · 2013 [cited by examiner]
US 20140012453A1 · Johnson · 2014 [cited by examiner]
US 20170225336A1 · Deyle · 2017 [cited by examiner]
US 20170229019A1 · Ichinose · 2017 [cited by examiner]
US 20170277197A1 · Liao · 2017 [cited by examiner]
US 20170332871A1 · Sung · 2017 [cited by examiner]
US 20180084708A1 · Neitemeier · 2018 [cited by examiner]
US 20190012798A1 · Amano · 2019 [cited by examiner]
US 20190120633A1 · Afrouzi · 2019 [cited by examiner]
US 20190241408A1 · Strahl · 2019 [cited by examiner]
US 20200338733A1 · Dupuis · 2020 [cited by examiner]
US 20200375095A1 · Koto · 2020 [cited by examiner]
US 20210163270A1 · Kosaka · 2021 [cited by examiner]
US 20210197712A1 · Korjus · 2021 [cited by examiner]
US 20220066456A1 · Ebrahimi Afrouzi · 2022 [cited by examiner]
US 20220175210A1 · Choi · 2022 [cited by examiner]
US 20220374639A1 · Nakagawa · 2022 [cited by examiner]
US 20230009071A1 · Zhu · 2023 [cited by examiner]
US 20230017850A1 · Thorson · 2023 [cited by examiner]
US 20250013245A1 · Nishibeppu · 2025 [cited by examiner]
US 20250067875A1 · Sawahashi · 2025 [cited by examiner]
US 20250306201A1 · Honda · 2025 [cited by examiner]
US 20250328147A1 · Cheng · 2025 [cited by examiner]
US 20250361698A1 · Kawate · 2025 [cited by examiner]
US 20260015833A1 · Dianics · 2026 [cited by examiner]
US 20260015834A1 · Dianics · 2026 [cited by examiner]
US 20260021998A1 · Ulbrich · 2026 [cited by examiner]
CN 106436544A · 2017 [cited by examiner]
CN 111928782A · 2020 [cited by examiner]
EP 0358628A2 · 1990 [cited by examiner]
EP 3190576A1 · 2017 [cited by examiner]
EP 3808694A1 · 2021 [cited by examiner]
EP 4560426A1 · 2025 [cited by examiner]
EP 4560426B1 · 2026 [cited by examiner]
JP 09128043A · 1997 [cited by examiner]
JP 2006146376A · 2006 [cited by applicant]
JP 2015219802A · 2015 [cited by applicant]
JP 2018095365A · 2018 [cited by applicant]
JP 2018113937A · 2018 [cited by examiner]
JP 6677513B2 · 2020 [cited by examiner]
JP 2021077003A · 2021 [cited by examiner]
JP 2023169512A · 2023 [cited by examiner]
KR 20180123725A · 2018 [cited by examiner]
WO WO2023116914A1 · 2023 [cited by examiner]
“Lidar based off-road negative obstacle detection and analysis;” Larson, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC) (2011, pp. 192-197); Dec. 20, 2011. (Year: 2011). [cited by examiner]
“Adaptive Obstacle Detection for Mobile Robots in Urban Environments Using Downward-Looking 2D LiDAR;” Pang et al., Sensors (Basel, Switzerland), 18(6), 1749; May 29, 2018. (Year: 2018). [cited by examiner]
“Obstacle Detection and Height Estimation Using Fisheye Stereo Camera Considering Intensity Information,” Chikugo et al., 2024 IEEE/SICE International Symposium on System Integration (SII) (2024, pp. 147-152); Jan. 8, 2… [cited by examiner]
JP 2021077003 A—Machine Translation (Year: 2021). [cited by examiner]
International Search Report and Written Opinion mailed on Aug. 1, 2023, received for PCT Application PCT /JP2023/023283, filed on Jun. 23, 2023, 10 pages including English Translation. [cited by applicant]