IP Library Granted Patent US 12,709,846
Granted Patent B2
US 12,709,846 · App. 18/572,978 · Granted Aug 18, 2026

Road surface management device, road surface management method, and recording medium

Inventors: Chisato Sugawara (Tokyo, JP); Toshimichi Yokote (Tokyo, JP); Yosuke Kimura (Tokyo, JP)
Assignee: NEC CORPORATION
E01C23/01G01N21/8851G01N2021/8887
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,709,846
App. No.
18/572,978
Filed
Dec 21, 2023
Granted
Aug 18, 2026
Kind
B2
Art Unit
2672
USPC
382/100
Abstract

A road surface management device 1 includes a deterioration detection unit 2 , a deterioration index calculation unit 3 , and a display processing unit 4 . The deterioration detection unit 2 detects a crack in a road surface on the basis of an image of the road surface acquired from a vehicle. The deterioration index calculation unit 3 calculates, for the detected crack, a crack width and a crack rate on the basis of the image. The display processing unit 4 superimposes the calculated crack width and crack rate on the road surface on a map.

Claims (71)

1 . An apparatus comprising:

a memory storing instructions, time series information about a crack width of a crack of a road surface, and time series information about a crack rate of the crack of the road surface; and

at least one processor configured to execute the instructions to:

detect, based on an image of the road surface acquired from a sensor or sensors mounted on a mobile body, the crack of the road surface;

calculate the crack width and the crack rate of the detected crack based on at least one of the image and an acceleration of the mobile body acquired from the sensor or sensors mounted on the mobile body;

store the calculated crack width and the calculated crack rate in the memory in time series;

exclude or correct an outlier in at least one of the time series information about the crack width and the time series information about the crack rate, which are stored in the memory, by a statistical process;

calculate a rate of change in an index value of at least one of the crack width and the crack rate in a predetermined period, based on the time series information about the crack width or the time series information about the crack rate that has been subjected to the statistical process;

predict deterioration of the crack of the road surface based on the rate of change; and

display the calculated crack width and the calculated crack rate over the road surface on a map in a superimposed manner, thereby reducing a burden of management regarding deterioration of the road surface.

2 . The apparatus according to claim 1 , wherein

the at least one processor is further configured to execute the instructions to:

display at least one of time series information about the crack width and time series information about the crack rate, together with the map.

3 . The apparatus according to claim 2 , wherein

the at least one processor is further configured to execute the instructions to:

display any one of the time series information about the crack width and the time series information about the crack rate, according to selection by a user.

4 . The apparatus according to claim 1 , wherein

the at least one processor is further configured to execute the instructions to:

calculate time series information about the rate of change in an index value of at least one of the crack width and the crack rate.

5 . The apparatus according to claim 1 , wherein

the at least one processor is further configured to execute the instructions to:

predict the deterioration of the crack of the road surface based on at least one of the time series information about the crack width and the time series information about the crack rate, and on time series information about ground surface displacement information.

6 . The apparatus according to claim 1 , further comprising:

the at least one processor is further configured to execute the instructions to:

predict a repair time of the crack of the road surface based on the deterioration of the crack of the road surface predicted.

7 . The apparatus according to claim 6 , wherein

the at least one processor is further configured to execute the instructions to:

display the repair time of the crack of the road surface.

8 . The apparatus according to claim 1 , wherein

the at least one processor is further configured to execute the instructions to:

calculate a crack rate of each of first units obtained by dividing the road surface, and display the crack rate for each of the first units.

9 . The apparatus according to claim 8 , wherein

the at least one processor is further configured to execute the instructions to:

calculate a crack width of second units obtained by dividing the road surface by an area smaller than an area of each of the first units, and

display the crack width for each of the second units together with the crack rate of each of the first units.

10 . The apparatus according to claim 1 , wherein

the at least one processor is further configured to execute the instructions to:

detect another road surface deterioration other than the crack, the another road surface deterioration including at least one of rutting, a pot hole, an International Roughness Index (IRI), a Maintenance Control Index (MCI), flatness σ, and a Boeing Bump Index (BBI), based on at least one of the image and an acceleration of the mobile body acquired from the mobile body,

calculate an index value indicating a state of the another road surface deterioration, and

display the another road surface deterioration on the map in a display mode according to the index value.

11 . The apparatus according to claim 10 , wherein

the at least one processor is further configured to execute the instructions to:

display time series information about the index value of the another road surface deterioration, together with the map.

12 . The apparatus according to claim 11 , wherein

the at least one processor is further configured to execute the instructions to:

display, according to selection of a type of the another road surface deterioration by a user, time series information about an index value of the selected another road surface deterioration.

13 . The apparatus according to claim 10 , wherein

the at least one processor is further configured to execute the instructions to:

predict the index value of the another road surface deterioration based on time series information about the index value of the another road surface deterioration.

14 . The apparatus according to claim 13 , wherein

the at least one processor is further configured to execute the instructions to:

calculate a rate of change in the index value of the another road surface deterioration in a predetermined period, and predict the another road surface deterioration based on the rate of change.

15 . The apparatus according to claim 14 , wherein

the at least one processor is further configured to execute the instructions to:

calculate the rate of change in the index value of the another road surface deterioration by excluding or correcting an outlier by a statistical process.

16 . A method comprising:

detecting, based on an image of a road surface acquired from a sensor or sensors mounted on a mobile body, a crack of the road surface;

calculating a crack width and a crack rate of the detected crack based on at least one of the image and an acceleration of the mobile body acquired from the sensor or sensors mounted on the mobile body;

storing the calculated crack width and the calculated crack rate in a memory in time series;

exclude or correct an outlier in at least one of time series information about the crack width and time series information about the crack rate, which are stored in the memory, by a statistical process;

calculating a rate of change in an index value of at least one of the crack width and the crack rate in a predetermined period, based on the time series information about the crack width or the time series information about the crack rate that has been subjected to the statistical process;

predicting deterioration of the crack of the road surface based on the rate of change; and

displaying the calculated crack width and the calculated crack rate over the road surface on a map in a superimposed manner, thereby reducing a burden of management regarding deterioration of the road surface.

17 . A recording medium non-transitorily storing a program for causing a computer to execute the processes of:

detecting, based on an image of a road surface acquired from a sensor or sensors mounted on a mobile body, a crack of the road surface;

calculating a crack width and a crack rate of the detected crack based on at least one of the image and an acceleration of the mobile body acquired from the sensor or sensors mounted on the mobile body;

storing the calculated crack width and the calculated crack rate in a memory in time series;

exclude or correct an outlier in at least one of time series information about the crack width and time series information about the crack rate, which are stored in the memory, by a statistical process;

calculating a rate of change in an index value of at least one of the crack width and the crack rate in a predetermined period, based on the time series information about the crack width or the time series information about the crack rate that has been subjected to the statistical process;

predicting deterioration of the crack of the road surface based on the rate of change; and

displaying the calculated crack width and the calculated crack rate over the road surface on a map in a superimposed manner, thereby reducing a burden of management regarding deterioration of the road surface.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 21, 2023
From: SUGAWARA, CHISATO; YOKOTE, TOSHIMICHI; KIMURA, YOSUKE
To: NEC CORPORATION
Reel/Frame 065930/0105 →
Continuity (1)
Related Publication 20240287748A1 · Aug 29, 2024
References Cited (34)
US 20060274930A1 · Laurent et al. · 2006 [cited by applicant]
US 20180195973A1 · Yonekawa · 2018 [cited by examiner]
US 20210303883A1 · Jumonji · 2021 [cited by examiner]
US 20230091376A1 · Jumonji · 2023 [cited by examiner]
CN 107403197B · 2020 [cited by examiner]
EP 3633605A1 · 2020 [cited by examiner]
JP 2004156417A · 2004 [cited by examiner]
JP 2006112127A · 2006 [cited by applicant]
JP 2011052373A · 2011 [cited by applicant]
JP 2013079889A · 2013 [cited by applicant]
JP 2015007341A · 2015 [cited by applicant]
JP 2017101416A · 2017 [cited by applicant]
JP 2018021375A · 2018 [cited by applicant]
JP 2018087484A · 2018 [cited by applicant]
JP 2019100136A · 2019 [cited by examiner]
JP 2019163624A · 2019 [cited by applicant]
JP 2020013537A · 2020 [cited by applicant]
JP 2020035104A · 2020 [cited by applicant]
JP 2020046228A · 2020 [cited by applicant]
JP 2020056303A · 2020 [cited by applicant]
JP 6678267B1 · 2020 [cited by examiner]
JP 6790210B1 · 2020 [cited by examiner]
JP 2021060656A · 2021 [cited by applicant]
KR 20080004737A · 2008 [cited by examiner]
WO 2021070842A1 · 2021 [cited by applicant]
Translated version of JP 2004156417 (Year: 2004). [cited by examiner]
Translated version of JP 2019100136 (Year: 2019). [cited by examiner]
Translated version of KR 20080004737 (Year: 2008). [cited by examiner]
Gavilán, Miguel, David Balcones, Oscar Marcos, David F. Llorca, Miguel A. Sotelo, Ignacio Parra, Manuel Ocaña, Pedro Aliseda, Pedro Yarza, and Alejandro Amírola. “Adaptive road crack detection system by pavement classif… [cited by examiner]
Oliveira, Henrique, and Paulo Lobato Correia. “Automatic road crack detection and characterization.” IEEE Transactions on Intelligent Transportation Systems 14, No. 1 (2012): 155-168. (Year: 2012). [cited by examiner]
Zalama, Eduardo, Jaime Gómez-García-Bermejo, Roberto Medina, and José Llamas. “Road crack detection using visual features extracted by Gabor filters.” Computer-Aided Civil and Infrastructure Engineering 29, No. 5 (2014)… [cited by examiner]
International Search Report for PCT Application No. PCT/JP2021/024661, mailed on Sep. 14, 2021. [cited by applicant]
English translation of Written opinion for PCT Application No. PCT/JP2021/024661, mailed on Sep. 14, 2021. [cited by applicant]
JP Office Action for JP Application No. 2023-531218, mailed on Nov. 5, 2024 with English Translation. [cited by applicant]