IP Library Granted Patent US 12,345,567
Granted Patent B2
US 12,345,567 · App. 17/987,007 · Granted Jul 1, 2025

Road surface conditions detection by distributed optic fiber system

Inventors: Yuheng Chen (South Brunswick, NJ); Ming-Fang Huang (Princeton, NJ); Ting Wang (West Windsor, NJ); Jingnan Zhao (Edison, NJ)
Assignee: NEC Corporation
G01H9/004G01P3/36G06N3/08G06N20/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,345,567
App. No.
17/987,007
Granted
Jul 1, 2025
Kind
B2
Abstract

A fiber optic sensing cable located along a side of a paved road and runs parallel to a driving direction is monitored by distributed fiber optic sensing (DFOS) using Rayleigh backscattering generated along the length of the optical sensor fiber cable under dynamic vehicle loads. The interaction of vehicles with roadway locations exhibiting distressed pavement generates unique patterns of localized signals that are identified/distinguished from signals resulting from vehicles operating on roadway exhibiting a smooth pavement surface. Machine learning methods are employed to estimate an overall road surface quality as well as localizing pavement damage. Power spectral density estimation, principal component analysis, support vector machine (SVM) combined with principal component analysis (PCA), local binary pattern (LBP), and convolutional neural network (CNN) are applied to develop the machine learning models.

Claims (21)

1. A method for road surface conditions detection using distributed fiber optic sensing (DFOS), said method comprising:

providing a length of optical sensor fiber, said length of optical sensor fiber being positioned parallel to the road surface;

providing a DFOS interrogator in optical communication with the optical sensor fiber, said DFOS interrogator configured to generate optical pulses, introduce the generated pulses into the length of optical sensor fiber, and receive backscattered signals from the length of the optical sensor fiber; and

providing an intelligent analyzer configured to analyze the received backscattered signals and determine from the backscattered signals, vibrational activity occurring at locations along the length of the optical sensor fiber;

determine vehicle speed of vehicles operating on the road surface from the backscattered signals using Hough transform methods;

determine locations of potholes or cracks in the road surface; and

outputting an indicium of the pothole or crack locations;

wherein the intelligent analyzer determines the vibrational activity occurring at locations along the length of the optical sensor fiber by generating annotated waterfall plot images from the backscattered signals and extracting features of the annotated images using local binary pattern histograms, and by performing a principal component analysis (PCA) on the annotated images such that a dimension is reduced and employing a support vector machine methodology as a classifier to generate a trained model; and

wherein a convolutional neural network (CNN) is used to train binary classification data to generate a trained model.

2. The method of claim 1 further comprising deploying the trained model based on support vector machine (SVM) and CNN to detect road roughness level(s) and classify such level(s) as good, fair, or poor.

3. A system for road surface condition detection comprising:

a DFOS interrogator in optical communication with an optical sensor fiber positioned along the road surface, said DFOS interrogator configured to:

generate optical pulses, introduce the generated pulses into the length of optical sensor fiber, and receive backscattered signals from the length of the optical sensor fiber;

an intelligent analyzer configured to:

analyze the received backscattered signals and determine from the backscattered signals, vibrational activity occurring at locations along the length of the optical sensor fiber;

determine vehicle speed of vehicles operating on the road surface from the backscattered signals using Hough transform methods;

determine locations of potholes or cracks in the road surface; and

output an indicium of the pothole or crack locations;

wherein the intelligent analyzer determines the vibrational activity occurring at locations along the length of the optical sensor fiber by generating annotated waterfall plot images from the backscattered signals and extracting features of the annotated images using local binary pattern histograms, and by performing a principal component analysis (PCA) on the annotated images such that a dimension is reduced and employing a support vector machine methodology as a classifier to generate a trained model; and

wherein a convolutional neural network (CNN) is used to train binary classification data to generate a trained model.

4. The system of claim 3 wherein the trained model is based on support vector machine (SVM) and CNN to detect road roughness level(s) and classify such level(s) as good, fair, or poor.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 13, 2025
From: NEC LABORATORIES AMERICA, INC.
To: NEC CORPORATION
Reel/Frame 071095/0825 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 15, 2022
From: CHEN, YUHENG; HUANG, MING-FANG; WANG, TING; ZHAO, JINGNAN
To: NEC LABORATORIES AMERICA, INC.
Reel/Frame 061768/0665 →
Continuity (2)
Provisional Application 63280258 · Nov 17, 2021
Related Publication 20230152150A1 · May 18, 2023
References Cited (12)
US 20180266902A1 · Logan et al. · 2018 [cited by applicant]
US 20190236477A1 · Huang · 2019 [cited by examiner]
US 20200003588A1 · Huang · 2020 [cited by examiner]
US 20220230539A1 · Han · 2022 [cited by examiner]
US 20220333956A1 · Han · 2022 [cited by examiner]
CN 107591002A · 2018 [cited by examiner]
CN 106600981B · 2018 [cited by examiner]
WO WO2020257167A1 · 2020 [cited by examiner]
Machine Translation of CN 106600981 (Year: 2018). [cited by examiner]
Machine Translation of CN 107591002 A (Year: 2018). [cited by examiner]
Balzanella et al., “Automatic Classification of Road Traffic with Fiber Based Sensors in Smart Cities Applications”, 2020, pp. 31-46 (Year: 2020). [cited by examiner]
Hough Transforms—Science Direct, downloaded Oct. 3, 2024 (Year: 2024). [cited by examiner]