IP Library Granted Patent US 12,662,176
Granted Patent B2
US 12,662,176 · App. 18/829,218 · Granted Jun 23, 2026

Apparatuses, systems, and methods for monitoring moving vehicles

Inventors: Mabby Nicholas Amouie (Atlanta, GA); Evan Thomas Gebhardt (Atlanta, GA); Colin Usher (Atlanta, GA); Benjamin Quick (Atlanta, GA); Trent Black (Atlanta, GA); Emily Strube (Atlanta, GA); Brian Thomas Yeager (Atlanta, GA); Thomas Samuel Fox (Atlanta, GA)
Assignee: Norfolk Southern Corporation & Georgia Tech Research Corporation
B61L25/021B61L25/025B61L25/04B61L27/53B61L27/57B61L27/70G01M17/10G06T7/0002G06T7/001G06T7/55G06T7/80G06V20/52G06V20/54G06V20/63G06V30/10H04N7/18H04N7/188H04N23/11H04N23/51H04N23/52H04N23/56H04N23/64H04N23/90G06T2207/10024G06T2207/10048G06T2207/30252G06V2201/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,662,176
App. No.
18/829,218
Granted
Jun 23, 2026
Kind
B2
Abstract

Railcar inspection systems, methods, and apparatuses are disclosed, including a railcar inspection portal. The railcar inspection portal includes a physical structure positioned around a railroad track, and through which a railcar can travel. The railcar inspection portal can include wheel detection sensors along the railroad track for detecting the presence of a railcar passing over the sensors. The sensors can transmit signals, corresponding to railcars passing over the sensors, to computing devices for determining railcar speeds. The railcar inspection portal can include imaging devices configured to capture images and readings of railcars passing through the inspection portal. Based on a determined speed corresponding to a passing railcar, the computing devices can control the imaging devices to capture specific areas or components of the passing railcar, or individual cars thereon. The computing devices can process the captured images to detect defects corresponding to the passing railcar, or individual cars thereon.

Claims (80)

1 . A system comprising:

one or more imaging devices configured to capture inspection images of a passing railcar travelling along a railway, the imaging devices comprises one or more infrared (IR) sensors;

one or more computing devices in communication with the one or more imaging devices, the one or more computing devices being configured to:

receive one or more IR images of one or more target regions of the passing railcar, each target region corresponding to one or more railcar components to be inspected;

process the one or more IR images to determine a detected heat pattern for a given target region of the one or more target regions by at least determining one or more determined shapes each corresponding to one or more temperature ranges;

determine that the detected heat pattern indicates that one or more components in the given target region has an operating temperature above a threshold temperature by at least:

comparing the one or more determined shapes of the detected heat pattern to one or more stored shapes of one or more stored heat patterns, the one or more stored heat patterns indicating an acceptable operating temperature for each of the one or more components in the given target region; and

determining that at least some of the one or more determined shapes is within a predetermined level of similarity to at least one of the one or more stored heat patterns;

in response to determining the one or more components in the given target region has an operating temperature above the threshold temperature, determine an abnormality associated with the detected heat pattern;

determine a likely root cause of the abnormality; and

output a notification comprising an identifier identifying the passing railcar, an indication of the abnormality, and an indication of the likely root cause.

2 . The system of claim 1 , wherein processing the one or more IR images comprises:

analyzing one or more pixel values for each pixel of each of the one or more IR images;

storing the one or more pixel values for each pixel of each of the one or more IR images in a vector format as a corresponding pixel vector of a plurality of pixel vectors for each of the one or more IR images; and

identifying, based at least in part on the plurality of pixel vectors for each of the one or more IR images, the detected heat pattern for the given target region.

3 . The system of claim 2 , wherein the one or more pixel values comprise RGB values.

4 . The system of claim 3 , wherein:

each component in the given target region has a range of acceptable operating temperatures; and

one or more groups pixels having RGB values indicating a temperature above the range of acceptable operating temperatures is indicative of the abnormality.

5 . A system comprising:

one or more imaging devices configured to capture inspection images of a passing railcar travelling along a railway, the imaging devices comprises one or more infrared (IR) sensors;

one or more computing devices in communication with the one or more imaging devices, the one or more computing devices being configured to:

receive one or more IR images of one or more target regions of the passing railcar, each target region corresponding to one or more railcar components to be inspected;

process the one or more IR images to determine a detected heat pattern for a given target region of the one or more target regions by at least determining one or more determined shapes each corresponding to one or more temperature ranges;

determine that the detected heat pattern indicates that one or more components in the given target region has an operating temperature above a threshold temperature by at least:

comparing the one or more determined shapes of the detected heat pattern to one or more stored shapes of one or more stored heat patterns, the one or more stored heat patterns indicating an unacceptable operating temperature for each of the one or more components in the given target region; and

determining that at least some of the one or more determined shapes is different from the one or more stored heat patterns;

in response to determining the one or more components in the given target region has an operating temperature above the threshold temperature, determine an abnormality associated with the detected heat pattern;

determine a likely root cause of the abnormality; and

output a notification comprising an identifier identifying the passing railcar, an indication of the abnormality, and an indication of the likely root cause.

6 . A method comprising:

capturing one or more infrared (IR) images of one or more target regions of a passing railcar travelling along a railway, each target region corresponding to one or more railcar components of the passing railcar;

processing the one or more IR images to determine a detected heat pattern for a given target region of the one or more target regions, wherein processing the one or more IR images comprises:

analyzing one or more pixel values for each pixel of each of the one or more IR images;

storing the one or more pixel values for each pixel of each of the one or more IR images in a vector format as a corresponding pixel vector of a plurality of pixel vectors for each of the one or more IR images; and

identifying, based at least in part on the plurality of pixel vectors for each of the one or more IR images, the detected heat pattern for the given target region by at least determining one or more determined shapes each corresponding to one or more temperature ranges;

determining that the detected heat pattern indicates that one or more components in the given target region has an operating temperature above a threshold temperature by at least:

comparing the one or more determined shapes of the detected heat pattern to one or more stored shapes of one or more stored heat patterns, the one or more stored heat patterns indicating an acceptable operating temperature for each of the one or more components in the given target region; and

determining that at least some of the one or more determined shapes is within a predetermined level of similarity to at least one of the one or more stored heat patterns;

in response to determining the one or more components in the given target region has an operating temperature above the threshold temperature, determining an abnormality associated with the detected heat pattern; and

outputting a notification comprising an identifier identifying the passing railcar and an indication of the abnormality.

7 . The method of claim 6 , further comprising determining a likely root cause of the abnormality, wherein the notification further comprises an indication of the likely root cause.

8 . The method of claim 6 , wherein processing the one or more IR images comprises:

analyzing one or more pixel values for each pixel of each of the one or more IR images;

storing the one or more pixel values for each pixel of each of the one or more IR images in a vector format as a corresponding pixel vector of a plurality of pixel vector for each of the one or more IR images; and

identifying, based at least in part on the plurality of pixel vector for each of the one or more IR images, the detected heat pattern for the given target region.

9 . A method comprising:

capturing one or more infrared (IR) images of one or more target regions of a passing railcar travelling along a railway, each target region corresponding to one or more railcar components of the passing railcar;

processing the one or more IR images to determine a detected heat pattern for a given target region of the one or more target regions, wherein processing the one or more IR images comprises:

analyzing one or more pixel values for each pixel of each of the one or more IR images;

storing the one or more pixel values for each pixel of each of the one or more IR images in a vector format as a corresponding pixel vector of a plurality of pixel vectors for each of the one or more IR images; and

identifying, based at least in part on the plurality of pixel vectors for each of the one or more IR images, the detected heat pattern for the given target region by at least determining one or more determined shapes each corresponding to one or more temperature ranges;

determining the detected heat pattern indicates that one or more components in the given target region has an operating temperature above a threshold temperature by at least:

comparing the one or more determined shapes of the detected heat pattern to one or more stored shapes of one or more stored heat patterns, the one or more stored heat patterns indicating an unacceptable operating temperature for each of the one or more components in the given target region; and

determining that at least some of the one or more determined shapes is within a predetermined level of similarity from the one or more stored heat patterns;

in response to determining the one or more components in the given target region has an operating temperature above the threshold temperature, determining an abnormality associated with the detected heat pattern; and

outputting a notification comprising an identifier identifying the passing railcar and an indication of the abnormality.

10 . A non-transitory, computer readable medium storing instructions that, when executed by one or processors, causes a computing system to:

output instructions to capture one or more infrared (IR) images of one or more target regions of a passing railcar travelling along a railway, each target region corresponding to one or more railcar components of the passing railcar;

process the one or more IR images to determine a detected heat pattern for a given target region of the one or more target regions, wherein processing the one or more IR images comprises:

analyzing one or more pixel values for each pixel of each of the one or more IR images;

storing the one or more pixel values for each pixel of each of the one or more IR images in a vector format as a corresponding pixel vector of a plurality of pixel vectors for each of the one or more IR images; and

identifying, based at least in part on the plurality of pixel vectors for each of the one or more IR images, the detected heat pattern for the given target region by at least determining one or more determined shapes each corresponding to one or more temperature ranges;

determine that the detected heat pattern indicates that one or more components in the given target region has an operating temperature above a threshold temperature by at least:

comparing the one or more determined shapes of the detected heat pattern to one or more stored shapes of one or more stored heat patterns, the one or more stored heat patterns indicating an acceptable operating temperature for each of the one or more components in the given target region; and

determining that at least some of the one or more determined shapes is within a predetermined level of similarity to at least one of the one or more stored heat patterns;

in response to determining the one or more components in the given target region has an operating temperature above the threshold temperature, determine an abnormality associated with the detected heat pattern; and

output a notification comprising an identifier identifying the passing railcar and an indication of the abnormality.

11 . A non-transitory, computer readable medium storing instructions that, when executed by one or processors, causes a computing system to:

output instructions to capture one or more infrared (IR) images of one or more target regions of a passing railcar travelling along a railway, each target region corresponding to one or more railcar components of the passing railcar;

process the one or more IR images to determine a detected heat pattern for a given target region of the one or more target regions, wherein processing the one or more IR images comprises:

analyzing one or more pixel values for each pixel of each of the one or more IR images;

storing the one or more pixel values for each pixel of each of the one or more IR images in a vector format as a corresponding pixel vector of a plurality of pixel vectors for each of the one or more IR images; and

identifying, based at least in part on the plurality of pixel vectors for each of the one or more IR images, the detected heat pattern for the given target region by at least determining one or more determined shapes each corresponding to one or more temperature ranges;

determine that the detected heat pattern indicates that one or more components in the given target region has an operating temperature above a threshold temperature by at least:

comparing the one or more determined shapes of the detected heat pattern to one or more stored shapes of one or more stored heat patterns, the one or more stored heat patterns indicating an unacceptable operating temperature for each of the one or more components in the given target region; and

determining that at least some of the one or more determined shapes is different from the one or more stored heat patterns;

in response to determining the one or more components in the given target region has an operating temperature above the threshold temperature, determine an abnormality associated with the detected heat pattern;

determine a likely root cause of the abnormality; and

output a notification comprising an identifier identifying the passing railcar, an indication of the abnormality, and an indication of the likely root cause.

Assignments (9)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 28, 2025
From: FOX, THOMAS SAMUEL
To: NORFOLK SOUTHERN CORPORATION
Reel/Frame 071238/0229 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2025
From: STRUBE, EMILY
To: GEORGIA TECH RESEARCH CORPORATION
Reel/Frame 070453/0989 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2025
From: USHER, COLIN
To: GEORGIA TECH RESEARCH CORPORATION
Reel/Frame 070453/0509 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2025
From: FOX, THOMAS SAMUEL
To: NORFOLK SOUTHERN CORPORATION
Reel/Frame 070452/0780 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2025
From: YEAGER, BRIAN THOMAS
To: NORFOLK SOUTHERN CORPORATION
Reel/Frame 070453/0260 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2025
From: QUICK, BENJAMIN
To: GEORGIA TECH RESEARCH CORPORATION
Reel/Frame 070453/0786 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2025
From: AMOUIE, MABBY NICHOLAS
To: NORFOLK SOUTHERN CORPORATION
Reel/Frame 070452/0311 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2025
From: BLACK, TRENT
To: GEORGIA TECH RESEARCH CORPORATION
Reel/Frame 070454/0183 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2025
From: GEBHARDT, EVAN THOMAS
To: NORFOLK SOUTHERN CORPORATION
Reel/Frame 070452/0426 →
Continuity (3)
Provisional Application 63582165 · Sep 12, 2023
Provisional Application 63581554 · Sep 8, 2023
Related Publication 20250086771A1 · Mar 13, 2025
References Cited (81)
US 4915504A · Thurston · 1990 [cited by applicant]
US 5793492A · Vanaki · 1998 [cited by applicant]
US 6813581B1 · Snyder · 2004 [cited by applicant]
US 6909514B2 · Nayebi · 2005 [cited by applicant]
US 7681443B2 · Kilian et al. · 2010 [cited by applicant]
US 7714886B2 · Kilian et al. · 2010 [cited by applicant]
US 7715026B2 · Nayebi · 2010 [cited by applicant]
US 8289526B2 · Kilian et al. · 2012 [cited by applicant]
US 8480008B1 · Arnold · 2013 [cited by applicant]
US 8668136B2 · Ahern et al. · 2014 [cited by applicant]
US 8780189B2 · Kilian · 2014 [cited by applicant]
US 8934007B2 · Snead · 2015 [cited by applicant]
US 9033219B2 · Schoner et al. · 2015 [cited by applicant]
US 9073559B2 · Kilian et al. · 2015 [cited by applicant]
US 9129248B2 · Reynolds et al. · 2015 [cited by applicant]
US 9438754B2 · Schoner et al. · 2016 [cited by applicant]
US 9516199B2 · Kilian et al. · 2016 [cited by applicant]
US 9625607B2 · Tudor et al. · 2017 [cited by applicant]
US 9671191B1 · Sullivan et al. · 2017 [cited by applicant]
US 9709394B2 · Schoner et al. · 2017 [cited by applicant]
US 9836893B2 · Chundru et al. · 2017 [cited by applicant]
US 10513279B2 · Mulligan · 2019 [cited by applicant]
US 10523858B1 · Arcaini et al. · 2019 [cited by applicant]
US 10984521B2 · Kohler et al. · 2021 [cited by applicant]
US 11107233B2 · Saniei et al. · 2021 [cited by applicant]
US 11172107B1 · Hoeppner · 2021 [cited by applicant]
US 11235788B2 · Snyder et al. · 2022 [cited by applicant]
US 11285980B2 · Popplewell · 2022 [cited by applicant]
US 11423559B2 · Kohler · 2022 [cited by applicant]
US 11620743B2 · Kohler et al. · 2023 [cited by applicant]
US 11688169B1 · Dryer et al. · 2023 [cited by applicant]
US 11763480B2 · Saniei et al. · 2023 [cited by applicant]
US 11776145B2 · Kohler · 2023 [cited by applicant]
US 11861509B2 · Neal, Jr. et al. · 2024 [cited by applicant]
US 11891098B1 · Smythe et al. · 2024 [cited by applicant]
US 11932290B2 · Davis et al. · 2024 [cited by applicant]
US 11974035B1 · Buschelman · 2024 [cited by applicant]
US 12033312B2 · Kohler et al. · 2024 [cited by applicant]
US 20040263624A1 · Nejikovsky et al. · 2004 [cited by applicant]
US 20050253926A1 · Chung et al. · 2005 [cited by applicant]
US 20060276985A1 · Xu et al. · 2006 [cited by applicant]
US 20070040911A1 · Riley · 2007 [cited by applicant]
US 20100100275A1 · Mian · 2010 [cited by examiner]
US 20120113259A1 · Jie et al. · 2012 [cited by applicant]
US 20130054158A1 · Toms · 2013 [cited by applicant]
US 20160096536A1 · Toms · 2016 [cited by applicant]
US 20170066459A1 · Singh · 2017 [cited by examiner]
US 20170199215A1 · Arcaini et al. · 2017 [cited by applicant]
US 20180222498A1 · Kelley · 2018 [cited by applicant]
US 20180237041A1 · Mesher · 2018 [cited by applicant]
US 20190061791A1 · Yaktine et al. · 2019 [cited by applicant]
US 20190094154A1 · Iler · 2019 [cited by applicant]
US 20190260972A1 · Behety · 2019 [cited by applicant]
US 20200408682A1 · Mian et al. · 2020 [cited by applicant]
US 20210058588A1 · Abreo · 2021 [cited by applicant]
US 20210403060A1 · Pertosa · 2021 [cited by applicant]
US 20220377251A1 · Grata et al. · 2022 [cited by applicant]
US 20230194746A1 · Morton · 2023 [cited by applicant]
US 20230410342A1 · Kohler · 2023 [cited by applicant]
US 20230410354A1 · Saniei et al. · 2023 [cited by applicant]
US 20240004775A1 · Liu · 2024 [cited by applicant]
US 20240035931A1 · Grata · 2024 [cited by applicant]
US 20240043043A1 · Brooks et al. · 2024 [cited by applicant]
US 20240137635A1 · Buschelman · 2024 [cited by applicant]
US 20240236464A9 · Buschelman · 2024 [cited by applicant]
CN 111483496A · 2020 [cited by applicant]
CN 111923962A · 2020 [cited by applicant]
CN 111942434A · 2020 [cited by applicant]
WO 9532581A1 · 1995 [cited by applicant]
WO 2022192962A1 · 2022 [cited by applicant]
WO 2024050200A1 · 2023 [cited by applicant]
WO 2024050201A1 · 2024 [cited by applicant]
WO 2024196402A1 · 2024 [cited by applicant]
Chong et al., S.Y. A Review of Health and Operation Monitoring Technologies for Trains, Google Scholar, Smart Structures and Systems, vol. 6, No. 9, 2010, pp. 1079-1105. (Year: 2010). [cited by applicant]
Gao et al., L. Anomaly Detection of Trackside Equipment Based on GPS and Image Matching, IEEE Access, vol. 6, Jan. 2020, pp. 17346-17355. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/829,199, mailed Dec. 27, 2024, 12 Pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 18/829,216 dated Dec. 12, 2024, 2 pages. [cited by applicant]
Qiushi et al., “M. Composite Railway Health Monitoring System based on Fiber Optic Bragg Grating Sensing Array”, IEEE Far East Forum on Nondestructive Evaluation/Testing, Jun. 2014, pp. 259-264. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/829,194 dated Nov. 18, 2024, 18 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/829,189 dated Nov. 4, 2024, 18 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/829,200 dated Oct. 29, 2024, 19 pages. [cited by applicant]