IP Library › Granted Patent US 11,904,914
Granted Patent B2
US 11,904,914 · App. 16/827,238 · Granted Feb 20, 2024

Systems and methods for identifying potential deficiencies in railway environment objects

Inventors: Dennis William Morgart (Topeka, KS); Joshua John McBain (Lawrence, KS); Corey Tremain Pasta (Topeka, KS); Aaron Thomas Ratledge (Haslet, TX)
Assignee: BNSF Railway Company
B61L23/041B61L3/002B61L15/0072B61L15/0081B61L23/007B61L23/042B61L23/044B61L23/047B61L23/048B61L27/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,904,914
App. No.
16/827,238
Granted
Feb 20, 2024
Kind
B2
Abstract

In one embodiment, a method includes capturing, by a machine vision device, an image of an object in a railway environment. The machine vision device is attached to a first train car that is moving in a first direction along a first railroad track of the railway environment. The method also includes analyzing, by the machine vision device, the image of the object using one or more machine vision algorithms to determine a value associated with the object. The method further includes determining, by the machine vision device, that the value associated with the object indicates a potential deficiency of the object and communicating, by the machine vision device, an alert to a component external to the first train car. The alert comprises an indication of the potential deficiency of the object.

Claims (72)

1. A method, comprising:

capturing, by a machine vision device, an image of an object in a railway environment, wherein the machine vision device is attached to a first train car that is moving in a first direction along a first railroad track of the railway environment;

analyzing, by the machine vision device, the image of the object using one or more machine vision algorithms to determine a value associated with the object;

determining, by the machine vision device, that the value associated with the object indicates a potential deficiency of the object affecting a second railroad track of the railway environment and not affecting the first railroad track; and

communicating, by the machine vision device, an alert to a component of a second train car that is moving in a second direction along a second railroad track instructing the second train car to perform an action associated with the second railroad track, wherein the second direction along the second railroad track is different from the first direction along the first railroad track, wherein the alert comprises an indication of the potential deficiency of the object, wherein the first railroad track of the railway environment is adjacent to the second railroad track of the railway environment.

2. The method of claim 1 , wherein the potential deficiency of the object is one

of the following:

a misalignment of a second railroad track;

a malfunction of a crossing warning device;

an obstructed view of a second railroad track;

damage to the object; and

a misplacement of the object.

3. The method of claim 1 , wherein the component external to the first train car is a device located within a network operations center.

4. The method of claim 1 , wherein the alert further comprises at least one of the following:

a description of the object;

a description of the potential deficiency;

the image of the object;

a location of the object;

a time when the object was captured by the machine vision device of the first train car;

a date when the object was captured by the machine vision device of the first train car;

an identification of the first train car;

an indication of the first direction of the first train car; and

an indication of one or more train cars that are scheduled to pass through the railway environment within a predetermined amount of time.

5. The method of claim 1 , wherein the machine vision device captures the image of the object and communicates the alert to the component external to the first train car in less than ten seconds.

6. The method of claim 1 , wherein the machine vision device is mounted to a front windshield of the first train car.

7. A system comprising one or more processors and a memory storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

capturing, by a machine vision device, an image of an object in a railway environment, wherein the machine vision device is attached to a first train car that is moving in a first direction along a first railroad track of the railway environment;

analyzing the image of the object using one or more machine vision algorithms to determine a value associated with the object;

determining that the value associated with the object indicates a potential deficiency of the object affecting a second railroad track of the railway environment and not affecting the first railroad track; and

communicating an alert to a component of a second train car that is moving in a second direction along a second railroad track instructing the second train car to perform an action associated with the second railroad track, wherein the second direction along the second railroad track is different from the first direction along the first railroad track, wherein the alert comprises an indication of the potential deficiency of the object, wherein the first railroad track of the railway environment is adjacent to the second railroad track of the railway environment.

8. The system of claim 7 , wherein the potential deficiency of the object is one of the following:

a misalignment of a second railroad track;

a malfunction of a crossing warning device;

an obstructed view of a second railroad track;

damage to the object; and

a misplacement of the object.

9. The system of claim 7 , wherein the component external to the first train car is a device located within a network operations center.

10. The system of claim 7 , wherein the alert further comprises at least one of the following:

a description of the object;

a description of the potential deficiency;

the image of the object;

a location of the object;

a time when the object was captured by the machine vision device of the first train car;

a date when the object was captured by the machine vision device of the first train car;

an identification of the first train car;

an indication of the first direction of the first train car; and

an indication of one or more train cars that are scheduled to pass through the railway environment within a predetermined amount of time.

11. The system of claim 7 , wherein the machine vision device captures the image of the object and communicates the alert to the component external to the first train car in less than ten seconds.

12. The system of claim 7 , wherein the machine vision device is mounted to a front windshield of the first train car.

13. One or more computer-readable storage media embodying instructions that, when executed by a processor, cause the processor to perform operations comprising:

capturing, by a machine vision device, an image of an object in a railway environment, wherein the machine vision device is attached to a first train car that is moving in a first direction along a first railroad track of the railway environment;

analyzing the image of the object using one or more machine vision algorithms to determine a value associated with the object;

determining that the value associated with the object indicates a potential deficiency of the object affecting a second railroad track of the railway environment and not affecting the first railroad track; and

communicating an alert to a component of a second train car that is moving in a second direction along a second railroad track instructing the second train car to perform an action associated with the second railroad track, wherein the second direction along the second railroad track is different from the first direction along the first railroad track, wherein the alert comprises an indication of the potential deficiency of the object, wherein the first railroad track of the railway environment is adjacent to the second railroad track of the railway environment.

14. The one or more computer-readable storage media of claim 13 , wherein the potential deficiency of the object is one of the following:

a misalignment of a second railroad track;

a malfunction of a crossing warning device;

an obstructed view of a second railroad track;

damage to the object; and

a misplacement of the object.

15. The one or more computer-readable storage media of claim 13 , wherein the component external to the first train car is a device located within a network operations center.

16. The one or more computer-readable storage media of claim 13 , wherein the alert further comprises at least one of the following:

a description of the object;

a description of the potential deficiency;

the image of the object;

a location of the object;

a time when the object was captured by the machine vision device of the first train car;

a date when the object was captured by the machine vision device of the first train car;

an identification of the first train car;

an indication of the first direction of the first train car; and

an indication of one or more train cars that are scheduled to pass through the railway environment within a predetermined amount of time.

17. The one or more computer-readable storage media of claim 13 , wherein the machine vision device captures the image of the object and communicates the alert to the component external to the first train car in less than ten seconds.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2020
From: MORGART, DENNIS WILLIAM; MCBAIN, JOSHUA JOHN; PASTA, COREY TREMAIN; RATLEDGE, AARON THOMAS
To: BNSF RAILWAY COMPANY
Reel/Frame 052198/0608 →
Continuity (1)
Related Publication 20210291881A1 · Sep 23, 2021