IP Library Granted Patent US 11,107,233
Granted Patent B2
US 11,107,233 · App. 16/540,867 · Granted Aug 31, 2021

Systems and methods for locating objects

Inventors: Michael Saied Saniei (Fort Worth, TX); Xiaoyan Si (Kirkland, WA); Siva Prasad Vysyaraju (Keller, TX)
Assignee: BNSF Railway Company
G06T7/70G01S19/45G06T7/50G06T7/80G06T2207/10028G06T2207/30244G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,107,233
App. No.
16/540,867
Granted
Aug 31, 2021
Kind
B2
Abstract

In one embodiment, a method includes receiving an image generated by a camera associated with a vehicle. The image includes a point of interest (POI) associated with a physical object. The method also includes determining a number of pixels from the POI of the image to an edge of the image. The edge of the image represents a location of the camera. The method further includes determining an offset distance from the POI to a Global Positioning System (GPS) unit associated with the vehicle using the number of pixels.

Claims (74)

1. A method, comprising:

receiving an image generated by a camera associated with a vehicle, the image comprising a point of interest (POI) associated with a physical object;

determining a number of pixels from the POI of the image to an edge of the image, the edge of the image representing a location of the camera;

determining an offset distance from the POI to a Global Positioning System (GPS) unit associated with the vehicle using the number of pixels;

determining a first distance from the POI to the camera using the number of pixels and an angle of the camera, wherein the camera is mounted to a front top end of the vehicle;

determining a second distance from the camera to the GPS unit, wherein the GPS unit is mounted to a center top portion of the vehicle; and

adding the first distance to the second distance to determine the offset distance.

2. The method of claim 1 , further comprising:

receiving a GPS location generated by the GPS unit associated with the vehicle, wherein the GPS location is represented by latitude and longitude coordinates;

determining a travel direction of the vehicle along a railroad track, wherein the vehicle is a track geometry car; and

determining a POI location associated with the physical object using the GPS location, the offset distance, and the travel direction of the vehicle, wherein the POI location is represented by latitude and longitude coordinates.

3. The method of claim 1 , further comprising:

detecting an object in the image;

determining an object POI in the detected object of the image; and

mapping the object POI to a center of a railroad track in the image to generate the POI.

4. The method of claim 1 , further comprising:

comparing the POI location associated with the physical object to a field measurement location associated with the physical object;

determining that the POI location and the field measurement location are separated by more than a predetermined distance; and

applying a defect to the physical object in response to determining that the POI location and the field measurement location are separated by more than a predetermined distance.

5. The method of claim 1 , wherein determining the offset distance using the number of pixels comprises converting each pixel to a distance, each pixel being associated with a different distance.

6. The method of claim 1 , wherein the physical object represents at least one of the following positive train control (PTC) critical assets:

a train-controlled signal;

a switch point;

a crossing;

a mile post sign;

a speed sign; and

a clearance point.

7. A system comprising one or more processors and a memory storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

receiving an image generated by a camera associated with a vehicle, the image comprising a point of interest (POI) associated with a physical object;

determining a number of pixels from the POI of the image to an edge of the image, the edge of the image representing a location of the camera;

determining an offset distance from the POI to a Global Positioning System (GPS) unit associated with the vehicle using the number of pixels;

determining a first distance from the POI to the camera using the number of pixels and an angle of the camera, wherein the camera is mounted to a front top end of the vehicle;

determining a second distance from the camera to the GPS unit, wherein the GPS unit is mounted to a center top portion of the vehicle; and

adding the first distance to the second distance to determine the offset distance.

8. The system of claim 7 , the operations further comprising:

receiving a GPS location generated by the GPS unit associated with the vehicle, wherein the GPS location is represented by latitude and longitude coordinates;

determining a travel direction of the vehicle along a railroad track, wherein the vehicle is a track geometry car; and

determining a POI location associated with the physical object using the GPS location, the offset distance, and the travel direction of the vehicle, wherein the POI location is represented by latitude and longitude coordinates.

9. The system of claim 7 , the operations further comprising:

detecting an object in the image;

determining an object POI in the detected object of the image; and

mapping the object POI to a center of a railroad track in the image to generate the POI.

10. The system of claim 7 , the operations further comprising:

comparing the POI location associated with the physical object to a field measurement location associated with the physical object;

determining that the POI location and the field measurement location are separated by more than a predetermined distance; and

applying a defect to the physical object in response to determining that the POI location and the field measurement location are separated by more than a predetermined distance.

11. The system of claim 7 , wherein determining the offset distance using the number of pixels comprises converting each pixel to a distance, each pixel being associated with a different distance.

12. The system of claim 7 , wherein the physical object represents at least one of the following positive train control (PTC) critical assets:

a train-controlled signal;

a switch point;

a crossing;

a mile post sign;

a speed sign; and

a clearance point.

13. One or more non-transitory computer-readable storage media embodying instructions that, when executed by a processor, cause the processor to perform operations comprising:

receiving an image generated by a camera associated with a vehicle, the image comprising a point of interest (POI) associated with a physical object;

determining a number of pixels from the POI of the image to an edge of the image, the edge of the image representing a location of the camera; and

determining an offset distance from the POI to a Global Positioning System (GPS) unit associated with the vehicle using the number of pixels;

determining a first distance from the POI to the camera using the number of pixels and an angle of the camera, wherein the camera is mounted to a front top end of the vehicle;

determining a second distance from the camera to the GPS unit, wherein the GPS unit is mounted to a center top portion of the vehicle; and

adding the first distance to the second distance to determine the offset distance.

14. The one or more non-transitory computer-readable storage media of claim 13 , the operations further comprising:

receiving a GPS location generated by the GPS unit associated with the vehicle, wherein the GPS location is represented by latitude and longitude coordinates;

determining a travel direction of the vehicle along a railroad track, wherein the vehicle is a track geometry car; and

determining a POI location associated with the physical object using the GPS location, the offset distance, and the travel direction of the vehicle, wherein the POI location is represented by latitude and longitude coordinates.

15. The one or more non-transitory computer-readable storage media of claim 13 , the operations further comprising:

detecting an object in the image;

determining an object POI in the detected object of the image; and

mapping the object POI to a center of a railroad track in the image to generate the POI.

16. The one or more non-transitory computer-readable storage media of claim 13 , the operations further comprising:

comparing the POI location associated with the physical object to a field measurement location associated with the physical object;

determining that the POI location and the field measurement location are separated by more than a predetermined distance; and

applying a defect to the physical object in response to determining that the POI location and the field measurement location are separated by more than a predetermined distance.

17. The one or more non-transitory computer-readable storage media of claim 13 , wherein determining the offset distance using the number of pixels comprises converting each pixel to a distance, each pixel being associated with a different distance.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 14, 2019
From: SANIEI, MICHAEL SAIED; SI, XIAOYAN; VYSYARAJU, SIVA PRASAD
To: BNSF RAILWAY COMPANY
Reel/Frame 050055/0635 →
Continuity (1)
Related Publication 20210049783A1 · Feb 18, 2021
Cited By (6)
US 12,269,524 US 12,344,294 US 12,348,880 US 12,365,373 US 12,420,851 US 12,662,176