IP Library Granted Patent US 11,763,480
Granted Patent B2
US 11,763,480 · App. 17/364,660 · Granted Sep 19, 2023

Systems and methods for locating objects

Inventors: Michael Saied Saniei (Fort Worth, TX); Xiaoyan Si (Kirkland, WA); Siva Prasad Vysyaraju (Keller, TX)
Assignee: BNSF RAILWAY COMPANY
G06T7/70G01S19/45G06T7/50G06T7/80G06T2207/10028G06T2207/30244G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,763,480
App. No.
17/364,660
Granted
Sep 19, 2023
Kind
B2
Abstract

In one embodiment, a method includes receiving an image generated by a camera associated with a vehicle. The image includes a point of interest (POI) associated with a physical object. The method also includes determining a number of pixels from the POI of the image to an edge of the image. The edge of the image represents a location of the camera. The method further includes determining an offset distance from the POI to a Global Positioning System (GPS) unit associated with the vehicle using the number of pixels.

Claims (32)

1. A method, comprising:

determining a point of interest (POI) in an image generated by a camera associated with a vehicle, wherein the POI is associated with a physical object;

determining a first distance from the POI to the camera using pixels from the image and an angle of the camera;

determining a second distance from the camera to a Global Positioning System (GPS) unit associated with the vehicle; and

adding the first distance to the second distance to determine an offset distance from the POI to the GPS unit associated with the vehicle.

2. The method of claim 1 , further comprising; receiving a GPS location generated by the GPS unit associated with the vehicle, wherein the GPS location is represented by latitude and longitude coordinates; determining a travel direction of the vehicle along a railroad track, wherein the vehicle is a track geometry car; and determining a POI location associated with the physical object using the GPS location, the offset distance, and the travel direction of the vehicle, wherein the POI location is represented by latitude and longitude coordinates.

3. The method of claim 1 , wherein; the camera is mounted to a front top end of the vehicle; and the GPS unit is mounted to a center top portion of the vehicle.

4. The method of claim 1 , further comprising; detecting an object in the image; determining an object POI in the detected object of the image; and mapping the object POI to a center of a railroad track in the image to generate the POI.

5. The method of claim 1 , further comprising; comparing the POI location associated with the physical object to a field measurement location associated with the physical object; determining that the P 01 location and the field measurement location are separated by more than a predetermined distance; and applying a defect to the physical object in response to determining that the POI location and the field measurement location are separated by more than a predetermined distance.

6. The method of claim 1 , wherein determining a first distance from the POI to the camera using pixels from the image comprises converting each of the pixels to a distance, each of the pixels being associated with a different distance.

7. The method of claim 1 , wherein the physical object represents at least one of the following positive train control (PTC) critical assets; a train-controlled signal; a switch point; a crossing; a mile post sign; a speed sign; and a clearance point.

8. A system comprising one or more processors and a memory storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

determining a point of interest (POI) in an image generated by a camera associated with a vehicle, wherein the POI is associated with a physical object;

determining a first distance from the POI to the camera using pixels from the image and an angle of the camera;

determining a second distance from the camera to a Global Positioning System (GPS) unit associated with the vehicle; and

adding the first distance to the second distance to determine an offset distance from the POI to the GPS unit associated with the vehicle.

9. The system of claim 8 , the operations further comprising; receiving a GPS location generated by the GPS unit associated with the vehicle, wherein the GPS location is represented by latitude and longitude coordinates; determining a travel direction of the vehicle along a railroad track, wherein the vehicle is a track geometry car; and determining a POI location associated with the physical object using the GPS location, the offset distance, and the travel direction of the vehicle, wherein the POI location is represented by latitude and longitude coordinates.

10. The system of claim 8 , wherein; the camera is mounted to a front top end of the vehicle; and the GPS unit is mounted to a center top portion of the vehicle.

11. The system of claim 8 , the operations further comprising; detecting an object in the image; determining an object POI in the detected object of the image; and mapping the object POI to a center of a railroad track in the image to generate the POI.

12. The system of claim 8 , the operations further comprising; comparing the POI location associated with the physical object to a field measurement location associated with the physical object; determining that the POI location and the field measurement location are separated by more than a predetermined distance; and applying a defect to the physical object in response to determining that the POI location and the field measurement location are separated by more than a predetermined distance.

13. The system of claim 8 , wherein determining a first distance from the POI to the camera using pixels from the image comprises converting each of the pixels to a distance, each of the pixels being associated with a different distance.

14. The system of claim 8 , wherein the physical object represents at least one of the following positive train control (PTC) critical assets; a train-controlled signal; a switch point; a crossing; a mile post sign; a speed sign; and a clearance point.

15. One or more non-transitory computer-readable storage media embodying instructions that, when executed by a processor, cause the processor to perform operations comprising:

determining a point of interest (POI) in an image generated by a camera associated with a vehicle, wherein the POI is associated with a physical object;

determining a first distance from the POI to the camera using pixels from the image and an angle of the camera;

determining a second distance from the camera to a Global Positioning System (GPS) unit associated with the vehicle; and

adding the first distance to the second distance to determine an offset distance from the POI to the GPS unit associated with the vehicle.

16. The one or more non-transitory computer-readable storage media of claim 15 , the operations further comprising; receiving a GPS location generated by the GPS unit associated with the vehicle, wherein the GPS location is represented by latitude and longitude coordinates; determining a travel direction of the vehicle along a railroad track, wherein the vehicle is a track geometry car; and determining a POI location associated with the physical object using the GPS location, the offset distance, and the travel direction of the vehicle, wherein the POI location is represented by latitude and longitude coordinates.

17. The one or more non-transitory computer-readable storage media of claim 15 , wherein; the camera is mounted to a front top end of the vehicle; and the GPS unit is mounted to a center top portion of the vehicle.

18. The one or more non-transitory computer-readable storage media of claim 15 , the operations further comprising: detecting an object in the image; determining an object POI in the detected object of the image; and mapping the object POI to a center of a railroad track in the image to generate the POI.

19. The one or more non-transitory computer-readable storage media of claim 15 , the operations further comprising: comparing the POI location associated with the physical object to a field measurement location associated with the physical object; determining that the POI location and the field measurement location are separated by more than a predetermined distance; and applying a defect to the physical object in response to determining that the POI location and the field measurement location are separated by more than a predetermined distance.

20. The one or more non-transitory computer-readable storage media of claim 15 , wherein determining a first distance from the POI to the camera using pixels from the image comprises converting each of the pixels to a distance, each of the pixels being associated with a different distance.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2021
From: SANIEI, MICHAEL SAIED; SI, XIAOYAN; VYSYARAJU, SIVA PRASAD
To: BNSF RAILWAY COMPANY
Reel/Frame 056725/0499 →
Continuity (2)
Continuation 16540867 · Aug 14, 2019
Related Publication 20210327087A1 · Oct 21, 2021
Cited By (6)
US 12,269,524 US 12,344,294 US 12,348,880 US 12,365,373 US 12,420,851 US 12,662,176