IP Library Granted Patent US 12,254,648
Granted Patent B2
US 12,254,648 · App. 18/459,406 · Granted Mar 18, 2025

Systems and methods for locating objects

Inventors: Michael Saied Saniei (Fort Worth, TX); Xiaoyan Si (Kirkland, WA); Siva Prasad Vysyaraju (Keller, TX)
Assignee: BNSF Railway Company
G06T7/70G01S19/45G06T7/50G06T7/80G06T2207/10028G06T2207/30244G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,254,648
App. No.
18/459,406
Granted
Mar 18, 2025
Kind
B2
Abstract

In one embodiment, a method includes receiving an image generated by a camera associated with a vehicle. The image includes a point of interest (POI) associated with a physical object. The method also includes determining a number of pixels from the POI of the image to an edge of the image. The edge of the image represents a location of the camera. The method further includes determining an offset distance from the POI to a Global Positioning System (GPS) unit associated with the vehicle using the number of pixels.

Claims (28)

1. A system for locating objects, comprising:

a data collection engine configured to collect data, via one or more processors, from a GPS unit, a camera, and an administrator, and detect an object in an image representative of a physical object, wherein the data collection engine receives the image from the camera via a network;

a pixel engine configured to analyze, via the one or more processors, pixels of the image with a point of interest (POI) from data collection engine and determine a number of pixels from the POI of the image to an edge of image;

a locator engine configured to determine, via the one or more processors, a POI location associated with physical object by determining a first distance from the POI to the camera using the number of pixels and an angle of camera; and

a comparison engine configured to compare, via the one or more processors, two determined locations associated with the physical object by comparing the POI location to a field location associated with physical object.

2. The system of claim 1 , wherein each image includes a representation of a physical object and a railroad track.

3. The system of claim 1 , wherein the data collection engine determines an object POI in the detected object of image, wherein the object POI represents a specific reference point within the detected object of image.

4. The system of claim 3 , wherein the data collection engine maps the object POI to a centerline of a railroad track in the image to generate the POI representing a location of the physical object transposed to the centerline of the railroad track.

5. The system of claim 1 , wherein the edge of the image represents a location of the camera.

6. The system of claim 1 , wherein the pixel engine converts each pixel from the POI to the edge of the image to an equivalent distance.

7. The system of claim 6 , wherein each pixel may be associated with a different distance due to the camera view angle.

8. The system of claim 1 , wherein the locator engine receives a GPS location from the data collection engine and determines the POI location associated with the physical object using the GPS location, an offset distance, and a travel direction.

9. The system of claim 1 , wherein the field location is a location determined by field measurement.

10. The system of claim 1 , wherein the comparison engine determines whether the POI location and the field location are within a predetermined distance of each other.

11. A method for locating objects, comprising:

collecting data, via a data collection engine, from a GPS unit, a camera, and an administrator, and detect an object in an image representative of a physical object, wherein the data collection engine receives the image from the camera via a network;

analyzing, via a pixel engine, pixels of the image with a point of interest (POI) from data collection engine and determine a number of pixels from the POI of the image to an edge of image;

determining, via a locator engine, a POI location associated with physical object by determining a first distance from the POI to the camera using the number of pixels and an angle of camera; and

comparing, via a comparison engine, two determined locations associated with the physical object by comparing the POI location to a field location associated with physical object.

12. The method of claim 11 , wherein each image includes a representation of a physical object and a railroad track.

13. The method of claim 11 , wherein the data collection engine determines an object POI in the detected object of image, wherein the object POI represents a specific reference point within the detected object of image.

14. The method of claim 13 , wherein the data collection engine maps the object POI to a centerline of a railroad track in the image to generate the POI representing a location of the physical object transposed to the centerline of the railroad track.

15. The method of claim 11 , wherein the edge of the image represents a location of the camera.

16. The method of claim 11 , wherein the pixel engine converts each pixel from the POI to the edge of the image to an equivalent distance.

17. The method of claim 16 , wherein each pixel may be associated with a different distance due to the camera view angle.

18. The method of claim 11 , wherein the locator engine receives a GPS location from the data collection engine and determines the POI location associated with the physical object using the GPS location, an offset distance, and a travel direction.

19. The method of claim 11 , wherein the field location is a location determined by field measurement.

20. The method of claim 11 , wherein the comparison engine determines whether the POI location and the field location are within a predetermined distance of each other.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2023
From: SANIEI, MICHAEL SAIED; SI, XIAOYAN; VYSYARAJU, SIVA PRASAD
To: BNSF RAILWAY COMPANY
Reel/Frame 064769/0792 →
Continuity (3)
Continuation 17364660 · Jun 30, 2021
Continuation 16540867 · Aug 14, 2019
Related Publication 20230410354A1 · Dec 21, 2023
References Cited (9)
US 20040264761A1 · Mas et al. · 2004 [cited by applicant]
US 20150269722A1 · Naithani et al. · 2015 [cited by applicant]
US 20180127006A1 · Wade · 2018 [cited by applicant]
US 20190180118A1 · Kraeling · 2019 [cited by examiner]
US 20190183310A1 · Herron · 2019 [cited by examiner]
US 20190259281A1 · Martin · 2019 [cited by examiner]
US 20210049783A1 · Saniei et al. · 2021 [cited by applicant]
Patent Cooperation Treaty, Search Report and Written Opinion, International No. PCT/US2020/039044, date of mailing Oct. 2, 2020, 16 pages. [cited by applicant]
Ellum, Cameron, et al.; “The Development of a Backpack Mobile Mapping Systems”, Article, International of Photogrammetry and Remote Sensing, vol. XXXIII, Part B2, pp. 184-191, Amsterdam 2000. [cited by applicant]