IP Library Granted Patent US 11,423,559
Granted Patent B2
US 11,423,559 · App. 16/917,590 · Granted Aug 23, 2022

Systems and methods for reconstructing objects using transitional images

Inventor: Rachel Kohler (Fort Worth, TX)
Assignee: BNSF Railway Company
G06T7/55G06T7/12G06T7/97G06T2207/30236
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,423,559
App. No.
16/917,590
Granted
Aug 23, 2022
Kind
B2
Abstract

In one embodiment, a method includes receiving, by an object reconstruction module, a first image and a second image. The first image includes a first region of an object and the second image comprises a second region of the object. The method also includes identifying, by the object reconstruction module, a transitional image. The transitional image includes the first region of the object and the second region of the object. The method further includes determining, by the object reconstruction module, that the first region of the object in the transitional image and the first region of the object in the first image are equivalent regions and generating, by the object reconstruction module, a reconstruction of the object using the first image and the transitional image. The reconstruction of the object includes the first region of the object and the second region of the object and excludes equivalent regions.

Claims (67)

1. An apparatus, comprising:

one or more processors; and

one or more computer-readable non-transitory storage media coupled to the one or more processors and comprising instructions that, when executed by the one or more processors, cause the apparatus to perform operations comprising:

receiving a first image of transportation infrastructure components and a second image of the transportation infrastructure components, wherein the first image comprises a first region of an object and the second image comprises a second region of the object;

identifying a transitional image, wherein the transitional image comprises:

the first region of the object; and

the second region of the object;

determining that the first region of the object in the transitional image and the first region of the object in the first image are first equivalent regions; and

generating a reconstruction of the object using the first image and the transitional image, wherein:

the reconstruction of the object comprises the first region of the object and the second region of the object;

the reconstruction of the object excludes duplication of the first equivalent regions;

identifying a first portion of the object in the first image;

constructing a first bounding box around the first portion of the object in the first image, wherein the first bounding box comprises the first region of the object;

identifying a second portion of the object in the transitional image; and

constructing a second bounding box around the second portion of the object in the transitional image, wherein the second bounding box comprises the first region of the object in the transitional image and the second region of the object.

2. The apparatus of claim 1 , wherein:

the first image further comprises a third region of the object, a fourth region of the object, and a fifth region of the object; and

the transitional image comprises the third region of the object and the fourth region of the object.

3. The apparatus of claim 2 , the operations further comprising:

determining that the third region of the object in the transitional image and the third region of the object in the first image are third equivalent regions; and

determining that the fourth region of the object in the transitional image and the fourth region of the object in the first image are fourth equivalent regions, wherein the reconstruction of the object excludes the third and fourth equivalent regions.

4. The apparatus of claim 2 , the operations further comprising concatenating the first region of the object, the second region of the object, the third region of the object, the fourth region of the object, and the fifth region of the object to generate the reconstruction of the object, wherein the reconstruction of the object represents the object in its entirety.

5. The apparatus of claim 1 , the operations further comprising using intersection over union (IoU) to determine that the first region of the object in the transitional image and the first region of the object in the first image are the first equivalent regions.

6. The apparatus of claim 1 , wherein the transitional image comprises half of the first image and half of the second image.

7. A method, comprising:

receiving, by an object reconstruction module, a first image of transportation infrastructure components and a second image of the transportation infrastructure components, wherein the first image comprises a first region of an object and the second image comprises a second region of the object;

identifying, by the object reconstruction module, a transitional image, wherein the transitional image comprises:

the first region of the object; and

the second region of the object;

determining, by the object reconstruction module, that the first region of the object in the transitional image and the first region of the object in the first image are first equivalent regions; and

generating, by the object reconstruction module, a reconstruction of the object using the first image and the transitional image, wherein:

the reconstruction of the object comprises the first region of the object and the second region of the object;

the reconstruction of the object excludes duplication of the first equivalent regions;

identifying, by the object reconstruction module, a first portion of the object in the first image;

constructing, by the object reconstruction module, a first bounding box around the first portion of the object in the first image, wherein the first bounding box comprises the first region of the object;

identifying, by the object reconstruction module, a second portion of the object in the transitional image; and

constructing, by the object reconstruction module, a second bounding box around the second portion of the object in the transitional image, wherein the second bounding box comprises the first region of the object in the transitional image and the second region of the object.

8. The method of claim 7 , wherein:

the first image further comprises a third region of the object, a fourth region of the object, and a fifth region of the object; and

the transitional image comprises the third region of the object and the fourth region of the object.

9. The method of claim 8 , further comprising:

determining, by the object reconstruction module, that the third region of the object in the transitional image and the third region of the object in the first image are third equivalent regions; and

determining, by the object reconstruction module, that the fourth region of the object in the transitional image and the fourth region of the object in the first image are fourth equivalent regions, wherein the reconstruction of the object excludes the third and fourth equivalent regions.

10. The method of claim 8 , further comprising concatenating, by the object reconstruction module, the first region of the object, the second region of the object, the third region of the object, the fourth region of the object, and the fifth region of the object to generate the reconstruction of the object, wherein the reconstruction of the object represents the object in its entirety.

11. The method of claim 7 , further comprising using intersection over union (IoU) to determine that the first region of the object in the transitional image and the first region of the object in the first image are the first equivalent regions.

12. The method of claim 7 , wherein the transitional image comprises half of the first image and half of the second image.

13. One or more computer-readable non-transitory storage media embodying instructions that, when executed by a processor, cause the processor to perform operations comprising:

receiving, by an object reconstruction module, a first image of transportation infrastructure components and a second image of the transportation infrastructure components, wherein the first image comprises a first region of an object and the second image comprises a second region of the object;

identifying, by the object reconstruction module, a transitional image, wherein the transitional image comprises:

the first region of the object; and

the second region of the object;

determining, by the object reconstruction module, that the first region of the object in the transitional image and the first region of the object in the first image are first equivalent regions; and

generating, by the object reconstruction module, a reconstruction of the object using the first image and the transitional image, wherein:

the reconstruction of the object comprises the first region of the object and the second region of the object;

the reconstruction of the object excludes duplication of the first equivalent regions;

identifying, by the object reconstruction module, a first portion of the object in the first image;

constructing, by the object reconstruction module, a first bounding box around the first portion of the object in the first image, wherein the first bounding box comprises the first region of the object;

identifying, by the object reconstruction module, a second portion of the object in the transitional image; and

constructing, by the object reconstruction module, a second bounding box around the second portion of the object in the transitional image, wherein the second bounding box comprises the first region of the object in the transitional image and the second region of the object.

14. The one or more computer-readable non-transitory storage media of claim 13 , wherein:

the first image further comprises a third region of the object, a fourth region of the object, and a fifth region of the object; and

the transitional image comprises the third region of the object and the fourth region of the object.

15. The one or more computer-readable non-transitory storage media of claim 14 , the operations further comprising:

determining, by the object reconstruction module, that the third region of the object in the transitional image and the third region of the object in the first image are third equivalent regions; and

determining, by the object reconstruction module, that the fourth region of the object in the transitional image and the fourth region of the object in the first image are fourth equivalent regions, wherein the reconstruction of the object excludes the third and fourth equivalent regions.

16. The one or more computer-readable non-transitory storage media of claim 14 , the operations further comprising concatenating, by the object reconstruction module, the first region of the object, the second region of the object, the third region of the object, the fourth region of the object, and the fifth region of the object to generate the reconstruction of the object, wherein the reconstruction of the object represents the object in its entirety.

17. The one or more computer-readable non-transitory storage media of claim 13 , the operations further comprising using intersection over union (IoU) to determine that the first region of the object in the transitional image and the first region of the object in the first image are the first equivalent regions.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2020
From: KOHLER, RACHEL
To: BNSF RAILWAY COMPANY
Reel/Frame 053093/0387 →
Continuity (1)
Related Publication 20210407118A1 · Dec 30, 2021
Cited By (6)
US 12,269,524 US 12,344,294 US 12,348,880 US 12,365,373 US 12,420,851 US 12,662,176