IP Library Granted Patent US 11,776,145
Granted Patent B2
US 11,776,145 · App. 17/813,767 · Granted Oct 3, 2023

Systems and methods for reconstructing objects using transitional images

Inventor: Rachel Kohler (Fort Worth, TX)
Assignee: BNSF Railway Company
G06T7/55G06T7/12G06T7/97G06T2207/30236
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,776,145
App. No.
17/813,767
Granted
Oct 3, 2023
Kind
B2
Abstract

In one embodiment, a method includes receiving, by an object reconstruction module, a first image and a second image. The first image includes a first region of an object and the second image comprises a second region of the object. The method also includes identifying, by the object reconstruction module, a transitional image. The transitional image includes the first region of the object and the second region of the object. The method further includes determining, by the object reconstruction module, that the first region of the object in the transitional image and the first region of the object in the first image are equivalent regions and generating, by the object reconstruction module, a reconstruction of the object using the first image and the transitional image. The reconstruction of the object includes the first region of the object and the second region of the object and excludes equivalent regions.

Claims (58)

1. An apparatus, comprising:

one or more processors; and

one or more computer-readable non-transitory storage media coupled to the one or more processors and comprising instructions that, when executed by the one or more processors, cause the apparatus to perform operations comprising:

identifying a transitional image, via a processor, wherein the transitional image comprises:

a first region of an object in a first image of a transportation infrastructure component, and

a second region of the object in a second image of the transportation infrastructure component;

generating a reconstruction of the object using the transitional image, wherein the reconstruction of the object comprises a first region of the object and the second region of the object;

identifying a first portion of the object in a first image;

constructing a first bounding box around the first portion of the object in the first image, wherein the first bounding box comprises the first region of the object;

identifying a second portion of the object in the transitional image; and

constructing a second bounding box around the second portion of the object in the transitional image, wherein the second bounding box comprises the first region of the object in the transitional image and the second region of the object.

2. The apparatus of claim 1 , wherein:

the first image further comprises a third region of the object, a fourth region of the object, and a fifth region of the object; and

the transitional image comprises the third region of the object and the fourth region of the object.

3. The apparatus of claim 2 , the operations further comprising:

determining that the third region of the object in the transitional image and the third region of the object in the first image are third equivalent regions; and

determining that the fourth region of the object in the transitional image and the fourth region of the object in the first image are fourth equivalent regions, wherein the reconstruction of the object excludes the third and fourth equivalent regions.

4. The apparatus of claim 2 , the operations further comprising concatenating the first region of the object, the second region of the object, the third region of the object, the fourth region of the object, and the fifth region of the object to generate the reconstruction of the object, wherein the reconstruction of the object represents the object in its entirety.

5. The apparatus of claim 1 , the operations further comprising using intersection over union (IoU) to determine that the first region of the object in the transitional image and the first region of the object in the first image are the first equivalent regions.

6. The apparatus of claim 1 , wherein the one or more processors include an object reconstruction module.

7. The apparatus of claim 1 , wherein the transitional image comprises half of the first image and half of the second image.

8. A method, comprising:

identifying a transitional image, via a processor, wherein the transitional image comprises:

a first region of an object in a first image of a transportation infrastructure component, and

a second region of the object in a second image of the transportation infrastructure component;

generating a reconstruction of the object using the transitional image, wherein the reconstruction of the object comprises a first region of the object and the second region of the object;

identifying a first portion of the object in a first image;

constructing a first bounding box around the first portion of the object in the first image, wherein the first bounding box comprises the first region of the object;

identifying a second portion of the object in the transitional image; and

constructing a second bounding box around the second portion of the object in the transitional image, wherein the second bounding box comprises the first region of the object in the transitional image and the second region of the object.

9. The method of claim 8 , wherein:

the first image further comprises a third region of the object, a fourth region of the object, and a fifth region of the object; and

the transitional image comprises the third region of the object and the fourth region of the object.

10. The method of claim 9 , further comprising:

determining, by an object reconstruction module, that the third region of the object in the transitional image and the third region of the object in the first image are third equivalent regions; and

determining, by the object reconstruction module, that the fourth region of the object in the transitional image and the fourth region of the object in the first image are fourth equivalent regions, wherein the reconstruction of the object excludes the third and fourth equivalent regions.

11. The method of claim 9 , further comprising concatenating, by the object reconstruction module, the first region of the object, the second region of the object, the third region of the object, the fourth region of the object, and the fifth region of the object to generate the reconstruction of the object, wherein the reconstruction of the object represents the object in its entirety.

12. The method of claim 8 , further comprising using intersection over union (IoU) to determine that the first region of the object in the transitional image and the first region of the object in the first image are the first equivalent regions.

13. The method of claim 8 , wherein the processor includes an object reconstruction module.

14. The method of claim 8 , wherein the transitional image comprises half of the first image and half of the second image.

15. One or more computer-readable non-transitory storage media embodying instructions that, when executed by a processor, cause the processor to perform operations comprising:

identifying a transitional image, via a processor, wherein the transitional image comprises:

a first region of an object in a first image of a transportation infrastructure component, and

a second region of the object in a second image of the transportation infrastructure component;

generating a reconstruction of the object using the transitional image, wherein the reconstruction of the object comprises a first region of the object and the second region of the object;

identifying a first portion of the object in a first image;

constructing a first bounding box around the first portion of the object in the first image, wherein the first bounding box comprises the first region of the object;

identifying a second portion of the object in the transitional image; and

constructing a second bounding box around the second portion of the object in the transitional image, wherein the second bounding box comprises the first region of the object in the transitional image and the second region of the object.

16. The one or more computer-readable non-transitory storage media of claim 15 , wherein:

the first image further comprises a third region of the object, a fourth region of the object, and a fifth region of the object; and

the transitional image comprises the third region of the object and the fourth region of the object.

17. The one or more computer-readable non-transitory storage media of claim 16 , the operations further comprising:

determining, by the object reconstruction module, that the third region of the object in the transitional image and the third region of the object in the first image are third equivalent regions; and

determining, by the object reconstruction module, that the fourth region of the object in the transitional image and the fourth region of the object in the first image are fourth equivalent regions, wherein the reconstruction of the object excludes the third and fourth equivalent regions.

18. The one or more computer-readable non-transitory storage media of claim 16 , the operations further comprising concatenating, by the object reconstruction module, the first region of the object, the second region of the object, the third region of the object, the fourth region of the object, and the fifth region of the object to generate the reconstruction of the object, wherein the reconstruction of the object represents the object in its entirety.

19. The one or more computer-readable non-transitory storage media of claim 15 , the operations further comprising using intersection over union (IoU) to determine that the first region of the object in the transitional image and the first region of the object in the first image are the first equivalent regions.

20. The one or more computer-readable non-transitory storage media of claim 15 , wherein the one or more processors include an object reconstruction module.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2022
From: KOHLER, RACHEL
To: BNSF RAILWAY COMPANY
Reel/Frame 060567/0267 →
Continuity (2)
Continuation 16917590 · Jun 30, 2020
Related Publication 20230010706A1 · Jan 12, 2023
Cited By (6)
US 12,269,524 US 12,344,294 US 12,348,880 US 12,365,373 US 12,420,851 US 12,662,176