IP Library Granted Patent US 12,118,703
Granted Patent B2
US 12,118,703 · App. 17/365,773 · Granted Oct 15, 2024

Photo-realistic infrastructure inspection

Inventors: Andrew Harmen (Doylestown, PA); Gabe Detter (Landisville, PA); Mohamed Morsy (Bridgeville, PA); Andrew Lawniczak (South Park Township, PA); Galin Konalchiev (Pittsburgh, PA); Matthew Crowell (Murrysville, PA); Jack Buffington (Pittsburgh, PA); Mohsen Pashna (Chatswood, NZ); Richard Rigby (Stillwater, NZ); Jason Mizgorski (Gibsonia, PA); Foster J Salotti (Warrendale, PA); Jjianan Lin (Auckland, NZ); Valerie Walch (Warrendale, PA)
Assignee: RedZone Robotics, Inc.
G06T7/0004G06T7/344G06T7/55G06T17/20G06T2207/10016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,118,703
App. No.
17/365,773
Granted
Oct 15, 2024
Kind
B2
Abstract

One aspect provides a modular inspection robot for inspecting vertical shafts, chambers or tunnels. An embodiment provides related methods and products. One method includes: capturing, using a plurality of video cameras associated with an infrastructure inspection unit, two or more videos of infrastructure; accessing, using one or more processors, image metadata indicating a mesh of connected vertices based on the two or more videos; selecting, using the one or more processors, image data of frames of the two or more videos for inclusion in an output based on the mesh; and outputting, using the one or more processors, a photo-realistic image of the infrastructure comprising the image data selected. Other examples are described and claimed.

Claims (37)

1. A method, comprising:

capturing, using one or more video cameras associated with an infrastructure inspection unit, two or more video frames of infrastructure;

accessing, using one or more processors, image metadata indicating a model of connected points based on the two or more video frames;

identifying, using the one or more processors, image data of the two or more video frames of the infrastructure;

selecting, using the one or more processors, image data of the two or more video frames for inclusion in an output based on the model;

wherein the selecting comprises selecting first image data of a single frame for inclusion in a photorealistic image; and

outputting, using the one or more processors, the photo-realistic image of the infrastructure comprising the image data selected.

2. The method of claim 1 , wherein the selecting is based on a point of view of a video camera of the one or more video cameras.

3. The method of claim 1 , wherein the photo-realistic image comprises the model.

4. The method of claim 3 , comprising providing, using the one or more processors, an interface element for culling data from the model.

5. The method of claim 3 , comprising providing, using the one or more processors, an interface element for indicating a portion of the model.

6. The method of claim 5 , comprising, responsive to receiving an indication via the interface element, providing quantitative measurement data for a feature of the infrastructure based on the model.

7. The method of claim 6 , comprising automatically scaling, based on the feature, quantitative measurement data for one or more other features of the infrastructure based on the indication.

8. The method of claim 1 , wherein the photo-realistic image is one or more of an image, a frame in a video, a virtual three-dimensional image, and the model comprising pixels of image data of the two or more video frames.

9. A computer program product, comprising:

a non-transitory computer readable medium storing computer-executable code comprising:

code for accessing two or more video frames of infrastructure;

code for accessing image metadata indicating a model of connected points based on the two or more video frames;

code for identifying image data of the two or more video frames of the infrastructure;

code for selecting image data of the two or more video frames for inclusion in an output based on the model; and

wherein the selecting comprises selecting first image data of a single frame for inclusion in a photorealistic image;

code for outputting the photo-realistic image of the infrastructure comprising the image data selected.

10. The computer program product of claim 9 , wherein the selecting is based on a point of view of a video camera of one or more video cameras.

11. The computer program product of claim 9 , wherein the photo-realistic image comprises the model.

12. The computer program product of claim 11 , comprising code for providing an interface element for culling data from the model.

13. The computer program product of claim 11 , comprising code for providing an interface element for indicating a portion of the model.

14. The computer program product of claim 13 , comprising code for, responsive to receiving an indication via the interface element, providing quantitative measurement data for a feature of the infrastructure based on the model.

15. The computer program product of claim 14 , comprising code for automatically scaling, based on the feature, quantitative measurement data for one or more other features of the infrastructure based on the indication.

16. The computer program product of claim 9 , wherein the photo-realistic image is one or more of an image, a frame in a video, a virtual three-dimensional image, and the model comprising pixels of image data of the two or more video frames.

17. A method, comprising:

obtaining, from one or more video cameras associated with an infrastructure inspection unit, two or more video frames of infrastructure;

accessing, using one or more processors, image metadata indicating overlap between the two or more video frames;

identifying, using the one or more processors, image data of the two or more video frames of the infrastructure;

selecting, using the one or more processors, image data of the two or more video frames for inclusion in an output based on the model;

wherein the selecting comprises selecting first image data of a single frame for inclusion in a photorealistic image; and

outputting, using the one or more processors, the photo-realistic image of the infrastructure comprising the image data selected.

18. The method of claim 3 , comprising providing, using the one or more processors, an interface element for interacting with the model.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 28, 2024
From: LIN, JIANAN; CROWELL, MATTHEW; KONALCHIEV, GALIN; PASHNA, MOSHEN; RIGBY, RICHARD; SALOTTI, FOSTER J.
To: REDZONE ROBOTICS, INC.
Reel/Frame 067542/0472 →
SECURITY INTEREST Recorded Dec 20, 2022
From: REDZONE ROBOTICS, INC.; RZR HOLDCO, INC.; RZR BUYER SUB, INC.
To: FIRST COMMONWEALTH BANK
Reel/Frame 062160/0976 →
Continuity (2)
Provisional Application 63047393 · Jul 2, 2020
Related Publication 20220028054A1 · Jan 27, 2022