IP Library › Granted Patent US 12,620,112
Granted Patent B2
US 12,620,112 · App. 18/887,980 · Granted May 5, 2026

Subsurface imaging and display of 3D digital image and 3D image sequence

Inventors: Jerry Nims (Sandy Springs, GA); William M. Karszes (Hilton Head, SC); Samuel Pol (Lawrenceville, GA)
G06T7/593G01S15/86G01S15/8993G01S17/86G01S17/894G06T7/0012G06T7/521G06T2207/10064G06T2207/10081G06T2207/10088G06T2207/10104G06T2207/10116G06T2207/10136
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,620,112
App. No.
18/887,980
Granted
May 5, 2026
Kind
B2
Abstract

To simulate a 3D image of a subsurface below a surface, the system having a memory device for storing an instruction, a processor in communication with the memory device configured to execute the instruction, and a subsurface image capture module in communication with the processor, the subsurface image capture module having one or more wave generating device and one or more sensor affixed to a vehicle to capture a series of digital image datasets of the subsurface with a coordinate reference data, wherein the processor executes an instruction to generate a digital model of the series of digital image datasets of the subsurface while maintaining the coordinate reference data, wherein the processor executes an instruction to determine a depth map of the digital model, and wherein the processor executes an instruction to identify a key subject point in the digital model, where subsurface includes an internal biology, below ground, underwater.

Claims (57)

1 . A system to capture a plurality of two dimensional (2D) images of a terrain of a scene, process the images, and view a multidimensional digital image, the system comprising:

a vehicle having a geocoding detector to identify coordinate reference data of said vehicle, a memory device for storing an instruction, a processor in communication with said memory device configured to execute said instruction, and an image capture module in communication with said processor, said capture module having a 2D RGB digital camera to capture a plurality of 2D digital images of the terrain and a digital depth capture device to capture a series of digital elevation scans to generate a digital elevation model of the terrain, with said coordinate reference data;

said processor executes an instruction to overlay said plurality of 2D digital images of the terrain thereon said digital elevation model of the terrain while maintaining said coordinate reference data, wherein said processor executes an instruction to determine a depth map of said digital elevation model;

said processor executes an instruction to save said plurality of 2D digital image of the terrain in a sequence relative to said coordinate reference data;

said processor executes an instruction to align said sequence of said plurality of said 2D digital images of the terrain horizontally and vertically;

said processor executes an instruction to select a key subject point in said sequence of said plurality of 2D digital images of the terrain and align said sequence of said plurality of 2D digital images about said key subject point;

a display in communication with said processor, said display configured to display said multidimensional digital image, said display having a lenticular lens configured as a plurality of pixels having a refractive element integrated therein, said refractive element having a repeating series of lens segments aligned as a single layer therewith said plurality of pixels,

said processor executes an instruction to interphase said sequence of said plurality of 2D digital images of the terrain aligned about said key subject point to correspond to said lenticular lens spacing;

said processor executes an instruction to save said sequence of said 2D digital images of the terrain as one of a plurality of image datasets of the terrain;

said processor executes an instruction to generate a digital model of said sequence of 2D digital images of the terrain while maintaining said coordinate reference data and generate the multidimensional digital image therefrom; and

said processor executes an instruction to display the multidimensional digital image of the terrain on said display.

2 . The system of claim 1 , wherein said processor executes an instruction to automatically select said key subject point in said sequence of said plurality of 2D digital images of the terrain.

3 . The system of claim 1 , wherein said processor executes an instruction to enable a user to select said key subject point in said sequence of said plurality of 2D digital images of the terrain via an input from said display.

4 . The system of claim 1 , wherein said processor executes an instruction to merge said plurality of 2D digital images into a 2D digital image dataset of the terrain with said coordinate reference data.

5 . The system of claim 4 , wherein said processor executes an instruction to merge said series of digital elevation scans into a digital elevation model of the terrain with said coordinate reference data.

6 . The system of claim 5 , wherein said processor executes an instruction to overlay said 2D digital image dataset thereon said digital elevation model of the terrain while maintaining said coordinate reference data as 3D color mesh dataset.

7 . The system of claim 6 , wherein said processor executes an instruction to determine a depth map of said 3D color mesh dataset.

8 . The system of claim 7 , wherein said processor executes an instruction to identify a key subject point in said 3D color mesh dataset.

9 . The system of claim 8 , wherein said processor executes an instruction to generate a set of 3D frames of said 3D color mesh Dataset images via a virtual camera moving in an arc about said key subject point.

10 . The system of claim 9 , wherein said processor executes an instruction to horizontally align said set of 3D frames about said key subject point as a set of 3D HIT images to create a parallax between a near plane and a far plane relative to said key subject point.

11 . The system of claim 10 , wherein said processor executes an instruction to perform a dimensional image format transform of said 3D HIT images to a 3D DIF images.

12 . The system of claim 9 , wherein said processor executes an instruction to identify a first proximal plane and a second distal plane within said 3D frames.

13 . The system of claim 12 , wherein said processor executes an instruction to determine a depth estimate for said first proximal plane and said second distal plane within said 3D frames.

14 . The system of claim 11 , wherein said processor executes an instruction to align said 3D DIF images sequentially in a palindrome loop as a multidimensional digital image sequence.

15 . The system of claim 14 , wherein said processor executes an instruction to edit said multidimensional digital image sequence.

16 . The system of claim 15 , wherein said processor executes an instruction to display said multidimensional digital image sequence on said display.

17 . The system of claim 10 , wherein said processor executes an instruction to perform an interphasing of two of said 3D DIF images relative to said key subject point as a multidimensional digital image to introduce a binocular disparity between said two of said 3D DIF images.

18 . The system of claim 17 , wherein said processor executes an instruction to edit said multidimensional digital image.

19 . The system of claim 15 , wherein said processor executes an instruction to display said multidimensional digital image on said display.

20 . The system of claim 19 , wherein said display is configured having alternating digital black lines via a barrier screen.

21 . The system of claim 19 , wherein said display is configured as a plurality of pixels, each said pixel having a refractive element integrated therewith.

22 . The system of claim 21 , wherein said refractive element is configured having a cross-section shaped as an arc.

23 . The system of claim 21 , said refractive element is configured having a cross-section shaped as a dome.

24 . The system of claim 21 , wherein said refractive element is configured having a cross-section shaped as a plurality of trapezoid sections, each of said plurality of trapezoid sections having a flat section, an incline angle, and a decline angle.

25 . The system of claim 21 , wherein said display is configured to display said multidimensional digital image and utilizes at least one layer selected from the group consisting of a lenticular lens, a barrier screen, a parabolic lens, an overlay, a waveguide, and combinations thereof.

26 . A method of capturing a plurality of two dimensional (2D) images of a terrain of a scene, processing the images, and view a multidimensional digital image, the method comprising the steps of:

providing a vehicle having a geocoding detector to identify coordinate reference data of said vehicle, a memory device for storing an instruction, a processor in communication with said memory device configured to execute said instruction, and an image capture module in communication with said processor, said capture module having a 2D RGB digital camera to capture a plurality of 2D digital images of the terrain and a digital depth capture device to capture a plurality of digital elevation scans to generate a digital elevation model of the terrain, with said coordinate reference data, a display in communication with said processor, said display configured to display said multidimensional digital image, said display having a lenticular lens configured as a plurality of pixels having a refractive element integrated therein, said refractive element having a repeating series of lens segments aligned as a single layer therewith said plurality of pixels;

executing an instruction, by said processor, to overlay said plurality of 2D digital images of the terrain thereon said digital elevation model of the terrain while maintaining said coordinate reference data:

executing an instruction, by said processor, to determine a depth map of said digital elevation model;

executing an instruction, by said processor, to save said plurality of 2D digital image of the terrain in a sequence relative to said coordinate reference data;

executing an instruction, by said processor, to align said sequence of said plurality of said 2D digital images of the terrain horizontally and vertically;

executing an instruction, by said processor, to select a key subject point in said sequence of said plurality of 2D digital images of the terrain and align said sequence of said plurality of 2D digital images about said key subject point;

executing an instruction, by said processor, to interphase said sequence of said plurality of 2D digital images of the terrain aligned about said key subject point to correspond to said lenticular lens spacing;

executing an instruction, by said processor, to save said sequence of said 2D digital images of the terrain as one of a plurality of image datasets of the terrain;

executing an instruction, by said processor, to generate a digital model of said sequence of 2D digital images of the terrain while maintaining said coordinate reference data and generate the multidimensional digital image therefrom; and

executing an instruction, by said processor, to display the multidimensional digital image of the terrain on said display.

27 . The method of claim 26 , further comprising the step of overlaying said 2D digital image dataset thereon said digital elevation model of the terrain while maintaining said coordinate reference data as a 3D color mesh dataset.

28 . The method of claim 27 , further comprising the step of selecting a key subject point in said 3D color mesh dataset.

29 . The method of claim 27 , further comprising the step of performing a horizontal image translation of said 3D color mesh dataset about said key subject point.

30 . The method of claim 29 , further comprising the step of generating a depth map from said 3D color mesh dataset.

31 . The method of claim 30 , further comprising the step of aligning horizontally and vertically a first proximal plane of each image frame in said 3D color mesh dataset and shifting a second distal plane of each subsequent image frame in said 3D color mesh dataset based on a depth estimate of said second distal plane to produce a modified 3D color mesh dataset.

32 . The method of claim 31 , further comprising the step of aligning said modified 3D color mesh dataset sequentially in a palindrome loop as a multidimensional digital image sequence.

33 . The method of claim 32 , further comprising the step of editing said multidimensional digital image sequence.

34 . The method of claim 33 , further comprising the step of displaying said multidimensional digital image sequence on said display.

35 . The method of claim 31 , further comprising the step of performing an interphasing of said modified 3D color mesh dataset as a multidimensional digital image.

36 . The method of claim 35 , further comprising the step of providing said display having at least one layer selected from the group consisting of a lenticular lens, a barrier screen, a parabolic lens, an overlay, a waveguide, and combinations thereof.

37 . The method of claim 36 , further comprising the step of displaying said multidimensional digital image on said display.

Continuity (2)
Continuation 17511490 · Oct 26, 2021
Related Publication 20250014202A1 · Jan 9, 2025
References Cited (16)
US 7298869B1 · Abernathy · 2007 [cited by examiner]
US 7580952B2 · Logan · 2009 [cited by examiner]
US D893620S · Faulkner · 2020 [cited by examiner]
US 12106501B2 · Nims · 2024 [cited by examiner]
US 20120113100A1 · Niioka · 2012 [cited by examiner]
US 20130176297A1 · Broberg · 2013 [cited by examiner]
US 20160227184A1 · Nims · 2016 [cited by examiner]
US 20170039765A1 · Zhou · 2017 [cited by examiner]
US 20190049574A1 · Simula · 2019 [cited by examiner]
US 20200057488A1 · Johnson · 2020 [cited by examiner]
US 20200275083A1 · Yoneda · 2020 [cited by examiner]
US 20210392314A1 · Nims · 2021 [cited by examiner]
US 20210405638A1 · Boyraz · 2021 [cited by examiner]
US 20220066456A1 · Ebrahimi Afrouzi · 2022 [cited by examiner]
US 20220092305A1 · Loveland · 2022 [cited by examiner]
US 20230064675A1 · Higgins · 2023 [cited by examiner]