IP Library Granted Patent US 12,401,774
Granted Patent B2
US 12,401,774 · App. 18/337,175 · Granted Aug 26, 2025

Matching segments of video for virtual display of a space

Inventor: Eugene Herbert Dierks, III (Spokane Valley, WA)
Assignee: DIERKS TECHNOLOGY, INC.
H04N13/156G06T7/74H04N13/122H04N13/221H04N13/282
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,401,774
App. No.
18/337,175
Granted
Aug 26, 2025
Kind
B2
Abstract

Systems, methods, and non-transitory computer-readable medium storing instructions that, when executed, causes a processor to perform operations to display a three-dimensional (3D) space. The methods may include, with an imaging device, capturing a first series of frames as the imaging device travels from a first location to a second location within a space, and capturing a second series of frames as the imaging device travels from the second location to the first location. The method may also include determining a first segment in the first series of frames that matches a second segment in the second series of frames to create a segmentation dataset, generating video clip data based on the segmentation dataset, the video clip data defining a series of video clips, and displaying the series of video clips.

Claims (78)

1. A non-transitory computer-readable medium storing instructions that, when executed, causes a processor to perform operations comprising:

creating a segmentation dataset based on a first segment in a first series of frames captured along a first direction of a path that matches a second segment in a second series of frames captured along a second direction of the path, the first direction being opposite the second direction along the path;

generating video clip data based on the segmentation dataset, the video clip data defining a series of video clips; and

with an imaging device:

capturing the first series of frames as the imaging device travels from a first location to a second location within a space, and

capturing the second series of frames as the imaging device travels from the second location to the first location,

wherein the imaging device captures the first series of frames and the second series of frames for the segmentation dataset, and

wherein the segmentation dataset is created based at least in part on metadata derived via execution of a visual simultaneous location and mapping (VSLAM) process.

2. The non-transitory computer-readable medium of claim 1 ,

wherein the imaging device captures the first series of frames and the second series of frames in a single video clip.

3. The non-transitory computer-readable medium of claim 1 , further comprising presenting the series of video clips comprising:

detecting instructions to advance along the second direction of the path at an intermediate portion of the first segment along the first direction; and

presenting a corresponding portion of the second segment matching the intermediate portion of the first segment.

4. The non-transitory computer-readable medium of claim 1 , the operations further comprising:

defining coordinates and angles of capture of frames in the first series of frames and the second series of frames relative to at least a first frame of the frames; and

storing the coordinates and the angles of capture as mapping data in a database.

5. The non-transitory computer-readable medium of claim 4 , wherein:

the segmentation dataset is created based at least in part on the mapping data, and

the operation of generating the video clip data based on the segmentation dataset comprises:

normalizing a distance between the frames in the first series of frames and the second series of frames within a space based on the mapping data;

removing a frame of the first series of frames or the second series of frames to normalize a distance traveled along the first segment and the second segment to obtain normalized segments; and

storing the normalized segments as the segmentation dataset.

6. The non-transitory computer-readable medium of claim 1 , the operations further comprising, based at least in part on the video clip data, identifying an endpoint of a first video clip and a second video clip of the series of video clips.

7. The non-transitory computer-readable medium of claim 6 , the operations further comprising:

defining the endpoint as a decision point within a space at which at least three available directions of movement within the space are presented via a user interface displaying the series of video clips; and

presenting on the user interface a direction selection defining a direction from the endpoint, a turning selection defining a turning around at the endpoint, one of the first video clip or the second video clip defining movement in a direction based on the direction selection, or a third video clip of a turning around movement based on the turning selection.

8. A client device comprising:

a processor; and

a non-transitory computer-readable media storing instructions that, when executed by the processor, causes the processor to perform operations comprising:

creating a segmentation dataset based on a first segment in a first series of frames captured along a first direction of a path that matches a second segment in a second series of frames captured along a second direction of the path, the first direction being opposite the second direction along the path;

generating video clip data based on the segmentation dataset, the video clip data defining a series of video clips; and

with an imaging device:

capturing the first series of frames as the imaging device travels from a first location to a second location within a space, and

capturing the second series of frames as the imaging device travels from the second location to the first location, and

wherein the segmentation dataset is created based at least in part on metadata derived via execution of a visual simultaneous location and mapping (VSLAM) process.

9. The client device of claim 8 , wherein the imaging device captures the first series of frames and the second series of frames in a single video clip.

10. The client device of claim 8 , wherein the imaging device is a 360 degree video capture device.

11. The client device of claim 8 , the operations further comprising:

defining coordinates and angles of capture of frames in the first series of frames and the second series of frames relative to at least a first frame of the frames; and

storing the coordinates and angles of capture as mapping data in a database,

wherein:

the segmentation dataset is created based at least in part on the mapping data, and

the generating the video clip data based on the segmentation dataset comprises:

normalizing a distance between the frames in the first series of frames and the second series of frames within a space based on the mapping data;

removing a frame of the first series of frames or the second series of frames to normalize a distance traveled along the first segment and the second segment to obtain normalized segments; and

storing the normalized segments as the segmentation dataset.

12. The client device of claim 8 , the operations further comprising, based at least in part on the video clip data, identifying an endpoint of a first video clip and a second video clip of the series of video clips.

13. The client device of claim 12 , the operations further comprising:

defining the endpoint as a decision point within a space at which at least three available directions of movement within the space are presented via a user interface displaying the series of video clips; and

presenting on the user interface a direction selection defining a direction from the endpoint, a turning selection defining a turning around at the endpoint, one of the first video clip or the second video clip defining movement in a direction based on the direction selection, or a third video clip of a turning around movement based on the turning selection.

14. A method of displaying a three-dimensional (3D) space, comprising:

creating a segmentation dataset based on a first segment in a first series of frames captured along a first direction of a path that matches a second segment in a second series of frames captured along a second direction of the path, the first direction being opposite the second direction along the path;

generating video clip data based on the segmentation dataset, the video clip data defining a series of video clips and

with an imaging device:

capturing the first series of frames as the imaging device travels from a first location to a second location within a space, and

capturing the second series of frames as the imaging device travels from the second location to the first location, and

wherein the segmentation dataset is created based at least in part on metadata derived via execution of a visual simultaneous location and mapping (VSLAM) process.

15. The method of claim 14 , further comprising:

defining coordinates and angles of capture of frames in the first series of frames and the second series of frames relative to at least a first frame of the frames; and

storing the coordinates and the angles of capture as mapping data in a database.

16. The method of claim 15 , wherein:

the segmentation dataset is created based at least in part on the mapping data, and

the generating the video clip data based on the segmentation dataset comprises:

normalizing a distance between the frames in the first series of frames and the second series of frames within a space based on the mapping data;

removing a frame of the first series of frames or the second series of frames to normalize a distance traveled along the first segment and the second segment to obtain normalized segments; and

storing the normalized segments as the segmentation dataset.

17. The method of claim 14 , further comprising, based at least in part on the video clip data, identifying an endpoint of a first video clip and a second video clip of the series of video clips.

18. The method of claim 17 , further comprising:

defining the endpoint as a decision point within a space at which at least three available directions of movement within the space are presented via a user interface displaying the series of video clips; and

presenting on the user interface a direction selection defining a direction from the endpoint, a turning selection defining a turning around at the endpoint, one of the first video clip or the second video clip defining movement in a direction based on the direction selection, or a third video clip of a turning around movement based on the turning selection.

19. The method of claim 14 , further comprising:

with an imaging device:

capturing a first series of frames as the imaging device travels from a first location to a second location within a space; and

capturing a second series of frames as the imaging device travels from the second location to the first location,

wherein:

the imaging device captures the first series of frames and the second series of frames in a single video clip, and

the imaging device is a 360 degree video capture device.

20. The client device of claim 8 , wherein the imaging device captures the first series of frames and the second series of frames for the segmentation dataset.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2025
From: DIERKS, EUGENE HERBERT, III
To: DIERKS TECHNOLOGY, INC.
Reel/Frame 071389/0206 →
Continuity (2)
Continuation 17339703 · Jun 4, 2021
Related Publication 20230412786A1 · Dec 21, 2023
References Cited (37)
US 8797315B1 · Kuhne · 2014 [cited by applicant]
US 9786097B2 · Bell et al. · 2017 [cited by applicant]
US 10030979B2 · Bjorke et al. · 2018 [cited by applicant]
US 10530997B2 · Shan et al. · 2020 [cited by applicant]
US 10825247B1 · Vincent · 2020 [cited by examiner]
US 11252329B1 · Cier · 2022 [cited by examiner]
US 20090248304A1 · Roumeliotis · 2009 [cited by examiner]
US 20100312670A1 · Dempsey · 2010 [cited by examiner]
US 20180074508A1 · Kleiner · 2018 [cited by examiner]
US 20180143756A1 · Mildrew et al. · 2018 [cited by applicant]
US 20190020817A1 · Shan · 2019 [cited by examiner]
US 20190162534A1 · Metzler et al. · 2019 [cited by applicant]
US 20190179145A1 · Ibrahim · 2019 [cited by examiner]
US 20190183310A1 · Herron · 2019 [cited by examiner]
US 20190197769A1 · Khosrowpour · 2019 [cited by applicant]
US 20190220019A1 · Tan · 2019 [cited by examiner]
US 20200092473A1 · Shan et al. · 2020 [cited by applicant]
US 20200116493A1 · Colburn et al. · 2020 [cited by applicant]
US 20200275023A1 · Birkler · 2020 [cited by applicant]
US 20200296350A1 · Oh · 2020 [cited by applicant]
US 20200336675A1 · Dawson et al. · 2020 [cited by applicant]
US 20200408532A1 · Colburn et al. · 2020 [cited by applicant]
US 20210089040A1 · Ebrahimi Afrouzi et al. · 2021 [cited by applicant]
US 20210105313A1 · Wang et al. · 2021 [cited by applicant]
US 20210125397A1 · Moulon et al. · 2021 [cited by applicant]
US 20210385378A1 · Cier et al. · 2021 [cited by applicant]
US 20220003555A1 · Colburn et al. · 2022 [cited by applicant]
US 20220101557A1 · Niday · 2022 [cited by examiner]
US 20220114291A1 · Li · 2022 [cited by examiner]
US 20220224833A1 · Cier · 2022 [cited by examiner]
US 20220269885A1 · Wixson · 2022 [cited by examiner]
US 20220269888A1 · Stoeva · 2022 [cited by examiner]
US 20220394228A1 · Dierks · 2022 [cited by applicant]
US 20230300312A1 · Kim · 2023 [cited by examiner]
CA 3069813A1 · 2019 [cited by applicant]
Office Action for U.S. Appl. No. 17/339,703,mailed on Mar. 23, 2022, Dierks II, Matching Segments of Video for Virtual Display of a Space:, 16 Pages. [cited by applicant]
Office Action for U.S. Appl. No. 17/339,703, mailed on Aug. 22, 2022, Dierks III, “Matching Segments of Video for Virtual Display of a Space”, 45 Pages. [cited by applicant]