IP Library › Granted Patent US 12,322,188
Granted Patent B2
US 12,322,188 · App. 17/669,516 · Granted Jun 3, 2025

System and method of capturing and processing exterior environment of a structure via an autonomous vehicle

Inventor: Nadeem Alam Shah (Mumbai, IN)
G06V20/56G05D1/101G06T7/70G05D2105/89G05D2109/20G06Q50/16G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,322,188
App. No.
17/669,516
Granted
Jun 3, 2025
Kind
B2
Abstract

A system and a method of capturing and processing exterior environment of a structure via an autonomous vehicle are disclosed. The system receives location details, an elevation plan and a floor plan of a structure. The system prepares an image mapping plan for collecting images of the structure at each level. The system identifies a direction orientation for setting a Ground Control Point (GCP) at a base of the structure for operating an autonomous vehicle. The system employs the autonomous vehicle for capturing images of interior and exterior of the structure at each level by an image sensor of the autonomous vehicle. The system places icons mapping the images captured with the image mapping plan. The system accesses the images of the interior and exterior of the structure upon selecting the icons placed on the image mapping plan.

Claims (26)

1. A method of capturing and processing images of interior and exterior environment of a structure via an autonomous vehicle, the method comprising steps of:

acquiring, by a processor, location details, an elevation plan and a floor plan of the structure;

preparing, by the processor, an image mapping plan for collecting images of the structure at each level based on the location details, the elevation plan and the floor plan of the structure;

identifying, by the processor, a direction orientation of the structure for setting a Ground Control Point (GCP) at a base of the structure for operating the autonomous vehicle based on the image mapping plan;

positioning, by the processor, the autonomous vehicle by setting a Real Time Kinematics (RTK) base station at the Ground Control Point (GCP) at the base of the structure;

operating, by the processor, the autonomous vehicle vertically from the base to the top of the structure corresponding to the direction orientation;

employing, by the processor, the autonomous vehicle for capturing images of interior and exterior of the structure at each level by an image sensor of the autonomous vehicle based on the image mapping plan, wherein the image mapping plan indicates a directory structure in which the images are stored and linked at each level of the structure, and wherein the autonomous vehicle is employed for capturing details corresponding to wind direction, wind speed, and ambient noise at each level of the structure;

editing, by the processor, the images for color corrections;

cropping, by the processor, the images for adjusting the direction orientation corresponding to the floor plan, wherein the images are collated forming a single and continuous image of the structure;

placing, by the processor, icons by mapping the images captured with the image mapping plan; and

accessing, by the processor, the images of the interior and exterior of the structure and details corresponding to wind direction, wind speed, and ambient noise at each level of the structure upon selecting the icons placed on the image mapping plan.

2. The method of claim 1 , further comprising transmitting, by the processor, the images of the interior and exterior of the structure to a user device.

3. A system for capturing and processing images of interior and exterior environment of a structure via an autonomous vehicle, the system comprising:

a memory; and

a processor coupled to the memory, wherein the processor executes program instructions stored in the memory, to:

receive location details, an elevation plan and a floor plan of the structure;

prepare an image mapping plan for collecting images of the structure at each level based on the location details, the elevation plan and the floor plan of the structure;

identify a direction orientation of the structure for setting a Ground Control Point (GCP) at a base of the structure for operating the autonomous vehicle based on the image mapping plan;

positioning the autonomous vehicle by setting a Real Time Kinematics (RTK) base station at the Ground Control Point (GCP) at the base of the structure;

operate the autonomous vehicle vertically from the base to the top of the structure corresponding to the direction orientation;

employ the autonomous vehicle for capturing images of interior and exterior of the structure at each level by an image sensor of the autonomous vehicle based on the image mapping plan, wherein the image mapping plan indicates a directory structure in which the images are stored and linked at each level of the structure, and wherein the autonomous vehicle is employed for capturing details corresponding to wind direction, wind speed, and ambient noise at each level of the structure;

editing the images for color corrections;

cropping the images for adjusting the direction orientation corresponding to the floor plan, wherein the images are collated forming a single and continuous image of the structure;

place icons to map the images captured with the image mapping plan; and

access the images of the interior and exterior of the structure and details corresponding to wind direction, wind speed, and ambient noise at each level of the structure upon selecting the icons placed on the image mapping plan.

4. The system of claim 3 , wherein the processor executes the program instructions to transmit the images of the interior and exterior of the structure to a user device.

Continuity (1)
Related Publication 20220254163A1 · Aug 11, 2022
References Cited (16)
US 6084978A · Taylor · 2000 [cited by examiner]
US 9898558B1 · Tofte · 2018 [cited by examiner]
US 10055831B2 · Loveland · 2018 [cited by examiner]
US 10825247B1 · Vincent · 2020 [cited by examiner]
US 11069145B1 · Pearson · 2021 [cited by examiner]
US 11216663B1 · Ettinger · 2022 [cited by examiner]
US 11783385B1 · Khosravan · 2023 [cited by examiner]
US 20130179841A1 · Mutton · 2013 [cited by examiner]
US 20170011477A1 · Murphey · 2017 [cited by examiner]
US 20190147749A1 · Lewis · 2019 [cited by examiner]
US 20190369648A1 · Fang · 2019 [cited by examiner]
US 20200019167A1 · Alshamrani · 2020 [cited by examiner]
US 20200103552A1 · Phelan · 2020 [cited by examiner]
CN 107807950A · 2018 [cited by examiner]
KR 101769852B1 · 2017 [cited by examiner]
Sreeram et al., “Virtual Design Review and Planning Using Augmented Reality and Drones,” 2018 Second International Conference on Intelligent Computing and Control Systems (ICICCS), Madurai, India, 2018, pp. 915-918 (Yea… [cited by examiner]