IP Library Granted Patent US 11,851,179
Granted Patent B1
US 11,851,179 · App. 16/845,054 · Granted Dec 26, 2023

Imaging controls for unmanned aerial vehicles

Inventors: Agris Kipurs (Jelgava, LV); Ilja Nevdahs (Carnikava, LV); Deins Egle (Riga, LV)
Assignee: Alarm.com Incorporated
B64C39/024G05D1/106B64U2101/30B64U2201/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,851,179
App. No.
16/845,054
Granted
Dec 26, 2023
Kind
B1
Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, are described for performing privacy-aware surveillance with a security camera drone. The drone obtains image data using an imaging device and processes the image data to detect an object external to the drone. In response to processing the image data, the drone determines multiple viewing angles indicated in the image data with respect to the object. Based on the image data and the multiple viewing angles, a first section of the area for surveillance and a second, different section of the area to be excluded from surveillance are identified. The drone determines an adjustment to at least one of the multiple viewing angles to cause the second section to be excluded from surveillance. Based on the adjustment, the drone controls the imaging device to exclude the second section from surveillance imagery obtained by the drone.

Claims (68)

1. A method for surveilling an area using a drone from a drone system, the method comprising:

obtaining, using one or more processors of the drone system, image data using a plurality of imaging devices installed at the drone;

processing, using the one or more processors of the drone system, the image data to detect an object that is external to the drone;

in response to processing the image data, determining, using the one or more processors of the drone system, a plurality of viewing angles indicated in the image data with respect to the object;

based on the image data and the plurality of viewing angles, identifying, using the one or more processors of the drone system, a first section of the area for surveillance and a second, different section of the area to be excluded from surveillance;

dynamically calculating a respective frame coverage for the plurality of imaging devices installed at the drone, wherein each of the respective frame coverages are calculated concurrently as the image data is being obtained;

determining, based on the respective frame coverage and using the one or more processors of the drone system, an adjustment to at least one of the plurality of viewing angles to cause the second, different section of the area to be excluded from surveillance; and

based on the adjustment, controlling, using the one or more processors of the drone system, the plurality of imaging devices installed at the drone to exclude the second, different section of the area from surveillance imagery obtained by the drone.

2. The method of claim 1 , wherein determining the adjustment to at least one of the plurality of viewing angles comprises:

selecting a first viewing angle among the plurality of viewing angles;

calculating a new viewing angle that decreases an amount of the second, different section that is viewable from the first viewing angle; and

determining the adjustment based on the new viewing angle.

3. The method of claim 2 , comprising:

determining an operating altitude of the drone, wherein the operating altitude corresponds to an altitude range that allows the drone to exclude the second, different section of the area from being included in the surveillance imagery obtained by the drone; and

based at least on the operating altitude, controlling the drone, a sensor installed at the drone, and the imaging device to exclude the second, different section of the area from surveillance imagery obtained by the drone.

4. The method of claim 1 , wherein determining the adjustment to at least one of the plurality of viewing angles comprises:

determining a physical attribute of the object; and

determining the adjustment based on the physical attribute of the object.

5. The method of claim 1 , wherein the object:

is intermediate the first section and the second, different section of the area; and

defines a boundary that separates a first property represented by the first section owned by a first entity and a second, different property represented by the second, different section owned by a second entity.

6. The method of claim 1 , wherein the object is a virtual object inserted as an overlay to define a boundary between the first section and the second, different section.

7. The method of claim 1 , wherein determining the adjustment to at least one of the plurality of viewing angles comprises:

determining the adjustment based on an adjustment algorithm that is implemented using the imaging device, a sensor installed at the drone, and on-board circuitry of the drone.

8. The method of claim 7 , wherein the adjustment algorithm is an on-board viewing angle adjustment algorithm that is implemented using software instructions executed by a processor integrated in the on-board circuitry of the drone.

9. The method of claim 7 , wherein the adjustment algorithm is operable to adjust viewing angles of the imaging device during operation of the drone as the drone obtains surveillance imagery of a property.

10. The method of claim 1 , comprising:

performing an initial mapping of the area based on a mapping algorithm;

generating an initial map of the area in response to performing the initial mapping; and

generating, using the mapping algorithm, one or more subsequent maps of the area based on the adjustment.

11. The method of claim 1 , wherein:

the drone includes a plurality of cameras, and each camera of the plurality of cameras represents a respective imaging device installed at the drone; and

processing the image data comprises determining frame coverages for each of the plurality of cameras installed at the drone.

12. A drone system for surveilling an area using a drone, the system comprising:

one or more processors;

one or more non-transitory machine-readable storage devices storing instructions that are executable by the one or more processors to cause performance of operations comprising:

obtaining image data using an imaging device installed at the drone;

processing the image data to detect an object that is external to the drone;

in response to processing the image data, determining a plurality of viewing angles indicated in the image data with respect to the object;

based on the image data and the plurality of viewing angles, identifying a first section of the area for surveillance and a second, different section of the area to be excluded from surveillance;

dynamically calculating a respective frame coverage for the plurality of imaging devices installed at the drone, wherein each of the respective frame coverages are calculated concurrently as the image data is being obtained;

determining, based on the respective frame coverage, an adjustment to at least one of the plurality of viewing angles to cause the second, different section of the area to be excluded from surveillance; and

based on the adjustment, controlling the imaging device installed at the drone to exclude the second, different section of the area from surveillance imagery obtained by the drone.

13. The drone system of claim 12 , wherein determining the adjustment to at least one of the plurality of viewing angles comprises:

selecting a first viewing angle among the plurality of viewing angles;

calculating a new viewing angle that decreases an amount of the second, different section that is viewable from the first viewing angle; and

determining the adjustment based on the new viewing angle.

14. The drone system of claim 13 , wherein the operations comprise:

determining an operating altitude of the drone, wherein the operating altitude corresponds to an altitude range that allows the drone to exclude the second, different section of the area from being included in the surveillance imagery obtained by the drone; and

based at least on the operating altitude, controlling the drone, a sensor installed at the drone, and the imaging device to exclude the second, different section of the area from surveillance imagery obtained by the drone.

15. The drone system of claim 12 , wherein determining the adjustment to at least one of the plurality of viewing angles comprises:

determining a physical attribute of the object; and

determining the adjustment based on the physical attribute of the object.

16. The drone system of claim 12 , wherein the object:

is intermediate the first section and the second, different section of the area; and

defines a boundary that separates a first property represented by the first section owned by a first entity and a second, different property represented by the second, different section owned by a second entity.

17. The drone system of claim 12 , wherein the object is a virtual object inserted as an overlay to define a boundary between the first section and the second, different section.

18. The drone system of claim 12 , wherein determining the adjustment to at least one of the plurality of viewing angles comprises:

determining the adjustment based on an adjustment algorithm that is implemented using the imaging device, a sensor installed at the drone, and on-board circuitry of the drone;

wherein the adjustment algorithm is an on-board viewing angle adjustment algorithm that is implemented using software instructions executed by a processor integrated in the on-board circuitry of the drone.

19. One or more non-transitory machine-readable storage devices storing instructions for a drone system for surveilling an area using a drone, the instructions being executable by one or more processors to cause performance of operations comprising:

obtaining image data using an imaging device installed at the drone;

processing the image data to detect an object that is external to the drone;

in response to processing the image data, determining a plurality of viewing angles indicated in the image data with respect to the object;

based on the image data and the plurality of viewing angles, identifying a first section of the area for surveillance and a second, different section of the area to be excluded from surveillance;

dynamically calculating a respective frame coverage for the plurality of imaging devices installed at the drone, wherein each of the respective frame coverages are calculated concurrently as the image data is being obtained;

determining, based on the respective frame coverage, an adjustment to at least one of the plurality of viewing angles to cause the second, different section of the area to be excluded from surveillance; and

based on the adjustment, controlling the imaging device installed at the drone to exclude the second, different section of the area from surveillance imagery obtained by the drone.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 10, 2020
From: KIPURS, AGRIS; NEVDAHS, ILJA; EGLE, DEINS
To: ALARM.COM INCORPORATED
Reel/Frame 054675/0442 →
Continuity (1)
Provisional Application 62831583 · Apr 9, 2019
Cited By (1)
US 12,296,996