IP Library Granted Patent US 10,679,368
Granted Patent B2
US 10,679,368 · App. 15/851,127 · Granted Jun 9, 2020

Methods and apparatus to reduce depth map size in collision avoidance systems

Inventors: Daniel Pohl (Puchheim, DE); Markus Achtelik (Deutsch, DE)
Assignee: Intel IP Corporation
G06T7/55B64C39/024G06T3/40G06T7/74G08G5/04H04N19/176G06T2207/10028G08G5/045
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,679,368
App. No.
15/851,127
Granted
Jun 9, 2020
Kind
B2
Abstract

Methods and apparatus to reduce a depth map size for use in a collision avoidance system are described herein. Examples described herein may be implemented in an unmanned aerial vehicle. An example unmanned aerial vehicle includes a depth sensor to generate a first depth map. The first depth map includes a plurality of pixels having respective distance values. The unmanned aerial vehicle also includes a depth map modifier to divide the plurality of pixels into blocks of pixels and generate a second depth map having fewer pixels than the first depth map based on distance values of the pixels in the blocks of pixels. The unmanned aerial vehicle further includes a collision avoidance system to analyze the second depth map.

Claims (74)

1. An unmanned aerial vehicle comprising:

a depth sensor to generate a first depth map, the first depth map including a plurality of pixels having respective distance values;

a processor to:

divide the plurality of pixels into blocks of pixels; and

generate a second depth map having fewer pixels than the first depth map based on the distance values of the pixels in the blocks of pixels, the processor to generate the second depth map by saving respective pixels from respective ones of the blocks of pixels having the smallest distance values in the respective blocks of pixels and discarding the other pixels in the blocks of pixels; and

a collision avoidance system to analyze the second depth map.

2. An unmanned aerial vehicle comprising:

a depth sensor to generate a first depth map, the first depth map including a plurality of pixels having respective distance values;

a processor to:

divide the plurality of pixels into blocks of pixels; and

generate a second depth map having fewer pixels than the first depth map based on the distance values of the pixels in the blocks of pixels, the processor to generate the second depth map by downsizing the respective blocks of pixels into single pixels having assigned distance values corresponding to respective smallest distance values within the respective blocks of pixels; and

a collision avoidance system to analyze the second depth map.

3. An unmanned aerial vehicle comprising:

a depth sensor to generate a first depth map, the first depth map including a plurality of pixels having respective distance values;

a processor to:

divide the plurality of pixels into blocks of pixels; and

generate a second depth map having fewer pixels than the first depth map based on the distance values of the pixels in the blocks of pixels, the processor to generate the second depth map by assigning the smallest distance value in each block of pixels to a center pixel of the respective block of pixels, saving the center pixels with the assigned smallest distance values, and discarding the other pixels in the blocks of pixels; and

a collision avoidance system to analyze the second depth map.

4. An unmanned aerial vehicle comprising:

a depth sensor to generate a first depth map, the first depth map including a plurality of pixels having respective distance values;

a processor to:

divide the plurality of pixels into blocks of pixels; and

generate a second depth map having fewer pixels than the first depth map based on the distance values of the pixels in the blocks of pixels by comparing a difference between the smallest distance value to a largest distance value in each block of pixels to a threshold distance; and

a collision avoidance system to analyze the second depth map.

5. The unmanned aerial vehicle of claim 4 , wherein:

if the difference for a block of pixels satisfies the threshold distance, the processor is to assign the smallest distance value in the block of pixels to a center pixel in the block of pixels, save the center pixel, and discard the other pixels in the block of pixels; and

if the difference for a block of pixels does not satisfy the threshold distance, the processor is to save the pixel having the smallest distance value in the block of pixels and discard the other pixels in the block of pixels.

6. An unmanned aerial vehicle comprising:

a depth sensor to generate a first depth map, the first depth map including a plurality of pixels having respective distance values;

a processor to:

determine a direction of travel of the unmanned aerial vehicle;

determine a high detail area and a low detail area within the plurality of pixels of the first depth map based on the direction of travel;

divide the pixels of the plurality of pixels within the high detail area into first blocks of pixels with a first size filter block;

divide the pixels of the plurality of pixels within the low detail area into second blocks of pixels with a second size filter block, the second size filter block having a larger size filter block than the first size filter block; and

generate a second depth map having fewer pixels than the first depth map based on the distance values of the pixels in the first and second blocks of pixels; and

a collision avoidance system to analyze the second depth map.

7. The unmanned aerial vehicle of claim 6 , wherein the depth sensor has a field of view, and the high detail area corresponds to a virtual cone to be projected from the unmanned aerial vehicle in the direction of travel, the virtual cone being smaller than the field of view.

8. The unmanned aerial vehicle of claim 1 , wherein the collision avoidance system is to modify at least one of a trajectory or a velocity of the unmanned aerial vehicle if a potential collision is detected.

9. A method to reduce a size of a depth map, the method comprising:

applying, by executing an instruction with at least one processor, a filter block to a plurality of pixels of a first depth map to divide the plurality of pixels into blocks of pixels, the pixels of the first depth map having respective distance values;

identifying, by executing an instruction with the at least one processor, in the respective blocks of pixels, respective smallest distance values associated with the pixels in the respective blocks of pixels; and

generating, by executing an instruction with the at least one processor, a second depth map based on the smallest distance values in the blocks of pixels, the second depth map having fewer pixels than the first depth map.

10. The method of claim 9 , wherein the generating of the second depth map includes:

assigning a smallest distance value in each respective block of pixels to a center pixel of the respective blocks of pixels;

saving the center pixels with the assigned smallest distance values; and

discarding the other pixels in the blocks of pixels.

11. The method of claim 9 , wherein the generating of the second depth map includes:

saving the pixels having the smallest distance values from the respective blocks of pixels; and

discarding the other pixels in the blocks of pixels.

12. The method of claim 9 , wherein the generating of the second depth map includes:

determining, for each respective block of pixels, a difference between the smallest distance value and a largest distance value for the pixels in the respective block of pixels to determine differences for the respective blocks of pixels;

comparing the differences to a threshold distance;

if the respective difference for a respective block of pixels satisfies the threshold distance:

assigning the smallest distance value in the respective block of pixels to a center pixel in the respective block of pixels;

saving the center pixel of the respective block of pixels; and

discarding the other pixels in the respective block of pixels; and

if the respective difference for a respective block of pixels does not satisfy the threshold distance:

saving the pixel having the smallest distance in the respective block of pixels; and

discarding the other pixels in the respective block of pixels.

13. The method of claim 9 , further including obtaining the first depth map with a depth sensor carried on a vehicle.

14. The method of claim 13 , wherein the vehicle is an unmanned aerial vehicle.

15. The method of claim 14 , further including:

analyzing, via a collision avoidance system, the second depth map to monitor a location of an object near the unmanned aerial vehicle.

16. A non-transitory machine readable storage medium comprising instructions that, when executed, cause one or more processors to at least:

apply a filter block to a first plurality of pixels of a first depth map to divide the first plurality of pixels into blocks of pixels, the first plurality of pixels having respective distance values;

identify, in the respective blocks of pixels, respective smallest distance values associated with the pixel in the respective blocks of pixels; and

generate a second depth map based on the smallest distance values in the blocks of pixels, the second depth map having a second plurality of pixels, the second plurality of pixels less than the first plurality of pixels.

17. The non-transitory machine readable storage medium of claim 16 , wherein the instructions, when executed, cause the one or more processors to generate the second depth map by downsizing each block of pixels into one pixel having an assigned distance value corresponding to the smallest distance value within the block of pixels.

18. The non-transitory machine readable storage medium of claim 16 , wherein the instructions, when executed, cause the one or more processors to generate the second depth map by:

assigning a smallest distance value in each respective block of pixels to a center pixel of the respective block;

saving the center pixels with the assigned smallest distance values; and

discarding the other pixels in the blocks of pixels, the second plurality of pixels corresponding to the saved center pixels with the assigned smallest distance values.

19. The non-transitory machine readable storage medium of claim 16 , wherein the first depth map is obtained by a depth sensor carried on a vehicle.

20. The unmanned aerial vehicle of claim 1 , wherein the collision avoidance system is implemented by the processor.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 22, 2021
From: INTEL IP CORPORATION
To: INTEL CORPORATION
Reel/Frame 056337/0609 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2017
From: POHL, DANIEL; ACHTELIK, MARKUS
To: INTEL IP CORPORATION
Reel/Frame 044496/0913 →
Continuity (1)
Related Publication 20190051007A1 · Feb 14, 2019