Processing images to obtain environmental information
A system for processing images captured by a movable object includes one or more processors individually or collectively configured to process a first image set captured by a first imaging component to obtain texture information in response to a second image set captured by a second imaging component having a quality below a predetermined threshold, and obtain environmental information for the movable object based on the texture information. The first imaging component has a first field of view and the second imaging component has a second field of view narrower than the first field of view.
1. A system for processing images captured by a movable object comprising:
one or more processors individually or collectively configured to:
process a first image set captured by a first imaging component to obtain texture information in response to a second image set captured by a second imaging component having a quality below a predetermined threshold, the first imaging component having a first field of view and the second imaging component having a second field of view narrower than the first field of view; and
obtain environmental information for the movable object based on the texture information.
2. The system of claim 1 , wherein the environmental information includes at least one of depth information, obstacle information, or state information of the movable object.
3. The system of claim 1 , wherein the one or more processors are further configured to generate a control signal to:
control at least a position or an orientation of the movable object based on the environmental information; or
control at least a position or an orientation of an imaging device coupled to the movable object relative to the movable object based on the environmental information.
4. The system of claim 1 , wherein the first imaging component includes a first lens system and the second imaging component includes a second lens system.
5. The system of claim 1 , wherein the one or more processors are further configured to process the second image set to obtain the environmental information for the movable object in response to the quality of the second image set being above the predetermined threshold.
6. The system of claim 5 , wherein the one or more processors are further configured to not process the first image set to obtain the environmental information for the movable object in response to the quality of the second image being above the predetermined threshold.
7. The system of claim 1 , wherein the one or more processors are further configured to generate a control signal to adjust an optical axis of the second imaging component in response to the quality of the second image set being below the predetermined threshold.
8. The system of claim 7 , wherein the control signal depends on the texture information of the first image set.
9. The system of claim 1 , wherein the one or more processors are further configured to analyze a saliency or gradient of images of the second image set or a feature point number or optical flow within the second image set to determine the quality of the second image set.
10. The system of claim 1 , wherein the first field of view and the second field of view are overlapping.
11. The system of claim 10 , wherein the second field of view is encompassed by the first field of view.
12. The system of claim 1 , wherein the second field of view has an angle of view between about 50° and 80° and the first field of view has an angle of view between about 90° and 180°.
13. The system of claim 1 , wherein each of the first imaging component and the second imaging component includes a monocular lens system.
14. The system of claim 1 , wherein the first imaging component is located on a first imaging device and the second imaging component is located on a second imaging device.
15. The system of claim 1 , wherein the first imaging component and the second imaging component are located on a single imaging device.
16. The system of claim 1 , wherein the first imaging component and the second imaging component are located on board the movable object.
17. The system of claim 1 , wherein the one or more processors are located on board the movable object.
18. The system of claim 1 , wherein the one or more processors are configured to, during flight of the movable object, repeatedly process the first image set to obtain the texture information in response to the quality of the second image set being below the predetermined threshold and obtain the environmental information based on the texture information.
19. A method of processing images captured by a movable object comprising:
capturing a first image set through a first imaging component having a first field of view;
capturing a second image set through a second imaging component having a second field of view narrower than the first field of view;
with aid of one or more processors, individually or collectively,
processing the first image set to obtain texture information in response to the second image set having a quality below a predetermined threshold; and
obtaining environmental information for the movable object based on the texture information.
20. An apparatus for processing images captured by a movable object comprising:
a first imaging component having a first field of view and configured to capture a first image set;
a second imaging component having a second field of view narrower than the first field of view and configured to capture a second image set; and
one or more processors, individually or collectively configured to:
process the first image set to obtain texture information in response to the second image set having a quality below a predetermined threshold; and
obtain environmental information for the movable object based on the texture information.