Image processing for a dual camera mobile device
Some embodiments provide a method of processing images for a first camera and a second camera of a mobile device using a shared pipeline. A method receives a first set of images captured by the first camera of the mobile device. The method processes the first set of images using a first configuration of the shared pipeline. The method also receives a second set of images captured by the second camera of the mobile device, and processes the second set of images using a second configuration of the shared pipeline different from the first configuration.
1. A method of processing images for first and second cameras of a mobile device using a single processing pipeline, said method comprising:
receiving a first set of images captured by the first camera of the mobile device;
processing the first set of images using a first configuration of the single processing pipeline, wherein the first configuration of the single processing pipeline is stored in a first set of registers included in the single processing pipeline;
receiving a second set of images captured by the second camera of the mobile device; and
processing the second set of images using a second configuration of the single processing pipeline, wherein the second configuration is different from the first configuration.
2. The method of claim 1 , wherein the second configuration of the single processing pipeline is stored in a second set of registers included in the single processing pipeline.
3. The method of claim 2 , wherein the first and second sets of registers are different.
4. The method of claim 1 further comprising, before processing the first set of images, reading values stored in the first set of registers.
5. The method of claim 2 further comprising, before processing the second set of images, reading values stored in the second set of registers.
6. A method of processing images for first and second cameras of a mobile device using a single processing pipeline, said method comprising:
during a vertical blanking interval of the second camera, processing a first image from the first camera using a first configuration in the single processing pipeline, wherein the first configuration of the single processing pipeline is stored in a first set of registers included in the single processing pipeline; and
during a vertical blanking interval of the first camera, processing a second image from the second camera using a second configuration in the single processing pipeline.
7. The method of claim 6 , wherein the vertical blanking interval of the second camera and the vertical blanking interval of the first camera are the same interval.
8. A non-transitory computer readable medium storing a computer program which when executed by at least one processing unit processes images for first and second cameras of a mobile device using a single processing pipeline, the computer program comprising sets of instructions for:
receiving a first set of images captured by the first camera of the mobile device;
processing the first set of images using a first configuration of the single processing pipeline wherein the first configuration of the single processing pipeline is stored in a first set of registers included in the single processing pipeline;
receiving a second set of images captured by the second camera of the mobile device; and
processing the second set of images using a second configuration of the single processing pipeline, wherein the second configuration is different from the first configuration.
9. The non-transitory computer readable medium of claim 8 , wherein the first configuration of the single processing pipeline is for processing images having a first size.
10. The non-transitory computer readable medium of claim 9 , wherein the second configuration of the single processing pipeline is for processing images having a second size.
11. The non-transitory computer readable medium of claim 10 , wherein the first size and the second size are different.
12. The non-transitory computer readable medium of claim 8 , wherein the first configuration of the single processing pipeline is for processing images at a first frame rate.
13. The non-transitory computer readable medium of claim 12 , wherein the second configuration of the single processing pipeline is for processing images at a second frame rate.
14. The non-transitory computer readable medium of claim 13 , wherein the first frame rate and the second frame rate are different.
15. A mobile device comprising:
a first camera comprising a first image sensor for capturing images;
a second camera comprising a second image sensor for capturing images;
a single processing pipeline for processing images captured by the first and second image sensors of the first and second cameras;
a first set of registers for storing a first set of values that specify a first configuration of the single processing pipeline; and
a second set of registers for storing a second set of values that specify a second, different configuration of the single processing pipeline, wherein the first configuration of the single processing pipeline is for processing images captured by the first sensor of the first camera and the second configuration of the single processing pipeline is for processing images captured by the second sensor of the second camera.
16. The mobile device of claim 15 further comprising a storage for storing images processed by the single processing pipeline.
17. The mobile device of claim 15 further comprising an image sensor module for retrieving images captured by the first and second image sensors of the first and second cameras for the single processing pipeline to process.
18. The mobile device of claim 15 , wherein the single processing pipeline reads the first set of values that specify the first configuration from the first set of registers before the single processing pipeline processes images captured by the first image sensor of the first camera.
19. The mobile device of claim 18 , wherein the single processing pipeline reads the first set of values from the first set of registers when the single processing pipeline is in the second configuration.
20. The mobile device of claim 18 , wherein the single processing pipeline reads the second set of values that specify the second configuration from the second set of registers before the single processing pipeline processes images captured by the second image sensor of the second camera.
21. The mobile device of claim 20 , wherein the single processing pipeline reads the second set of values from the second set of registers when the single processing pipeline is in the first configuration.
22. The method of claim 6 , wherein the vertical blanking interval of the second camera and the vertical blanking interval of the first camera have different intervals.
23. The method of claim 6 further comprising adjusting the vertical blanking interval of the second camera in order to adjust a speed at which the single processing pipeline processes images from the first camera.
24. The method of claim 23 , wherein adjusting the vertical blanking interval comprises decreasing the vertical blanking interval of the second camera in order to increase the speed at which the single processing pipeline processes images from the first camera.
25. The method of claim 23 , wherein adjusting the vertical blanking interval comprises increasing the vertical blanking interval of the second camera in order to decrease the speed at which the single processing pipeline processes images from the first camera.
26. The method of claim 23 further comprising adjusting the vertical blanking interval of the first camera in order to adjust a speed at which the single processing pipeline processes images from the second camera.
27. The method of claim 26 , wherein adjusting the vertical blanking interval comprises decreasing the vertical blanking interval of the first camera in order to increase the speed at which the single processing pipeline processes images from the second camera.
28. The method of claim 26 , wherein adjusting the vertical blanking interval comprises increasing the vertical blanking interval of the first camera in order to decrease the speed at which the single processing pipeline processes images from the second camera.