Multi-camera on a chip and camera module design
A camera system includes two or more sensor arrays and an optical path. The sensor arrays are on the same sensor chip. Each sensor array includes the same field of view (FOV) as each other sensor array. The optical path includes a main lens and a metalens that are shared by each sensor array, and a microlens associated with each sensor array. The metalens splits incident light into different spectrums of light and directs each respective spectrum to a corresponding sensor array. The different spectrums of light include at least two of visible light, near infrared light, shortwave infrared and longwave infrared, and at least one sensor array includes single-photon avalanche diodes. The image processor that provides image processing, object recognition and object tracking and/or image fusion functionality may be on the same sensor chip as the sensor arrays.
1. A camera system, comprising:
two or more sensor arrays on a same die, each sensor array comprising an array of pixels that sense light and each sensor array comprising a same field of view (FOV) as each other sensor array; and
an optical path comprising a main lens, a metalens and two or more microlens arrays, the main lens and the metalens being shared by each sensor array and each microlens array being associated with a corresponding sensor array, the metalens splitting light incident on the metalens into different spectrums of light and directing each respective spectrum to a corresponding sensor array; and
wherein the metalens comprises at least one layer of nanostructures formed on a substrate, the at least one layer of nanostructures diffracting and/or focusing at least one spectrum of the light incident on the metalens to the corresponding sensor array.
2. The camera system of claim 1 , wherein the different spectrums of light comprises at least two of visible light, near infrared light, shortwave infrared and longwave infrared.
3. The camera system of claim 2 , wherein at least one sensor array includes a single-photon avalanche diode.
4. The camera system of claim 1 , wherein nanostructures of the at least one layer of nanostructures comprise a material having a refractive index greater than 1.9.
5. The camera system of claim 1 , wherein the at least one layer of nanostructures is formed on a first surface of the substrate.
6. The camera system of claim 5 , wherein a second layer of nanostructures is formed on a second surface of the substrate that is opposite the first surface of the substrate.
7. The camera system of claim 1 , wherein the substrate comprises one of a planar surface and a curved surface.
8. The camera system of claim 1 , further comprising an image processor on the same die as the sensor arrays, the image processor providing at least one of image processing, object recognition and object tracking of at least one output from the two or more sensor arrays and image fusion of outputs from two or more sensor array.
9. The camera system of claim 1 , wherein the camera system is part of a smartphone.
10. A camera system, comprising:
two or more sensor arrays on a same die, each sensor array comprising an array of pixels that sense light and each sensor array comprising a same field of view (FOV) as each other sensor array;
an optical path comprising a main lens, a metalens and two or more microlens arrays, the main lens and the metalens being shared by each sensor array and each microlens array being associated with a corresponding sensor array, the metalens splitting light incident on the metalens into different spectrums of light and directing each respective spectrum to a corresponding sensor array; and
an image processor on the same die as the sensor arrays, the image processor providing at least one of image processing, object recognition and object tracking of at least one output from the two or more sensor arrays and image fusion of outputs from two or more sensor array; and
wherein the metalens comprises at least one layer of nanostructures formed on a substrate, the at least one layer of nanostructures diffracting and/or focusing at least one spectrum of the light incident on the metalens to the corresponding sensor array.
11. The camera system of claim 10 , wherein the different spectrums of light comprises at least two of visible light, near infrared light, shortwave infrared and longwave infrared, and
wherein at least one sensor array includes a single-photon avalanche diode.
12. The camera system of claim 10 ,
wherein nanostructures of the at least one layer of nanostructures comprise a material having a refractive index greater than 1.9.
13. The camera system of claim 12 , wherein the substrate comprises one of a planar surface and a curved surface.
14. The camera system of claim 13 , wherein the at least one layer of nanostructures is formed on a first surface of the substrate.
15. The camera system of claim 14 , wherein a second layer of nanostructures is formed on a second surface of the substrate that is opposite the first surface of the substrate.
16. A camera system, comprising:
two or more sensor arrays on a same die, each sensor array comprising an array of pixels that sense light, each sensor array comprising a same field of view (FOV) as each other sensor array, and at least one sensor array includes a single-photon avalanche diode; and
an optical path comprising a main lens, a metalens and two or more microlens arrays, the main lens and the metalens being shared by each sensor array and each microlens array being associated with a corresponding sensor array, the metalens splitting light incident on the metalens into different spectrums of light and directing each respective spectrum to a corresponding sensor array; and
wherein the metalens comprises at least one layer of nanostructures formed on a substrate, the at least one layer of nanostructures diffracting and/or focusing at least one spectrum of the light incident on the metalens to the corresponding sensor array.
17. The camera system of claim 16 , wherein the different spectrums of light comprises at least two of visible light, near infrared light, shortwave infrared and longwave infrared.
18. The camera system of claim 17 ,
wherein nanostructures of the at least one layer of nanostructures comprise a material having a refractive index greater than 1.9, and
the substrate comprises one of a planar surface and a curved surface.
19. The camera system of claim 18 , further comprising an image processor on the same die as the sensor arrays, the image processor providing at least one of image processing, object recognition and object tracking of at least one output from the two or more sensor arrays and image fusion of outputs from two or more sensor array.