Devices and methods for obtaining three-dimensional shape information using polarization and phase detection photodiodes
In some embodiments, an image sensor is provided. The image sensor comprises a plurality of photodiodes arranged as a photodiode array. The plurality of photodiodes includes a first set of photodiodes configured as phase detection photodiodes, and a second set of photodiodes configured as polarization detection photodiodes. In some embodiments, a controller is provided. The controller comprises circuitry configured to process signals from a first set of photodiodes of a photodiode array to obtain depth information; process signals from a second set of photodiodes of the photodiode array to obtain polarization information; process the polarization information to obtain an ambiguous set of surface normals; and process the ambiguous set of surface normals using the depth information to obtain a three-dimensional shape image.
1. An image sensor, comprising:
a plurality of photodiodes arranged as a photodiode array, wherein the plurality of photodiodes includes:
a first set of photodiodes configured as phase detection photodiodes; and
a second set of photodiodes configured as polarization detection photodiodes;
wherein the first set of photodiodes configured as phase detection photodiodes includes:
at least one square group of photodiodes; and
at least one microlens arranged over more than one photodiode of the at least one square group of photodiodes; and
wherein the at least one microlens is arranged over fewer than all of the photodiodes of the at least one square group of photodiodes.
2. The image sensor of claim 1 , wherein the at least one microlens is arranged over at least a portion of all of the photodiodes of the at least one square group of photodiodes.
3. The image sensor of claim 2 , wherein the at least one square group of photodiodes includes four photodiodes, nine photodiodes, or sixteen photodiodes.
4. The image sensor of claim 1 , wherein the at least one microlens is arranged over a horizontally adjacent pair of photodiodes.
5. The image sensor of claim 1 , wherein the at least one microlens is arranged over a vertically adjacent pair of photodiodes.
6. The image sensor of claim 1 , wherein the second set of photodiodes configured as polarization detection photodiodes includes at least one square group of four photodiodes, and wherein the image sensor further comprises:
at least four microlenses, each microlens arranged over one photodiode of the four photodiodes;
polarization wires in a first orientation that correspond with a first photodiode of the four photodiodes;
polarization wires in a second orientation that correspond with a second photodiode of the four photodiodes;
polarization wires in a third orientation that correspond with a third photodiode of the four photodiodes; and
polarization wires in a fourth orientation that correspond with a fourth photodiode of the four photodiodes.
7. The image sensor of claim 1 , wherein the second set of photodiodes configured as polarization detection photodiodes includes at least one square group of nine photodiodes, and wherein the image sensor further comprises:
polarization wires in a first orientation that correspond with four of the nine photodiodes;
polarization wires in a second orientation that correspond with two of the nine photodiodes;
polarization wires in a third orientation that correspond with two of the nine photodiodes; and
polarization wires in a fourth orientation that correspond with one of the nine photodiodes.
8. The image sensor of claim 7 , further comprising at least one microlens arranged over the at least one square group of nine photodiodes.
9. The image sensor of claim 7 , further comprising a color filter arranged over the at least one square group of nine photodiodes.
10. The image sensor of claim 1 , wherein the second set of photodiodes configured as polarization detection photodiodes includes at least one square group of sixteen photodiodes, and wherein the image sensor further comprises:
polarization wires in a first orientation that correspond with four of the sixteen photodiodes;
polarization wires in a second orientation that correspond with four of the sixteen photodiodes;
polarization wires in a third orientation that correspond with four of the sixteen photodiodes; and
polarization wires in a fourth orientation that correspond with four of the sixteen photodiodes.
11. The image sensor of claim 10 , further comprising at least one microlens arranged over the at least one square group of sixteen photodiodes.
12. The image sensor of claim 10 , further comprising a color filter arranged over the at least one square group of sixteen photodiodes.
13. An image sensor, comprising:
a plurality of photodiodes arranged as a photodiode array, wherein the plurality of photodiodes includes:
a first set of photodiodes configured as phase detection photodiodes;
a second set of photodiodes configured as polarization detection photodiodes; and
circuitry configured to:
process signals from the first set of photodiodes to obtain depth information;
process signals from the second set of photodiodes to obtain polarization information;
process the polarization information to obtain an ambiguous set of surface normals; and
process the ambiguous set of surface normals using the depth information to obtain a three-dimensional shape image;
wherein processing signals from the first set of photodiodes to obtain depth information includes comparing electrical signals between photodiodes that have a common corresponding microlens.
14. The image sensor of claim 13 , wherein comparing electrical signals between photodiodes that have a common corresponding microlens includes comparing electrical signals between adjacent photodiodes and comparing electrical signals between diagonal photodiodes.
15. A controller comprising circuitry configured to:
process signals from a first set of photodiodes of a photodiode array to obtain depth information;
process signals from a second set of photodiodes of the photodiode array to obtain polarization information;
process the polarization information to obtain an ambiguous set of surface normals; and
process the ambiguous set of surface normals using the depth information to obtain a three-dimensional shape image;
wherein processing signals from the first set of photodiodes of the photodiode array to obtain the depth information includes comparing electrical signals between photodiodes that have a common corresponding microlens.
16. The controller of claim 15 , wherein comparing electrical signals between photodiodes that have a common corresponding microlens includes comparing electrical signals between adjacent photodiodes and comparing electrical signals between diagonal photodiodes.
17. An image sensor, comprising:
a plurality of photodiodes arranged as a photodiode array, wherein the plurality of photodiodes includes:
a first set of photodiodes configured as phase detection photodiodes; and
a second set of photodiodes configured as polarization detection photodiodes;
wherein the second set of photodiodes configured as polarization detection photodiodes includes at least one square group of nine photodiodes; and
wherein the image sensor further comprises:
polarization wires in a first orientation that correspond with four of the nine photodiodes;
polarization wires in a second orientation that correspond with two of the nine photodiodes;
polarization wires in a third orientation that correspond with two of the nine photodiodes;
polarization wires in a fourth orientation that correspond with one of the nine photodiodes; and
at least one microlens arranged over the at least one square group of nine photodiodes.
18. The image sensor of claim 17 , further comprising a color filter arranged over the at least one square group of nine photodiodes.
19. An image sensor, comprising:
a plurality of photodiodes arranged as a photodiode array, wherein the plurality of photodiodes includes:
a first set of photodiodes configured as phase detection photodiodes; and
a second set of photodiodes configured as polarization detection photodiodes;
wherein the second set of photodiodes configured as polarization detection photodiodes includes at least one square group of sixteen photodiodes, and
wherein the image sensor further comprises:
polarization wires in a first orientation that correspond with four of the sixteen photodiodes;
polarization wires in a second orientation that correspond with four of the sixteen photodiodes;
polarization wires in a third orientation that correspond with four of the sixteen photodiodes;
polarization wires in a fourth orientation that correspond with four of the sixteen photodiodes; and
at least one microlens arranged over the at least one square group of sixteen photodiodes.
20. The image sensor of claim 19 , further comprising a color filter arranged over the at least one square group of sixteen photodiodes.