IP Library › Granted Patent US 12,003,870
Granted Patent B2
US 12,003,870 · App. 17/721,801 · Granted Jun 4, 2024

Binning in hybrid pixel structure of image pixels and event vision sensor (EVS) pixels

Inventors: Pooria Mostafalu (Penfield, NY); Frederick T. Brady (Webster, NY); Sungin Han (Pittsford, NY); Hongyi Mi (Victor, NY)
Assignee: Sony Semiconductor Solutions Corporation
H04N25/46H04N25/42H04N25/77
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,003,870
App. No.
17/721,801
Granted
Jun 4, 2024
Kind
B2
Abstract

Binning in a hybrid pixel structure of image pixels and event vision sensor (EVS) pixels. In one embodiment, the imaging sensor includes a pixel array including a plurality of pixel circuits and a plurality of binning transistors. A first portion of the plurality of pixel circuits individually includes an intensity photodiode. A second portion of the plurality of pixel circuits individually includes an event vision sensor (EVS) photodiode. The plurality of binning transistors is configured to bin together at least one of the first portion or the second portion.

Claims (38)

1. An imaging sensor comprising:

a pixel array including a plurality of pixel circuits; and

a plurality of binning transistors,

wherein a first portion of the plurality of pixel circuits individually includes two or more intensity photodiodes and a second portion of the plurality of pixel circuits individually includes two or more event vision sensor (EVS) photodiodes that are separate and distinct from the two or more intensity photodiodes, and

wherein the plurality of binning transistors is configured to

bin together the first portion,

bin together the second portion, and

bin together the first portion and bin together the second portion, respectively.

2. The imaging sensor according to claim 1 , wherein the plurality of binning transistors includes a plurality of SNG transistors that horizontally bin together sense nodes of the second portion on a row-by-row basis of the pixel array.

3. The imaging sensor according to claim 1 , wherein the plurality of binning transistors includes a plurality of VNG transistors that vertically bin together sense nodes of the second portion on a column-by-column basis of the pixel array.

4. The imaging sensor according to claim 1 , wherein the plurality of binning transistors includes a plurality of ALSEN transistors that horizontally bin together floating diffusions of the first portion on a row-by-row basis of the pixel array.

5. The imaging sensor according to claim 1 , wherein the plurality of binning transistors includes a plurality of FDI transistors that vertically bin together floating diffusions of the first portion on a column-by-column basis of the pixel array.

6. The imaging sensor according to claim 1 , wherein the plurality of pixel circuits forms a hybrid unit pixel, wherein the first portion with respect to the hybrid unit pixel is twelve intensity photodiodes, wherein the second portion with respect to the hybrid unit pixel is four EVS photodiodes, and wherein each of the twelve intensity photodiodes has a gate that shares one of four floating diffusions.

7. The imaging sensor according to claim 1 , wherein the plurality of pixel circuits forms a hybrid unit pixel, wherein the first portion with respect to the hybrid unit pixel is fourteen intensity photodiodes, wherein the second portion with respect to the hybrid unit pixel is four EVS photodiodes, and wherein each of the fourteen intensity photodiodes has a gate that shares one of four floating diffusions.

8. The imaging sensor according to claim 7 , wherein the fourteen intensity photodiodes includes four intensity photodiodes with a blue light filter, six intensity photodiodes with a green light filter, and four intensity photodiodes with a red light filter.

9. A method comprising:

controlling, with control circuitry, a plurality of binning transistors according to a first mode; and

controlling, with the control circuitry, the plurality of binning transistors to change from the first mode to a second mode,

wherein, in the second mode, the plurality of binning transistors bins together a first portion of a plurality of pixel circuits in a pixel array and bins together a second portion of the plurality of pixel circuits, respectively, and

wherein the first portion of the plurality of pixel circuits individually includes two or more intensity photodiodes and the second portion of the plurality of pixel circuits individually includes two or more vision sensor (EVS) photodiodes that are separate and distinct from the two or more intensity photodiodes.

10. The method according to claim 9 , wherein the first mode is a non-binning mode, and wherein, in the non-binning mode, the plurality of binning transistors are in an OFF state.

11. The method according to claim 9 , wherein the second mode is a first binning mode and the plurality of binning transistors includes a plurality of SNG transistors, and wherein, in the first binning mode, the control circuitry controls the plurality of SNG transistors to horizontally bin together sense nodes of the second portion on a row-by-row basis of the pixel array.

12. The method according to claim 9 , wherein the second mode is a first binning mode and the plurality of binning transistors includes a plurality of VNG transistors, wherein, in the first binning mode, the control circuitry controls the plurality of VNG transistors to vertically bin together sense nodes of the second portion on a column-by-column basis of the pixel array.

13. The method according to claim 9 , wherein the second mode is a first binning mode and the plurality of binning transistors includes a plurality of ALSEN transistors, and wherein, in the first binning mode, the control circuitry controls the plurality of AL SEN transistors to horizontally bin together floating diffusions of the first portion on a row-by-row basis of the pixel array.

14. The method according to claim 13 , wherein the plurality of binning transistors includes a plurality of VNG transistors, wherein, in the first binning mode, the control circuitry controls the plurality of VNG transistors to vertically bin together the floating diffusions of the first portion on a column-by-column basis of the pixel array.

15. The method according to claim 9 , wherein the first mode is a first binning mode and the second mode is a second binning mode, wherein the plurality of binning transistors includes a plurality of SNG transistors, and wherein, in the first binning mode, the control circuitry controls the plurality of SNG transistors to horizontally bin together sense nodes of the second portion on a row-by-row basis of the pixel array.

16. The method according to claim 15 , wherein the plurality of binning transistors includes a plurality of VNG transistors, and wherein, in the first binning mode, the control circuitry controls the plurality of VNG transistors to vertically bin together the sense nodes of the second portion on a column-by-column basis of the pixel array.

17. The method according to claim 9 , wherein the first mode is a first binning mode and the second mode is a second binning mode, wherein the plurality of binning transistors includes a plurality of ALSEN transistors, and wherein, in the first binning mode, the control circuitry controls the plurality of ALSEN transistors to horizontally bin together floating diffusions of the first portion on a row-by-row basis of the pixel array.

18. The method according to claim 17 , wherein the plurality of binning transistors includes a plurality of VNG transistors, wherein, in the first binning mode, the control circuitry controls the plurality of VNG transistors to vertically bin together the floating diffusions of the first portion on a column-by-column basis of the pixel array.

19. An electronic device comprising:

a pixel array including a plurality of pixel circuits; and

a plurality of binning transistors,

wherein a first portion of the plurality of pixel circuits individually includes two or more intensity photodiodes and a second portion of the plurality of pixel circuits individually includes two or more event vision sensor (EVS) photodiodes that are separate and distinct from the two or more intensity photodiodes, and

wherein the plurality of binning transistors are configured to

bin together the first portion,

bin together the second portion, and

bin together the first portion and bin together the second portion, respectively.

20. The electronic device according to claim 19 , wherein the plurality of binning transistors includes a plurality of SNG transistors that are configured to horizontally bin together sense nodes of the second portion on a row-by-row basis of the pixel array.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 9, 2022
From: MOSTAFALU, POORIA; BRADY, FREDERICK T.; HAN, SUNGIN; MI, HONGYI
To: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
Reel/Frame 060758/0826 →
Continuity (1)
Related Publication 20230336881A1 · Oct 19, 2023
Cited By (1)
US 12,413,869