IP Library › Granted Patent US 12,442,901

Granted Patent B2

US 12,442,901 · App. 17/513,000 · Granted Oct 14, 2025

Readout architectures for motion blur reduction in indirect time-of-flight sensors

Inventors: Andreas Suess (San Jose, CA); Zheng Yang (San Jose, CA)

Assignee: OMNIVISION TECHNOLOGIES, INC.

G01S7/4861 G01S7/4865 G01S17/89 H04N23/682

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 12,442,901
App. No.: 17/513,000
Granted: Oct 14, 2025
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

A time-of-flight pixel circuit includes a photodiode configured to generate charge in response to modulated light reflected from an object. First and second transfer transistors are coupled to the photodiode. The first transfer transistor transfers a first portion of charge from the photodiode in response to a first modulation signal and the second transfer transistor transfers a second portion of charge from the photodiode in response to a second modulation signal. The second modulation signal is an inverted first modulation signal. A first floating diffusion is coupled to the first transfer transistor to receive the first portion of charge in response to a first modulation signal. Each one of a first plurality of sample and hold transistors is coupled between a respective one of a first plurality of memory nodes and the first transfer transistor.

Claims (218)

1. A time-of-flight pixel circuit, comprising:

a photodiode configured to generate charge in response to modulated light emitted from a light source and reflected from an object to the photodiode;

a first transfer transistor coupled to the photodiode;

a second transfer transistor coupled to the photodiode, wherein the first transfer transistor is configured to transfer a first portion of charge from the photodiode in response to a first modulation signal, wherein the second transfer transistor is configured to transfer a second portion of charge from the photodiode in response to a second modulation signal, wherein the second modulation signal is an inverted first modulation signal;

a first floating diffusion coupled to the first transfer transistor to receive the first portion of charge in response to the first modulation signal;

a first plurality of memory nodes;

a first plurality of sample and hold transistors, wherein each one of the first plurality of sample and hold transistors is coupled between a respective one of the first plurality of memory nodes and the first transfer transistor;

a first output source follower transistor;

a first plurality of readout transistors, wherein each one of the first plurality of readout transistors is coupled between the respective one of the first plurality of memory nodes and a gate of the first output source follower transistor; and

a first row select transistor coupled to the first output source follower transistor,

wherein:

a first one of the first plurality of memory nodes is coupled to the first floating diffusion through a first one of the first plurality of sample and hold transistors during a first subframe,

a second one of the first plurality of memory nodes is coupled to the first floating diffusion through a second one of the first plurality of sample and hold transistors during a second subframe, and

the first one of the first plurality of memory nodes is coupled to the gate of the first output source follower transistor through a first one of the first plurality of readout transistors during the second subframe.

2. The time-of-flight pixel circuit of claim 1 ,

wherein the second one of the first plurality of memory nodes is coupled to the gate of the first output source follower transistor through a second one of the first plurality of readout transistors during a third subframe,

wherein the first one of the first plurality of memory nodes is coupled to the first floating diffusion through the first one of the first plurality of sample and hold transistors during the third subframe.

3. The time-of-flight pixel circuit of claim 2 ,

wherein the first modulation signal and the second modulation signal are configured to be modulated at a first modulation frequency during the first subframe and the third subframe,

wherein the first modulation signal and the second modulation signal are further configured to be modulated at a second modulation frequency during the second subframe and a fourth subframe.

4. The time-of-flight pixel circuit of claim 3 ,

wherein the first modulation signal is configured to be in phase with modulated light emitted from the light source during the first subframe and the second subframe,

wherein the first modulation signal is further configured to be 90 degrees out of phase with modulated light emitted from the light source during the third subframe and the fourth subframe.

5. The time-of-flight pixel circuit of claim 4 ,

wherein the first modulation signal is further configured to be 180 degrees out of phase with modulated light emitted from the light source during a fifth subframe and a sixth subframe,

wherein the first modulation signal is further configured to be 270 degrees out of phase with modulated light emitted from the light source during a seventh subframe and an eighth subframe,

wherein the first modulation signal and the second modulation signal are further configured to be modulated at the first modulation frequency during the fifth subframe and the seventh subframe,

wherein the first modulation signal and the second modulation signal are further configured to be modulated at the second modulation frequency during the sixth subframe and the eighth subframe.

6. The time-of-flight pixel circuit of claim 5 , further comprising a first reset transistor coupled between a supply rail and the first floating diffusion, wherein the first reset transistor is configured to reset the first floating diffusion.

7. The time-of-flight pixel circuit of claim 6 , wherein the first reset transistor is coupled to receive an overflow signal.

8. The time-of-flight pixel circuit of claim 7 , further comprising a first output reset transistor coupled between the supply rail and the gate of the first output source follower transistor.

9. The time-of-flight pixel circuit of claim 7 , further comprising:

a first floating diffusion capacitor coupled to the first floating diffusion; and

a first amplifying stage coupled between the first floating diffusion and the first plurality of sample and hold transistors.

10. The time-of-flight pixel circuit of claim 9 , wherein the first amplifying stage comprises:

a first amplifying source follower transistor having a gate coupled to the first floating diffusion and a source coupled to the first plurality of sample and hold transistors;

a first enable transistor; and

a first bias transistor coupled to the first enable transistor, wherein the first enable transistor and the first bias transistor are coupled between the source of the first amplifying source follower transistor and ground.

11. The time-of-flight pixel circuit of claim 6 , further comprising:

a second floating diffusion coupled to the second transfer transistor to receive the second portion of charge in response to the second modulation signal;

a second plurality of memory nodes; and

a second plurality of sample and hold transistors, wherein each one of the second plurality of sample and hold transistors is coupled between a respective one of the second plurality of memory nodes and the second transfer transistor.

12. The time-of-flight pixel circuit of claim 11 , further comprising:

a second output source follower transistor;

a second plurality of readout transistors, wherein each one of the second plurality of readout transistors is coupled between the respective one of the second plurality of memory nodes and a gate of the second output source follower transistor; and

a second row select transistor coupled to the second output source follower transistor.

13. The time-of-flight pixel circuit of claim 12 ,

wherein a first one of the second plurality of memory nodes is coupled to the second floating diffusion through a first one of the second plurality of sample and hold transistors during the first subframe,

wherein a second one of the second plurality of memory nodes is coupled to the second floating diffusion through a second one of the second plurality of sample and hold transistors during the second subframe,

wherein the first one of the second plurality of memory nodes is coupled to the gate of the second output source follower transistor through a second one of the first plurality of readout transistors during the second subframe.

14. The time-of-flight pixel circuit of claim 13 ,

wherein the second one of the second plurality of memory nodes is coupled to the gate of the second output source follower transistor through a second one of the second plurality of readout transistors during the third subframe,

wherein the first one of the second plurality of memory nodes is coupled to the second floating diffusion through the second one of the second plurality of sample and hold transistors during the third subframe.

15. The time-of-flight pixel circuit of claim 14 , further comprising a second reset transistor coupled between the supply rail and the second floating diffusion, wherein the second reset transistor is configured to reset the second floating diffusion.

16. The time-of-flight pixel circuit of claim 15 , wherein the second reset transistor is coupled to receive an overflow signal.

17. The time-of-flight pixel circuit of claim 16 , further comprising a second output reset transistor coupled between the supply rail and the gate of the second output source follower transistor.

18. The time-of-flight pixel circuit of claim 16 , further comprising:

a second floating diffusion capacitor coupled to the second floating diffusion; and

a second amplifying stage coupled between the second floating diffusion and the second plurality of sample and hold transistors.

19. The time-of-flight pixel circuit of claim 18 , wherein the second amplifying stage comprises:

a second amplifying source follower transistor having a gate coupled to the second floating diffusion and a source coupled to the second plurality of sample and hold transistors;

a second enable transistor; and

a second bias transistor coupled to the second enable transistor, wherein the second enable transistor and the second bias transistor are coupled between the source of the second amplifying source follower transistor and ground.

20. A time-of-flight pixel circuit, comprising:

a photodiode configured to generate charge in response to modulated light emitted from a light source and reflected from an object to the photodiode;

a first transfer transistor coupled to the photodiode;

a first floating diffusion coupled to the first transfer transistor to receive the first portion of charge in response to the first modulation signal;

a first plurality of memory nodes;

a first output source follower transistor;

a first row select transistor coupled to the first output source follower transistor,

wherein:

each one of the first plurality of memory nodes is coupled to sample and hold one of a plurality of subframe portions of the first portion of charge from the first floating diffusion through a respective one of the first plurality of sample and hold transistors,

each one of the plurality of subframe portions of the first portion of charge is coupled to be read out from the respective one of the first plurality of memory nodes through a respective one of the first plurality of readout transistors after all of the first plurality of memory nodes have sampled and held the plurality of subframe portions of the first portion of charge from the first floating diffusion,

the first modulation signal is configured to be a first phase modulation signal during a first one of the plurality of subframes and a second one of the plurality of subframes,

the first modulation signal is further configured to be a third phase modulation signal during a third one of the plurality of subframes and a fourth one of the plurality of subframes,

the first modulation signal is further configured to be a second phase modulation signal during a fifth one of the plurality of subframes and a sixth one of the plurality of subframes, and

the first modulation signal is further configured to be a fourth phase modulation signal during a seventh one of the plurality of subframes and an eighth one of the plurality of subframes.

21. The time-of-flight pixel circuit of claim 20 ,

wherein the first modulation signal is configured to be modulated at a first modulation frequency during the first, the third, the fifth, and the seventh ones of the plurality of subframes,

wherein the first modulation signal is configured to be modulated at a second modulation frequency during the second, the fourth, the sixth, and the eighth ones of the plurality of subframes.

22. The time-of-flight pixel circuit of claim 21 , further comprising:

a second floating diffusion coupled to the second transfer transistor to receive the second portion of charge in response to the second modulation signal;

a second plurality of memory nodes; and

23. The time-of-flight pixel circuit of claim 22 , further comprising:

a second output source follower transistor;

a second row select transistor coupled to the second output source follower transistor.

24. The time-of-flight pixel circuit of claim 23 ,

wherein each one of the second plurality of memory nodes is coupled to sample and hold one of a plurality of subframe portions of the second portion of charge from the second floating diffusion through a respective one of the second plurality of sample and hold transistors,

wherein each one of the plurality of subframe portions of the second portion of charge is coupled to be read out from the respective one of the second plurality of memory nodes through a respective one of the second plurality of readout transistors after all of the second plurality of memory nodes have sampled and held the plurality of subframe portions of the second portion of charge from the second floating diffusion.

25. The time-of-flight pixel circuit of claim 24 ,

wherein the second modulation signal is configured to be the second phase modulation signal during the first one of the plurality of subframes and the second one of the plurality of subframes,

wherein the second modulation signal is further configured the fourth phase modulation signal during the third one of the plurality of subframes and the fourth one of the plurality of subframes,

wherein the second modulation signal is further configured to be the first phase modulation signal during the fifth one of the plurality of subframes and the sixth one of the plurality of subframes,

wherein the second modulation signal is further configured to be the third phase modulation signal during the seventh one of the plurality of subframes and the eighth one of the plurality of subframes.

26. The time-of-flight pixel circuit of claim 25 ,

wherein the second modulation signal is configured to be modulated at the first modulation frequency during the first, the third, the fifth, and the seventh ones of the plurality of subframes,

wherein the second modulation signal is configured to be modulated at the second modulation frequency during the second, the fourth, the sixth, and the eighth ones of the plurality of subframes.

27. The time-of-flight pixel circuit of claim 26 ,

wherein the first phase modulation signal is configured to be in phase with the modulated light emitted from the light source,

wherein the second phase modulation signal is configured to be 90 degrees out of phase with the modulated light emitted from the light source,

wherein the third phase modulation signal is configured to be 180 degrees out of phase with the modulated light emitted from the light source,

wherein the fourth phase modulation signal is configured to be 270 degrees out of phase with the modulated light emitted from the light source.

28. A time-of-flight sensing system, comprising:

a light source configured to emit modulated light to an object; and

a time-of-flight pixel array configured to be illuminated with the modulated light reflected from the object, wherein the time-of-flight pixel array comprises a plurality of time-of-flight pixel circuits, wherein each one of the plurality of time-of-flight pixel circuits comprises:

a photodiode configured to generate charge in response to the modulated light reflected from the object to the photodiode;

a first transfer transistor coupled to the photodiode;

a first floating diffusion coupled to the first transfer transistor to receive the first portion of charge in response to the first modulation signal;

a first plurality of memory nodes;

a first output source follower transistor;

a first row select transistor coupled to the first output source follower transistor,

wherein:

wherein a first one of the first plurality of memory nodes is coupled to the first floating diffusion through a first one of the first plurality of sample and hold transistors during a first subframe,

wherein a second one of the first plurality of memory nodes is coupled to the first floating diffusion through a second one of the first plurality of sample and hold transistors during a second subframe,

wherein the first one of the first plurality of memory nodes is coupled to the gate of the first output source follower transistor through a first one of the first plurality of readout transistors during the second subframe.

29. The time-of-flight sensing system of claim 28 ,

30. The time-of-flight sensing system of claim 29 ,

wherein the first modulation signal and the second modulation signal are configured to be modulated at a first modulation frequency during the first subframe and the third subframe,

wherein the first modulation signal and the second modulation signal are further configured to be modulated at a second modulation frequency during the second subframe and a fourth subframe.

31. The time-of-flight sensing system of claim 30 ,

wherein the first modulation signal is configured to be in phase with modulated light emitted from the light source during the first subframe and the second subframe,

wherein the first modulation signal is further configured to be 90 degrees out of phase with modulated light emitted from the light source during the third subframe and the fourth subframe.

32. The time-of-flight sensing system of claim 31 ,

wherein the first modulation signal is further configured to be 180 degrees out of phase with modulated light emitted from the light source during a fifth subframe and a sixth subframe,

wherein the first modulation signal is further configured to be 270 degrees out of phase with modulated light emitted from the light source during a seventh subframe and an eighth subframe,

wherein the first modulation signal and the second modulation signal are further configured to be modulated at the first modulation frequency during the fifth subframe and the seventh subframe,

wherein the first modulation signal and the second modulation signal are further configured to be modulated at the second modulation frequency during the sixth subframe and the eighth subframe.

33. The time-of-flight sensing system of claim 32 , wherein each one of the plurality of time-of-flight pixel circuits further comprises a first reset transistor coupled between a supply rail and the first floating diffusion, wherein the first reset transistor is configured to reset the first floating diffusion.

34. The time-of-flight sensing system of claim 33 , wherein the first reset transistor is coupled to receive an overflow signal.

35. The time-of-flight sensing system of claim 34 , wherein each one of the plurality of time-of-flight pixel circuits further comprises a first output reset transistor coupled between the supply rail and the gate of the first output source follower transistor.

36. The time-of-flight sensing system of claim 35 , wherein each one of the plurality of time-of-flight pixel circuits further comprises:

a first floating diffusion capacitor coupled to the first floating diffusion; and

a first amplifying stage coupled between the first floating diffusion and the first plurality of sample and hold transistors.

37. The time-of-flight sensing system of claim 36 , wherein the first amplifying stage comprises:

a first amplifying source follower transistor having a gate coupled to the first floating diffusion and a source coupled to the first plurality of sample and hold transistors;

a first enable transistor; and

38. The time-of-flight sensing system of claim 33 , further comprising:

a second floating diffusion coupled to the second transfer transistor to receive the second portion of charge in response to the second modulation signal;

a second plurality of memory nodes; and

39. The time-of-flight sensing system of claim 38 , further comprising:

a second output source follower transistor;

a second row select transistor coupled to the second output source follower transistor.

40. The time-of-flight sensing system of claim 39 ,

41. The time-of-flight sensing system of claim 40 ,

42. The time-of-flight sensing system of claim 41 , wherein each one of the plurality of time-of-flight pixel circuits further comprises a second reset transistor coupled between the supply rail and the second floating diffusion, wherein the second reset transistor is configured to reset the second floating diffusion.

43. The time-of-flight sensing system of claim 42 , wherein the second reset transistor is coupled to receive an overflow signal.

44. The time-of-flight sensing system of claim 43 , wherein each one of the plurality of time-of-flight pixel circuits further comprises a second output reset transistor coupled between the supply rail and the gate of the second output source follower transistor.

45. The time-of-flight sensing system of claim 43 , wherein each one of the plurality of time-of-flight pixel circuits further comprises:

a second floating diffusion capacitor coupled to the second floating diffusion; and

a second amplifying stage coupled between the second floating diffusion and the second plurality of sample and hold transistors.

46. The time-of-flight sensing system of claim 45 , wherein the second amplifying stage comprises:

a second amplifying source follower transistor having a gate coupled to the second floating diffusion and a source coupled to the second plurality of sample and hold transistors;

a second enable transistor; and

47. A time-of-flight sensing system, comprising:

a light source configured to emit modulated light to an object; and

a photodiode configured to generate charge in response to the modulated light reflected from the object to the photodiode;

a first transfer transistor coupled to the photodiode;

a first floating diffusion coupled to the first transfer transistor to receive the first portion of charge in response to the first modulation signal;

a first plurality of memory nodes;

a first output source follower transistor;

a first row select transistor coupled to the first output source follower transistor,

wherein:

the first modulation signal is configured to be a first phase modulation signal during a first one of the plurality of subframes and a second one of the plurality of subframes,

the first modulation signal is further configured to be a third phase modulation signal during a third one of the plurality of subframes and a fourth one of the plurality of subframes,

the first modulation signal is further configured to be a second phase modulation signal during a fifth one of the plurality of subframes and a sixth one of the plurality of subframes, and

the first modulation signal is further configured to be a fourth phase modulation signal during a seventh one of the plurality of subframes and an eighth one of the plurality of subframes.

48. The time-of-flight sensing system of claim 47 ,

wherein the first modulation signal is configured to be modulated at a first modulation frequency during the first, the third, the fifth, and the seventh ones of the plurality of subframes,

wherein the first modulation signal is configured to be modulated at a second modulation frequency during the second, the fourth, the sixth, and the eighth ones of the plurality of subframes.

49. The time-of-flight sensing system of claim 48 , further comprising:

a second floating diffusion coupled to the second transfer transistor to receive the second portion of charge in response to the second modulation signal;

a second plurality of memory nodes; and

50. The time-of-flight sensing system of claim 49 , further comprising:

a second output source follower transistor;

a second row select transistor coupled to the second output source follower transistor.

51. The time-of-flight sensing system of claim 50 ,

52. The time-of-flight sensing system of claim 51 ,

wherein the second modulation signal is configured to be the second phase modulation signal during the first one of the plurality of subframes and the second one of the plurality of subframes,

wherein the second modulation signal is further configured the fourth phase modulation signal during the third one of the plurality of subframes and the fourth one of the plurality of subframes,

wherein the second modulation signal is further configured to be the first phase modulation signal during the fifth one of the plurality of subframes and the sixth one of the plurality of subframes,

53. The time-of-flight sensing system of claim 52 ,

wherein the second modulation signal is configured to be modulated at the first modulation frequency during the first, the third, the fifth, and the seventh ones of the plurality of subframes,

wherein the second modulation signal is configured to be modulated at the second modulation frequency during the second, the fourth, the sixth, and the eighth ones of the plurality of subframes.

54. The time-of-flight sensing system of claim 53 ,

wherein the first phase modulation signal is configured to be in phase with the modulated light emitted from the light source,

wherein the second phase modulation signal is configured to be 90 degrees out of phase with the modulated light emitted from the light source,

wherein the third phase modulation signal is configured to be 180 degrees out of phase with the modulated light emitted from the light source,

wherein the fourth phase modulation signal is configured to be 270 degrees out of phase with the modulated light emitted from the light source.

Assignments (1)

ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2021

From: SUESS, ANDREAS; YANG, ZHENG

To: OMNIVISION TECHNOLOGIES, INC.

Reel/Frame 057963/0943 →

Continuity (1)

Related Publication 20230134910A1 · May 4, 2023

References Cited (12)

US 20230088191A1 · Guo · 2023 [cited by examiner]

CN 113359143A · 2021 [cited by examiner]

Bernard Buttgen and Peter Seitz, “Robust Optical Time-of-Flight Range Imaging Base on Smart Pixel Structures,” [Online], IEEE Transactions on Circuits and Systems—I: Regular Papers, vol. 55, No. 6, Jul. 2008 [retrieved … [cited by applicant]

Datasheet—EPC660, “3D TOF imager 320 ×240 pixel,” 2019 ESPROS Photonics Corporation, [Online], <https://www.espros.com>, [retrieved Oct. 6, 2021], pp. 1-61. [cited by applicant]

Andreas Suss, “High Performance CMOS Range Imaging,” doctoral dissertation, University Duisburg-Essen, Duisburg, Germany, Feb. 19, 2014, pp. 1-280. [cited by applicant]

Robert Lange, “3D Time-of-Flight Distance Measurement with Custom Solid-State Image Sensors in CMOS/CCD-Technology,” doctoral dissertation, University of Siegen, Siegen, Germany, Jun. 28, 2000, pp. 1-223. [cited by applicant]

Min-Sun Keel et al., “A 640×480 Indirect Time-of-Flight CMOS Image Sensor with 4-tap 7-um Global-Shutter Pixel and Fixed-Pattem Phase Noise Self-Compensation Scheme,” [Online], Samsung Electronics Co., Ltd., 2019 Sympos… [cited by applicant]

Yuya Shirakawa et al., “An 8-tap CMOS Lock-in Pixel Image Sensor for Short-Pulse Time-of-Flight Measurements,” Shizuoka University, R-15, pp. 1-4. [cited by applicant]

Andrew Payne et al., “A 512−424 CMOS 3D Time-of-Flight Image Sensor with Multi-Frequency Photo Demodulation up to 130MHz and 2GS/s ADC,” ISSCC 2014 / Session 7 / Image Sensors / 7.6; Microsoft, Mountain View, CA, Feb. 1… [cited by applicant]

A. Payne et al., “7.6-A 512−424 CMOS 3D Time-of-Flight Image Sensor with Multi-Frequency Photo-Demodulation up To 130MHz and 2GS/s ADC” [Presentation Slides], Microsoft © 2014 IEEE ISSCC: Feb. 10, 2014, pp. 1-23. [cited by applicant]

Cyrus S. Bamji et al., “1Mpixel 65nm BSI 320MHz Demodulated TOF Image Sensor with 3.5μm Global Shutter Pixels and Analog Binning,” ISCC 2018 / Session 5 / Image Sensors / 5.8; Microsoft, Mountain View, CA, Feb. 12, 2018… [cited by applicant]

Cyrus S. Bamji et al., “1Mpixel 65nm BSI 320MHz Demodulated TOF Image Sensor with 3.5μm Global Shutter Pixels and Analog Binning” [Presentation Slides], Microsoft Corp., Mountain View, CA; Paper 5.8: Feb. 12, 2018, pp. … [cited by applicant]

Cited By (3)

US 12,677,078 US 12,726,733 US 12,750,604