IP Library › Granted Patent US 12,363,457
Granted Patent B2
US 12,363,457 · App. 18/451,764 · Granted Jul 15, 2025

Fixed pattern noise reduction in image sensors operated with pulsed illumination

Inventors: Andreas Suess (San Jose, CA); Tomas Geurts (Santa Clara, CA)
Assignee: OMNIVISION TECHNOLOGIES, INC.
H04N25/67H04N25/616H04N25/671H04N25/706H04N25/709H04N25/7795H04N25/78
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,363,457
App. No.
18/451,764
Granted
Jul 15, 2025
Kind
B2
Abstract

Fixed pattern noise (FPN) reduction techniques in image sensors operated with pulse illumination are disclosed herein. In one embodiment, a method includes, during a first sub-exposure period of a frame, (a) operating a first tap of a pixel to capture a first signal corresponding to first charge at a first floating diffusion, the first charge corresponding to first light incident on a photosensor, and (b) operating a second tap of the pixel to capture a first parasitic signal corresponding to FPN at a second floating diffusion. The method further includes, during a second sub-exposure period of the frame, (a) operating the second tap to capture a second signal corresponding to second charge at the second floating diffusion, the second charge corresponding to second light incident on the photosensor, and (b) operating the first tap to capture a second parasitic signal corresponding to FPN at the first floating diffusion.

Claims (186)

1. A method of operating a pixel to reduce fixed pattern noise, the method comprising:

during a first sub-exposure period of a frame,

capturing, using a first tap of the pixel, a first signal corresponding to first charge at a first floating diffusion of the first tap, wherein the first charge is generated by a photosensor of the pixel in response to one or more first light pulses incident on the photosensor, and wherein capturing the first signal includes sampling a plurality of first voltage signals using circuitry of the first tap, and

capturing, using a second tap of the pixel, a first noise signal corresponding to fixed pattern noise (FPN) at a second floating diffusion of the second tap, wherein capturing the first noise signal includes sampling a plurality of second voltage signals using circuitry of the second tap; and

during a second sub-exposure period of the frame,

capturing, using the second tap, a second signal corresponding to second charge at the second floating diffusion, wherein the second charge is generated by the photosensor in response to one or more second light pulses incident on the photosensor, and wherein capturing the second signal includes sampling a plurality of third voltage signals using circuitry of the second tap, and

capturing, using the first tap, a second noise signal corresponding to fixed pattern noise (FPN) at the first floating diffusion, wherein capturing the second noise signal includes sampling a plurality of fourth voltage signals using circuitry of the second tap.

2. The method of claim 1 , wherein sampling the plurality of first voltage signals includes:

sampling a reference voltage for the first signal onto a first sampling capacitor of the first tap; and

sampling a signal voltage for the first signal onto a second sampling capacitor of the first tap.

3. The method of claim 2 , wherein capturing the first signal further includes: reading the reference voltage for the first signal out of the pixel, and reading the signal voltage for the first signal out of the pixel; and the pixel.

4. The method of claim 2 , wherein sampling the plurality of second voltage signals includes:

sampling a reference voltage for the first noise signal onto a first sampling capacitor of the second tap; and

sampling a signal voltage for the first noise signal onto a second sampling capacitor of the second tap.

5. The method of claim 1 , wherein:

sampling the plurality of first voltage signals includes:

sampling a reference voltage for the first signal, and

sampling a signal voltage for the first signal; and

capturing the first signal further includes computing, using a difference amplifier of the first tap, a difference between the reference voltage for the first signal and the signal voltage for the first signal.

6. The method of claim 5 , wherein capturing the first signal further includes reading the difference out of the pixel.

7. The method of claim 5 , wherein:

sampling the plurality of second voltage signals includes:

sampling a reference voltage for the first noise signal, and

sampling a signal voltage for the first noise signal; and

capturing the first noise signal further includes computing, using a difference amplifier of the second tap, a difference between the reference voltage for the first noise signal and the signal voltage for the first noise signal.

8. The method of claim 1 , wherein:

sampling the plurality of first voltage signals includes:

sampling a first reset noise voltage for the first signal,

sampling a reference voltage for the first signal,

sampling a signal voltage for the first signal, and

sampling a second reset noise voltage for the first signal; and

capturing the first signal further includes:

computing, using a different amplifier of the first tap, a first difference between the first reset noise voltage for the first signal and the reference voltage for the first signal, and

computing, using the difference amplifier of the first tap, a second difference between the signal voltage for the first signal and the second reset noise voltage for the first signal.

9. The method of claim 8 , wherein capturing the first signal further includes reading the first and second differences out of the pixel.

10. The method of claim 8 , wherein capturing the first signal further includes:

storing the first difference on a first capacitor of a capacitor bank of the first tap; and

storing the second difference on a second capacitor of the capacitor bank of the first tap.

11. The method of claim 10 , wherein capturing the first signal further includes:

computing the first signal, wherein computing the first signal includes shorting the first capacitor of the capacitor bank storing the first difference with the second capacitor of the capacitor bank storing the second difference; and

reading the first signal out from the pixel.

12. The method of claim 10 , wherein:

sampling the plurality of fourth voltage signals includes:

sampling a first reset noise voltage for the second noise signal,

sampling a reference voltage for the second noise signal,

sampling a signal voltage for the second noise signal, and

sampling a second reset noise voltage for the second noise signal; and

capturing the second noise signal further includes:

computing, using the difference amplifier of the first tap, a third difference between the first reset noise voltage for the second noise signal and the reference voltage for the second noise signal,

storing the third difference on a third capacitor of the capacitor bank of the first tap,

computing, using the difference amplifier of the first tap, a fourth difference between the signal voltage for the second noise signal and the second reset noise voltage for the second noise signal, and

storing the fourth difference on a fourth capacitor of the capacitor bank of the first tap.

13. The method of claim 12 , wherein:

capturing the first signal further includes computing the first signal;

computing the first signal includes shorting the first capacitor of the capacitor bank storing the first difference with the second capacitor of the capacitor bank storing the second difference;

capturing the second noise signal further includes computing the second noise signal;

computing the second noise signal includes shorting the third capacitor of the capacitor bank storing the third difference with the fourth capacitor of the capacitor bank storing the fourth difference; and

the method further comprises computing, using a second difference amplifier, a fifth difference between the first signal and the second noise signal.

14. The method of claim 13 , further comprising reading the fifth difference out of the pixel.

15. The method of claim 8 , wherein:

sampling the plurality of second voltage signals includes:

sampling a first reset noise voltage for the first noise signal,

sampling a reference voltage for the first noise signal,

sampling a signal voltage for the first noise signal, and

sampling a second reset noise voltage for the first noise signal; and

capturing the first noise signal further includes:

computing, using a difference amplifier of the second tap, a third difference between the first reset noise voltage for the first noise signal and the reference voltage for the first noise signal, and

computing, using the difference amplifier of the second tap, a fourth difference between the signal voltage for the first noise signal and the second reset noise voltage for the first noise signal.

16. The method of claim 15 , wherein capturing the first noise signal further includes:

storing the third difference on a first capacitor of a capacitor bank of the second tap, and

storing the fourth difference on a second capacitor of a capacitor bank of the second tap.

17. The method of claim 16 , wherein capturing the first noise signal further includes:

computing the first noise signal, wherein computing the first noise signal includes shorting the first capacitor of the capacitor bank storing the third difference with the second capacitor of the capacitor bank storing the fourth difference; and

reading the first noise signal out from the pixel.

18. The method of claim 16 , wherein:

sampling the plurality of third voltage signals includes:

sampling a first reset noise voltage for the second signal,

sampling a reference voltage for the second signal,

sampling a signal voltage for the second signal, and

sampling a second reset noise voltage for the second signal; and

capturing the second signal further includes:

computing, using the difference amplifier of the second tap, a fifth difference between the first reset noise voltage for the second signal and the reference voltage for the second signal,

storing the fifth difference on a third capacitor of the capacitor bank of the second tap,

computing, using the difference amplifier of the second tap, a sixth difference between the signal voltage for the second signal and the second reset noise voltage for the second signal, and

storing the sixth difference on a fourth capacitor of the capacitor bank of the second tap.

19. The method of claim 18 , wherein:

capturing the first noise signal further includes computing the first noise signal;

computing the first noise signal includes shorting the first capacitor of the capacitor bank storing the third difference with the second capacitor of the capacitor bank storing the fourth difference;

capturing the second signal further includes computing the second noise signal;

computing the second signal includes shorting the third capacitor of the capacitor bank storing the fifth difference with the fourth capacitor of the capacitor bank storing the sixth difference; and

the method further comprises computing, using a second difference amplifier, a seventh difference between the first noise signal and the second signal.

20. The method of claim 19 , further comprising reading the seventh difference out of the pixel.

21. The method of claim 19 , wherein:

capturing the first signal further includes:

storing the first difference on a first capacitor of a capacitor bank of the first tap,

storing the second difference on a second capacitor of the capacitor bank of the first tap, and

computing the first signal;

computing the first signal includes shorting the first capacitor of the capacitor bank storing the first difference with the second capacitor of the capacitor bank storing the second difference;

sampling the plurality of fourth voltage signals includes:

sampling a first reset noise voltage for the second noise signal,

sampling a reference voltage for the second noise signal,

sampling a signal voltage for the second noise signal, and

sampling a second reset noise voltage for the second noise signal;

capturing the second noise signal further includes:

computing, using the difference amplifier of the first tap, an eighth difference between the first reset noise voltage for the second noise signal and the reference voltage for the second noise signal,

storing the eighth difference on a third capacitor of the capacitor bank of the first tap,

computing, using the difference amplifier of the first tap, a ninth difference between the signal voltage for the second noise signal and the second reset noise voltage for the second noise signal,

storing the ninth difference on a fourth capacitor of the capacitor bank of the first tap, and

computing the second noise signal;

computing the second noise signal includes shorting the third capacitor of the capacitor bank storing the eighth difference with the fourth capacitor of the capacitor bank storing the ninth difference; and

the method further comprises computing, using a third difference amplifier, a tenth difference between the first signal and the second noise signal.

22. The method of claim 21 , further comprising:

computing a sum of the seventh difference and the tenth difference, wherein computing the sum of the seventh difference and the tenth difference includes shorting an output of a source follower transistor of the first tap with an output of a source follower transistor of the second tap; and

reading the sum of the seventh difference and the tenth difference out of the pixel.

23. The method of claim 21 , further comprising:

computing a sum of the seventh difference and the tenth difference, wherein computing the sum of the seventh difference and the tenth difference includes shorting an output of the second difference amplifier with an output of the third difference amplifier; and

reading the sum of the seventh difference and the tenth difference out of the pixel.

24. The method of claim 1 , further comprising computing a sum of the first signal and the second signal, wherein computing the sum of the first signal and the second signal includes shorting together (i) a first capacitor of a capacitor bank of the first tap, (ii) a second capacitor of the capacitor bank of the first tap, (iii) a first capacitor of a capacitor bank of the second tap, and (iv) a second capacitor of the capacitor bank of the second tap.

25. The method of claim 24 , further comprising computing a sum of the first noise signal and the second noise signal, wherein computing the sum of the first noise signal and the second noise signal includes shorting together (i) a third capacitor of the capacitor bank of the first tap, (ii) a fourth capacitor of the capacitor bank of the first tap, (iii) a third capacitor of the capacitor bank of the second tap, and (iv) a fourth capacitor of the capacitor bank of the second tap.

26. The method of claim 25 , further comprising:

computing, using a difference amplifier of the pixel, a difference between (a) the sum of the first signal and the second signal and (b) the sum of the first noise signal and the second noise signal; and

reading the difference out of the pixel.

27. The method of claim 1 , wherein:

capturing the first signal further includes:

storing, on a first capacitor of a capacitor bank of the first tap, a first difference between (i) a first reset noise voltage for the first signal and (ii) a reference voltage for the first signal, and

storing, on a second capacitor of the capacitor bank of the first tap, a second difference between (i) a signal voltage for the first signal and (ii) a second reset noise voltage for the first signal; and

capturing the second noise signal further includes:

storing, on the first capacitor of the capacitor bank of the first tap, a third difference between (i) a first reset noise voltage for the second noise signal and (ii) a reference voltage for the second noise signal.

28. The method of claim 27 , further comprising:

reading the first difference out of the pixel during the first sub-exposure period; and

reading the second difference and the third difference out of the pixel during the second sub-exposure period.

29. The method of claim 27 , wherein:

capturing the first noise signal further includes:

storing, on a first capacitor of a capacitor bank of the second tap, a fourth difference between (i) a first reset noise voltage for the first noise signal and (ii) a reference voltage for the first noise signal, and

storing, on a second capacitor of the capacitor bank of the second tap, a second difference between (i) a signal voltage for the first noise signal and (ii) a second reset noise voltage for the first noise signal; and

capturing the second signal further includes:

storing, on the first capacitor of the capacitor bank of the second tap, a third difference between (i) a first reset noise voltage for the second signal and (ii) a reference voltage for the second signal.

30. The method of claim 1 , wherein:

capturing the first signal includes:

sampling, on a first capacitor of the pixel, a first difference between (i) a first reset noise voltage for the first signal and (ii) a reference voltage for the first signal,

sampling, on a second capacitor of the pixel, a second difference between (i) a signal voltage for the first signal and (ii) a second reset noise voltage for the first signal,

computing the first signal, wherein computing the first signal includes shorting the first capacitor storing the first difference with the second capacitor storing the second difference; and

storing the first signal on a third capacitor of the pixel; and

capturing the first noise signal includes:

sampling, on a fourth capacitor of the pixel, a third difference between (i) a first reset noise voltage for the first noise signal and (ii) a reference voltage for the first noise signal,

sampling, on a fifth capacitor of the pixel, a fourth difference between (i) a signal voltage for the first noise signal and (ii) a second reset noise voltage for the first noise signal,

computing the first noise signal, wherein computing the first noise signal includes shorting the fourth capacitor storing the third difference with the fifth capacitor storing the fourth difference, and

storing the first noise signal on a sixth capacitor of the pixel.

31. The method of claim 30 , wherein:

capturing the second noise signal includes:

sampling, on a seventh capacitor of the pixel, a fifth difference between (i) a first reset noise voltage for the second noise signal and (ii) a reference voltage for the second noise signal,

sampling, on an eighth capacitor of the pixel, a sixth difference between (i) a signal voltage for the second noise signal and (ii) a second reset noise voltage for the second noise signal,

computing the second noise signal, wherein computing the second noise signal includes shorting the seventh capacitor storing the fifth difference with the eighth capacitor storing the sixth difference, and

storing the second noise signal on a ninth capacitor of the pixel; and

capturing the second signal includes:

sampling, on a tenth capacitor of the pixel, a seventh difference between (i) a first reset noise voltage for the second signal and (ii) a reference voltage for the second signal,

sampling, on an eleventh capacitor of the pixel, an eighth difference between (i) a signal voltage for the second signal and (ii) a second reset noise voltage for the second signal,

computing the second signal, wherein computing the second signal includes shorting the tenth capacitor storing the seventh difference with the eleventh capacitor storing the eighth difference, and

storing the second signal on a twelfth capacitor of the pixel.

32. The method of claim 31 , further comprising:

computing a sum of the first signal and the second signal, wherein computing the sum of the first signal and the second signal includes shorting the third capacitor storing the first signal with the twelfth capacitor storing the second signal;

storing the sum of the first signal and the second signal on a thirteenth capacitor of the pixel;

computing a sum of the first noise signal and the second noise signal, wherein computing the sum of the first noise signal and the second noise signal includes shorting the sixth capacitor storing the first noise signal with the ninth capacitor storing the second noise signal; and

storing the sum of the first noise signal and the second noise signal on a fourteenth capacitor of the pixel.

33. The method of claim 32 , further comprising:

computing, using a difference amplifier of the pixel, a difference between (i) the sum of the first signal and the second signal and (ii) the sum of the first noise signal and the second noise signal; and

reading the difference out of the pixel.

34. The method of claim 32 , wherein:

the first capacitor, the third capacitor, and the thirteenth capacitor refer to a first same capacitor of the pixel;

the fourth capacitor, the sixth capacitor, and the fourteenth capacitor refer to a second same capacitor of the pixel;

the second capacitor, the seventh capacitor, and the ninth capacitor refer to a third same capacitor of the pixel; and

the fifth capacitor, the tenth capacitor, and the twelfth capacitor refer to a fourth same capacitor of the pixel.

35. The method of claim 1 , wherein:

sampling the plurality of first voltage signals includes:

sampling, on a first capacitor of the pixel, a first voltage for the first signal, and

sampling, on a second capacitor of the pixel, a second voltage for the first signal;

capturing the first signal further includes computing a sum of the first voltage and the second voltage; and

computing the sum of the first voltage and the second voltage includes shorting the first capacitor with the second capacitor.

36. The method of claim 35 , wherein capturing the first signal further includes storing the sum of the first voltage and the second voltage to a third capacitor of the pixel, wherein the third capacitor is one of the first and second capacitors.

37. The method of claim 36 , wherein sampling the plurality of first voltage signals further includes:

sampling, on a fourth capacitor of the pixel, a third voltage for the first signal, and

sampling, on a fifth capacitor of the pixel different from the third capacitor, a fourth voltage for the first signal, wherein the fifth capacitor is another one of the first and second capacitors.

38. The method of claim 37 , wherein capturing the first signal further includes:

computing a sum of the third voltage and the fourth voltage, wherein computing the sum of the third voltage and the fourth voltage includes shorting the fourth capacitor with the fifth capacitor; and

storing the sum of the third voltage and the fourth voltage on a sixth capacitor of the pixel, wherein the sixth capacitor is one of the fourth and fifth capacitors.

39. The method of claim 38 , wherein sampling the plurality of fourth voltage signals includes sampling, on a seventh capacitor of the pixel different from the sixth capacitor, a first voltage for the first noise signal, wherein the seventh capacitor is another one of the fourth and fifth capacitors.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2023
From: SUESS, ANDREAS; GEURTS, TOMAS
To: OMNIVISION TECHNOLOGIES, INC.
Reel/Frame 064705/0290 →
Continuity (2)
Provisional Application 63373722 · Aug 28, 2022
Related Publication 20240073557A1 · Feb 29, 2024
References Cited (3)
US 11729524B2 · Jin · 2023 [cited by examiner]
US 20190006403A1 · Ikeda · 2019 [cited by examiner]
US 20190124278A1 · Velichko · 2019 [cited by examiner]