Granted Patent B2

US 12,742,882 · App. 17/575,520 · Granted Sep 22, 2026

Inventor: Andreas Abmann (Edinburgh, GB)

Assignee: STMicroelectronics (Research & Development) Limited

G01S17/10G01S7/51G01S17/894G01S17/931

Abstract

Claims (32)

1 . A system to sample light comprising:

an array of light-sensitive pixels; and

a content display comprising:

an array of content-display pixels; and

an array of masking pixels arranged between the array of content-display pixels and the array of light-sensitive pixels, each pixel in the array of masking pixels individually selectable to switch between an opaque state and a transparent state, the array of masking pixels being aligned with the array of light-sensitive pixels so light-sensitive pixels may be selected to receive light passing through the content display by selecting the states of the array of masking pixels.

2 . The system of claim 1 , wherein the array of content-display pixels comprises a transparent Organic Light Emitting Diode Array.

3 . The system of claim 1 , further comprising a light source aligned with the array of masking pixels so light may be projected through the content display from the light source in illumination patterns that are determined by selecting the states of the array of masking pixels.

4 . The system of claim 3 , wherein the array of light-sensitive pixels is aligned with the array of masking pixels to receive light passing through the content display from a three-dimensional environment and the light source is aligned with the array of masking pixels to project light through the content display into the three-dimensional environment.

5 . The system of claim 1 , further comprising a non-transitory computer readable memory and a processor in communication with the array of light-sensitive pixels, the non-transitory computer readable memory storing an instruction set that when executed causes the processor to derive a three-dimensional image from data collected from the array of light-sensitive pixels.

6 . The system of claim 5 , wherein data collected from the array of light-sensitive pixels includes data from light-sensitive pixels aligned with masking pixels in the opaque state.

7 . The system of claim 1 , further comprising a controller that provides a drive signal to select the states of the array of masking pixels.

8 . The system of claim 7 , wherein the controller comprises a graphics processing unit.

9 . A method to sense light comprising:

having an array of content-display pixels and an array of masking pixels arranged between the array of content-display pixels and an array of light-sensitive pixels, each pixel in the array of masking pixels individually addressable to switch between an opaque state and a transparent state, the array of masking pixels being aligned with the array of light-sensitive pixels so light-sensitive pixels may be selected to receive light passing through the array of content-display pixels by selecting the states of the array of masking pixels; and

simultaneously displaying content on the array of content-display pixels and receiving light at the array of light-sensitive pixels through a pattern of masking pixels selected to be in the transparent state.

10 . The method of claim 9 , wherein the pattern of masking pixels is sparse.

11 . The method of claim 9 further comprising projecting a light pulse into a three-dimensional environment and collecting time of flight data from the array of light-sensitive pixels for light reflected from the three-dimensional environment through the array of content-display pixels.

12 . The method of claim 11 , further comprising deriving a three-dimensional image from the time of flight data.

13 . The method of claim 12 , wherein deriving the three-dimensional image from the time of flight data comprises utilizing compressed sensing.

14 . The method of claim 13 , wherein the time of flight data used to derive the three-dimensional image is augmented with data from the array of content-display pixels.

15 . The method of claim 9 , further comprising repeatedly varying the pattern of masking pixels selected to be in the transparent state to sample a three dimensional environment.

16 . A system to sample light comprising:

an array of light-sensitive pixels;

a light source;

a content display comprising:

an array of content-display pixels; and

an array of masking pixels arranged between the array of content-display pixels and the array of light-sensitive pixels, each pixel in the array of masking pixels individually selectable to switch between an opaque state and a transparent state, the array of masking pixels being aligned with the array of light-sensitive pixels so light-sensitive pixels may be selected to receive light passing through the content display by selecting the states of the array of masking pixels, and the array of masking pixels being aligned with the light source so light may be projected through the content display from the light source in illumination patterns that are determined by selecting the states of the array of masking pixels; and

a controller coupled with the array of masking pixels to provide a drive signal to select the states of the array of masking pixels.

17 . The system of claim 16 , further comprising a non-transitory computer readable memory and a processor in communication with the array of light-sensitive pixels, the non-transitory computer readable memory storing an instruction set that when executed causes the processor to derive a three-dimensional image from data collected from the array of light-sensitive pixels.

18 . The system of claim 17 , wherein data collected from the array of light-sensitive pixels includes data from light-sensitive pixels aligned with masking pixels in the opaque state.

19 . The system of claim 18 , wherein the array of content-display pixels comprises a transparent Organic Light Emitting Diode Array.

20 . The system of claim 19 , wherein the controller comprises a graphics processing unit.

Assignments (1)

Continuity (1)

References Cited (32)