Granted Patent B1

US 12,277,794 · App. 17/303,623 · Granted Apr 15, 2025

Inventors: Baomin Wang (Herndon, VA); Umer Shahid (Sammamish, WA); Tianyi Wang (Kenmore, WA); Georgios Skolianos (Seattle, WA); Rui Zhao (Bellevue, WA); Manoj Aggarwal (Seattle, WA); Gerard Guy Medioni (Los Angeles, CA)

Assignee: AMAZON TECHNOLOGIES, INC.

G06V40/107G06V10/141G06V10/143G06V10/56

Abstract

Claims (92)

1. A method comprising:

determining a first illumination sequence comprising a first plurality of timeslots, each timeslot being associated with a single color of light;

operating one or more light sources of a device to illuminate a first field of view (FOV) during a first duration using the first illumination sequence;

determining a first distance between an object and the device;

determining a first value based on the first distance;

operating a detector of the device during the first duration to acquire first intensity data that is indicative of an intensity of light incident on the detector during individual ones of the first plurality of timeslots, wherein the first intensity data is based on a product of the first value and an uncorrected intensity value; and

determining, based on the first illumination sequence and the first intensity data, a second value.

2. The method of claim 1 , further comprising:

determining a brightness level based on the first distance; and

wherein the operating the one or more light sources is based on the brightness level.

3. The method of claim 1 , the determining the second value comprising:

determining a first color ratio based on a first intensity associated with a first color and a second intensity associated with a second color; and

determining a second color ratio based on a third intensity associated with a third color and the second intensity associated with the second color.

4. The method of claim 1 , the determining the second value comprising:

determining a first color ratio based on a first intensity associated with a first color, a second intensity associated with a second color, and the first distance; and

determining a second color ratio based on a third intensity associated with a third color, the second intensity associated with the second color, and the first distance.

5. The method of claim 1 , the determining the second value comprising:

determining a first color ratio based on a first intensity associated with a first color and a second intensity associated with a violet color; and

determining a second color ratio based on a third intensity associated with a third color and the second intensity associated with the violet color.

6. The method of claim 1 , wherein the first illumination sequence specifies a first ordering of colors presented during the individual ones of the first plurality of timeslots; and the method further comprising:

determining a second illumination sequence comprising a second ordering of colors, wherein the second ordering differs from the first ordering.

7. The method of claim 1 , wherein at least one timeslot of the first illumination sequence is associated with a first color; and

wherein a portion of the first intensity data that is indicative of intensity of light associated with the at least one timeslot is not used to determine the second value.

8. The method of claim 1 , the first plurality of timeslots comprising:

a first timeslot having a second duration; and

a second timeslot having a third duration, wherein the third duration is less than the second duration.

9. A device comprising:

one or more light sources, wherein the one or more light sources during operation emit light to illuminate at least a portion of a first FOV;

a detector that is sensitive to the emitted light, wherein the detector has a second FOV that includes at least the portion of the first FOV; and

electronics to:

determine a first illumination sequence comprising a first plurality of timeslots, each timeslot being associated with a single color of light;

operate, beginning at a first time, the one or more light sources to emit light according to the first illumination sequence;

acquire, using the detector, first intensity data that is indicative of an intensity of light incident on the detector during individual ones of the first plurality of timeslots; and

determine, based on the first illumination sequence and the first intensity data, a first value that is indicative of a user being present within the first FOV, wherein a portion of the first intensity data that is indicative of intensity of light associated with at least one timeslot is not used to determine the first value.

10. The device of claim 9 , further comprising:

a distance sensor; and

the electronics further to:

determine, using the distance sensor, a first distance between an object and the device; and

determine the first value based at least in part on the first distance.

11. The device of claim 9 , the electronics further to:

determine a first color ratio based on a first intensity associated with a first color and a second intensity associated with a second color; and

determine a second color ratio based on a third intensity associated with a third color and the second intensity associated with the second color;

wherein the first value is based on the first color ratio and the second color ratio.

12. The device of claim 9 , the electronics further to:

determine a first color ratio based on a first intensity associated with a first color and a second intensity associated with a violet color; and

determine a second color ratio based on a third intensity associated with a third color and the second intensity;

wherein the first value is based on the first color ratio and the second color ratio.

13. The device of claim 9 , the electronics further to:

determine a second illumination sequence comprising a second plurality of timeslots, each timeslot of the second plurality of timeslots being associated with a single color of light, wherein the second illumination sequence comprises a different ordering of single colors of light compared to the first illumination sequence;

operate, beginning at a second time, the one or more light sources to emit light according to the second illumination sequence;

acquire, using the detector, second intensity data that is indicative of an intensity of light incident on the detector during individual ones of the second plurality of timeslots; and

determine, based on the second illumination sequence and the second intensity data, a second value that is indicative of the user being present within the second FOV.

14. The device of claim 9 , wherein the detector comprises a photodetector having a response time of less than 100 microseconds.

15. The device of claim 9 , wherein the detector comprises a camera; and

the electronics further to:

acquire a set of images, each image associated with a timeslot of the first plurality of timeslots;

determine, for the each image of the set of images, a region of interest indicative of a portion of the each image; and

determine, based on intensity values of pixels within the region of interest, the first intensity data.

16. The device of claim 9 , further comprising:

one or more infrared light sources; and

an infrared camera; and

the electronics to, concurrent with operation of the one or more light sources to emit light according to at least a portion of the first illumination sequence:

acquire a first image using the infrared camera, wherein the first image depicts surface features of the user; and

acquire a second image using the infrared camera, wherein the second image depicts subcutaneous features of the user.

17. A device comprising:

a distance sensor;

one or more light sources, wherein the one or more light sources during operation emit light to illuminate at least a portion of a first FOV;

a detector that is sensitive to the emitted light, wherein the detector has a second FOV that includes at least the portion of the first FOV; and

electronics to:

determine, using the distance sensor, a first distance between an object and the device;

determine a first illumination sequence comprising a first plurality of timeslots, each timeslot of the first plurality of timeslots being associated with a single color of light;

operate, beginning at a first time, the one or more light sources to emit light according to the first illumination sequence;

acquire, using the detector, first intensity data that is indicative of an intensity of light incident on the detector during individual ones of the first plurality of timeslots;

determine a first color ratio based on a first intensity associated with a first color, a second intensity associated with a second color, and the first distance;

determine a second color ratio based on a third intensity associated with a third color and the second intensity; and

determine, based on the first illumination sequence, the first intensity data, the first color ratio, and the second color ratio, a first value that is indicative of the object being present within the first FOV.

18. The device of claim 17 , the electronics further to:

determine a second illumination sequence comprising a second plurality of timeslots, each timeslot of the second plurality of timeslots being associated with a single color of light, wherein the second illumination sequence comprises a different ordering of single colors of light compared to the first illumination sequence;

operate, beginning at a second time, the one or more light sources to emit light according to the second illumination sequence;

acquire, using the detector, second intensity data that is indicative of an intensity of light incident on the detector during individual ones of the second plurality of timeslots; and

determine, based on the second illumination sequence and the second intensity data, a second value that is indicative of the object being present within the second FOV.

19. The device of claim 17 , wherein the detector comprises a camera; and

the electronics further to:

acquire a set of images, each image associated with a timeslot of the first plurality of timeslots;

determine, for the each image of the set of images, a region of interest indicative of a portion of the each image; and

determine, based on intensity values of pixels within the region of interest, the first intensity data.

20. The device of claim 17 , further comprising:

one or more infrared light sources; and

an infrared camera; and

the electronics further to, concurrent with operation of the one or more light sources to emit light according to the first illumination sequence:

acquire a first image using the infrared camera, wherein the first image depicts surface features of the object; and

acquire a second image using the infrared camera, wherein the second image depicts subcutaneous features of the object.

Assignments (2)

References Cited (27)

Cited By (3)

US 12,457,408 US 12,633,166 US 12,711,807