Granted Patent B1

US 12,406,225 · App. 17/177,902 · Granted Sep 2, 2025

Inventors: Jun Ai (Seattle, WA); Rani Awale (Bothell, WA); Andre David Brown (Issaquah, WA); Kavitha Lingamoorthy (Shoreline, WA); Ajay Kumar Ponnuswamy (Seattle, WA); Gopi Prashanth Gopal (Redmond, WA); Sudheer Ramoji (Sammamish, WA); Edwin Thorne (Seattle, WA)

Assignee: Amazon Technologies, Inc.

G06Q10/087F25D27/005F25D29/00G06N3/08G06V10/255G06V20/52H04W4/80F25D2700/02

Abstract

Claims (52)

1. A method comprising:

capturing, at a first time, a first image by a first camera disposed within a first housing of a first monitoring unit, wherein at least a portion of a first field of view of the first camera is illuminated by a first illuminator disposed within the first housing at the first time, and wherein the first monitoring unit is mounted to an interior surface of an enclosure within a vicinity of a plane through which the enclosure is accessible;

providing at least the first image as an input to an artificial neural network trained to detect at least one item within an image, wherein the artificial neural network is executed by at least one processor;

receiving at least one output from the artificial neural network;

detecting, by the at least one processor, a first item depicted within the first image based at least in part on the at least one output;

identifying, by the at least one processor, the first item based at least in part on the first image; and

storing, by the at least one processor, an indication that at least the first item has entered the enclosure or has departed from the enclosure in at least one of a first memory component disposed within the first monitoring unit or a computer system external to the first monitoring unit.

2. The method of claim 1 , wherein the at least one processor is disposed within the first housing.

3. The method of claim 1 , wherein the at least one processor is provided in the computer system external to the first monitoring unit,

wherein the first monitoring unit further comprises a first transceiver disposed within the first housing, and

wherein the method further comprises:

transmitting, by the first transceiver, at least the first image to the computer system over at least one network,

wherein the first item depicted within the first image is identified by the at least one processor provided in the computer system external to the first monitoring unit based at least in part on at least the first image.

4. The method of claim 1 , wherein detecting the first item depicted within the first image comprises:

detecting at least one visual feature of the first item within at least the first image, wherein the at least one visual feature comprises one of a contour, an outline, a color, a texture, a silhouette, a shape, an alphanumeric character or a bar code,

wherein the first item is identified based at least in part on the at least one visual feature.

5. The method of claim 1 , wherein the first monitoring unit further comprises:

a cover slidably provided within a channel of at least a portion of the first housing,

wherein the cover comprises an opening,

wherein the cover is configured to travel within the channel between a first position and a second position,

wherein the opening is provided over a lens of the first camera with the cover in the first position, and

wherein the lens of the first camera is obscured with the cover in the second position.

6. The method of claim 1 , wherein capturing the first image by the first camera comprises:

capturing a plurality of images by the first camera over a period of time, wherein the first image is one of the plurality of images, and wherein the period of time includes the first time and a second time;

detecting, by the at least one processor, the first item depicted within a second image, wherein the second image is one of the plurality of images, and wherein the second image was captured at the second time; and

determining at least the first item has entered the enclosure or has departed from the enclosure based at least in part on a first location of the first item depicted within the first image and a second location of the first item depicted within the second image.

7. The method of claim 1 , wherein the first monitoring unit further comprises a light sensor disposed within the first housing, and

wherein the method further comprises:

detecting, by the light sensor, light within the enclosure prior to the first time,

wherein the first camera is caused to capture the first image at the first time in response to detecting the light within the enclosure prior to the first time.

8. The method of claim 1 , wherein the first monitoring unit further comprises a motion sensor disposed within the first housing, and

wherein the method further comprises:

detecting, by the motion sensor, motion within the enclosure prior to the first time,

wherein the first camera is caused to capture the first image at the first time in response to detecting the motion within the enclosure prior to the first time.

9. The method of claim 1 , wherein each of the first camera and the first illuminator is configured to receive power from a power source,

wherein the power source is one of:

a power source disposed within the first housing;

a power source associated with the enclosure, wherein the first monitoring unit is electrically coupled to the power source associated with the enclosure by at least a first cord having a first plug inserted into a first receptacle provided on the interior surface of the enclosure; or

a power source external to the enclosure, wherein the first monitoring unit is electrically coupled to the power source external to the enclosure by at least a second cord having a second plug inserted into a second receptacle provided external to the enclosure.

10. The method of claim 1 , wherein the first housing comprises:

an upper section, wherein the first field of view of the first camera extends through the upper section, and wherein the first illuminator is configured to emit light through at least a second opening in the upper section;

a lower section, wherein the upper section is coupled to the lower section; and

at least one printed circuit board disposed between the upper section and the lower section, wherein the first camera, the first illuminator and the first memory component are coupled to the at least one printed circuit board, and

wherein each of the upper section and the lower section is formed from a plastic comprising a polycarbonate and an acrylonitrile butadiene styrene.

11. The method of claim 1 , wherein the enclosure is one of:

a cabinet;

a closet;

a freezer; or

a refrigerator.

12. The method of claim 1 , wherein the enclosure further comprises at least one door configured to move between a closed position and at least one open position,

wherein access to an interior compartment of the enclosure defined at least in part by the interior surface is inhibited with the at least one door in the closed position, and

wherein the plane through which the enclosure is accessible is substantially parallel to the at least one door in the closed position.

Assignments (1)

References Cited (93)