Automated vision-based clutter detector and notifier

1. A method of monitoring a customer space comprising:

obtaining visual data comprising image frames of the customer space over a period of time;

periodically defining a region of interest within the customer space using computer vision techniques to locate an elevated surface that is movable to different locations within the customer space;

monitoring the region of interest for at least one predefined clutter condition; and

generating a notification when the at least one predefined clutter condition is detected;

wherein the region of interest corresponds to a portion of the customer space in which customers relocate objects, and wherein the predefined clutter condition includes detecting a presence of relocated objects in the region of interest.

2. The method of claim 1 , wherein the detecting a presence of relocated objects includes estimating the appearance of a background space and detecting the appearance of foreground objects.

3. The method of claim 1 , wherein the detecting a presence of relocated objects includes analyzing the visual data with an object detection algorithm configured to identify specific objects within the region of interest.

4. The method of claim 3 , wherein the object detection algorithm is configured to detect objects including at least one of dining objects, litter, spills and personal accessories.

5. The method of claim 1 , wherein the predefined clutter condition includes the presence of relocated objects in the region of interest and the absence of motion in the region of interest for a prescribed period of time.

6. The method of claim 5 , wherein the prescribed period of time is at least ten seconds.

7. The method of claim 1 , wherein the obtaining visual data includes recording images with a camera.

8. The method of claim 1 , wherein the defining a region of interest is performed manually by selecting the region of interest in a video frame with an input device.

9. The method of claim 1 , wherein the computer vision techniques include at least one of sensing horizontal support surfaces or generating a depth map using stereo vision techniques.

10. A non-transitory computer-readable medium having stored thereon computer-executable instructions for monitoring a customer space, the instructions being executable by a processor and comprising:

receiving visual data of the customer space over a period of time;

periodically defining a region of interest within the customer space, the region of interest corresponding to a portion of the customer space in which customers periodically relocate objects;

monitoring the region of interest for at least one predefined clutter condition; and

generating a notification when the at least one predefined clutter condition is detected;

wherein the predefined clutter condition includes detecting a presence of relocated objects in the region of interest; and

wherein the periodically defining a region of interest within the customer space includes using computer vision techniques to locate an elevated surface that is movable to different locations within the customer space.

11. The non-transitory computer-readable medium as set forth in claim 10 , wherein the predefined clutter condition further includes a sustained presence or absence of motion in the region of interest.

12. The non-transitory computer-readable medium as set forth in claim 11 , wherein the detecting a presence of relocated objects includes defining a background space and detecting the appearance of foreground objects.

13. The non-transitory computer-readable medium as set forth in claim 11 , wherein the detecting a presence of relocated objects includes analyzing the visual data with an object detection algorithm configured to identify specific objects within the region of interest.

14. The non-transitory computer-readable medium as set forth in claim 13 , wherein the object detection algorithm is configured to detect objects including at least one of dining objects, litter, spills and personal accessories.

15. A system for monitoring a customer space comprising:

at least one optical sensor for obtaining visual data corresponding to the customer space; and

a central processing unit including a processor and a non-transitory computer-readable medium having stored thereon computer-executable instructions for monitoring a customer space executable by the processor, the instructions comprising:

receiving visual data of the customer space over a period of time from the optical sensor;

periodically defining a region of interest within the customer space using computer vision techniques to locate an elevated surface that is movable to different locations within the customer space, the region of interest corresponding to a portion of the customer space in which customers periodically relocate objects;

monitoring the region of interest for at least one predefined clutter condition; and

generating a notification when the at least one predefined clutter condition is detected;

wherein the predefined clutter condition includes detecting a presence of relocated objects in the region of interest.

16. The system for monitoring a customer space as set forth in claim 15 , wherein the predefined clutter condition further includes a sustained presence or absence of motion in the region of interest.

17. The system for monitoring a customer space as set forth in claim 15 , wherein the detecting a presence of relocated objects includes analyzing the visual data with an object detection algorithm configured to identify specific objects within the region of interest.