IP Library › Granted Patent US 11,475,416
Granted Patent B1
US 11,475,416 · App. 16/549,531 · Granted Oct 18, 2022

System and method for auditing the fill status of a customer waste container by a waste services provider during performance of a waste service activity

Inventors: Kalpesh Patel (Houston, TX); Barry Skolnick (Reno, NV); Shivkumar Vithal (Houston, TX); Pamela C. Jansen (Houston, TX)
Assignee: WM INTELLECTUAL PROPERTY HOLDINGS LLC
G06Q10/30B65F3/02G06Q20/145G06V20/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,475,416
App. No.
16/549,531
Granted
Oct 18, 2022
Kind
B1
Abstract

Systems and methods are provided for using video/still images captured by continuously recording optical sensors mounted on waste collection vehicles used in in the waste collection, disposal and recycling industry for operational and customer service related purposes. A system is provided for auditing the fill status of a customer waste container by a waste services provider during performance of a waste service activity.

Claims (46)

1. A system for auditing the fill status of a customer waste container by a waste services provider during performance of a waste service activity, the system comprising:

an optical sensor disposed on a waste collection vehicle and configured to capture image data of the customer waste container that is indicative of the fill status of the container, wherein the customer waste container is located at a customer site and the direction of image capture for the optical sensor is outward facing with respect to the waste collection vehicle and towards the customer waste container at the customer site;

a memory storage area, and

a processor in communication with the memory storage area and configured to, in real time during performance of the waste service activity: receive the image data from the optical sensor; compare the fill status from the image data of the customer waste container to a predetermined overload threshold condition for an exemplary customer waste container stored in the memory storage area; determine, based on the comparison, whether the fill status of the customer waste container has met or exceeded the predetermined overload threshold condition; if the fill status has met or surpassed the predetermined overload threshold condition, generate an action proposal; and execute an action from the action proposal, wherein the action comprises a customer communication,

wherein the processor is trained, using machine learning, to recognize and identify the fill status of the customer waste container based on the image data received from the optical sensor, and wherein the recognition and identifying of the fill status of the customer waste container is based upon a feature in the image data comprising a programmed recognition pattern of shapes or sizes that indicate trash protruding from the top of the customer waste container, and wherein the predetermined overload threshold condition is associated with existing images stored in the memory storage area,

and wherein generating an action proposal comprises:

collecting historical account information and attributes of the customer;

collecting historical account information and attributes of similar customers, wherein

the similar customer are customers of the waste services provider;

developing a plurality of action proposals using the collected information; and

scoring and ranking the action proposals to determine an action.

2. A method for auditing the fill status of a customer waste container by a waste service provider during performance of a waste service activity, the method comprising:

capturing image data of the customer waste container that is indicative of the fill status of the container, wherein the image data is captured using an optical sensor located on a waste collection vehicle, and wherein the customer waste container is located at a customer site and wherein the direction of image capture of the optical sensor is outward facing with respect to the waste collection vehicle and towards the customer waste container at the customer site;

comparing the fill status from the image data to a predetermined overload threshold condition for the customer waste container;

determining, based on the comparison, whether the fill status has met or exceeded the predetermined overload threshold condition, wherein the determination is made using machine learning to recognize and identify the fill status of the customer waste container based on the image data received from the optical sensor, and wherein the recognition and identifying of the fill status of the customer waste container is based upon a feature in the image data comprising a programmed recognition pattern of shapes or sizes that indicate trash protruding from the top of the customer waste container, and wherein the predetermined overload threshold condition is associated with existing images stored in the memory storage area;

if the fill status has met or surpassed the predetermined overload threshold condition, generating an action proposal; and

executing an action from the action proposal, wherein the action comprises a customer communication,

wherein generating an action proposal comprises:

collecting historical account information and attributes of the customer;

collecting historical account information and attributes of similar customers, wherein the similar customer are customers of the waste services provider;

developing a plurality of action proposals using the collected information; and

scoring and ranking the action proposals to determine an action.

3. The system of claim 1 , wherein the action further comprises a container recovery instruction for the customer waste container for delivery to the waste collection vehicle to collect the customer waste container and remove the customer waste container from the customer location.

4. The system of claim 1 , wherein the action further comprises a customer billing adjustment.

5. The system of claim 1 , wherein the customer communication comprises an educational message to the customer regarding container overages.

6. The method of claim 2 , wherein the action further comprises a container recovery instruction for the customer waste container for delivery to the waste collection vehicle to collect the customer waste container and remove the customer waste container from the customer location.

7. The method of claim 2 , wherein the action further comprises a customer billing adjustment.

8. The method of claim 2 , wherein the customer communication comprises an educational message to the customer regarding container overages.

9. The method of claim 2 , wherein the predetermined overload threshold condition is specific to the customer at the customer site.

10. The method of claim 2 , further comprising soliciting a confirmation from a driver of the waste collection vehicle via visual inspection that the fill status has met or surpassed the predetermined overload threshold condition.

11. The system of claim 1 , wherein the action further comprises a container recovery instruction for delivery to the waste collection vehicle to remove the customer waste container from the customer location and replace the customer waste container with a new container.

12. The system of claim 1 , wherein the action further comprises a container recovery instruction for delivery to the waste collection vehicle to remove the customer waste container from the customer location and replace the customer waste container with a new container.

13. The system of claim 1 , wherein the action further comprises a container recovery instruction for delivery to the waste collection vehicle to provide an additional container at the customer location.

14. The system of claim 1 , wherein the action further comprises a container recovery instruction for delivery to the waste collection vehicle to provide an additional container at the customer location.

15. The system of claim 1 , wherein the customer scoring is impacted by acceptances of similar action proposals by other customers of the waste services provider.

16. The method of claim 2 , wherein the customer scoring is impacted by acceptances of similar action proposals by other customers of the waste services provider.

17. The system of claim 1 , wherein the processor is further configured to identify that the container lid is open due to overloading of the container, and wherein the customer communication comprises (i) a video or still image to demonstrate to the customer that the container lid is open, and (ii) a request to the customer to close the container lid.

18. The method of claim 2 , wherein the processor is further configured to identify that the container lid is open due to overloading of the container, and wherein the customer communication comprises (i) a video or still image to demonstrate to the customer that the container lid is open, and (ii) a request to the customer to close the container lid.

19. The system of claim 1 , wherein the predetermined overload threshold condition is specific to the particular customer receiving the customer communication.

20. The system of claim 1 , wherein the predetermined overload threshold condition is specific to the particular customer receiving the customer communication.

21. The system of claim 1 , wherein the image data is displayed on a graphical user interface for viewing by a user, and wherein the determination of whether the fill status of the customer waste container has met or exceeded the predetermined overload threshold condition is made by both the user and the processor.

22. The system of claim 21 , wherein the determination of whether the fill status of the customer waste container has met or exceeded the predetermined overload threshold condition is made by the user, the processor and by a driver of the waste collection vehicle.

23. The method of claim 22 , wherein the determination made by the driver of the waste collection vehicle is subsequent to the determination made by the user and the processor.

24. The method of claim 2 , wherein the image data is displayed on a graphical user interface for viewing by a user, and wherein the determination of whether the fill status of the customer waste container has met or exceeded the predetermined overload threshold condition is made by both the user and the processor.

25. The method of claim 24 , wherein the determination of whether the fill status of the customer waste container has met or exceeded the predetermined overload threshold condition is made by the user, the processor and by a driver of the waste collection vehicle.

26. The method of claim 25 , wherein the determination made by the driver of the waste collection vehicle is subsequent to the determination made by the user and the processor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 23, 2019
From: PATEL, KALPESH; SKOLNICK, BARRY; VITHAL, SHIVKUMAR; JANSEN, PAMELA C.
To: WM INTELLECTUAL PROPERTY HOLDINGS LLC
Reel/Frame 050151/0488 →
Cited By (5)
US 12,266,268 US 12,332,073 US 12,361,432 US 12,373,850 US 12,464,097