Selective capture of work machine productivity factors based on work state estimation
A computer-implemented system and method are provided for state-based payload capture by a work machine comprising ground engaging units supporting a frame, and a work implement moveable with respect to the frame for loading and unloading payloads. At least a first set of sensors associated with the work machine are used to detect event-based transitions between work states in a defined work cycle having a sequence of work states therein, e.g., from digging states to loaded states. An onboard payload measuring unit is used to selectively capture payload data corresponding to a current work cycle in association with the detected transition. The captured payload data is categorized and stored, independently for the current work cycle with respect to associated locations within a work site and/or with respect to time, and in aggregate with other captured payload data for each of a plurality of work cycles for the work machine.
1 . A computer-implemented method of state-based payload capture by a work machine comprising a plurality of ground engaging units supporting a main frame, and at least one work implement moveable with respect to the main frame and configured for loading and unloading a payload, the method comprising:
classifying over time combinations of data from one or more sensors associated with the work machine into different predetermined work states, and generating a learning model trained to correlate data from at least one of the one or more sensors as relating to productive work during one or more of the work states;
during a current work cycle:
detecting, at least via the one or more sensors associated with the work machine, event-based transitions between the work states;
detecting at least a first work state in the current work cycle correlating to non-productive work based on a comparison of the received input signals to the classified combinations of data, and detecting at least a second work state in the current work cycle correlating to productive work based on a subsequent comparison of the received input signals to the classified combinations of data;
selectively capturing payload data corresponding to the at least second work state in the current work cycle from an onboard payload measuring unit in association with the detected transition;
detecting and classifying, at least via a further one or more sensors associated with the work machine, a type of material being loaded from a first location and subsequently unloaded in a second location by the work machine in association with the payload;
categorizing the captured payload data and the type of material at least in data storage, independently for the current work cycle with respect to one or more associated locations within a work site and/or with respect to time, and in aggregate with other captured payload data and types of material for each of a plurality of work cycles for the work machine, and
generating a representative display of the work site on a display unit, the representative display comprising one or more indicators corresponding to at least the first location and the second location, and aggregate values corresponding to the respective selectively captured payload data and tracking relative increases or decreases at each of the first location and the second location for each type of material;
wherein the selectively captured payload data corresponding to the at least second work state in the current work cycle is independent of payload data corresponding to the at least first work state, wherein productive material removal is not over-estimated via the representative display.
2 . The computer-implemented method of claim 1 , wherein the selectively captured payload data comprises a representative payload value for the at least second work state.
3 . The computer-implemented method of claim 1 , wherein payload data is continuously generated by the onboard payload measuring unit, and wherein the selectively captured payload data excludes payload data generated other than in the at least second work state.
4 . The computer-implemented method of claim 1 , wherein the first work state comprises a loading operation utilizing the at least one work implement.
5 . The computer-implemented method of claim 1 , wherein the one or more sensors associated with the work machine comprise at least one sensor of the onboard payload measuring unit.
6 . The computer-implemented method of claim 1 , wherein the onboard payload measuring unit comprises one or more position sensors, and one or more hydraulic pressure sensors.
7 . The computer-implemented method of claim 1 , wherein the one or more sensors associated with the work machine comprise one or more sensors configured to generate output signals representative of wheel speed, positions of the at least one work implement, load sense pressure, engine speed, and engine torque.
8 . A system for state-based payload capture comprising:
a work machine comprising a plurality of ground engaging units supporting a main frame, and at least one work implement moveable with respect to the main frame and configured for loading and unloading a payload;
a first set of one or more sensors associated with the work machine and configured to generate output signals representative of work states thereof;
an onboard payload measuring unit comprising a second set of one or more sensors configured to generate output signals representative of a current payload for the at least one work implement;
a third set of sensors comprising one or more imaging devices configured to generate output signals corresponding to a material being loaded and unloaded in association with the current payload; and
one or more processors functionally linked to the each of the sensors and configured to classify over time combinations of data from one or more sensors associated with the work machine into different predetermined work states, and to generate a learning model trained to correlate data from at least one of the one or more sensors as relating to productive work during one or more of the work states;
wherein the one or more processors are further configured, during a current work cycle having a sequence of work states therein, to:
detect, at least via the first set of one or more sensors associated with the work machine, event-based transitions between the work states;
detect at least a first work state in the current work cycle correlating to non-productive work based on a comparison of the received input signals to the classified combinations of data, and detect at least a second work state in the current work cycle correlating to productive work based on a subsequent comparison of the received input signals to the classified combinations of data;
selectively capture the payload data corresponding to the at least second work state in the current work cycle from the second set of one or more sensors in association with the detected transitions;
detect and classify a type of material being loaded from a first location and subsequently unloaded in a second location by the work machine in association with the payload;
categorize the captured payload data and the type of material at least in data storage, independently for the current work cycle with respect to one or more associated locations within a work site and/or with respect to time, and in aggregate with other captured payload data and types of material for each of a plurality of work cycles for the work machine; and
generate a representative display of the work site on a display unit, the representative display comprising one or more indicators corresponding to at least the first location and the second location, and aggregate values corresponding to the respective selectively captured payload data and tracking relative increases or decreases at each of the first location and the second location for each type of material;
wherein the selectively captured payload data corresponding to the at least second work state in the current work cycle is independent of payload data corresponding to the at least first work state, wherein productive material removal is not over-estimated via the representative display.
9 . The system of claim 8 , wherein the selectively captured payload data comprises a representative payload value for the at least second work state.
10 . The system of claim 8 , wherein payload data is continuously generated by the onboard payload measuring unit, and wherein the selectively captured payload data excludes payload data generated other than in the at least second work state.
11 . The system of claim 8 , wherein the first work state comprises a loading operation utilizing the at least one work implement.
12 . The system of claim 8 , wherein the first set of one or more sensors associated with the work machine comprise at least one sensor of the onboard payload measuring unit.
13 . The system of claim 8 , wherein the onboard payload measuring unit comprises one or more position sensors, and one or more hydraulic pressure sensors.
14 . The system of claim 8 , wherein the one or more sensors associated with the work machine comprise one or more sensors configured to generate output signals representative of wheel speed, positions of the at least one work implement, load sense pressure, engine speed, and engine torque.