Graphical user interface for real-time management of an earth shaping vehicle

1. A method for managing a material moving routine in a site, the method comprising:

generating, by a computing device, a graphical user interface displaying a three-dimensional representation of the site comprising a position of a vehicle capable of moving material within the site and a target location within the site for the vehicle to move material and a representation of a planned movement of a tool overlaying the representation of the site, the representation of the planned movement divided into a plurality of segments, wherein each segment of the plurality of segments represents a portion of the planned movement of the tool;

transmitting, by the computing device, a set of instructions to cause the vehicle to move a volume of material from the target location;

as the vehicle moves material from the target location based on the set of instructions:

receiving, at the computing device, data recorded by one or more sensors mounted to the vehicle describing a current depth of the target location, a current volume of material moved from the target location, a position of the vehicle relative to the target location, a location of a pile of material, and a height of the pile of material;

modifying, based on the data recorded by the one or more sensors, the graphical user interface to display the current depth of the target location, the position of the vehicle relative to the target location, the location of the pile of material, and the height of the pile of material; and

modifying, by the computing device, the set of instructions based on the received data recorded by the one or more sensors and providing the modified set of instructions to the vehicle.

2. The method of claim 1 , wherein the computing device continuously receives the data recorded by the one or more sensors as the vehicle moves material from the target location and modifies the graphical user interface continuously as the vehicle moves material from the target location.

3. The method of claim 1 , wherein the graphical user interface further displays a side-profile view of the three-dimensional representation of the site, the method further comprising:

receiving data recorded by one or more sensors mounted to the vehicle describing a current position of the vehicle and material moving tool coupled to the vehicle in the site; and

as the vehicle moves material from the target location, modifying the graphical user interface to display the current position of the vehicle and the material moving tool based on the data describing the current position of the vehicle and material moving tool coupled to the vehicle in the site.

4. The method of claim 1 , wherein the computing device transmits a second set of instructions for the vehicle to move material from a second target location, the method further comprising:

receiving second data recorded by the one or more sensors indicating that the vehicle has navigated to the second target location;

modifying the graphical user interface to display the position of the vehicle at the second target location; and

as the vehicle moves material from the second target location, modifying, based on the second data recorded by the one or more sensors, the graphical user interface to display the second target location, a current depth of the second target location, a position of the vehicle relative to the second target location, and an updated height of the of the pile of material, wherein the height of the pile of material is updated based on the volume of material moved from the second target location.

5. The method of claim 1 , wherein the graphical user interface further displays a representation of a ground surface of the site and one or more of the following features:

a representation of a range of motion of a tool of the vehicle and the vehicle overlaying the representation of the ground surface;

a three-dimensional representation of a previous target location overlaying the representation of the ground surface; and

a representation illustrating continuous movement of a material moving tool as the vehicle executes the set of instructions to move material from the target location.

6. The method of claim 1 , further comprising:

responsive to receiving data recorded by one or more sensors mounted to the vehicle as the vehicle moves material, generating a notification comprising one or more of:

a warning message;

an error message;

a fatal error alert;

an informational message; and

an interactive message, wherein the interactive message displays a prompt for an operator to provide additional information regarding the set of instructions.

7. The method of claim 1 , further comprising:

computing one or more material moving metrics based on the volume of material moved from the target location and an amount of time that the vehicle to has spent moving material from the target location; and

generating graphic elements of the graphical user interface to display the computed material moving metrics using a first subset of graphical representations and a second set of numerical metrics.

8. The method of claim 1 , further comprising:

accessing a set of instructions to be executed by the vehicle, wherein the set of instructions define operations for moving material at the target location; and

generating the representation of the planned movement of the tool by determining a visual representation of the accessed set of instructions.

9. A non-transitory computer readable medium storing instructions for managing a material moving routine in a site encoded thereon that, when executed by a processor, cause the processor to:

generate a graphical user interface displaying a three-dimensional representation of the site comprising a position of a vehicle capable of moving material within the site and a target location within the site for the vehicle to move material and a representation of a planned movement of a tool overlaying the representation of the site, the representation of the planned movement divided into a plurality of segments, wherein each segment of the plurality of segments represents a portion of the planned movement of the tool;

transmit, to a controller of the vehicle, a set of instructions to cause the vehicle to move a volume of material from the target location;

as the vehicle moves material from the target location based on the set of instructions:

receive data recorded by one or more sensors mounted to the vehicle describing a current depth of the target location, a current volume of material moved from the target location, a position of the vehicle relative to the target location, a location of a pile of material, and a height of the pile of material;

modify, based on the data recorded by the one or more sensors, the graphical user interface to display the current depth of the target location, the position of the vehicle relative to the target location, the location of the pile of material, and the height of the pile of material; and

modify the set of instructions based on the received data recorded by the one or more sensors and providing the modified set of instructions to the vehicle.

10. The non-transitory computer readable medium of claim 9 , wherein the processor continuously receives the data recorded by the one or more sensors as the vehicle moves material from the target location and modifies the graphical user interface continuously as the vehicle moves material from the target location.

11. The non-transitory computer readable medium of claim 9 , wherein the graphical user interface displays a side-profile view of the three-dimensional representation of the site, the instructions further causing the processor to:

receive data recorded by one or more sensors mounted to the vehicle describing a current position of the vehicle and material moving tool coupled to the vehicle in the site; and

as the vehicle moves material from the target location, modifying the graphical user interface to display the current position of the vehicle and the material moving tool based on the data describing the current position of the vehicle and material moving tool coupled to the vehicle in the site.

12. The non-transitory computer readable medium of claim 9 , wherein the processor transmits a second set of instructions for the vehicle to move material from a second target location, the instructions further causing the processor to:

receive second data recorded by the one or more sensors indicating that the vehicle has navigated to the second target location;

modify the graphical user interface to display the position of the vehicle at the second target location; and

as the vehicle moves material from the second target location, modify, based on the second data recorded by the one or more sensors, the graphical user interface to display the second target location, a current depth of the second target location, a position of the vehicle relative to the second target location, and an updated height of the of the pile of material, wherein the height of the pile of material is updated based on the volume of material moved from the second target location.

13. The non-transitory computer readable medium of claim 9 , further comprising instructions that cause the graphical user interface to display a representation of a ground surface of the site and one or more of the following features:

a representation of a range of motion of a tool of the vehicle and the vehicle overlaying the representation of the ground surface;

a three-dimensional representation of a previous target location overlaying the representation of the ground surface; and

a representation illustrating continuous movement of a material moving tool as the vehicle executes the set of instructions to move material from the target location.

14. The non-transitory computer readable medium of claim 9 , further comprising instructions that cause the processor to:

responsive to receiving data recorded by one or more sensors mounted to the vehicle as the vehicle moves material, generate a notification comprising one or more of:

a warning message;

an error message;

a fatal error alert;

an informational message; and

an interactive message, wherein the interactive message displays a prompt for an operator to provide additional information regarding the set of instructions.

15. The non-transitory computer readable medium of claim 9 , further comprising instructions that cause the processor to:

compute one or more material moving metrics based on the volume of material moved from the target location and an amount of time that the vehicle to has spent moving material from the target location; and

generate graphic elements of the graphical user interface to display the computed material moving metrics using a first subset of graphical representations and a second set of numerical metrics.

16. A system for managing a material moving routine in a site, the system comprising:

a vehicle capable of moving material within the site positioned within the site and comprising one or more sensors mounted to the vehicle and a controller of the vehicle, wherein the one or more sensors record data describing the site; and

a computing device communicatively coupled to the vehicle, the computing device comprising a processor and a non-transitory computer readable medium storing instructions encoded thereon that, when executed by the processor, cause the processor to:

generate a graphical user interface displaying a three-dimensional representation of the site comprising a position of the vehicle capable of moving material within the site and a target location within the site for the vehicle to move material and a representation of a planned movement of a tool overlaying the representation of the site, the representation of the planned movement divided into a plurality of segments, wherein each segment of the plurality of segments represents a portion of the planned movement of the tool;

transmit, to a controller of the vehicle, a set of instructions to cause the vehicle to move a volume of material from the target location;

as the vehicle moves material from the target location based on the set of instructions:

receive data recorded by one or more sensors mounted to the vehicle describing a current depth of the target location, a current volume of material moved from the target location, a position of the vehicle relative to the target location, a location of a pile of material, and a height of the pile of material;

modify, based on the data recorded by the one or more sensors, the graphical user interface to display the current depth of the target location, the position of the vehicle relative to the target location, the location of the pile of material, and the height of the pile of material; and

modify the set of instructions based on the received data recorded by the one or more sensors and providing the modified set of instructions to the vehicle.

17. The system of claim 16 , wherein the processor continuously receives the data recorded by the one or more sensors as the vehicle moves material from the target location and modifies the graphical user interface continuously as the vehicle moves material from the target location.

18. The system of claim 16 , wherein the graphical user interface displays a side-profile view of the three-dimensional representation of the site, the instructions further causing the processor to:

receive data recorded by one or more sensors mounted to the vehicle describing a current position of the vehicle and material moving tool coupled to the vehicle in the site; and

as the vehicle moves material from the target location, modifying the graphical user interface to display the current position of the vehicle and the material moving tool based on the data describing the current position of the vehicle and material moving tool coupled to the vehicle in the site.

19. The system of claim 16 , wherein the processor transmits a second target tool path with operations for the vehicle to perform to excavate a volume of earth from a second target location, the instructions further causing the processor:

receive second data recorded by the one or more sensors indicating that the vehicle has navigated to the second target location;

modify the graphical user interface to display the position of the vehicle at the second target location; and

as the vehicle moves material from the second target location, modify, based on the second data recorded by the one or more sensors, the graphical user interface to display the second target location, a current depth of the second target location, a position of the vehicle relative to the second target location, and an updated height of the of the pile of material, wherein the height of the pile of material is updated based on the volume of material moved from the second target location.

20. The system of claim 16 , further comprising instructions that cause the graphical user interface to display a representation of a ground surface of the site and one or more of the following features:

a representation of a range of motion of a tool of the vehicle and the vehicle overlaying the representation of the ground surface;

a three-dimensional representation of a previous target location overlaying the representation of the ground surface; and

a representation illustrating continuous movement of a material moving tool as the vehicle executes the set of instructions to move material from the target location.

21. The system of claim 16 , further comprising instructions that cause the processor to:

responsive to receiving data recorded by one or more sensors mounted to the vehicle as the vehicle moves material, generate a notification comprising one or more of:

a warning message;

an error message;

a fatal error alert;

an informational message; and

an interactive message, wherein the interactive message displays a prompt for an operator to provide additional information regarding the set of instructions.

22. The system of claim 16 , further comprising instructions that cause the processor to:

compute one or more material moving metrics based on the volume of material moved from the target location and an amount of time that the vehicle to has spent moving material from the target location; and

generate graphic element on the graphical user interface to display the material moving metrics using a first subset of graphical representations and a second set of numerical metrics.