User-assisted robotic control systems
Exemplary embodiments relate to user-assisted robotic control systems, user interfaces for remote control of robotic systems, vision systems in robotic control systems, and modular grippers for use by robotic systems. The systems, methods, apparatuses and computer-readable media instructions described interact with and control robotic systems, in particular pick and place systems using soft robotic actuators to grasp, move and release target objects.
1. A system comprising:
a display configured to show a control interface;
an interface configured to transmit control commands to a pick-and-place station, the pick-and-place station comprising a robotic gripper, a source location, and two or more different target locations; and
a processor; and
a memory storing instructions configured to:
receive, via the control interface on the display, a selection of a target object to be grasped at the source location;
cause the control interface to display a graphical element corresponding to each of the two or more different target locations;
receive, via the control interface of the display, a selection of one of the displayed graphical elements representing a selected target location from among the two or more different target locations; and
cause the interface to transmit a control signal to the pick-and-place station, the control signal configured to cause the robotic gripper to grasp the target object to the source location and move the target object to the selected target location.
2. The system of claim 1 , wherein the graphical element comprises a camera view of a destination bin or receptacle, and receiving the selection of one of the displayed graphical elements comprises receiving the selection at a point corresponding to a location at which the target object is to be placed.
3. The system of claim 1 , wherein the instructions further comprise instructions configured to receive, via the control interface, a location or a pattern that the robotic gripper should employ when delivering grasp targets.
4. The system of claim 3 , wherein the location or pattern is maintained for future grasps.
5. The system of claim 3 , wherein the instructions are further configured to optimize or normalize the received location or pattern.
6. The system of claim 5 , wherein the optimizing or normalizing comprises aligning the received location or pattern to a grid.
7. The system of claim 5 , wherein the optimizing or normalizing comprises equalizing a distance between received points corresponding to the location or pattern.
8. The system of claim 3 , wherein the instructions further comprise instructions for auto-completing the pattern.
9. The system of claim 1 , wherein the instructions further comprise instructions configured to receive, via the control interface a sequence or ordering for placing target objects in designated positions.
10. The system of claim 9 , wherein the sequence or ordering comprises multiple points corresponding to a grid configuration.
11. The system of claim 10 , wherein the instructions are further configured to:
determine when all of the multiple points of the grid configuration have been filled; and
transmit a control instruction to a conveyor associated with the selected target location to cause the conveyor to move a filled destination bin or receptacle and replace the filled destination bin or receptacle with a new bin or receptacle.
12. A computer-implemented method implemented in a robotic system comprising an interface configured to transmit control commands to a pick-and-place station, the pick-and-place station comprising a robotic gripper, a source location, and two or more different target locations, the method comprising:
receiving, via a control interface on a display, a selection of a target object to be grasped at the source location;
causing the control interface to display a graphical element corresponding to each of the two or more different target locations;
receiving, via the control interface of the display, a selection of one of the displayed graphical elements representing a selected target location from among the two or more different target locations; and
causing the interface to transmit a control signal to the pick-and-place station, the control signal configured to cause the robotic gripper to grasp the target object to the source location and move the target object to the selected target location.
13. The method of claim 12 , wherein the graphical element comprises a camera view of a destination bin or receptacle, and receiving the selection of one of the displayed graphical elements comprises receiving the selection at a point corresponding to a location at which the target object is to be placed.
14. The method of claim 12 , further comprising receiving, via the control interface, a location or a pattern that the robotic gripper should employ when delivering grasp targets.
15. The method of claim 14 , wherein the location or pattern is maintained for future grasps in a memory of the robotic system.
16. The method of claim 14 , further comprising optimizing or normalizing the received location or pattern.
17. The method of claim 16 , wherein the optimizing or normalizing comprises aligning the received location or pattern to a grid.
18. The method of claim 16 , wherein the optimizing or normalizing comprises equalizing a distance between received points corresponding to the location or pattern.
19. The method of claim 14 , further comprising auto-completing the pattern using a processor of the robotic system.
20. The method of claim 12 , further comprising receiving, via the control interface a sequence or ordering for placing target objects in designated positions.