Robotic device
A robotic device comprising internal and external sensors is physically coupled to or hosts a controllable device such as a computer interface device. Based on inferences the robotic device controls a controllable device user interface via at least one actuated link. Multiple robotic devices may be coupled and composed to host and manipulate multiple controlled devices.
1. A robotic device for manipulating a computer control device positioned adjacent a first securable connector, the robotic device comprising:
a first optical sensor,
a second optical sensor;
at least one actuated link;
a second securable connector;
at least one of the first optical sensor or the second optical sensor being arranged to provide a field of view towards the second securable connector and the computer control device;
a user interface; and
one or more processors in communication with a memory, the memory storing programmable instructions configured to cause the one or more processors to:
determine, based on inputs from at least one of the first optical sensor or the second optical sensor, that the first securable connector is fastened to the second securable connector, the second securable connector being positioned to retain the robotic device adjacent the computer control device when the first securable connector is fastened to the second securable connector;
cause the actuated link to physically interact with the computer control device, whereby a first movement of the actuated link causes the computer control device to achieve a first state at a first time, and a second movement of the actuated link causes the computer control device to achieve a second state at a second time; and
present an augmented display on the user interface, the augmented display including an indication of the state of the computer control device.
2. The robotic device of claim 1 , wherein the computer control device is a physical button.
3. The robotic device of claim 1 , wherein the computer control device is a physical switch.
4. The robotic device of claim 1 , wherein the computer control device is a displayed button.
5. The robotic device of claim 1 , wherein the computer control device is a keyboard.
6. The robotic device of claim 1 , wherein the computer control device is a remote control.
7. The robotic device of claim 1 , wherein the computer control device is portion of a remote control.
8. The robotic device of claim 1 , wherein the computer control device is a wireless mouse.
9. The robotic device of claim 1 , wherein the computer control device is a portion of a wireless mouse.
10. The robotic device of claim 1 , wherein the computer control device is a touch screen.
11. The robotic device of claim 1 , wherein the computer control device is a user interface control.
12. The robotic device of claim 1 , wherein the computer control device is a tablet computer.
13. The robotic device of claim 1 , wherein the computer control device is a laptop computer.
14. The robotic device of claim 1 , wherein the computer control device is portion of a keyboard.
15. A robotic device comprising:
an external optical sensor,
an internal optical sensor;
at least one actuated link;
at least one latch or pod;
at least one pocket;
one or more processors in communication with a memory, the memory storing a programmable instructions configured to cause the one or more processors to:
determine based on inputs from the at least one among the internal and external optical sensors that a target device is inserted, at least partially, into the at least one pocket at a first time;
fasten the target device to the robotic device by actuating the at least one latch or pod at a second time, the target device being manipulated, fastened and secured to be significantly encompassed and secured into the pocket of the robotic device;
the internal optical sensor being arranged to have a field of view towards the target device; and
cause the target device to be manipulated via the at least one actuated link;
wherein the manipulation includes causing the actuated link to physically interact with a user interface control on the target device.
16. The robotic device of claim 15 , wherein the target device is a physical switch.
17. The robotic device of claim 16 , wherein the user interface control is a switch lever.
18. The robotic device of claim 15 , wherein the user interface control is a button.
19. The robotic device of claim 15 , wherein the target device is a keyboard.
20. The robotic device of claim 15 , wherein the target device is a remote control.
21. The robotic device of claim 15 , wherein the target device is a wireless mouse.
22. The robotic device of claim 15 , wherein the target device is a touch screen.
23. The robotic device of claim 15 , wherein the user interface control is displayed on the touch screen.
24. The robotic device of claim 15 , wherein the target device is a tablet.
25. The robotic device of claim 24 , wherein the user interface control is displayed on the tablet.
26. The robotic device of claim 15 , wherein the target device is a laptop computer comprising at least one amongst a touch screen and a keyboard.
27. A robotic device for manipulating an electrical control device positioned on a first structure, the robotic device comprising:
a first optical sensor,
a second optical sensor;
at least one actuated link;
a first securable connector;
at least one of the first optical sensor or the second optical sensor being arranged to provide a field of view towards the first structure and the computer control device;
a user interface; and
one or more processors in communication with a memory, the memory storing programmable instructions configured to cause the one or more processors to:
determine, based on inputs from at least one of the first optical sensor or the second optical sensor, that the first securable connector is fastened to the first structure, the first securable connector being positioned to retain the robotic device adjacent the electrical control device when the first securable connector is fastened to the first structure;
cause the actuated link to physically interact with the electrical control device, whereby a first movement of the actuated link causes the electrical control device to achieve a first state at a first time, and a second movement of the actuated link causes the electrical control device to achieve a second state at a second time; and
present an augmented display on the user interface, the augmented display including an indication of the state of the electrical control device.
28. A robotic device for manipulating a computer control device, the robotic device comprising:
a first optical sensor,
a second optical sensor;
at least one actuated link;
a first securable connector;
at least one of the first optical sensor or the second optical sensor being arranged to provide a field of view towards the computer control device;
a user interface; and
one or more processors in communication with a memory, the memory storing programmable instructions configured to cause the one or more processors to:
determine, based on inputs from at least one of the first optical sensor or the second optical sensor, that the first securable connector is fastened to a computer control device enclosure or surface, the first securable connector being positioned to retain the robotic device adjacent the computer control device when the first securable connector is fastened to the computer control device enclosure or surface;
cause the actuated link to physically interact with the computer control device, whereby a first movement of the actuated link causes the computer control device to manipulate a displayed user interface control to achieve a first state at a first time, and a second movement of the actuated link causes the computer control device to manipulate the displayed user interface control to achieve a second state at a second time; and
present an augmented display on the user interface, the augmented display including an indication of the state of the displayed user interface control.