IP Library Granted Patent US 9,613,308
Granted Patent B2
US 9,613,308 · App. 14/244,892 · Granted Apr 4, 2017

Spoofing remote control apparatus and methods

Inventors: Eugene M. Izhikevich (San Diego, CA); Patryk Laurent (San Diego, CA); Vadim Polonichko (San Diego, CA)
Assignee: Brain Corporation
G06N3/008G06N3/049G06N99/005Y10S901/01Y10S901/47
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,613,308
App. No.
14/244,892
Granted
Apr 4, 2017
Kind
B2
Abstract

Robotic devices may be operated by users remotely. A learning controller apparatus may detect remote transmissions comprising user control instructions. The learning apparatus may receive sensory input conveying information about robot's state and environment (context). The learning apparatus may monitor one or more wavelength (infrared light, radio channel) and detect transmissions from user remote control device to the robot during its operation by the user. The learning apparatus may be configured to develop associations between the detected user remote control instructions and actions of the robot for given context. When a given sensory context occurs, the learning controller may automatically provide control instructions to the robot that may be associated with the given context. The provision of control instructions to the robot by the learning controller may obviate the need for user remote control of the robot thereby enabling autonomous operation by the robot.

Claims (89)

1. A learning apparatus configured to record and transmit remote control signals, the apparatus comprising:

a transceiver component comprising a receiver and a transmitter;

a sensor component configured to determine information related to a context of an environment of one or more remotely controlled devices; and

one or more physical processor apparatus configured to execute computer program instructions to cause the one or more physical processor apparatus to:

(1) during a first interval:

determine, via the receiver, a control signal provided by a user via a remote controller; and

store an association between the control signal provided by the user and the information related to the context of the environment of at least one of the one or more remotely controlled devices; and

(2) during a second interval subsequent to the first interval:

responsive to a receipt of the information, automatically provide the control signal via the transmitter, the control signal based at least in part on the stored association;

wherein the stored association is determined by logic comprising an adaptable predictor.

2. The apparatus of claim 1 , wherein:

the remote controller comprises a wireless transmitter; and

the remote controller is configured to cause the at least one of the one or more remotely controlled devices to perform a task responsive to the control signal.

3. The apparatus of claim 2 , wherein:

the control signal is configured to cause the at least one of the one or more remotely controlled devices to perform the task; and

the information related to the context of the environment is configured absent the control signal provided by the user.

4. The apparatus of claim 2 , wherein:

the storage of the association is effectuated autonomously by the apparatus absent user input; and

the control signal transmission is configured to cause the at least one of the one or more remotely controlled devices to perform a task autonomously absent a signal transmission from the remote controller.

5. The apparatus of claim 2 , wherein:

the transceiver component is configured to receive and transmit a carrier waveform;

the control signal is determined responsive to receipt of the carrier waveform over a first remote link between the remote controller and the transceiver, the first remote link being configured based on a transceiver identification; and

the control signal transmission to the at least one of the one or more remotely controlled devices comprises transmission of the carrier wave over a second remote link between the transceiver and the at least one of the one or more remotely controlled devices, the second remote link configured based on the transceiver identification and an identification of the at least one of the one or more remotely controlled devices.

6. The apparatus of claim 1 , further comprising:

an enclosure configured to house the receiver, the transmitter, and the one or more physical processor apparatus; and

wherein:

the sensor component is further configured to provide a sensory signal related to an environment surrounding the enclosure; and

at least a portion of the information comprises the sensory signal.

7. The apparatus of claim 1 , wherein:

the sensor component comprises a video camera component configured to provide one or more image frames configured to convey visual information from an environment surrounding the apparatus; and

a sensory signal received from the sensor component comprises the one or more image frames.

8. The apparatus of claim 1 , further comprising an interface communicatively coupled with the one or more physical processor apparatus, the interface being configured to receive a plurality of image frames of an environment surrounding the at least one of the one or more remotely controlled devices;

wherein the information is based on a difference operation applied to two frames of the plurality of frames.

9. The apparatus of claim 1 , wherein:

the remote controller comprises an infrared transmitter controller; and

the transmission comprises an infrared light wave transmission.

10. The apparatus of claim 1 , wherein:

the remote controller comprises a radio frequency transmitter; and

the transmission comprises a radio frequency wave transmission.

11. The apparatus of claim 1 , wherein the adaptable predictor is configured to perform a supervised learning process configured to:

associate a first version of the information with the control signal; and

associate a second version of the information with a second control signal provided by the user via the remote controller;

wherein the apparatus is configured to transmit either the control signal or the second control signal.

12. The apparatus of claim 2 , further comprising an enclosure configured to house the receiver, the transmitter, and the one or more physical processor apparatus;

wherein:

the enclosure is configured to be embodied within the at least one of the one or more remotely controlled devices; and

the enclosure is characterized by a form factor of a cylindrical battery, the battery having a size or type selected from the group consisting of AA, AAA, C, D, and 18500.

13. The apparatus of claim 1 , further comprising an enclosure configured to house the receiver, the transmitter, and the one or more physical processor apparatus;

wherein the enclosure is characterized by a form factor of an incandescent light bulb comprising male screw base.

14. The apparatus of claim 1 , further comprising a user interface component;

wherein:

the storage of the association is performed responsive to an indication provided by the user via the user interface component; and

the association is stored in a look-up table.

15. The apparatus of claim 1 , wherein:

the transceiver component is configured to facilitate receipt and transmission of a carrier waveform;

a signal interface is configured to provide information related to the carrier waveform to the one or more physical processor apparatus; and

the one or more physical processor apparatus are disposed within a portable computing device, the transceiver component being disposed at a location other than the portable computing device, the one or more physical processor apparatus being communicatively coupled with the transceiver component via the signal interface.

16. The apparatus of claim 15 , wherein the portable computing device is selected from the group consisting of a laptop computer, a tablet computer, a smartphone, a personal communications device, and a desktop computer.

17. The apparatus of claim 1 , wherein the provision of the control signal is characterized by a time interval during an absence of another control signal being provided by the user via the remote controller.

18. The apparatus of claim 1 , wherein:

the control signal provision by the user via the remote controller is characterized by a first time interval; and

the control signal transmission is characterized by a second time interval determined based on a time multiplex with the first time interval.

19. A learning apparatus configured to control a remote controlled device, the apparatus comprising:

a transceiver apparatus comprising a receiver and a transmitter;

a sensory interface comprising a sensor component configured to determine information relating to a context of an environment of one or more remotely controlled devices; and

one or more physical processor apparatus communicatively coupled with the transceiver apparatus and the sensory interface, the one or more physical processor apparatus being configured to execute computer program instructions to cause the one or more physical processor apparatus to:

associate a first context signal and a command sent to the device, the command being received by the receiver;

wherein the association is determined by logic comprising an adaptable predictor;

responsive to receipt of a second context signal similar to the first context signal, cause transmission of the command by the transmitter;

wherein the first context signal and the second context signal are determined based on the data provided via the sensory interface; and

wherein the association is stored in a table configured to characterize a relationship between the command sent to the device and the first context signal.

20. The apparatus of claim 19 , wherein the command is provided via a wireless communication from a remote controller.

21. The apparatus of claim 20 , wherein:

the command is configured to cause the device to perform a task;

the provision of the remote transmission occurs automatically and in absence of the wireless communication; and

the performance of the task by the device effectuated based on the command transmission is performed absent of additional wireless communications from the remote controller.

22. The apparatus of claim 21 , wherein:

the data related to the control instruction are determined based on the detection of the wireless transmission;

the wireless transmission is configured based on a carrier wave;

the control instruction comprises one or more pulses of the carrier wave; and

the data related to the control instruction comprise the one or more pulses of the carrier.

23. The apparatus of claim 19 , wherein:

the device comprises a robotic device;

a visual sensor component is configured to communicate the data to the one or more physical processor apparatus via the sensory interface; and

the context comprising information related to one or both of (i) a motion of the robotic device during execution of a task or (ii) a visual scene in an environment surrounding the robotic device.

24. The apparatus of claim 19 , wherein:

the remote controlled device comprises a robotic device;

the robotic device comprises a motion sensor configured to provide information related to one or both of a motion of the robotic device or a motion of objects in an environment surrounding the robotic device; and

the context comprises the motion information.

Assignments (3)
SECURITY INTEREST Recorded Oct 8, 2021
From: BRAIN CORPORATION
To: HERCULES CAPITAL, INC.
Reel/Frame 057851/0574 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 15, 2016
From: POLONICHKO, VADIM
To: BRAIN CORPORATION
Reel/Frame 040638/0383 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2014
From: IZHIKEVICH, EUGENE M.; LAURENT, PATRYK
To: BRAIN CORPORATION
Reel/Frame 033586/0776 →
Continuity (1)
Related Publication 20150283701A1 · Oct 8, 2015