SYSTEM AND METHOD FOR MODIFYING AN INITIAL POLICY OF AN INPUT/OUTPUT DEVICE
A system and method for modifying an initial policy of an input/output device are provided. The method includes receiving, by an input/output (I/O) device, an input from a user device, wherein the input comprises an initial policy of the I/O device; collecting, by the I/O device, a first set of real-time data related to an environment in proximity of a user interacting with the I/O device; applying a machine learning model on the collected first set of real-time data to determine a current state in proximity to the user; executing a plan based on the determined current state and the initial policy received from the user device, wherein the initial policy facilitates execution of at least one plan by the I/O device; collecting, by the I/O device, a feedback data feature with respect to the executed plan, wherein the feedback data feature relates to how the user responds to the executed plan; applying a machine learning model on the collected feedback data feature to determine if the initial policy should be modified; and modifying the initial policy of the I/O device when it is determined that the initial policy should be modified based the collected feedback data feature.
1 . A computerized method for modifying an initial policy of an input/output device, comprising:
receiving, by an input/output (I/O) device, an input from a user device, wherein the input comprises an initial policy of the I/O device;
collecting, by the I/O device, a first set of real-time data related to an environment in proximity of a user interacting with the I/O device;
applying a first machine learning model on the collected first set of real-time data to determine a current state in proximity to the user;
executing a plan based on the determined current state and the initial policy received from the user device, wherein the initial policy facilitates execution of at least one plan by the I/O device;
collecting, by the I/O device, a feedback data feature with respect to the executed plan, wherein the feedback data feature relates to how the user responds to the executed plan;
applying a second machine learning model on the collected feedback data feature to determine if the initial policy should be modified; and
modifying the initial policy of the I/O device when it is determined that the initial policy should be modified based the collected feedback data feature.
2 . The method of claim 1 , further comprising:
collecting, by the I/O device, a second set of real-time data, using at least a third sensor that is communicatively connected to the I/O device.
3 . The method of claim 2 , further comprising:
determining whether execution of a plan is desirable based on the collected second set of real-time data and the modified initial policy.
4 . The method of claim 3 , further comprising:
executing, by the I/O device, the plan, using the modified initial policy, upon determination that execution of the plan is desirable.
5 . The method of claim 1 , wherein the initial policy includes a set of initial guidelines that facilitates execution of at least one plan by the I/O device.
6 . The method of claim 2 , wherein the second set of real-time data is collected with respect to the user and the at least an environment in the proximity of the user.
7 . The method of claim 2 , wherein the first set of real-time data, the feedback data feature, and the second set of real-time data are collected by different sensors connected to the I/O device.
8 . The method of claim 1 , wherein the I/O device is integrated in a digital assistant, wherein the digital assistant is at least a social robot.
9 . A non-transitory computer readable medium having stored thereon instructions for causing a processing circuitry to execute a process, the process comprising:
receiving, by an input/output (I/O) device, an input from a user device, wherein the input comprises an initial policy of the I/O device;
collecting, by the I/O device, a first set of real-time data related to an environment in proximity of a user interacting with the I/O device;
applying a first machine learning model on the collected first set of real-time data to determine a current state in proximity to the user;
executing a plan based on the determined current state and the initial policy received from the user device, wherein the initial policy facilitates execution of at least one plan by the I/O device;
collecting, by the I/O device, a feedback data feature with respect to the executed plan, wherein the feedback data feature relates to how the user responds to the executed plan;
applying a second machine learning model on the collected feedback data feature to determine if the initial policy should be modified; and
modifying the initial policy of the I/O device when it is determined that the initial policy should be modified based the collected feedback data feature.
10 . A system for modifying an initial policy of an input/output device, comprising:
a processing circuitry; and
a memory, the memory containing instructions that, when executed by the processing circuitry, configure the system to:
receive, by an input/output (I/O) device, an input from a user device, wherein the input comprises an initial policy of the I/O device;
collect, by the I/O device, a first set of real-time data related to an environment in proximity of a user interacting with the I/O device;
apply a first machine learning model on the collected first set of real-time data to determine a current state in proximity to the user;
execute a plan based on the determined current state and the initial policy received from the user device, wherein the initial policy facilitates execution of at least one plan by the I/O device;
collect, by the I/O device, a feedback data feature with respect to the executed plan, wherein the feedback data feature relates to how the user responds to the executed plan;
apply a second machine learning model on the collected feedback data feature to determine if the initial policy should be modified; and
modify the initial policy of the I/O device when it is determined that the initial policy should be modified based the collected feedback data feature.
11 . The system of claim 10 , wherein the system is further configured to:
collect, by the I/O device, a second set of real-time data, using at least a third sensor that is communicatively connected to the I/O device.
12 . The system of claim 11 , wherein the system is further configured to:
determine whether execution of a plan is desirable based on the collected second set of real-time data and the modified initial policy.
13 . The system of claim 12 , wherein the system is further configured to:
execute, by the I/O device, the plan, using the modified initial policy, upon determination that execution of the plan is desirable.
14 . The system of claim 10 , wherein the initial policy includes a set of initial guidelines that facilitates execution of at least one plan by the I/O device.
15 . The system of claim 11 , wherein the second set of real-time data is collected with respect to the user and the at least an environment in the proximity of the user.
16 . The system of claim 11 , wherein the first set of real-time data, the feedback data feature, and the second set of real-time data are collected by different sensors connected to the I/O device.
17 . The system of claim 11 , wherein the I/O device is integrated in a digital assistant, wherein the digital assistant is at least a social robot.