Content transfer among remote-control units and integrated output devices
A method performed by a remote-control unit (RCU) of managing a content transfer to or from integrated output devices (IODs) in a physical room is disclosed. The content transfer involves moving application context of a computer application with which a user can interact, which includes a computer object being operated on and relevant metadata. The RCU is programmed to recognize simple user instructions for the content transfer and perform the content transfer from a source device to a target device in real time, regardless of data transfer protocols specific to computer applications. Specifically, the RCU is programmed to obtain source data from the source device, generate updated source data by combining the source data with one or more commands specifying how the source data is to be handled based on a session mode indicating a type of activity being performed in the physical room, and transmit the updated source data to the target device for further user interaction.
1. A computer-implemented method of controlling and effecting a content transfer in a physical room by a remote-control unit (RCU), comprising:
identifying a source device being an integrated output device (IOD) in the physical room in response to a first user input;
obtaining, in response to the identifying, source data from the source device, the source data including a first computer object being a copy of an active computer object operated on by an active computer application on the source device, structure information indicating a structure of the active computer object, and state information indicating which part of the structure is last accessed by a user via a user interface associated with the active computer application;
identifying a target device in the physical room in response to a second user input;
determining that no copy of the active computer application is installed or running on the target device based on device data indicating one or more computer applications that are installed or running on the target device;
creating a command for handling the source data on the target device based on a session mode of a plurality of session modes and the determining,
each session mode indicating a type of group activity being performed by users in the physical room and leading to a unique command,
the command indicating installing or running a copy of the active computer application on the target device;
transmitting updated source data including the command and the first computer object to the target device;
receiving updated device data periodically from each IOD of a plurality of IODs in the physical room;
receiving a notification of a failure from the target device;
selecting a second IOD of the plurality of IODs different from the target device based on the updated device data from the second IOD;
transmitting the updated source data to the second IOD,
wherein the method is performed by one or more processors of the RCU in real time.
2. The computer-implemented method of claim 1 ,
the first user input including engaging a user interface element of the RCU when the RCU is in a first physical state,
the second user input including releasing the user interface element when the RCU is in a second first physical state different from the first physical state.
3. The computer-implemented method of claim 1 ,
the session mode being question and answer (Q&A), collaboration, or clarification,
Q&A involving a user of the RCU answering questions from individuals in the physical room,
collaboration involving the user waiting for the individuals working in groups in the physical room,
clarification involving the user discussing work by an individual in the physical room.
4. The computer-implemented method of claim 3 , further comprising
determining the session mode based on a current position of a user of the RCU,
Q&A corresponding to the user being in a front and center of the physical room,
collaboration corresponding to the user being in a front and side of the physical room,
clarification corresponding to the user being in an area other than the front of the physical room.
5. The computer-implemented method of claim 3 ,
the command being for supplementing a computer object in the source data or incorporating the computer object into an existing computer object on the target device when the session mode is Q&A or collaboration,
the command being for magnifying a computer object in the source data when the session mode is clarification.
6. The computer-implemented method of claim 1 , further comprising obtaining, when the source device is an IOD, backup source data including a third computer object being a capture of an output of the IOD.
7. The computer-implemented method of claim 1 , further comprising:
causing a presentation of the first computer object via a specific user interface;
receiving a user instruction to filter or supplement the first computer object,
the creating comprising generating the command further based on the user instruction.
8. The computer-implemented method of claim 1 , further comprising:
identifying a second source device not being an IOD in the physical room in response to a third user input;
generating as second source data a second computer object to be handled by a computer application of a set of default computer applications;
identifying a second target device in the physical room in response to a fourth user input;
creating a second command for handling the second source data on the second target device based on the session mode and the device data;
transmitting second updated source data including the second command and the second computer object to the second target device.
9. The computer-implemented method of claim 8 ,
the third user input including selecting a first user interface element of the RCU,
identifying the second source device comprising interpreting a subsequent user input or a capture of surroundings or calculating a position and orientation of the RCU,
the fourth user input including selecting a second user interface element of the RCU different from the first user interface element after selecting the first user interface element.
10. The computer-implemented method of claim 9 , the generating comprising taking the capture of surroundings or a portion thereof as the second computer object.
11. The computer-implemented method of claim 9 ,
the generating further comprising identifying a certain item of a list of items respectively associated with a list of computer applications from the capture,
the command being for running a certain computer application associated with the certain item.
12. One or more non-transitory storage media storing instructions which, when executed by one or more computing devices, cause performance of a method of controlling and effecting a content transfer in a physical room by a remote-control unit (RCU), the method comprising:
identifying a source device being an integrated output device (IOD) in the physical room in response to a first user input;
obtaining, in response to the identifying, source data from the source device, the source data including a first computer object being a copy of an active computer object operated on by an active computer application on the source device, structure information indicating a structure of the active computer object, and state information indicating which part of the structure is last accessed by a user via a user interface associated with the active computer application;
identifying a target device in the physical room in response to a second user input;
determining that no copy of the active computer application is installed or running on the target device based on device data indicating one or more computer applications that are installed or running on the target device;
creating a command for handling the source data on the target device based on a session mode of a plurality of session modes and the determining,
each session mode indicating a type of group activity being performed by users in the physical room and leading to a unique command,
the command indicating installing or running a copy of the active computer application on the target device;
transmitting updated source data including the command and the first computer object to the target device;
receiving updated device data periodically from each IOD of a plurality of IODs in the physical room;
receiving a notification of a failure from the target device;
selecting a second IOD of the plurality of IODs different from the target device based on the updated device data from the second IOD;
transmitting the updated source data to the second IOD,
wherein the method is performed by one or more processors of the RCU in real time.
13. The one or more non-transitory storage media of claim 12 ,
the first user input including engaging a user interface element of the RCU when the RCU is in a first physical state,
the second user input including releasing the user interface element when the RCU is in a second first physical state different from the first physical state.
14. The one or more non-transitory storage media of claim 12 ,
the session mode being Q&A, collaboration, or clarification,
Q&A involving a user of the RCU answering questions from individuals in the physical room,
collaboration involving the user waiting for the individuals working in groups in the physical room,
clarification involving the user discussing work by an individual in the physical room.
15. The one or more non-transitory storage media of claim 14 , the method further comprising
determining the session mode based on a current position of a user of the RCU,
Q&A corresponding to the user being in a front and center of the physical room,
collaboration corresponding to the user being in a front and side of the physical room,
clarification corresponding to the user being in an area other than the front of the physical room.
16. The one or more non-transitory storage media of claim 14 ,
the command being for supplementing a computer object in the source data or incorporating the computer object into an existing computer object on the target device when the session mode is Q&A or collaboration,
the command being for magnifying a computer object in the source data when the session mode is clarification.
17. The one or more non-transitory storage media of claim 12 , the method further comprising:
identifying a second source device not being an IOD in the physical room in response to a third user input;
generating as second source data a second computer object to be handled by a computer application of a set of default computer applications;
identifying a second target device in the physical room in response to a fourth user input;
creating a second command for handling the second source data on the second target device based on the session mode and the device data;
transmitting second updated source data including the second command and the second computer object to the second target device.
18. The one or more non-transitory storage media of 22 ,
the third user input including selecting a first user interface element of the RCU,
identifying the second source device comprising interpreting a subsequent user input or a capture of surroundings or calculating a position and orientation of the RCU,
the fourth user input including selecting a second user interface element of the RCU different from the first user interface element after selecting the first user interface element.
19. The one or more non-transitory storage media of claim 18 , the generating comprising taking the capture of surroundings or a portion thereof as the second computer object.
20. A remote-control unit for controlling and effecting a content transfer in a physical room, comprising:
a memory;
one or more processors coupled to the memory and configured to perform:
identifying a source device being an integrated output device (IOD) in the physical room in response to a first user input;
obtaining, in response to the identifying, source data from the source device, the source data including a first computer object being a copy of an active computer object operated on by an active computer application on the source device, structure information indicating a structure of the active computer object, and state information indicating which part of the structure is last accessed by a user via a user interface associated with the active computer application;
identifying a target device in the physical room in response to a second user input;
determining that no copy of the active computer application is installed or running on the target device based on device data indicating one or more computer applications that are installed or running on the target device;
creating a command for handling the source data on the target device based on a session mode of a plurality of session modes and the determining,
each session mode indicating a type of group activity being performed by users in the physical room and leading to a unique command,
the command indicating installing or running a copy of the active computer application on the target device;
transmitting updated source data including the command and the first computer object to the target device;
receiving updated device data periodically from each IOD of a plurality of IODs in the physical room;
receiving a notification of a failure from the target device;
selecting a second IOD of the plurality of IODs different from the target device based on the updated device data from the second IOD;
transmitting the updated source data to the second IOD,
wherein one or more of the steps are performed by the one or more processors in real time.