VISUALLY AUTOMATED INTERFACE INTEGRATION
A system and method for visually automated interface integration that includes collecting image data; detecting a device interface source in the image data; processing the image data associated with the device interface source into an extracted interface representation; and exposing at least one access interface to the extracted interface representation.
1 . A method for uncoupled remote device monitoring comprising:
collecting image data;
detecting a device interface source present in the field of view of the image data;
processing the image data associated with the device interface source into an extracted interface representation; and
exposing at least one access interface to the extracted interface representation.
2 . The method of claim 1 , wherein processing the image data comprises applying image data transformations to a region of image data and thereby generating formatted image data of the device interface source.
3 . The method of claim 2 , wherein processing the image data comprises extracting a parameterized representation of the formatted image data and characterizing informational data from the parameterized representation.
4 . The method of claim 3 , wherein characterizing information data from the parameterized representation comprises characterizing at least two sets of information data from the parameterized representation.
5 . The method of claim 3 , wherein extracting a parameterized representation of the formatted image data comprises performing character recognition in at least one region and parameterizing graphical state of a second region of the formatted image data.
6 . The method of claim 3 , further comprising detecting device state and wherein characterizing informational data from the parameterized representation comprises selecting a type of information data for characterization based on detected device state.
7 . The method of claim 6 , wherein detecting device state comprises detecting a displayed mode indicator on the device interface source.
8 . The method of claim 6 , wherein detecting device state further comprises detecting state of physical elements of the device interface source.
9 . The method of claim 6 , wherein detecting device state comprises detecting an active application of the device interface source.
10 . The method of claim 3 , further comprising detecting a user-object in the image data and tracking machine state changes in association with the user-object.
11 . The method of claim 3 , further comprising analyzing patterns of the information data.
12 . The method of claim 3 , collecting image data comprises collecting audio-visual data and wherein processing the image data further comprises detecting audio output of the device interface source and characterizing informational data from the detected audio output.
13 . The method of claim 3 , wherein exposing at least one access interface to the extracted interface representation comprises streaming a rendered interface representation to a remote monitoring system, and further comprising selectively elevating priority of the rendered interface representation according to the informational data.
14 . The method of claim 3 , exposing at least one access interface to the extracted interface representation comprises exposing an application programming interface to a historical data record of the information data.
15 . The method of claim 2 , further comprising streaming the formatted image data to a remote monitoring system, wherein the remote monitoring system is configured to manage a set of media streams of formatted image data.
16 . The method of claim 1 , further comprising:
detecting a second device interface source present in the field of view of the image data;
processing the image data associated with the second device interface source into a second extracted interface representation; and
wherein the second extracted interface representation is exposed through the at least one access interface.
17 . The method of claim 1 , further comprising monitoring the capture status of a device interface source and generating feedback in response to a change of capture status of the device interface source.
18 . The method of claim 17 , further comprising tracking user presence in the field of view of the image data and wherein generating feedback in response to a change of capture status comprises announcing a change in capture status during user exit of the field of view.
19 . A method for uncoupled remote device monitoring comprising:
collecting image data from a plurality of imaging systems;
detecting a set of device interface sources observed in the image data;
processing the image data associated with the device interface source into extracted interface representations, wherein for each instance of a detected device interface processing comprises:
exposing an access interface to the extracted interface representations.
20 . The method of claim 19 , wherein for at least one instance of a detected device interface source processing the image data comprises extracting a parameterized representation of the formatted image data and characterizing informational data from the parameterized representation.
21 . The method of claim 20 , wherein extracting a parameterized representation for at least one instance of a detected device interface comprises performing character recognition; wherein extracting a parameterized representation for at least a second instance of a detected device interface comprises parameterizing graphical state of a visual output of the device interface source.
22 . The method of claim 20 , further comprising detecting a type of each of the set of device interface sources, wherein the processing is selectively applied to an instance of a detected device interface source based on the type of device interface source.
23 . The method of claim 20 , analyzing the extracted interface representations and selectively elevating priority of at least one instance of an interface representation according to an analysis result.