System and method for providing scene information toggled between virtual and real-world scene information
Aspects of embodiments pertain to a method for providing scene related information from a scene to a remote station. The method may comprise receiving, at the remote station, a data object in relation to at least one identified attribute of one or more physical objects located in an ROI of the scene acquired by at least one sensor. A priority level value (PLV) is associated with the data object. The method may further include generating, at the remote station, using local station data, a low-latency virtual representation of the scene for displaying, at the remote station, a scene representation comprising the low-latency scene representation and a visualization of the received data object. In addition, real-world scene data descriptive of real world ROI/Target information may be receive. A user may designate an ROI/Target of the data object visualization for displaying real world ROI/Target information relating to the designated ROI/Target.
1 . A system for providing scene related information from a scene including at least one real carrier platform, to a user at a remote station, the system comprising:
at least one sensor configured to acquire scene information for generating real-world data descriptive of at least one real-world object of the scene;
at least one memory configured to store data and program code instructions; and
at least one processor configured to execute program code instructions stored in the memory for enabling performing the following steps:
generating, at the remote station, a synthetic scene representation;
displaying, at the remote station, the synthetic scene representation, wherein the synthetic scene representation comprises one or more synthetic data objects that are descriptive of one or more respective real-world objects;
receiving, at the remote station, a designation of at least one region-of-interest (ROI) of the synthetic scene representation;
performing classification of the one or more synthetic data objects; and
based on the classification, adaptively modifying a display of at least one synthetic data object transitioning from outside the ROI into the ROI, to a live video feed of at least one corresponding real-world object.
2 . The system of claim 1 , further configured to modify the display of the live video feed of the at least one real-world object to display the corresponding at least one synthetic data object if the at least one real-world object moves from within the ROI to outside the ROI.
3 . The system of claim 1 , wherein the steps further comprise selecting at least one portion of the at least one ROI for displaying the selected at least one portion of the at least one ROI at the remote station at higher resolution compared to a non-selected portion.
4 . The system of claim 1 , wherein the steps further comprise:
selecting a portion of the at least one ROI for displaying the selected portion of the at least one ROI at the remote station at zero latency compared to a non-selected portion.
5 . The system of claim 1 , wherein the at least one sensor is accommodated by one more movable platforms.
6 . The system of claim 1 , further comprising identifying an object type located inside the designated ROI.
7 . The system of claim 6 , wherein the object type can be one of a moving and non-moving object type.
8 . The system of claim 6 , wherein the object type can be one of a high-interest and low-interest object type.
9 . A method for providing scene related information from a scene including at least one real carrier platform, to a user at a remote station, the method comprising:
acquiring scene information for generating real-world data descriptive of at least one real-world object of the scene;
generating, at the remote station, a synthetic scene representation;
displaying, at the remote station, the synthetic scene representation, wherein the synthetic scene representation comprises one or more synthetic data objects that are descriptive of one or more respective real-world objects located in the scene;
receiving, at the remote station, by the user, a designation of at least one region-of-interest (ROD) of the synthetic scene representation;
performing classification of the one or more data objects located in the ROI; and
determining, based on the classification, whether to display in the ROI a live video feed of the one or more respective real-world objects; and
adaptively modifying a display of at least one synthetic data object that has transitioned from outside the ROI into the ROI, to a live video feed of at least one corresponding real-world object.
10 . The system of claim 1 , further configured to modify the display of the live video feed of the at least one real-world object to display the corresponding at least one synthetic data object when the at least one real-world object moved from within the ROI to outside the ROI.
11 . The method of claim 9 , further comprising:
selecting at least one portion of the at least one ROI for displaying the selected portion of the at least one ROI at the remote station at higher resolution compared to a non-selected portion.
12 . The method of claim 9 , further comprising:
selecting at least one portion of the at least one ROI for displaying the selected at least one portion of the at least one ROI at the remote station at zero latency compared to a non-selected portion.
13 . The method of claim 9 , wherein the at least one sensor is accommodated by one more movable platforms.
14 . The method of claim 9 , further comprising identifying an object type of the designated ROI.
15 . The method of claim 14 , wherein the object type can be one of a moving and non-moving object type.
16 . A system for providing scene related information from a scene including at least one real carrier platform, to a user at a remote station, the system comprising:
at least one sensor configured to acquire scene information for generating real-world data descriptive of at least one real-world object of the scene;
at least one memory configured to store data and program code instructions; and
at least one processor configured to execute program code instructions stored in the memory for enabling performing the following steps:
acquiring scene information for generating real-world data descriptive of at least one real-world object of the scene;
generating, at the remote station, a synthetic scene representation;
displaying, at the remote station, the synthetic scene representation, wherein the synthetic scene representation comprises one or more synthetic data objects that are descriptive of one or more respective real-world objects located therein;
receiving, at the remote station, a designation of at least one region-of-interest (ROI) of the synthetic scene representation;
performing classification of the one or more synthetic data objects located in the ROI;
associating, based on the classification, a priority level value (PLV) with the one or more synthetic data objects of the ROI; and
if a PLV associated with at least one synthetic data object of the ROI exceeds a low threshold value:
transmitting corresponding real-world data from the sensor to the remote station; and
displaying, in the ROI, a live video feed of the at least one real-world object represented by the at least one synthetic data object.
17 . The system of claim 16 , further configured to modify the display of the live video feed of the at least one real-world object to display the corresponding at least one synthetic data object if the at least one real-world object moves from within the ROI to outside the ROI.