System and method to navigate 3D data on mobile and desktop
Disclosed is a system and method to navigate high-dimensional data in order to enhance the analytical capabilities of a data consumer. The technology disclosed can use a stereoscopic 3D viewer with a smartphone, a pair of 3D glasses with desktop, or a projected 3D image on a table. The solution provides a novel and accessible way of navigating high-dimensional data that has been organized into groups of two or three dimensions. Navigation is possible in all 3 dimensions (x, y, z) to explore the full potential of underlying data and elicit powerful insights to be acted on through informed decisions.
1. A method of supporting navigation through three-dimensional (3D) data presented stereoscopically to a viewer, the method including:
causing stereoscopic display of three-dimensional (3D) data to a viewer;
receiving gesture data from a 3D sensor that is monitoring a 3D sensory space, the gesture data indicating a user performing a point and dive gesture sequence;
wherein the gesture sequence observed in the 3D sensory space includes:
an index finger pointing to a data point on a surface of the 3D data display;
followed by, convergence of right and left hand palms;
further causing updating of the 3D data display, based on recognition of the pointing to the surface, to graphically depict selection of the data point responsive to the pointing, wherein the data point is located at a first location with reference to three axes of the 3D data display;
further causing updating of the 3D data display, based on recognition of the convergence of right and left hand palms, to include a menu comprising a list of actions to be performed on one or more data points, wherein the menu is rendered onto the 3D data display at a second location with reference to the three axes of the 3D data display; and
further causing updating of the 3D data display, based on recognition of a pointing to an item on the menu, to graphically depict a selection among the list of actions.
2. The method of claim 1 , wherein the convergence of right and left hand palms further includes fingers pointing towards the 3D data display below a horizon.
3. The method of claim 1 , wherein the pointing to the item on the menu includes using an index finger.
4. The method of claim 1 , further including:
receiving gesture data from the 3D sensor specifying detection of a dive gesture, wherein the received gesture data includes a signal to drill down into data selected by the pointing; and
causing updating of the 3D data display to graphically depict drilling down into the selected data.
5. The method of claim 4 , further including:
causing updating of the 3D data display to graphically depict a menu in response to the drilling down; and
causing updating of the 3D data display to graphically select a menu item from the menu in response to a pointing gesture performed after the drilling down.
6. A non-transitory computer readable storage medium impressed with computer program instructions to support navigation through three-dimensional (3D) data presented stereoscopically to a viewer, the instructions executable by a processor to:
cause stereoscopic display of 3D data to the viewer;
receive gesture data from a 3D sensor that is monitoring a 3D sensory space, the gesture data indicating a user performing a point and dive gesture sequence;
wherein the gesture sequence observed in the 3D sensory space includes:
an index finger pointing to a data point on a surface of the 3D data display;
followed by, convergence of right and left hand palms;
further cause updating of the 3D data display, based on recognition of the pointing to the surface, to graphically depict selection of the data point responsive to the pointing, wherein the data point is located at a first location with reference to three axes of the 3D data display;
further cause updating of the 3D data display, based on recognition of the convergence of right and left hand palms, to include a menu comprising a list of actions to be performed on one or more data points, wherein the menu is rendered onto the 3D data display at a second location with reference to the three axes of the 3D data display; and
further cause updating of the 3D data display, based on recognition of a pointing to an item on the menu, to graphically depict a selection among the list of actions.
7. The non-transitory computer readable storage medium of claim 6 , wherein the convergence of right and left hand palms further includes fingers pointing towards the 3D data display below a horizon.
8. The non-transitory computer readable storage medium of claim 6 , wherein the pointing to the item on the menu includes using an index finger.
9. The non-transitory computer readable storage medium of claim 6 , wherein the instructions are further executable by a processor to:
receive gesture data from the 3D sensor specifying detection of a dive gesture, wherein the received gesture data includes a signal to drill down into data selected by the pointing; and
cause updating of the 3D data display to graphically depict drilling down into the selected data.
10. The non-transitory computer readable storage medium of claim 6 , wherein the instructions are further executable by a processor to:
cause updating of the 3D data display to graphically depict a menu in response to the drilling down; and
cause updating of the 3D data display to graphically select a menu item from the menu in response to a pointing gesture performed after the drilling down.
11. A system including one or more processors coupled to memory, the memory loaded with computer instructions to support navigation through three-dimensional (3D) data presented stereoscopically to a viewer, the instructions, when executed on the processors, cause the system to:
cause stereoscopic display of 3D data to the viewer;
receive gesture data from a 3D sensor that is monitoring a 3D sensory space, the gesture data indicating a user performing a point and dive gesture sequence;
wherein the gesture sequence observed in the 3D sensory space includes:
an index finger pointing to a data point on a surface of the 3D data display;
followed by, convergence of right and left hand palms;
further cause updating of the 3D data display, based on recognition of the pointing to the surface, to graphically depict selection of the data point responsive to the pointing, wherein the data point is located at a first location with reference to three axes of the 3D data display;
further cause updating of the 3D data display, based on recognition of the convergence of right and left hand palms, to include a menu comprising a list of actions to be performed on one or more data points, wherein the menu is rendered onto the 3D data display at a second location with reference to the three axes of the 3D data display; and
further cause updating of the 3D data display, based on recognition of a pointing to an item on the menu, to graphically depict a selection among the list of actions.
12. The system of claim 11 , wherein the instructions are further executable by the system to:
receive gesture data from the 3D sensor specifying detection of a dive gesture, wherein the received gesture data includes a signal to drill down into data selected by the pointing; and
cause updating of the 3D data display to graphically depict drilling down into the selected data.
13. The system of claim 11 , wherein the convergence of right and left hand palms further includes fingers pointing towards the 3D data display below a horizon.
14. The system of claim 11 , wherein the pointing to the item on the menu includes using an index finger.
15. The system of claim 11 , wherein the instructions are further executable by the system to:
cause updating of the 3D data display to graphically depict a menu in response to the drilling down; and
cause updating of the 3D data display to graphically select a menu item from the menu in response to a pointing gesture performed after the drilling down.