Adaptive graphic user interfacing system
A system and method for an adaptive graphic user interface (AGUI) ( 501 ) that can identify the characteristics of one or more users and display candidates and dynamically select display content and generate an interface ( 502 - 506 . . . ) customized to one or more users and display candidates and dynamically arrange, modify, map and adapt an AGUI display to any object ( 350,730 ), device, clothing, equipment, furniture, appliance, room, building, vehicle, person, or other passive or active display surface, screen, space or other display candidate and embodiments of an AGUI apparatus ( 500 ) that can network, coordinate and/or operate with the AGUI platform ( 1302 ) to identify one or more users and display candidates and enabling one or more users to interface with a single AGUI display across multiple display candidates.
1 . A computing device for incorporation into or on a vehicle, the computing device comprising
at least one sensor for mapping an environment in proximity to the vehicle to identify a relative location between the vehicle and at least one user, and a memory containing an application coupled to a processor, wherein the processor is configured to execute the application to generate a display output to provide a graphical user interface on at least one display candidate associated with the vehicle;
wherein the at least one sensor for mapping an environment in proximity to the vehicle is configured to depth and surface map the at least one display candidate and to map at least one activity of a user;
wherein the application is further configured to generate the graphical user interface customized for the user and the at least one display candidate surface using mapping data obtained from the at least one display candidate and mapping data obtained from the at least one user activity; and
wherein the graphical user interface is further configured to continuously, in real time, dynamically arrange, modify, map and adapt the graphical user interface to the at least one display candidate using the mapping data obtained from the at least one display candidate and the mapping data obtained from the at least one user activity; wherein the mapping data obtained from the at least one user activity includes mapping data obtained from changes in the user's movement, gesture, proximity detected in relation to the at least one display candidate, or any combination thereof; and wherein the application is configured to provide the display output in coordination with the at least one sensor to enable the user to interface with the graphical user interface adapted to the at least one display candidate and wherein the application is further configured to control the graphical user interface in real-time in response to perturbations in the environment.
2 . A computing device of claim 1 , wherein the graphical user interface comprises at least one control affordance, and wherein said at least one control affordance is at least one virtual button, at least one icon, at least one slider, or at least other affordance, or any combination thereof, and wherein the application is configured to dynamically arrange and adapt the control affordance(s) based on the mapping data obtained from the at least one display candidate and the mapping data obtained from the at least one user activity, and to perform corresponding operations of the graphical user interface in real time in response to user interaction with the control affordance(s).
3 . Computing device of claim 2 , wherein the at least one display candidate comprises an exterior surface of the vehicle, the exterior surface of the vehicle being a passive exterior display surface, active exterior display surface, body panel, wrap, coating, projected display region on the exterior of the vehicle, or any combination thereof.
4 . A computing device of claim 3 , wherein the application is configured to continuously analyze the mapping data obtained from the at least one user activity to determine at least one interfacing action, the at least one interfacing action being at least one touch, motion, gesture, voice command, or other interfacing action, and to dynamically adapt the graphical user interface in real time in response to the determined interfacing action(s) and to perturbations in the environment.
5 . A computing device of claim 4 , wherein the application is configured to interpret the determined interfacing actions as executable commands, and to modify, navigate, or operate the graphical user interface in real time in response to the executable commands and changes in the user's movement, touch, gesture, proximity detected in relation to the at least display candidate, or any combination thereof.
6 . A computing device of claim 1 , wherein the at least one display candidate comprises an exterior surface of the vehicle, the exterior surface of the vehicle being a passive exterior display surface, active exterior display surface, body panel, wrap, coating, projected display region on the exterior of the vehicle, or any combination thereof.
7 . A computing device of claim 1 , wherein the at least one sensor is configured to depth-map and surface-map a plurality of display candidates, and wherein the application is configured to dynamically adapt the graphical user interface across the plurality of display candidates in real time.
8 . A computing device of claim 7 , wherein the plurality of display candidates comprises display candidates on two or more vehicles in proximity, and wherein the application is further configured to adapt the graphical user interface across the vehicles based on their relative movement, touch, gesture, proximity detected by the at least one sensor, or any combination thereof.
9 . A computing device of claim 7 , wherein the plurality of display candidates comprises display candidates on at least one object in the environment, and wherein the application is configured to adapt the graphical user interface across the vehicle and the at least one object.
10 . A computing device of claim 9 , wherein the at least one object is a least one stationary object, at least one moving object, or any combination thereof.
11 . A computing device of claim 9 , wherein the at least one object comprises a building, wall, ceiling, window, street surface, sidewalk, store façade, business façade, billboard, kiosk, bus stop, train station, or airport structure, or any combination thereof.
12 . A computing device of claim 1 , wherein the application is configured to dynamically select at least one display candidate from among multiple detected display candidates based on the user's movement, gesture, proximity detected in relation to the display candidates, or any combination thereof.
13 . A computing device of claim 7 , wherein the application is configured to assign one display candidate of the plurality of display candidates as a master display surface and one or more additional display candidates of the plurality of display candidates as sub display surfaces.
14 . A computing device of claim 1 , wherein the application is configured to generate enhanced display content based on characteristics of the at least one display candidate and the user's movement, gesture, proximity detected in relation to the at least one display candidate, or any combination thereof.
15 . A computing device of claim 1 , wherein the application is configured to detect perturbations in the environment and modify the graphical user interface in real time in response to the perturbations.
16 . A computing device of claim 1 , wherein the at least one display candidate is a passive surface and the display output comprises a projector.
17 . A computing device of claim 1 , further comprising wireless communication hardware configured to enable peer to peer or mesh networking with at least one additional vehicle, at least one object, or at least one device, or any combination thereof, to coordinate graphical user interface adaptation across multiple display candidates.
18 . A computing device of claim 1 , wherein the at least one sensor includes a biometric sensor configured to detect biometric characteristics of the user, and the application is configured to customize the graphical user interface based on the detected biometric characteristics.
19 . A computing device of claim 18 , wherein the application is configured to adjust parameters used to determine the user's movement, touch, gesture, or proximity detected, or any combination thereof, in relation to the at least one display candidate based on the detected biometric identity.
20 . A computing device of claim 1 , wherein the application is configured to network with a plurality of networked devices, each networked device having an associated identifier such that the networked devices are distinguishable from one another, and wherein the application is further configured to use the network identifiers to determine the relative movement, proximity, or activity, or any combination thereof, of the network devices in relation to the vehicle and/or the at least one user activity, and wherein the application is further configured to select mapping data based on the determined relative movement, or proximity, activity, or any combination thereof, of the network devices in relation to the vehicle and/or the at least one user activity, and to dynamically adapt the graphical user interface in real time using the selected mapping data.