Device and method for controlling user interface
A device for controlling a user interface may include a sensor configured to acquire information associated with a passenger of a vehicle, a user interface device configured to receive at least one user input of the passenger, and a processor. The processor may monitor, based on the information associated with the passenger, the passenger, determine, based on an abnormality associated with an appearance of the passenger, a passenger type for the passenger, and provide, based on the passenger type for passenger and via the user interface device, a user interface associated with the passenger type, wherein the user interface associated with the passenger type is configured to reduce a task completion time for the passenger type.
1 . A device comprising:
a sensor configured to acquire information associated with a passenger of a vehicle, wherein the information comprises an image of the passenger;
a user interface device configured to receive at least one user input of the passenger; and
a processor configured to:
identify, based on the image comprised in the information associated with the passenger, a type of an abnormality associated with an appearance the passenger;
determine, based on the type of the abnormality associated with the appearance of the passenger, a passenger type for the passenger;
provide, based on the passenger type for the passenger and via the user interface device, a user interface associated with the passenger type, wherein the user interface associated with the passenger type is configured to reduce a task completion time for the passenger type;
determine, based on the image of the passenger, an estimated age of the passenger; and
activate, based on the estimated age of the passenger being equal to or higher than a first critical age or being equal to or lower than a second critical age, a voice recognition device associated with the user interface such that the task completion time for controlling the user interface is shortened.
2 . The device of claim 1 , wherein the sensor comprises a camera configured to capture the image of the passenger, and
wherein the processor is further configured to:
perform an artificial intelligence learning process associated with at least one of:
a preset body part; or
a specific object connected to the preset body part; and
determine, based on an output of the artificial intelligence learning process, a degree of freedom of a body part of the passenger.
3 . The device of claim 2 , wherein the processor is further configured to activate, based on the degree of freedom of the body part of the passenger being equal to or lower than a critical degree of freedom, at least one of:
a motion recognition device associated with the user interface device; or
the voice recognition device associated with the user interface device.
4 . The device of claim 2 , wherein the processor is further configured to:
determine, based on the artificial intelligence learning process, the abnormality associated with the appearance of the passenger; and
activate, based on a determination that the passenger has a visual impairment or an arm impairment, the voice recognition device associated with the user interface device.
5 . The device of claim 1 , wherein the processor is further configured to activate, based on a determination that the passenger has a hearing impairment, at least one of:
a touch screen associated with the user interface device; or
a motion recognition device associated with the user interface device.
6 . The device of claim 1 , wherein the processor is further configured to identify personal information of the passenger to determine an abnormality associated with at least one body part of the passenger,
wherein the type of the abnormality is associated with a degree of freedom of a body part of the passenger and associated with a type of the body part, and
wherein the processor is further configured to activate at least one user interface device having a user interface type corresponding to the type of the abnormality.
7 . The device of claim 1 , wherein the processor is further configured to:
determine a behavior pattern of the passenger,
determine, based on characteristics of at least one body part of the passenger, one of a plurality of classes for the passenger, and
display a display image on a display device at a position facing a face of the passenger,
wherein different user interfaces are configured to be activated based on different passenger types respectively associated with different types of abnormality.
8 . The device of claim 1 , wherein the processor is further configured to activate, based on a determination that the passenger is eating or drinking, a speaker, of an output interface, and the voice recognition device.
9 . The device of claim 1 , wherein the processor is further configured to:
activate a display associated with a sitting position of the passenger; and
activate, based on the sitting position of the passenger corresponding to a rear seat of the vehicle, at least one of:
a voice recognition device; or
a motion recognition device.
10 . A method performed by a device of a vehicle, the method comprising:
detecting, via at least one sensor of the vehicle, information associated with a passenger of the vehicle, wherein the information comprises an image of the passenger;
identifying, by a processor of the device and based on the image comprised in the information associated with the passenger, a type of an abnormality associated with an appearance the passenger;
determining, by the processor and based on the type of the abnormality associated with the appearance of the passenger, a passenger type for the passenger;
providing, based on the passenger type for the passenger and via a user interface device, a user interface associated with the passenger type, wherein the user interface associated with the passenger type is configured to reduce a task completion time for the passenger type;
determining, by the processor and based on the image of the passenger, an estimated age of the passenger; and
activating, based on the estimated age of the passenger being equal to or higher than a first critical age or being equal to or lower than a second critical age, a voice recognition device associated with the user interface such that the task completion time for controlling the user interface is shortened.
11 . The method of claim 10 , wherein the detecting the information associated with the passenger comprises:
receiving the image of the passenger captured by a camera, and
wherein the determining the passenger type for the passenger comprises:
performing an artificial intelligence learning process associated with at least one of:
a preset body part; or
a specific object connected to the preset body part; and
determining, based on an output of the artificial intelligence learning process, a degree of freedom of a body part of the passenger.
12 . The method of claim 11 , further comprising:
activating, based on the degree of freedom of the body part of the passenger being equal to or lower than a critical degree of freedom, at least one of:
a motion recognition device associated with the user interface device; or
the voice recognition device associated with the user interface device.
13 . The method of claim 11 , further comprising:
determining, based on the artificial intelligence learning process, the abnormality associated with the appearance of the passenger, and
activating, based on a determination that the passenger has a visual impairment or an arm impairment, the voice recognition device associated with the user interface device.
14 . The method of claim 10 , further comprising:
activating, based on a determination that the passenger has a hearing impairment, at least one of:
a touch screen associated with the user interface device; or
a motion recognition device associated with the user interface device.
15 . The method of claim 13 , wherein the determining the abnormality associated with the appearance of the passenger is further based on personal information of the passenger, and
wherein the abnormality associated with the appearance of the passenger comprises an abnormality associated with at least one body part of the passenger.
16 . The method of claim 10 , further comprising:
displaying a display image on a display device at a position facing a face of the passenger,
wherein the determining the passenger type for the passenger further comprises:
determining a behavior pattern of the passenger.
17 . The method of claim 10 , further comprising:
activating, based on a determination that the passenger is eating or drinking, a speaker, of an output interface, and the voice recognition device.
18 . The method of claim 10 , further comprising:
determining a sitting position of the passenger;
activating a display associated with the sitting position of the passenger; and
activating, based on the sitting position of the passenger corresponding to a rear seat of the vehicle, at least one of:
a voice recognition device; or
a motion recognition device.
19 . The method of claim 10 , wherein the determining of the estimated age of the passenger comprises:
transmitting, as input to an artificial intelligence learning model, a signal indicating the information associated with the passenger, wherein the information comprises a plurality of images of the passenger; and
receiving, as output from the artificial intelligence learning model, output data indicating the estimated age of the passenger, wherein the artificial intelligence learning model is trained by the plurality of images of the passenger.
20 . A device comprising:
a sensor configured to acquire information associated with a passenger of a vehicle;
a user interface device configured to receive at least one user input of the passenger; and
a processor configured to:
monitor, based on the information associated with the passenger, the passenger;
determine, based on a type of an abnormality associated with an appearance of the passenger in a plurality of images captured by the sensor, a passenger type for the passenger;
provide, based on the passenger type for the passenger and via the user interface device, a user interface associated with the passenger type, wherein the user interface associated with the passenger type is configured to reduce a task completion time for the passenger type; and
activate, based on an estimated age of the passenger being equal to or higher than a first critical age or being equal to or lower than a second critical age, a voice recognition device associated with the user interface such that the task completion time for controlling the user interface is shortened.