Signal processing device and vehicle display apparatus including the same

1 . A signal processing device comprising:

at least one neural processor; and

a central processor configured to execute an application for driving a vehicle,

wherein the central processor is configured to:

in response to determination of operation failure of the application, execute a second application, corresponding to the application, in a second central processor or a second signal processing device, and

based on a safety level of the application, change a reference fallback guarantee time for the operation failure of the application,

wherein the central processor is configured to execute a hypervisor and a plurality of virtual machines on the hypervisor,

wherein a first virtual machine among the plurality of virtual machines is configured to execute a neural system service for controlling the neural processor, and

wherein in response to a second virtual machine among the plurality of virtual machines executing an application with a higher safety level than a third virtual machine among the plurality of virtual machines, the central processor is configured to control a reference fallback guarantee time of the application executed in the second virtual machine to be greater than a reference fallback guarantee time of the application executed in the third virtual machine.

2 . The signal processing device of claim 1 , wherein the central processor is configured to:

in response to the safety level of the application being a first safety level, set the reference fallback guarantee time to a first time; and

in response to the safety level of the application being a second safety level higher than the first safety level, set the reference fallback guarantee time to a second time longer than the first time.

3 . The signal processing device of claim 2 , wherein in response to the safety level of the application being a third safety level lower than the first safety level, the central processor is configured to set the reference fallback guarantee time to a third time shorter than the first time.

4 . The signal processing device of claim 1 , wherein in response to a calculated fallback guarantee time being greater than or equal to the reference fallback guarantee time, the central processor is configured to perform a predetermined operation.

5 . The signal processing device of claim 1 , wherein in response to a calculated fallback guarantee time being less than the reference fallback guarantee time, the central processor is configured to execute the second application, corresponding to the application, in the second central processor or the second signal processing device.

6 . The signal processing device of claim 1 , wherein in response to a calculated fallback guarantee time being less than the reference fallback guarantee time, the central processor is configured to perform a fallback operation.

7 . The signal processing device of claim 1 , wherein in response to a calculated fallback guarantee time being less than the reference fallback guarantee time, the central processor is configured to perform one of a plurality of fallback operations.

8 . The signal processing device of claim 7 , wherein the plurality of fallback operations comprise driver takeover request, blind brake, Lane Keeping and Blind Braking, Emergency lane change and braking, Pull over on a shoulder, or long distance route planning.

9 . The signal processing device of claim 1 , wherein in a state in which a calculated fallback guarantee time is greater than the reference fallback guarantee time and the calculated fallback guarantee time is reduced, as a difference between a calculated estimated reference fallback guarantee time and the reference fallback guarantee time decreases, the central processor is configured to restrict execution of an application with a higher safety level.

10 . The signal processing device of claim 1 , wherein the central processor is configured to:

in response to a difference between a calculated estimated reference fallback guarantee time and the reference fallback guarantee time being a first time, execute an application corresponding to a first safety level; and

in response to a difference between the calculated estimated reference fallback guarantee time and the reference fallback guarantee time being a second time greater than the first time, execute an application corresponding to a second safety level higher than the first safety level.

11 . The signal processing device of claim 1 , wherein the central processor is configured to change the reference fallback guarantee time based on a driving environment of the vehicle.

12 . The signal processing device of claim 1 , wherein the central processor is configured to calculate a fallback guarantee time based on at least one of temperature of a system, performance based on the safety level, an error history of the system, latency of the application or workload of the system.

13 . The signal processing device of claim 1 , wherein the neural processor is configured to perform neural processing based on at least one of temperature of a system, performance based on the safety level, error history of the system, latency of the application or workload of the system, and to calculate a fallback guarantee time based on the neural processing.

14 . The signal processing device of claim 13 , wherein the neural processor is configured to perform neural processing based on a feedback on power data or temperature data in result data of the neural processing.

15 . The signal processing device of claim 1 , wherein the second virtual machine among the plurality of virtual machines is configured to execute an Advanced Driver Assistance Systems (ADAS) application, and

wherein the third virtual machine among the plurality of virtual machines is configured to execute a driver monitoring system (DMS) application or an augmented reality (AR) application.

16 . A signal processing device comprising a central processor configured to execute an application for driving a vehicle,

wherein the central processor is configured to:

change a reference fallback guarantee time for an operation failure of the application based on a safety level of the application, and

in response to determination of operation failure of the application based on the reference fallback guarantee time and a calculated fallback guarantee time, perform a fallback operation or a fail operation,

wherein the central processor is configured to execute a hypervisor and a plurality of virtual machines on the hypervisor,

wherein a first virtual machine among the plurality of virtual machines is configured to execute a neural system service for controlling a neural processor, and

wherein in response to a second virtual machine among the plurality of virtual machines executing an application with a higher safety level than a third virtual machine among the plurality of virtual machines, the central processor is configured to control a reference fallback guarantee time of the application executed in the second virtual machine to be greater than a reference fallback guarantee time of the application executed in the third virtual machine.

17 . A vehicle display apparatus comprising:

at least one display; and

a signal processing device configured to output an image signal to the at least one display,

wherein the signal processing device comprises:

at least one neural processor; and

a central processor configured to execute an application for driving a vehicle,

wherein the central processor is configured to:

in response to determination of operation failure of the application, execute a second application, corresponding to the application, in a second central processor or a second signal processing device, and

based on a safety level of the application, change a reference fallback guarantee time for the operation failure of the application,

wherein the central processor is configured to execute a hypervisor and a plurality of virtual machines on the hypervisor,

wherein a first virtual machine among the plurality of virtual machines is configured to execute a neural system service for controlling the neural processor, and

wherein in response to a second virtual machine among the plurality of virtual machines executing an application with a higher safety level than a third virtual machine among the plurality of virtual machines, the central processor is configured to control a reference fallback guarantee time of the application executed in the second virtual machine to be greater than a reference fallback guarantee time of the application executed in the third virtual machine.

18 . The vehicle display apparatus of claim 17 , wherein the central processor is configured to:

in response to the safety level of the application being a first safety level, set the reference fallback guarantee time to a first time; and

in response to the safety level of the application being a second safety level higher than the first safety level, set the reference fallback guarantee time to a second time longer than the first time.