IP Library › Granted Patent US 10,134,139
Granted Patent B2
US 10,134,139 · App. 15/458,488 · Granted Nov 20, 2018

Data content integrity in display subsystem for safety critical use cases

Inventors: Rahul Gulati (San Diego, CA); Alex Kwang Ho Jong (San Diego, CA); John Chi Kit Wong (Markham, CA); Sanjay Gupta (North York, CA); Ike Ikizyan (San Diego, CA)
Assignee: QUALCOMM Incorporated
G06T7/11G06T2207/20021G06T2207/20104G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,134,139
App. No.
15/458,488
Granted
Nov 20, 2018
Kind
B2
Abstract

Techniques of this disclosure may include processing one or more regions-of-interest (ROI) of an input image through a model of a display processor, calculating a first data integrity check value on the one or more ROI of the input image after processing through the model, processing the input image by the display processor, calculating a second data integrity check value on the one or more ROI by the display processor after the display processor processes the input image, comparing the first data integrity check value to the second data integrity check value, and generating an interrupt if the comparison indicates that the first data integrity check value and the second data integrity check value do not match.

Claims (85)

1. A method of checking the integrity of an image, the method comprising:

processing one or more regions-of-interest (ROI) of an input image through a software model of a display processor, wherein the software model models the behavior of hardware units of the display processor;

calculating a first data integrity check value on the one or more ROI of the input image after processing through the software model of the display processor;

processing the input image by the display processor;

calculating a second data integrity check value on the one or more ROI by the display processor after the display processor processes the input image;

comparing the first data integrity check value to the second data integrity check value; and

generating an interrupt if the comparison indicates that the first data integrity check value and the second data integrity check value do not match within a predetermined margin of error.

2. The method of claim 1 , wherein processing the input image by the display processor comprises:

processing the input image by a first hardware block of the display processor that does not alter content in the one or more ROI of the input image; and

processing the input image by a second hardware block of the display processor that does alter the content in the one or more ROI of the input image.

3. The method of claim 2 , wherein calculating the second data integrity check value comprises calculating the second data integrity check value after processing the input image by the second hardware block.

4. The method of claim 2 , further comprising:

calculating a third data integrity check value on the one or more ROI of the input image before processing the input image through the software model of the display processor and before processing the input image by the display processor;

calculating a fourth data integrity check value on the one or more ROI of the input image after processing the input image by the first hardware block of the display processor, but before processing the input image by the second hardware block of the display processor;

comparing the third data integrity check value to the fourth data integrity check value; and

generating the interrupt if the comparison indicates that the third data integrity check value and the fourth data integrity check value do not match within a predetermined margin of error.

5. The method of claim 1 , wherein the input image is an image produced by a rearview camera of a vehicle.

6. The method of claim 1 , wherein the input image is an image to be displayed on an instrument cluster of a vehicle.

7. The method of claim 6 , wherein the one or more ROI of the input image are tell-tale icons of the instrument cluster.

8. The method of claim 7 , wherein one of the one or more ROI of the input image comprise a plurality of tell-tale icons of an instrument cluster.

9. The method of claim 1 , further comprising:

generating one or more of an auditory, visual, or haptic warning in response to generating the interrupt.

10. The method of claim 1 , further comprising:

initiating a recovery process in response to generating the interrupt.

11. An apparatus configured to check the integrity of an image, the apparatus comprising:

a processor, a display processor, and a comparison circuit,

wherein the processor is configured to:

process one or more regions-of-interest (ROI) of an input image through a software model of a display processor, wherein the software model models the behavior of hardware units of the display processor; and

calculate a first data integrity check value on the one or more ROI of the input image after processing through the software model of the display processor,

wherein display processor is configured to:

process the input image by the display processor; and

calculate a second data integrity check value on the one or more ROI by the display processor after the display processor processes the input image, and

wherein the comparison circuit is configured to:

compare the first data integrity check value to the second data integrity check value; and

generate an interrupt if the comparison indicates that the first data integrity check value and the second data integrity check value do not match within a predetermined margin of error.

12. The apparatus of claim 11 , wherein the display processor is further configured to:

process the input image by a first hardware block of the display processor that does not alter content in the one or more ROI of the input image; and

process the input image by a second hardware block of the display processor that does alter the content in the one or more ROI of the input image.

13. The apparatus of claim 12 , wherein the display processor is further configured to calculate the second data integrity check value after processing the input image by the second hardware block.

14. The apparatus of claim 12 , wherein the processor is further configured to calculate a third data integrity check value on the one or more ROI of the input image before processing the input image through the software model of the display processor and before processing the input image by the display processor,

wherein the display processor is further configured to calculate a fourth data integrity check value on the one or more ROI of the input image after processing the input image by the first hardware block of the display processor, but before processing the input image by the second hardware block of the display processor, and

wherein the comparison circuit is further configured to compare the third data integrity check value to the fourth data integrity check value, and

generate the interrupt if the comparison indicates that the third data integrity check value and the fourth data integrity check value do not match within a predetermined margin of error.

15. The apparatus of claim 11 , the apparatus further comprising:

a display configured to display the input image after processing by the display processor.

16. The apparatus of claim 15 , the apparatus further comprising:

a rearview camera, wherein the input image is an image produced by a rearview camera of a vehicle.

17. The apparatus of claim 15 , wherein the input image is an image to be displayed on an instrument cluster of a vehicle.

18. The apparatus of claim 17 , wherein the display is configured to display the instrument cluster, and wherein the one or more ROI of the input image are tell-tale icons of the instrument cluster.

19. The method of claim 18 , wherein one of the one or more ROI of the input image comprise a plurality of tell-tale icons of the instrument cluster.

20. The apparatus of claim 11 , wherein the processor is further configured to generate one or more of an auditory, visual, or haptic warning in response to generating the interrupt.

21. The apparatus of claim 11 , wherein the processor is further configured to initiate a recovery process in response to generating the interrupt.

22. The apparatus of claim 11 , wherein the processor, the display processor, and the comparison circuit are part of an advanced driver assistance system (ADAS) of a vehicle.

23. An apparatus configured to check the integrity of an image, the apparatus comprising:

means for processing one or more regions-of-interest (ROI) of an input image through a software model of a display processor, wherein the software model models the behavior of hardware units of the display processor;

means for calculating a first data integrity check value on the one or more ROI of the input image after processing through the software model of the display processor;

means for processing the input image by the display processor;

means for calculating a second data integrity check value on the one or more ROI by the display processor after the display processor processes the input image;

means for comparing the first data integrity check value to the second data integrity check value; and

means for generating an interrupt if the comparison indicates that the first data integrity check value and the second data integrity check value do not match within a predetermined margin of error.

24. The apparatus of claim 23 , wherein the means for processing the input image by the display processor comprises:

means for processing the input image by a first hardware block of the display processor that does not alter content in the one or more ROI of the input image; and

means for processing the input image by a second hardware block of the display processor that does alter the content in the one or more ROI of the input image.

25. The apparatus of claim 24 , wherein the means for calculating the second data integrity check value comprises means for calculating the second data integrity check value after processing the input image by the second hardware block.

26. The apparatus of claim 24 , further comprising:

means for calculating a third data integrity check value on the one or more ROI of the input image before processing the input image through the software model of the display processor and before processing the input image by the display processor;

means for

means for comparing the third data integrity check value to the fourth data integrity check value; and

means for generating the interrupt if the comparison indicates that the third data integrity check value and the fourth data integrity check value do not match within a predetermined margin of error.

27. A non-transitory computer-readable storage medium storing instructions that, when executed, cause one or more processors to:

process one or more regions-of-interest (ROI) of an input image through a software model of a display processor, wherein the software model models the behavior of hardware units of the display processor;

calculate a first data integrity check value on the one or more ROI of the input image after processing through the software model of the display processor;

process the input image by the display processor;

calculate a second data integrity check value on the one or more ROI by the display processor after the display processor processes the input image;

compare the first data integrity check value to the second data integrity check value; and

generate an interrupt if the comparison indicates that the first data integrity check value and the second data integrity check value do not match within a predetermined margin of error.

28. The non-transitory computer-readable storage medium of claim 27 , wherein to process the input image by the display processor, the instructions further cause the one or more processors to:

process the input image by a first hardware block of the display processor that does not alter content in the one or more ROI of the input image; and

process the input image by a second hardware block of the display processor that does alter the content in the one or more ROI of the input image.

29. The non-transitory computer-readable storage medium of claim 28 , wherein the instructions further cause the one or more processors to calculate the second data integrity check value after processing the input image by the second hardware block.

30. The non-transitory computer-readable storage medium of claim 28 , wherein the instructions further cause the one or more processors to:

calculate a third data integrity check value on the one or more ROI of the input image before processing the input image through the software model of the display processor and before processing the input image by the display processor;

calculate a fourth data integrity check value on the one or more ROI of the input image after processing the input image by the first hardware block of the display processor, but before processing the input image by the second hardware block of the display processor;

compare the third data integrity check value to the fourth data integrity check value; and

generate the interrupt if the comparison indicates that the third data integrity check value and the fourth data integrity check value do not match within a predetermined margin of error.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 14, 2017
From: GULATI, RAHUL; JONG, ALEX KWANG HO; WONG, JOHN CHI KIT; GUPTA, SANJAY; IKIZYAN, IKE
To: QUALCOMM INCORPORATED
Reel/Frame 041572/0085 →
Continuity (2)
Provisional Application 62433658 · Dec 13, 2016
Related Publication 20180165814A1 · Jun 14, 2018
Cited By (2)
US 12,319,246 US 12,602,759