IP Library Granted Patent US 12,337,761
Granted Patent B2
US 12,337,761 · App. 17/511,161 · Granted Jun 24, 2025

Rearview device simulation

Inventors: Thomas Jochmann (Stuttgart, DE); Andreas Herrmann (Stuttgart, DE); Martin Schwalb (Stuttgart, DE); Firas Mualla (Stuttgart, DE); Maximilian Kauffmann (Stuttgart, DE); Thorsten Steder (Stuttgart, DE)
Assignee: SMR Patents S.à.r.l.
B60R1/26B60R11/04G06T3/047G06V20/56B60R2011/004B60R2300/105B60R2300/207B60R2300/8046
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,337,761
App. No.
17/511,161
Granted
Jun 24, 2025
Kind
B2
Abstract

A method for displaying and processing an image includes capturing the image, calculating one or more of a size, a position, and a field of view of a first region of interest (ROI) of the captured image, calculating one or more of a size, a position, and a field of view of a second ROI of the captured image, calculating a blur factor for blurring the first ROI, manipulating an image gradient of the first ROI pixel by pixel using the blur factor to reduce at least one of a brightness or a contrast of one or more pixels of the ROI, manipulating the second ROI by changing a color of one or more pixel values from the second ROI, and displaying the processed image on a display. An imaging system which includes an image signal processor (ISP) is also described.

Claims (50)

1. A method for displaying and processing an image captured by an optical system used to simulate a rear-view system of a vehicle, the method comprising:

capturing the image;

processing the image to generate a processed image, wherein processing the image comprises

calculating one or more of a size, a position, and a field of view of a first region of interest (ROI) of the captured image,

calculating one or more of a size, a position, and a field of view of a second ROI of the captured image,

calculating a blur factor for blurring the first ROI,

manipulating an image gradient of the first ROI pixel by pixel using the blur factor to reduce at least one of a brightness or a contrast of one or more pixels of the ROI, and

manipulating the second ROI by changing a color of one or more pixel values from the second ROI; and

displaying the processed image on a display.

2. The method for displaying and processing as set forth in claim 1 , wherein the display on which the processed image is displayed is at least one of an internal vehicle dashboard display, an internal vehicle A-pillar display, or an external vehicle display at a side of the vehicle.

3. The method for displaying and processing as set forth in claim 1 , wherein one or more of the size, position, or field of view of at least one of the first ROI or the second ROI is calculated based on one or more preset parameters.

4. The method for displaying and processing as set forth in claim 3 , wherein the one or more preset parameters are based on one or more regulations related to a required field of view, and at least one of the first ROI or the second ROI is calculated as any region outside the required field of view.

5. The method for displaying and processing as set forth in claim 1 , wherein at least one of the first ROI or the second ROI comprises a plurality of regions.

6. The method for displaying and processing as set forth in claim 5 , wherein each region of the plurality of regions of one or more of the first ROI or the second ROI is manipulated using one or more of a different blur factor or a different color.

7. The method for displaying and processing as set forth in claim 1 , wherein one or more of the size, position, or field of view of at least one of the first ROI or the second ROI is calculated based on a user input.

8. The method for displaying and processing as set forth in claim 1 , wherein one or more of the size, position, or field of view of at least one of the first ROI or the second ROI is calculated based on a vehicle input comprising at least one of a vehicle speed, a surrounding environment, a detected weather condition, a detected user or driver, a detected traffic condition, or a location of the display.

9. The method for displaying and processing as set forth in claim 1 , further comprising calculating a vehicle input comprising at least one of a vehicle speed, a surrounding environment, a detected weather condition, a detected user or driver, a detected traffic condition, or a location of the display.

10. The method for displaying and processing as set forth in claim 9 , wherein the calculating of the blur factor comprises calculating the blur factor using the calculated vehicle input.

11. The method for displaying and processing as set forth in claim 10 , wherein the calculated vehicle input is vehicle speed and the blur factor increases in response to an increase in the calculated vehicle speed.

12. The method for displaying and processing as set forth in claim 1 , wherein the manipulating of the image gradient of the first ROI pixel by pixel comprises reducing the brightness and the contrast of each pixel in the first ROI.

13. The method for displaying and processing as set forth in claim 1 , wherein the manipulating of the image gradient of the first ROI pixel by pixel comprises at least one of applying a filter in the first ROI, applying via a tone reproduction curve, or desaturation of color in the first ROI.

14. The method for displaying and processing as set forth in claim 1 , wherein the manipulating of the image gradient of the first ROI pixel by pixel comprises adjusting pixel contrast to achieve a less than 90 degree step function.

15. The method for displaying and processing as set forth in claim 1 , wherein the manipulating of the image gradient of the first ROI pixel by pixel comprises adopting information from a first pixel to a second pixel and adopting information from the second pixel to the first pixel to achieve a blurriness effect.

16. The method for displaying and processing as set forth in claim 1 , wherein one or more of the first ROI or a halo ROI surrounding the first ROI is manipulated using one or more of a different color, brightness, transparency, contrast, or size.

17. The method for displaying and processing as set forth in claim 16 , wherein one or more of the first ROI or the halo ROI surrounding the first ROI is manipulated to blink.

18. An imaging system for a vehicle, the imaging system comprising:

an image sensor disposed on the vehicle and configured to generate image data, the image data comprising a set of pixel values;

an image signal processor (ISP) communicably coupled to the image sensor, the ISP configured to:

calculate one or more of a size, a position, and a field of view of a first region of interest (ROI) of the captured image;

calculate one or more of a size, a position, and a field of view of a second ROI of the captured image;

calculate a blur factor for blurring the first ROI;

manipulate an image gradient of the first ROI pixel by pixel using the blur factor to reduce at least one of a brightness or a contrast of one or more pixels of the ROI; and

manipulate the second ROI by changing a color of one or more pixel values from the second ROI; and

a display device configured to display the output image received from the ISP.

19. The imaging system as set forth in claim 18 , wherein the display on which the processed image is displayed is at least one of an internal vehicle dashboard display, an internal vehicle A-pillar display, or an external vehicle display at a side of the vehicle.

20. The imaging system as set forth in claim 18 , wherein one or more of the size, position, and field of view of at least one of the first ROI or the second ROI is calculated based on one or more preset parameters.

21. The imaging system as set forth in claim 18 , wherein the one or more preset parameters are based on one or more regulations related to a required field of view, and at least one of the first ROI or the second ROI is calculated as any region outside the required field of view.

22. The imaging system as set forth in claim 18 , wherein at least one of the first ROI or the second ROI comprises a plurality of regions.

23. The imaging system as set forth in claim 22 , wherein each region of the plurality of regions of one or more of the first ROI or the second ROI is manipulated using one or more of a different blur factor or a different color.

24. The imaging system as set forth in claim 18 , wherein one or more of the size, position, or field of view of at least one of the first ROI or the second ROI is calculated based on a user input.

25. The imaging system as set forth in claim 18 , wherein one or more of the size, position, or field of view of at least one of the first ROI or the second ROI is calculated based on a vehicle input comprising at least one of a vehicle speed, a surrounding environment, a detected weather condition, a detected user or driver, a detected traffic condition, or a location of the display.

26. The imaging system as set forth in claim 18 , wherein the ISP is further configured to calculate a vehicle input comprising at least one of a vehicle speed, a surrounding environment, a detected weather condition, a detected user or driver, a detected traffic condition, or a location of the display.

27. The imaging system as set forth in claim 26 , wherein the calculating of the blur factor comprises calculating the blur factor using the calculated vehicle input.

28. The imaging system as set forth in claim 27 , wherein the calculated vehicle input is vehicle speed and the blur factor increases in response to an increase in the calculated vehicle speed.

29. The imaging system as set forth in claim 18 , wherein the manipulating of the image gradient of the first ROI pixel by pixel comprises reducing the brightness and the contrast of each pixel in the first ROI.

30. The imaging system as set forth in claim 18 , wherein the manipulating of the image gradient of the first ROI pixel by pixel comprises at least one of applying a filter in the first ROI, applying contrast via a tone reproduction curve, or desaturation of color in the first ROI.

31. The imaging system as set forth in claim 18 , wherein the manipulating of the image gradient of the first ROI pixel by pixel comprises adjusting pixel contrast to achieve a less than 90 degree step function.

32. The imaging system as set forth in claim 18 , wherein the manipulating of the image gradient of the first ROI pixel by pixel comprises adopting information from a first pixel to a second pixel and adopting information from the second pixel to the first pixel to achieve a blurriness effect.

33. The imaging system as set forth in claim 18 , wherein one or more of the first ROI or a halo ROI surrounding the first ROI is manipulated using one or more of a different color, brightness, transparency, contrast, or size.

34. The imaging system as set forth in claim 33 , wherein one or more of the first ROI or the halo ROI surrounding the first ROI is manipulated to blink.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 28, 2025
From: KAUFFMANN, MAXIMILIAN; STEDER, THORSTEN; JOCHMANN, THOMAS; HERRMANN, ANDREAS; SCHWALB, MARTIN; MUALLA, FIRAS
To: SMR PATENTS S.À.R.L.
Reel/Frame 071237/0719 →
Priority Claims (1)
EP 10160325 · Apr 19, 2010 · regional
Continuity (9)
Continuation In Part 16440433 · Jun 13, 2019
Continuation In Part 16388321 · Apr 18, 2019
Continuation In Part 15712486 · Sep 22, 2017
Continuation In Part 15691332 · Aug 30, 2017
Continuation In Part 15602068 · May 22, 2017
Continuation 15287554 · Oct 6, 2016
Continuation 14968132 · Dec 14, 2015
Continuation 13090127 · Apr 19, 2011
Related Publication 20220041105A1 · Feb 10, 2022
References Cited (18)
US 11256931B2 · Herrmann · 2022 [cited by examiner]
US 20060125919A1 · Camilleri · 2006 [cited by examiner]
US 20120262600A1 · Velarde et al. · 2012 [cited by applicant]
US 20150062141A1 · Hayasaka · 2015 [cited by examiner]
US 20170046578A1 · Phillips · 2017 [cited by applicant]
US 20180040103A1 · Esparza Garcia et al. · 2018 [cited by applicant]
CN 202382141U · 2012 [cited by applicant]
DE 102007058779A1 · 2009 [cited by applicant]
DE 102011014113A1 · 2012 [cited by applicant]
DE 112016002268T5 · 2018 [cited by applicant]
EP 2843937A1 · 2015 [cited by applicant]
EP 2919188A1 · 2015 [cited by applicant]
EP 3281178A1 · 2018 [cited by applicant]
JP 2016134314A · 2016 [cited by applicant]
WO WO2018009897A1 · 2018 [cited by applicant]
Extended European Search Report dated Jul. 9, 2020 of EP application No. 20168712.6-1210. [cited by applicant]
Extended European Search Report dated Oct. 15, 2020 of European application No. 20179835.2. [cited by applicant]
German Office Action dated May 16, 2019 of German application DE 10 2018 113 370.7. [cited by applicant]
Cited By (1)
US 12,377,792