IP Library › Granted Patent US 12,243,496
Granted Patent B2
US 12,243,496 · App. 18/322,665 · Granted Mar 4, 2025

Glare and occluded view compensation for automotive and other applications

Inventors: Arthur J. Runyan (Folsom, CA); Richmond Hicks (Aloha, OR); Nausheen Ansari (Folsom, CA); Narayan Biswal (Folsom, CA); Ya-Ti Peng (Sunnyvale, CA); Abhishek R. Appu (El Dorado Hills, CA); Wen-Fu Kao (West Sacramento, CA); Sang-Hee Lee (Santa Clara, CA); Joydeep Ray (Folsom, CA); Changliang Wang (Bellevue, WA); Satyanarayana Avadhanam (El Dorado Hills, CA); Scott Janus (Rocklin, CA); Gary Smith (Bristol, GB); Nilesh V. Shah (Folsom, CA); Keith W. Rowe (Shingle Springs, CA); Robert J. Johnston (Carmichael, CA)
Assignee: Intel Corporation
G09G3/3406B60R1/24G02B27/01G06F3/147G09G3/3648G09G5/00G09G5/10G09G5/14G09G5/38B60K35/213B60K35/215B60K35/22B60K35/415B60K35/60B60K35/81B60K2360/21B60K2360/31B60K2360/334B60K2360/34B60K2360/77B60R2300/205B60R2300/207B60R2300/302B60R2300/802G09G2320/0626G09G2340/0464G09G2354/00G09G2360/144G09G2380/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,243,496
App. No.
18/322,665
Granted
Mar 4, 2025
Kind
B2
Abstract

Often when there is a glare on a display screen the user may be able to mitigate the glare by tilting or otherwise moving the screen or changing their viewing position. However, when driving a car there are limited options for overcoming glares on the dashboard, especially when you are driving for a long distance in the same direction. Embodiments are directed to eliminating such glare. Other embodiments are related to mixed reality (MR) and filling in occluded areas.

Claims (33)

1. A display system for a vehicle, comprising:

a display screen to output an electronic display to a driver;

a sensor interface to receive image data of an external environment from at least one camera disposed on the vehicle, the external environment including an area of a blind spot of the driver; and

processing circuitry, operably coupled to the display screen and the sensor interface, configured to:

display a plurality of objects in the electronic display, the plurality of objects corresponding to operation of the vehicle;

display, in the electronic display based upon the image data, an obscured object present in the external environment within the area of the blind spot of the driver; and

move, in response to a move command from the driver, a position of the plurality of objects in the electronic display, relative to a position of the obscured object in the electronic display,

wherein the move command from the driver includes a drag action.

2. The display system of claim 1 , wherein the processing circuitry is further to display at least one virtual gauge or dial corresponding to the vehicle,

wherein the at least one virtual gauge or dial includes a speedometer.

3. The display system of claim 1 , wherein the plurality of objects in the electronic display includes a sound system user interface and a navigation user interface.

4. The display system of claim 1 , wherein the display screen is included in a dashboard of the vehicle.

5. The display system of claim 1 , wherein the blind spot is occluded from view of the driver by a portion of the vehicle.

6. A non-transitory computer-readable storage medium capable of storing instructions that, when executed, cause at least one processing device of a display system for a vehicle to:

receive image data of an external environment from at least one camera disposed on the vehicle, the external environment including an area of a blind spot of a driver;

display a plurality of objects in an electronic display of the vehicle, the plurality of objects corresponding to operation of the vehicle;

display, in the electronic display based upon the image data, an obscured object present in the external environment within the area of the blind spot of the driver; and

move, in response to a move command from the driver, a position of the plurality of objects in the electronic display relative to a position of the obscured object in the electronic display,

wherein the move command from the driver includes a drag action.

7. The non-transitory computer-readable storage medium of claim 6 , the instructions further to cause the at least one processing device to display at least one virtual gauge or dial corresponding to the vehicle,

wherein the at least one virtual gauge or dial includes a speedometer.

8. The non-transitory computer-readable storage medium of claim 6 , wherein the plurality of objects in the electronic display includes a sound system user interface and a navigation user interface.

9. The non-transitory computer-readable storage medium of claim 6 , wherein the electronic display is output to a display screen, the display screen included in a dashboard of the vehicle.

10. The non-transitory computer-readable storage medium of claim 6 , wherein the blind spot is occluded from view of the driver by a portion of the vehicle.

11. An apparatus for a vehicle, comprising:

means for capturing image data of an external environment from at least one camera disposed on the vehicle, the external environment including an area of a blind spot of a driver;

means for (i) displaying a plurality of objects in an electronic display of the vehicle in the electronic display, the plurality of objects corresponding to operation of the vehicle, and (ii) displaying based upon the image data, an obscured object present in the external environment within the area of the blind spot of the driver; and

means for receiving user input to move, in response to a move command from the driver, a position of the plurality of objects in the electronic display relative to a position of the obscured object in the electronic display,

wherein the user input includes a drag action.

12. The apparatus of claim 11 , wherein the electronic display further includes at least one virtual gauge or dial corresponding to the vehicle.

13. The apparatus of claim 11 , wherein the plurality of objects in the electronic display includes a sound system user interface and a navigation user interface.

14. The apparatus of claim 11 , wherein the electronic display is provided by a display means included in a dashboard of the vehicle.

15. The apparatus of claim 11 , wherein the blind spot is occluded from view of the driver by a portion of the vehicle.

Continuity (4)
Continuation 17703645 · Mar 24, 2022
Continuation 16939916 · Jul 27, 2020
Continuation 15488602 · Apr 17, 2017
Related Publication 20230386417A1 · Nov 30, 2023
References Cited (136)
US 8953841B1 · Leblang et al. · 2015 [cited by applicant]
US 9469195B1 · Boss · 2016 [cited by applicant]
US 9654675B2 · Kessler · 2017 [cited by applicant]
US 10311304B2 · Bender et al. · 2019 [cited by applicant]
US 10726792B2 · Runyan et al. · 2020 [cited by applicant]
US 11322099B2 · Runyan et al. · 2022 [cited by applicant]
US 11699404B2 · Runyan et al. · 2023 [cited by applicant]
US 20080238942A1 · Sun et al. · 2008 [cited by applicant]
US 20090003702A1 · Ofek et al. · 2009 [cited by applicant]
US 20090040306A1 · Foote · 2009 [cited by applicant]
US 20090110239A1 · Chen et al. · 2009 [cited by applicant]
US 20100091836A1 · Jia · 2010 [cited by applicant]
US 20100127847A1 · Evans · 2010 [cited by examiner]
US 20100128777A1 · Garg et al. · 2010 [cited by applicant]
US 20100128797A1 · Dey · 2010 [cited by applicant]
US 20100128798A1 · Choudhury · 2010 [cited by applicant]
US 20100201791A1 · Slavenburg et al. · 2010 [cited by applicant]
US 20110085079A1 · Ruggiero · 2011 [cited by applicant]
US 20110248993A1 · Xu · 2011 [cited by applicant]
US 20120050303A1 · McAllister et al. · 2012 [cited by applicant]
US 20120075437A1 · Slavenburg et al. · 2012 [cited by applicant]
US 20120314937A1 · Kim et al. · 2012 [cited by applicant]
US 20130096820A1 · Agnew · 2013 [cited by applicant]
US 20130120524A1 · Zheng · 2013 [cited by applicant]
US 20130121563A1 · Chen et al. · 2013 [cited by applicant]
US 20130275923A1 · Griffin · 2013 [cited by applicant]
US 20130286004A1 · McCulloch et al. · 2013 [cited by applicant]
US 20130293586A1 · Kaino et al. · 2013 [cited by applicant]
US 20140019005A1 · Lee et al. · 2014 [cited by applicant]
US 20140028679A1 · Pajak et al. · 2014 [cited by applicant]
US 20140028703A1 · Pajak et al. · 2014 [cited by applicant]
US 20140049602A1 · Zhu et al. · 2014 [cited by applicant]
US 20140057714A1 · Phadake · 2014 [cited by applicant]
US 20140062975A1 · Panvelwala · 2014 [cited by applicant]
US 20140071245A1 · Zhang et al. · 2014 [cited by applicant]
US 20140079327A1 · Diard · 2014 [cited by applicant]
US 20140080428A1 · Rhoads et al. · 2014 [cited by applicant]
US 20140092113A1 · Petersen et al. · 2014 [cited by applicant]
US 20140109080A1 · Ricci · 2014 [cited by examiner]
US 20140141882A1 · Kim et al. · 2014 [cited by applicant]
US 20140153635A1 · Zhang et al. · 2014 [cited by applicant]
US 20140184813A1 · Cohen et al. · 2014 [cited by applicant]
US 20140184894A1 · Motta · 2014 [cited by applicant]
US 20140185952A1 · Cabral · 2014 [cited by applicant]
US 20140192227A1 · Zhang · 2014 [cited by applicant]
US 20140232630A1 · Plaehn · 2014 [cited by applicant]
US 20140267222A1 · Gupta et al. · 2014 [cited by applicant]
US 20140270551A1 · Baranowski et al. · 2014 [cited by applicant]
US 20140282751A1 · Lee et al. · 2014 [cited by applicant]
US 20140286390A1 · Fear · 2014 [cited by applicant]
US 20140321732A1 · Bhat et al. · 2014 [cited by applicant]
US 20140327771A1 · Malachowsky et al. · 2014 [cited by applicant]
US 20140347439A1 · Jia et al. · 2014 [cited by applicant]
US 20140364212A1 · Osman et al. · 2014 [cited by applicant]
US 20140369613A1 · Avadhanam et al. · 2014 [cited by applicant]
US 20150009306A1 · More · 2015 [cited by applicant]
US 20150022636A1 · Savransky · 2015 [cited by applicant]
US 20150036875A1 · Savransky · 2015 [cited by applicant]
US 20150094142A1 · Stafford · 2015 [cited by applicant]
US 20150103184A1 · Tracey et al. · 2015 [cited by applicant]
US 20150116294A1 · Kumar · 2015 [cited by applicant]
US 20150138065A1 · Alfieri · 2015 [cited by applicant]
US 20150139543A1 · Stewart · 2015 [cited by applicant]
US 20150208079A1 · Pore et al. · 2015 [cited by applicant]
US 20150221064A1 · Thomas et al. · 2015 [cited by applicant]
US 20150229879A1 · Vojkovich · 2015 [cited by applicant]
US 20150243048A1 · Kim · 2015 [cited by applicant]
US 20150245017A1 · Di Censo et al. · 2015 [cited by applicant]
US 20150264299A1 · Leech et al. · 2015 [cited by applicant]
US 20150310789A1 · Heide et al. · 2015 [cited by applicant]
US 20150310798A1 · Heide et al. · 2015 [cited by applicant]
US 20150348509A1 · Verbeure et al. · 2015 [cited by applicant]
US 20160148349A1 · Cho et al. · 2016 [cited by applicant]
US 20160184703A1 · Brav et al. · 2016 [cited by applicant]
US 20170004809A1 · Bieger · 2017 [cited by applicant]
US 20170013188A1 · Kothari · 2017 [cited by applicant]
US 20170374344A1 · Boulton et al. · 2017 [cited by applicant]
US 20180017791A1 · Beckman · 2018 [cited by applicant]
US 20180111451A1 · Martens · 2018 [cited by applicant]
US 20180157035A1 · Fujita · 2018 [cited by applicant]
US 20180222389A1 · Yaldo et al. · 2018 [cited by applicant]
US 20180301095A1 · Runyan et al. · 2018 [cited by applicant]
US 20190248288A1 · Oba · 2019 [cited by examiner]
US 20200189466A1 · Askeland · 2020 [cited by applicant]
US 20210012722A1 · Runyan et al. · 2021 [cited by applicant]
US 20220284867A1 · Runyan et al. · 2022 [cited by applicant]
EP 3392757 · 2018 [cited by applicant]
EP 3971823 · 2022 [cited by applicant]
WO 2016020921A1 · 2016 [cited by applicant]
“U.S. Appl. No. 15/488,602, Response filed Dec. 28, 2018 to Restriction Requirement mailed Oct. 30, 2018”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 15/488,602, Response filed Jul. 8, 2019 to Non Final Office Action mailed Apr. 8, 2019”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 15/488,602, Applicant's Summary of Examiner Interview filed Jul. 11, 2019”, 3 pgs. [cited by applicant]
“U.S. Appl. No. 15/488,602, Response filed Nov. 4, 2019 to Final Office Action mailed Sep. 3, 2019”, 15 pgs. [cited by applicant]
“U.S. Appl. No. 15/488,602, Applicant's Summary of Examiner Interview filed Nov. 26, 2019”, 1 pg. [cited by applicant]
“U.S. Appl. No. 15/488,602, 312 Amendment filed Apr. 8, 2020”, 8 pgs. [cited by applicant]
“European Application Serial No. 18167865.7, Extended European Search Report mailed Nov. 21, 2018”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 16/939,916, Preliminary Amendment filed Oct. 5, 2020”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 16/939,916, Examiner Interview Summary mailed Jan. 15, 2021”, 3 pgs. [cited by applicant]
“U.S. Appl. No. 16/939,916, Response filed Jan. 22, 2021 to Non Final Office Action mailed Oct. 28, 2020”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 16/939,916, Examiner Interview Summary mailed May 14, 2021”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 16/939,916, Response filed May 26, 2021 to Final Office Action mailed Mar. 26, 2021”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 16/939,916, Response filed Oct. 25, 2021 to Non Final Office Action mailed Jul. 23, 2021”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 16/939,916, Examiner Interview Summary mailed Oct. 26, 2021”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/703,645, Preliminary Amendment filed Jun. 7, 2022”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 17/703,645, Non Final Office Action mailed Nov. 2, 2022”, 15 pgs. [cited by applicant]
“U.S. Appl. No. 17/703,645, Examiner Interview Summary mailed Jan. 31, 2023”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/703,645, Response filed Feb. 2, 2023 to Non Final Office Action mailed Nov. 2, 2022”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/703,645, Applicant's Summary of Examiner Interview filed Feb. 15, 2023”, 3 pgs. [cited by applicant]
“U.S. Appl. No. 17/703,645, Notice of Allowance mailed Feb. 22, 2023”, 15 pgs. [cited by applicant]
“European Application Serial No. 21207591.5, Communication Pursuant to Article 94(3) EPC mailed Sep. 28, 2023”, 6 pgs. [cited by applicant]
“European Application Serial No. 21207591.5, Response filed Sep. 14, 2022 to Extended European Search Report mailed Feb. 8, 2022”, 8 pgs. [cited by applicant]
“European Application Serial No. 18167865.7, Response filed Jun. 19, 2019 to Extended European Search Report mailed Nov. 21, 2018”, 7 pgs. [cited by applicant]
“European Application Serial No. 18167865.7, Communication Pursuant to Article 94(3) EPC mailed Apr. 26, 2021”, 5 pgs. [cited by applicant]
“European Application Serial No. 18167865.7, Response filed Nov. 5, 2021 to Communication Pursuant to Article 94(3) EPC mailed Apr. 26, 2021”, 5 pgs. [cited by applicant]
“European Application Serial No. 18167865.7, Summons to Attend Oral Proceedings Pursuant mailed Dec. 8, 2022”, 6 pgs. [cited by applicant]
“European Application Serial No. 18167865.7, Response filed Apr. 17, 2023 to Summons to Attend Oral Proceedings Pursuant mailed Dec. 8, 2022”, 7 pgs. [cited by applicant]
“European Application Serial No. 18167865.7, Decision to Refuse mailed May 22, 2023”, 6 pgs. [cited by applicant]
“European Application Serial No. [Pending], Extended European Search Report mailed Nov. 16, 2023”, 7 pgs. [cited by applicant]
Young, Min Kim, “Acquiring 3D indoor environments with variability and repetition”, ACM Transactions On Graphics vol. 31, No. 6, (Nov. 1, 2012), 12 pgs. [cited by applicant]
Nicholas Wilt, “The CUDA Handbook: A Comprehensive Guide to GPU Programming”, 522 pages, Jun. 2013, Addison-Wesley, USA. [cited by applicant]
Shane Cook, “CUDA Programming: A Developer's Guide to Parallel Computing with GPUs”, 591 pages, 2013, Elsevier, USA. [cited by applicant]
Partial European Search Report for European Patent Application No. 18167865.7, dated Aug. 13, 2018, 14 pages. [cited by applicant]
Restriction Requirement for U.S. Appl. No. 15/488,602, mailed Oct. 30, 2018, 10 pages. [cited by applicant]
Office Action for U.S. Appl. No. 15/488,602, mailed Apr. 8, 2019, 28 pages. [cited by applicant]
Office Action for U.S. Appl. No. 15/488,602, mailed Sep. 3, 2019, 15 pages. [cited by applicant]
Advisory Action for U.S. Appl. No. 15/488,602, mailed Nov. 19, 2019, 3 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 15/488,602, mailed Mar. 5, 2020, 10 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 15/488,602, mailed Apr. 24, 2020, 6 pages. [cited by applicant]
Y. Kim et al., “Acquisition of 3D Indoor 5 Environments with Variability and Repetition,” <hci.stanford.edu/cstr/reports/2012-01.pdf>, 2012, 8 pages. [cited by applicant]
Extended European Search Report for European Patent Application No. 21207591.5, mailed Feb. 8, 2022, 11 pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/939,916, mailed Oct. 28, 2020, 11 pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/939,916, mailed Mar. 26, 2021, 18 pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/939,916, mailed Jun. 9, 2021, 3 pages. [cited by applicant]
Office Action for U.S. Appl. No. 16/939,916, mailed Jul. 23, 2021, 17 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/939,916 mailed Nov. 24, 2021, 9 pages. [cited by applicant]
Corrected Notice of Allowance for U.S. Appl. No. 16/939,916 mailed Apr. 4, 2022, 3 pages. [cited by applicant]