IP Library Granted Patent US 12,498,239
Granted Patent B2
US 12,498,239 · App. 17/807,216 · Granted Dec 16, 2025

System for extended reality augmentation of situational navigation

Inventors: Qiong Wu (Bridgewater, NJ); Aritra Guha (Edison, NJ); Eric Zavesky (Austin, TX); Wen-Ling Hsu (Bridgewater, NJ); Zhengyi Zhou (Chappaqua, NY); Louis Alexander (Franklin, NJ); Jean-Francois Paiement (Palm Desert, CA)
Assignee: AT&T Intellectual Property I, L.P.
G01C21/3635B60W60/0051G01C21/365G06T19/006G08G1/0969
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,498,239
App. No.
17/807,216
Granted
Dec 16, 2025
Kind
B2
Abstract

Extended reality augmentation of situational navigation (e.g., using a computerized tool) is enabled. For example, a system can comprise: a processor and a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, comprising: based on a route of a vehicle, determining a navigational instruction to be displayed via an augmented reality interface of the vehicle, and displaying the navigational instruction via the augmented reality interface, wherein displaying the navigational instruction comprises displaying a virtual leading vehicle to be followed by the vehicle.

Claims (61)

1 . A system, comprising:

a processing system including a processor; and

a memory that stores executable instructions that, when executed by the processing system, facilitate performance of operations, comprising:

based on a defined route of a vehicle according to a current position and a destination, determining a navigational instruction associated with the defined route of the vehicle to be displayed via an augmented reality interface of the vehicle;

displaying a presentation of the navigational instruction via the augmented reality interface, wherein displaying the presentation of the navigational instruction comprises displaying a virtual leading object to be followed by the vehicle according to the defined route of the vehicle;

obtaining an output of a sensor of the vehicle, wherein the sensor comprises a spatial distribution of reflected light sensor;

determining a glare on a surface of the vehicle based on the output of the spatial distribution of reflected light sensor; and

in response to the determining the glare on the surface of the vehicle:

modifying the presentation of the navigational instruction; and

executing automated navigation of the vehicle.

2 . The system of claim 1 , wherein the sensor of the vehicle further comprises a biometric sensor, and wherein the obtaining an output of a sensor of the vehicle further comprises obtaining a biometric output from the biometric sensor, the operations further comprising:

determining from the biometric output, a condition of an occupant of the vehicle; and

determining a representation of the virtual leading object based on the condition of the occupant of the vehicle, wherein the displaying the presentation of the virtual leading object further comprises displaying the representation of a virtual leading vehicle.

3 . The system of claim 1 , wherein the operations further comprise:

obtaining a preference associated with a user profile registered with the vehicle; and

determining a representation of the virtual leading object based on the preference, wherein the displaying the presentation of the virtual leading object comprises displaying the representation of the virtual leading object.

4 . The system of claim 1 , wherein the operations further comprise:

based on an output of a sensor of the vehicle, determining a potential collision, and wherein the navigational instruction is further based on the potential collision.

5 . The system of claim 1 , wherein the modifying the presentation of the navigational instruction further comprises switching to an audio-based navigational instruction.

6 . The system of claim 1 , wherein the operations further comprise:

determining a weather condition along the defined route of the vehicle based on the output of the sensor of the vehicle; and

determining a modified navigational instruction based on the weather condition.

7 . The system of claim 1 , wherein the virtual leading object comprises a virtual leading vehicle, wherein the defined route of the vehicle comprises a road, and wherein the operations further comprise:

generating a virtual representation of the virtual leading vehicle on a virtual representation of the road, and wherein displaying the navigational instruction comprises displaying the virtual representation of the vehicle following the virtual leading vehicle on the road.

8 . The system of claim 1 , wherein the operations further comprise:

determining, based on a defined danger criterion, a danger level associated with the navigational instruction, and wherein a color of the virtual leading object is determined based on the danger level.

9 . The system of claim 1 , wherein the operations further comprise:

determining, based on a user profile of a user of the vehicle, a driver skill level, wherein the user profile has been generated using a user profile model, and wherein the user profile model has been generated using machine learning based on past driving activities of one or more users of the vehicle.

10 . A non-transitory machine-readable medium, comprising executable instructions that, when executed by a processor, facilitate performance of operations, wherein the operations comprise:

based on a defined course of a vehicle according to a current position and a destination, wherein the vehicle is configured for transportation on a road, determining a navigational direction associated with the defined course to be presented via an extended reality interface of the vehicle;

presenting the navigational direction via the extended reality interface, wherein presenting the navigational direction comprises presenting a virtual leading object to be followed by the vehicle;

obtaining an output of a sensor of the vehicle, wherein the sensor comprises a spatial distribution of reflected light sensor;

determining a glare on a surface of the vehicle based on the output of the spatial distribution of reflected light sensor of the vehicle; and

in response to the determining the glare on the surface of the vehicle:

modifying the presentation of the navigational direction; and

executing automated navigation of the vehicle.

11 . The non-transitory machine-readable medium of claim 10 , wherein the operations further comprise:

based on a road on which the vehicle travels or is instructed to travel and based on an attribute of the vehicle according to operation of the vehicle on the road, determining a limitation of the vehicle according to operation of the vehicle on the road, and wherein the navigational direction is further based on the limitation of the vehicle.

12 . The non-transitory machine-readable medium of claim 11 , wherein the attribute comprises a weight of the vehicle or a size of the vehicle.

13 . The non-transitory machine-readable medium of claim 10 , wherein the operations further comprise:

determining a weather condition along the defined course of the vehicle based on the output of the sensor of the vehicle; and

determining a modified navigational instruction based on the weather condition.

14 . A method, comprising:

based on a defined route of a vehicle according to a current position and a destination, determining, by a processing system comprising a processor, a navigational instruction associated with the defined route of the vehicle to be displayed via an augmented reality interface of the vehicle; and

displaying, by the processing system via a display interface of the vehicle, the navigational instruction, wherein displaying the navigational instruction comprises displaying a virtual leading object to be followed by the vehicle;

obtaining, by the processing system, an output of a sensor of the vehicle, wherein the sensor comprises a spatial distribution of reflected light sensor;

determining, by the processing system, a glare on a surface of the vehicle based on the output of the spatial distribution of reflected light sensor of the vehicle; and

in response to the determining the glare on the surface of the vehicle:

modifying the displaying of the navigational instruction; and

executing, by the processing system, automated navigation of the vehicle.

15 . The method of claim 14 , wherein the display interface comprises a first display interface associated with a driver of the vehicle, the method further comprising:

displaying, by the processing system via a second display interface associated with a passenger of the vehicle, a visualization associated with the defined route of the vehicle.

16 . The method of claim 15 , further comprising:

receiving, by the processing system, request data representative of a request of the passenger of the vehicle, wherein the visualization is further based on the request of the passenger of the vehicle.

17 . The method of claim 15 , wherein the visualization is further based on a destination of the vehicle.

18 . The method of claim 15 , wherein the first display interface comprises a first augmented reality display interface, and wherein the second display interface comprises a second augmented reality display interface.

19 . The method of claim 14 , further comprising:

determining, by the processing system, a weather condition along the defined route of the vehicle based on the output of the sensor of the vehicle; and

determining, by the processing system, a modified navigational instruction based on the weather condition.

20 . The method of claim 14 , further comprising:

based on a road on which the vehicle travels or is instructed to travel and based on an attribute of the vehicle according to operation of the vehicle on the road, determining, by the processing system, a limitation of the vehicle according to operation of the vehicle on the road, and wherein the navigational instruction is further based on the limitation of the vehicle.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2022
From: WU, QIONG; GUHA, ARITRA; ZAVESKY, ERIC; HSU, WEN-LING; ZHOU, ZHENGYI; ALEXANDER, LOUIS; PAIEMENT, JEAN-FRANCOIS
To: AT&T INTELLECTUAL PROPERTY I, L.P.
Reel/Frame 060226/0444 →
Continuity (1)
Related Publication 20230408283A1 · Dec 21, 2023
References Cited (74)
US 7216035B2 · Hortner · 2007 [cited by examiner]
US 10618523B1 · Fields · 2020 [cited by examiner]
US 10967871B1 · Marti · 2021 [cited by examiner]
US 11254270B1 · Li · 2022 [cited by examiner]
US 20020055808A1 · Matsumoto · 2002 [cited by examiner]
US 20050071082A1 · Ohmura · 2005 [cited by examiner]
US 20060085125A1 · Shibata · 2006 [cited by examiner]
US 20060100774A1 · Barkowski · 2006 [cited by examiner]
US 20070067089A1 · Yoshida · 2007 [cited by examiner]
US 20100157430A1 · Hotta · 2010 [cited by examiner]
US 20100253541A1 · Seder · 2010 [cited by examiner]
US 20100292886A1 · Szczerba · 2010 [cited by examiner]
US 20130289875A1 · Kumon · 2013 [cited by examiner]
US 20140159886A1 · Hasegawa · 2014 [cited by examiner]
US 20140268353A1 · Fujimura · 2014 [cited by examiner]
US 20150149021A1 · Duncan · 2015 [cited by examiner]
US 20150226568A1 · Ann · 2015 [cited by examiner]
US 20150291160A1 · Kim · 2015 [cited by examiner]
US 20160124225A1 · Kwak · 2016 [cited by examiner]
US 20170106876A1 · Gordon · 2017 [cited by examiner]
US 20180053415A1 · Krunic · 2018 [cited by examiner]
US 20180058879A1 · Tayama · 2018 [cited by examiner]
US 20180105040A1 · Ryu · 2018 [cited by examiner]
US 20180196427A1 · Majumdar · 2018 [cited by examiner]
US 20180197039A1 · Guerreiro · 2018 [cited by examiner]
US 20180322715A1 · Toyoda · 2018 [cited by examiner]
US 20190009792A1 · Soderlind · 2019 [cited by examiner]
US 20190066382A1 · Kubo · 2019 [cited by examiner]
US 20190071075A1 · Mimura · 2019 [cited by examiner]
US 20190101405A1 · Feng · 2019 [cited by examiner]
US 20190146486A1 · Doster · 2019 [cited by examiner]
US 20190179305A1 · Magzimof · 2019 [cited by examiner]
US 20190299855A1 · Ostapenko · 2019 [cited by examiner]
US 20200031283A1 · Nakasho · 2020 [cited by examiner]
US 20200171951A1 · Matsumoto · 2020 [cited by examiner]
US 20200207272A1 · Matsuo · 2020 [cited by examiner]
US 20200215917A1 · Schöning · 2020 [cited by examiner]
US 20200371351A1 · Chang · 2020 [cited by examiner]
US 20210009117A1 · Emura · 2021 [cited by examiner]
US 20210174767A1 · Edgren · 2021 [cited by examiner]
US 20210300428A1 · Stent · 2021 [cited by examiner]
US 20220114988A1 · Prakah-Asante · 2022 [cited by examiner]
US 20220144296A1 · Seitz · 2022 [cited by examiner]
US 20220348195A1 · Mangal · 2022 [cited by examiner]
US 20230173919A1 · Kim · 2023 [cited by examiner]
US 20230186593A1 · Tryndin · 2023 [cited by examiner]
US 20230204373A1 · Lee · 2023 [cited by examiner]
US 20230286524A1 · Lu · 2023 [cited by examiner]
US 20230373504A1 · Diamond · 2023 [cited by examiner]
DE 102009046908A1 · 2011 [cited by examiner]
DE 102012103293A1 · 2013 [cited by examiner]
DE 102014208392A1 · 2015 [cited by examiner]
DE 102018214938A1 · 2020 [cited by examiner]
DE 102019129105A1 · 2021 [cited by examiner]
DE 102020102700A1 · 2021 [cited by examiner]
EP 3306523A1 · 2018 [cited by examiner]
JP 2005106663A · 2005 [cited by examiner]
JP 2005107917A · 2005 [cited by examiner]
JP 2006284195A · 2006 [cited by examiner]
JP 2019045190A · 2019 [cited by examiner]
JP 2019120652A · 2019 [cited by examiner]
JP 2020159768A · 2020 [cited by examiner]
KR 20190136633A · 2019 [cited by examiner]
KR 20200103463A · 2020 [cited by examiner]
KR 20230084809A · 2023 [cited by examiner]
WO WO2015045112A1 · 2015 [cited by examiner]
WO WO2019053927A1 · 2019 [cited by examiner]
WO WO2022224311A1 · 2022 [cited by examiner]
EPO machine translation of DE 102009046908 A1 (original DE document published May 26, 2011) (Year: 2011). [cited by examiner]
Wikipedia article, “Extended reality”, Old revision dated May 25, 2022, 2 pages (Year: 2022). [cited by examiner]
EPO machine translation of DE 102018214938A1 (original DE document published Mar. 5, 2020) (Year: 2020). [cited by examiner]
Sick product information, “Glare”—Glare Sensors, Redefining Polished Performance, 8017834/2016-03-29, 1M-Pre USmod en44, Mar. 29, 2016, 20 pages (Year: 2016). [cited by examiner]
Hong, D. | “Navigation and GPS Through Augmented Reality”, webpage https://medium.com/@dylanhongtech/navigation-and-gps-through-augmented-reality-cd8012dfc8f2, Nov. 9, 2018, 4 pages. [cited by applicant]
Dent, S. | “Google Maps' AR walking directions comes to many more phones”, webpage https://www.engadget.com/2019-08-08-google-maps-ar-walking-directions-live-view.html, Aug. 8, 2019, 5 pages. [cited by applicant]