IP Library Granted Patent US 12705845
Granted Patent B2
US 12705845 · App. 18/850,980 · Granted Aug 11, 2026

Providing augmented reality view based on geographical data

Inventor: Kathleen Alexandra Bryan (Mountain View, CA)
Assignee: GOOGLE LLC
G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12705845
App. No.
18/850,980
Granted
Aug 11, 2026
Kind
B2
Abstract

A method for providing an augmented reality view includes obtaining, based on a location of a computing device, a three-dimensional (3D) reconstruction of a scene associated with the location, the 3D reconstruction of the scene including one or more objects, processing the 3D reconstruction of the scene by generating one or more virtual objects which respectively correspond to the one or more objects, each virtual object being in a form of a virtual outline of a corresponding object among the one or more objects and, providing, for presentation on a display device of the computing device, an augmented reality view of the scene by overlaying at least one virtual outline onto a corresponding real-world object presented on the display device such that the at least one virtual outline at least partially frames the corresponding real-world object.

Claims (44)

1 . A computing device, comprising:

a display device;

at least one memory to store instructions; and

at least one processor configured to execute the instructions to:

request, from a server computing system, geographic data associated with a location of the computing device, wherein the geographic data includes latitude and longitude information about real-world objects in a surrounding environment of the computing device,

generate, based on the location of the computing device and the geographic data, a three-dimensional (3D) reconstruction of a scene associated with the location, the 3D reconstruction of the scene including one or more objects which represent the real-world objects in the surrounding environment of the computing device,

process the 3D reconstruction of the scene by generating one or more virtual objects which respectively correspond to the one or more objects, each virtual object being in a form of a virtual outline of a corresponding object among the one or more objects,

the virtual outline for each object among the one or more objects in the 3D reconstruction of the scene being formed by identifying at least one of: one or more edges of each object, one or more vertices of each object, or one or more contours of each object, and

provide, for presentation on the display device of the computing device, an augmented reality view of the scene by overlaying at least one virtual outline onto a corresponding real-world object presented on the display device such that the at least one virtual outline at least partially frames the corresponding real-world object.

2 . The computing device of claim 1 , wherein the at least one processor is configured to process the 3D reconstruction of the scene by generating the one or more virtual objects by utilizing a shader to illuminate each of the one or more virtual objects.

3 . The computing device of claim 1 , wherein the at least one processor is configured to generate the 3D reconstruction of the scene by mapping geographic data for one or more real-world objects among the real-world objects in the surrounding environment to corresponding virtual objects.

4 . The computing device of claim 1 , further comprising:

an ambient light sensor configured to sense ambient light in a surrounding environment of the computing device,

wherein the at least one processor is configured to execute the instructions to generate, based on the location of the computing device and the geographic data, the 3D reconstruction of the scene is based on the ambient light sensed by the ambient light sensor being less than a threshold level.

5 . The computing device of claim 1 , wherein

the one or more objects from the scene are disposed within a predetermined distance from the location of the computing device, and

the predetermined distance is adjustable by a user of the computing device to be outside a field of view of the computing device.

6 . A method, comprising:

requesting, from a server computing system, geographic data associated with a location of a computing device, wherein the geographic data includes latitude and longitude information about real-world objects in a surrounding environment of the computing device,

generating, based on the location of the computing device and the geographic data, a three-dimensional (3D) reconstruction of a scene associated with the location, the 3D reconstruction of the scene including one or more objects which represent the real-world objects in the surrounding environment of the computing device;

processing the 3D reconstruction of the scene by generating one or more virtual objects which respectively correspond to the one or more objects, each virtual object being in a form of a virtual outline of a corresponding object among the one or more objects,

the virtual outline for each object among the one or more objects in the 3D reconstruction of the scene being formed by identifying at least one of: one or more edges of each object, one or more vertices of each object, or one or more contours of each object; and

providing, for presentation on a display device of the computing device, an augmented reality view of the scene by overlaying at least one virtual outline onto a corresponding real-world object presented on the display device such that the at least one virtual outline at least partially frames the corresponding real-world object.

7 . A server computing system, comprising:

at least one memory to store instructions; and

at least one processor configured to execute the instructions to:

obtain geographic data associated with a location of a computing device, wherein the geographic data includes latitude and longitude information about real-world objects in a surrounding environment of the computing device,

generate, based on the location of the computing device and the geographic data, a three-dimensional (3D) reconstruction of a scene associated with the location, the 3D reconstruction of the scene including one or more objects which represent the real-world objects in the surrounding environment of the computing device;

process the 3D reconstruction of the scene by generating one or more virtual objects which respectively correspond to the one or more objects, each virtual object being in a form of a virtual outline of a corresponding object among the one or more objects,

the virtual outline for each object among the one or more objects in the 3D reconstruction of the scene being formed by identifying at least one of: one or more edges of each object, one or more vertices of each object, or one or more contours of each object; and

provide, for presentation on a display device of the computing device, an augmented reality view of the scene by overlaying at least one virtual outline onto a corresponding real-world object presented on the display device such that the at least one virtual outline at least partially frames the corresponding real-world object.

8 . A non-transitory computer readable medium storing instructions which, when executed by a processor, cause the processor to perform the method of claim 6 .

9 . The method of claim 6 , wherein processing the 3D reconstruction of the scene by generating the one or more virtual objects comprises utilizing a shader to illuminate each of the one or more virtual objects.

10 . The method of claim 6 , wherein generating, based on the location of the computing device and the geographic data, the 3D reconstruction of the scene comprises mapping the geographic data for one or more real-world objects among the real-world objects in the surrounding environment to corresponding virtual objects.

11 . The method of claim 6 , further comprising:

sensing ambient light in a surrounding environment of the computing device,

wherein generating, based on the location of the computing device and the geographic data, the 3D reconstruction of the scene is based on the ambient light sensed in the surrounding environment of the computing device being less than a threshold level.

12 . The method of claim 6 , wherein the one or more objects from the scene are disposed within a predetermined distance from the location of the computing device.

13 . The method of claim 12 , wherein the predetermined distance is adjustable by a user of the computing device.

14 . The method of claim 12 , wherein the predetermined distance from the location of the computing device is outside a field of view of the computing device.

15 . The method of claim 6 , wherein

the one or more objects correspond to one or more buildings,

each of the one or more virtual objects are in the form of the virtual outline of a corresponding building among the one or more buildings, and

at least one virtual outline at least partially frames a corresponding real-world building when presented on the display device.