IP Library Patent Application 19250957
Patent Application
App. No. 19/250,957

USABILITY HEATMAP GENERATION FOR AUGMENTED REALITY

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
19/250,957
Abstract

An online computing system generates and uses usability heatmaps to ensure that AR content is presented in suitable locations within geographic areas. To generate a usability heatmap, the online system accesses geographic data describing a geographic area for which the online system provides AR content services and identifies a set of portions of the geographic area. The online system identifies subsets of the geographic data for each of the portions of the geographic area and computes a usability score for each of the portions. The online system generates a usability heatmap based on the computed usability scores for the portions of the geographic area and stores the heatmap in a heatmap database that stores usability heatmaps for different geographic areas. The online system may use the heatmaps in the database to generate AR content when requested by client devices.

Claims (60)

1 . A computer-implemented method comprising:

accessing, by an online system, geographic data for a geographic area, wherein the geographic data describes features of the geographic area;

generating a usability heatmap for the geographic area based on the geographic data, wherein generating the usability heatmap comprises:

identifying a plurality of portions of the geographic area;

identifying a subset of the geographic data corresponding to each of the plurality of portions of the geographic area;

computing a usability score for each of the plurality of portions of the geographic area based on the corresponding subset of the geographic data for each of the portions; and

generating the usability heatmap based on the computed usability scores for the plurality of portions; and

storing the usability heatmap in association with the geographic area in a heatmap database, wherein the heatmap database stores a plurality of usability heatmaps in association with a plurality of geographic areas.

2 . The method of claim 1 , wherein the geographic data comprises location data captured by location sensors of client devices associated with users of the online system, wherein the location data describes locations of the client devices over time.

3 . The method of claim 2 , wherein the geographic data comprises trajectory data describing trajectories of client devices within the geographic area over time.

4 . The method of claim 1 , wherein the geographic data comprises semantic data comprising semantically segmented portions of the geographic area.

5 . The method of claim 4 , wherein generating the usability heatmap for the geographic area comprises:

generating an initial usability heatmap comprising a set of initial usability scores;

accessing a semantic map for a geographic region comprising the geographic area, wherein the semantic map comprises semantically segmented portions of the geographic region;

identifying one or more portions of the geographic region that overlap with the geographic area; and

updating the set of initial usability scores based on the identified one or more portions of the geographic region.

6 . The method of claim 1 , wherein the geographic data comprises image data comprising images depicting objects within the geographic area.

7 . The method of claim 6 , wherein computing a usability score for a portion of the geographic area comprises:

detecting an object in the image data; and

computing the usability score for the portion based on the detected object.

8 . The method of claim 1 , further comprising:

computing an overall usability score for each of the plurality of geographic areas based on the corresponding usability heatmap of the geographic area.

9 . The method of claim 1 , wherein computing a usability score for a portion of the geographic area comprises:

computing a frequency of a user being located within the portion based on the geographic data.

10 . The method of claim 1 , further comprising:

receiving, at the online system, a request for AR content from a client device associated with a user of the online system, wherein the request comprises location data describing a location of the client device;

identifying a geographic area of the plurality of geographic area containing the location of the client device;

identifying a usability heatmap in the heatmap database corresponding to the identified geographic area;

generating AR content based on the identified usability heatmap; and

transmitting the AR content to the client device for display to the user.

11 . A non-transitory computer-readable medium storing instructions that, when executed by a computer system, cause the computer system to perform operations comprising:

accessing, by an online system, geographic data for a geographic area, wherein the geographic data describes features of the geographic area;

generating a usability heatmap for the geographic area based on the geographic data, wherein generating the usability heatmap comprises:

identifying a plurality of portions of the geographic area;

identifying a subset of the geographic data corresponding to each of the plurality of portions of the geographic area;

computing a usability score for each of the plurality of portions of the geographic area based on the corresponding subset of the geographic data for each of the portions; and

generating the usability heatmap based on the computed usability scores for the plurality of portions; and

storing the usability heatmap in association with the geographic area in a heatmap database, wherein the heatmap database stores a plurality of usability heatmaps in association with a plurality of geographic areas.

12 . The computer-readable medium of claim 11 , wherein the geographic data comprises location data captured by location sensors of client devices associated with users of the online system, wherein the location data describes locations of the client devices over time.

13 . The computer-readable medium of claim 12 , wherein the geographic data comprises trajectory data describing trajectories of client devices within the geographic area over time.

14 . The computer-readable medium of claim 11 , wherein the geographic data comprises semantic data comprising semantically segmented portions of the geographic area.

15 . The computer-readable medium of claim 14 , wherein generating the usability heatmap for the geographic area comprises:

generating an initial usability heatmap comprising a set of initial usability scores;

accessing a semantic map for a geographic region comprising the geographic area, wherein the semantic map comprises semantically segmented portions of the geographic region;

identifying one or more portions of the geographic region that overlap with the geographic area; and

updating the set of initial usability scores based on the identified one or more portions of the geographic region.

16 . The computer-readable medium of claim 11 , wherein the geographic data comprises image data comprising images depicting objects within the geographic area.

17 . The computer-readable medium of claim 16 , wherein computing a usability score for a portion of the geographic area comprises:

detecting an object in the image data; and

computing the usability score for the portion based on the detected object.

18 . The computer-readable medium of claim 11 , the operations further comprising:

computing an overall usability score for each of the plurality of geographic areas based on the corresponding usability heatmap of the geographic area.

19 . The computer-readable medium of claim 11 , wherein computing a usability score for a portion of the geographic area comprises:

computing a frequency of a user being located within the portion based on the geographic data.

20 . The computer-readable medium of claim 11 , the operations further comprising:

receiving, at the online system, a request for AR content from a client device associated with a user of the online system, wherein the request comprises location data describing a location of the client device;

identifying a geographic area of the plurality of geographic area containing the location of the client device;

identifying a usability heatmap in the heatmap database corresponding to the identified geographic area;

generating AR content based on the identified usability heatmap; and

transmitting the AR content to the client device for display to the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 17, 2025
From: KNOBLAUCH, DANIEL; MUNUKUTLA, PURNA SOWMYA; GOVINDARAJ, KRITHIKA
To: NIANTIC SPATIAL, INC.
Reel/Frame 072278/0943 →