IP Library › Granted Patent US 12,597,214
Granted Patent B2
US 12,597,214 · App. 18/136,768 · Granted Apr 7, 2026

Scannable codes as landmarks for augmented-reality content

Inventor: Mason Spong (Provo, UT)
Assignee: Snap Inc.
G06T19/006G06K7/1417G06K7/1443
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,597,214
App. No.
18/136,768
Granted
Apr 7, 2026
Kind
B2
Abstract

A system to perform operations that include: generating, at a client device, a scan request that comprises image data, the image data comprising a depiction of a coded image that comprises a reference to a media repository; determining a set of coordinates that indicate a position and orientation of the coded image within a three-dimensional (3D) Euclidean space responsive to the scan request; defining a reference point at the client device based on the set of coordinates that indicate the position and orientation of the coded image within the 3D Euclidean space; accessing media content from within the media repository based on the reference to the media content associated with the coded image, wherein the media content may include AR content; and causing display of a presentation of the media content at the client device based on the reference point.

Claims (54)

1 . A method comprising:

generating, at a client device, a scan request that comprises image data, the image data comprising a depiction of a coded image that comprises one or more image features, and a reference to a media repository;

accessing gyroscope data generated by the client device responsive to the scan request;

determining a set of coordinates that indicate a position and orientation of the coded image within a three-dimensional (3D) Euclidean space based on the one or more image features of the coded image and the gyroscope data from the client device, the position and orientation including a horizontal position and orientation within the 3D Euclidean space;

defining a reference point at the client device based on the set of coordinates that indicate the position and orientation of the coded image within the 3D Euclidean space;

selecting a media category that corresponds with the horizontal position and orientation of the coded image within the 3D Euclidean space from among a plurality of media categories;

accessing media content from within the media category in the media repository based on the reference to the media content associated with the coded image; and

causing display of a presentation of the media content at the client device based on the reference point.

2 . The method of claim 1 , wherein the media content includes augmented-reality (AR) content.

3 . The method of claim 2 , wherein the causing display of the presentation of the media content at the client device based on the reference point includes:

causing display of the AR content at the position and orientation of the coded image within the 3D Euclidean space.

4 . The method of claim 1 , wherein the generating the scan request includes:

causing display of the image data at the client device, the image data depicting an environment that includes the coded image;

detecting the coded image within the image data; and

generating the scan request based on the detecting the coded image within the image data.

5 . The method of claim 1 , wherein the client device corresponds with a user profile, and wherein the accessing the media content from within the media repository is based on the reference to the media content associated with the coded image and user preferences from the user profile associated with the client device.

6 . The method of claim 1 , wherein the coded image comprises a Quick Response (QR) code.

7 . The method of claim 1 , wherein the causing display of the presentation of the media content at the client device based on the reference point includes:

determining a contextual condition associated with the client device; and

wherein the presentation of the media content is based on the contextual condition.

8 . The method of claim 7 , wherein the contextual condition is based on temporal data.

9 . The method of claim 1 , wherein the accessing the media content from within the media repository is based on the reference to the media content and the position and orientation of the coded image within the 3D Euclidean space.

10 . A system comprising:

a memory; and

at least one hardware processor to perform operations comprising:

generating, at a client device, a scan request that comprises image data, the image data comprising a depiction of a coded image that comprises one or more image features, and a reference to a media repository;

accessing gyroscope data generated by the client device responsive to the scan request;

determining a set of coordinates that indicate a position and orientation of the coded image within a three-dimensional (3D) Euclidean space based on the one or more image features of the coded image and the gyroscope data from the client device, the position and orientation including a horizontal position and orientation within the 3D Euclidean space;

defining a reference point at the client device based on the set of coordinates that indicate the position and orientation of the coded image within the 3D Euclidean space;

selecting a media category that corresponds with the horizontal position and orientation of the coded image within the 3D Euclidean space from among a plurality of media categories;

accessing media content from within the media category in the media repository based on the reference to the media content associated with the coded image; and

causing display of a presentation of the media content at the client device based on the reference point.

11 . The system of claim 10 , wherein the media content includes augmented-reality (AR) content.

12 . The system of claim 11 , wherein the causing display of the presentation of the media content at the client device based on the reference point includes:

causing display of the AR content at the position and orientation of the coded image within the 3D Euclidean space.

13 . The system of claim 10 , wherein the generating the scan request includes:

causing display of the image data at the client device, the image data depicting an environment that includes the coded image;

detecting the coded image within the image data; and

generating the scan request based on the detecting the coded image within the image data.

14 . The system of claim 10 , wherein the client device corresponds with a user profile, and wherein the accessing the media content from within the media repository is based on the reference to the media content associated with the coded image and user preferences from the user profile associated with the client device.

15 . The system of claim 10 , wherein the coded image comprises a Quick Response (QR) code.

16 . The system of claim 10 , wherein the causing display of the presentation of the media content at the client device based on the reference point includes:

determining a contextual condition associated with the client device; and

wherein the presentation of the media content is based on the contextual condition.

17 . The system of claim 16 , wherein the contextual condition is based on temporal data.

18 . The system of claim 10 , wherein the accessing the media content from within the media repository is based on the reference to the media content and the position and orientation of the coded image within the 3D Euclidean space.

19 . A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

generating, at a client device, a scan request that comprises image data, the image data comprising a depiction of a coded image that comprises one or more image features, and a reference to a media repository;

accessing gyroscope data generated by the client device responsive to the scan request;

determining a set of coordinates that indicate a position and orientation of the coded image within a three-dimensional (3D) Euclidean space based on the one or more image features of the coded image and the gyroscope data from the client device, the position and orientation including a horizontal position and orientation within the 3D Euclidean space;

defining a reference point at the client device based on the set of coordinates that indicate the position and orientation of the coded image within the 3D Euclidean space;

selecting a media category that corresponds with the horizontal position and orientation of the coded image within the 3D Euclidean space from among a plurality of media categories;

accessing media content from within the media category in the media repository based on the reference to the media content associated with the coded image; and

causing display of a presentation of the media content at the client device based on the reference point.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 19, 2023
From: SPONG, MASON
To: SNAP INC.
Reel/Frame 063382/0256 →
Continuity (1)
Related Publication 20240355059A1 · Oct 24, 2024
References Cited (3)
US 10146971B1 · Cansizoglu · 2018 [cited by examiner]
US 20170323488A1 · Mott · 2017 [cited by examiner]
Zhu et al. Design of the PromoPad: an automated augmented-Reality shopping assistant, Dec. 31, 2008, IGI Publishing, p. 41-56 (Year: 2008). [cited by examiner]