Granted Patent B2

US 12,541,928 · App. 18/147,941 · Granted Feb 3, 2026

Inventors: Helene Causse (Seattle, WA); Valentyn Fuchedzhy (Odesa, UA); Amin Madani (Los Angeles, CA); Alan Rawcliffe (Seattle, WA); Vincent Sung (Los Angeles, CA)

Assignee: Snap Inc.

G06T19/006G06F9/542G06Q30/0641

Abstract

Claims (61)

1 . A method, comprising:

receiving a selection of a first representation of a product from a set of representations of products;

rendering for display the first representation of the product from the set of representations of products based on metadata using an extension application programming interface (API), the rendering comprising:

determining augmented reality (AR) content that is stored remotely using the extension API;

sending a first request for remote AR content to a camera API using the extension API;

sending a second request for retrieving the remote AR content using the camera API;

sending, to the extension API a particular request to apply the remote AR content based on second metadata associated with the first representation of the product from the set of representations of products; and

in response to the particular request, mapping, by the extension API the second metadata to the remote AR content, the remote AR content being stored at a separate storage device over a network that is hosted by a third party vendor;

rendering the remote AR content using the camera API, wherein rendering for display the first representation of the product is initiated by a third party application, the third party application provided by the third party vendor that is different from an entity that provides the camera API and the extension API, the third party application being separate and distinct from the camera API and the extension API; and

receiving a notification that the remote AR content was rendered for display from the extension API.

2 . The method of claim 1 , wherein the extension API is a different API than the camera API, and the extension API is utilized by a third party to provide shopping related AR content generators.

3 . The method of claim 1 , further comprising:

requesting, by the camera API, the remote AR content based on the particular request.

4 . The method of claim 3 , wherein the remote AR content is provided by the third party vendor that is associated with the product from the set of representations of the products.

5 . The method of claim 1 , wherein the remote AR content comprises an AR object associated with a product provided by the third party vendor.

6 . The method of claim 1 , wherein the remote AR content comprises dynamic content that is updated over a periodic basis.

7 . The method of claim 1 , further comprising:

prior to receiving the selection of the first representation, rendering the set of representations of products based on first metadata associated with the set of representations of products, and wherein rendering for display the first representation further comprises:

generating third metadata comprising the mapping of the second metadata to the remote AR content; and

sending, by the extension API, the third metadata to the camera API, the third metadata being included in the first request.

8 . The method of claim 7 , wherein rendering for display the first representation further comprises:

receiving, by the camera API, the third metadata included in the first request;

in response to the first request, retrieving the remote AR content based on the third metadata;

sending, by the camera API, a particular notification to the extension API confirming that the remote AR content was rendered; and

in response to the particular notification, sending, by the extension API, the notification that the remote AR content was rendered for display.

9 . A system comprising:

a processor; and

a memory including instructions that, when executed by the processor, cause the processor to perform operations comprising:

receiving a selection of a first representation of a product from a set of representations of products;

rendering for display the first representation of the product from the set of representations of products based on metadata using an extension application programming interface (API), the rendering comprising:

determining augmented reality (AR) content that is stored remotely using the extension API;

sending a first request for remote AR content to a camera API using the extension API;

sending a second request for retrieving the remote AR content using the camera API;

sending, to the extension APL a particular request to apply the remote AR content based on second metadata associated with the first representation of the product from the set of representations of products; and

in response to the particular request, mapping, by the extension APL the second metadata to the remote AR content, the remote AR content being stored at a separate storage device over a network that is hosted by a third party vendor;

rendering the remote AR content using the camera API, wherein rendering for display the first representation of the product is initiated by a third party application, the third party application provided by the third party vendor that is different from an entity that provides the camera API and the extension API, the third party application being separate and distinct from the camera API and the extension API; and

receiving a notification that the remote AR content was rendered for display from the extension API.

10 . The system of claim 9 , wherein the extension API is a different API than the camera API, and the extension API is utilized by a third party to provide shopping related AR content generators.

11 . The system of claim 9 , wherein the operations further comprise: requesting, by the camera API, the remote AR content based on the particular request.

12 . The system of claim 11 , wherein the remote AR content is provided by the third party vendor that is associated with the product from the set of representations of the products.

13 . The system of claim 9 , wherein the remote AR content comprises an AR object associated with a product provided by the third party vendor.

14 . The system of claim 9 , wherein the remote AR content comprises dynamic content that is updated over a periodic basis.

15 . The system of claim 9 , wherein the operations further comprise:

prior to receiving the selection of the first representation, rendering the set of representations of products based on first metadata associated with the set of representations of products, and wherein rendering for display the first representation further comprises:

generating third metadata comprising the mapping of the second metadata to the remote AR content; and

sending, by the extension API, the third metadata to the camera API, the third metadata being included in the first request.

16 . The system of claim 15 , wherein rendering for display the first representation further comprises:

receiving, by the camera API, the third metadata included in the first request;

in response to the first request, retrieving the remote AR content based on the third metadata;

sending, by the camera API, a particular notification to the extension API confirming that the remote AR content was rendered; and

in response to the particular notification, sending, by the extension API, the notification that the remote AR content was rendered for display.

17 . A non-transitory computer-readable medium comprising instructions, which when executed by a computing device, cause the computing device to perform operations comprising:

receiving a selection of a first representation of a product from a set of representations of products;

rendering for display the first representation of the product from the set of representations of products based on metadata using an extension application programming interface (API), the rendering comprising:

determining augmented reality (AR) content that is stored remotely using the extension API;

sending a first request for remote AR content to a camera API using the extension API;

sending a second request for retrieving the remote AR content using the camera API;

sending, to the extension API a particular request to apply the remote AR content based on second metadata associated with the first representation of the product from the set of representations of products; and

in response to the particular request, mapping, by the extension APL the second metadata to the remote AR content, the remote AR content being stored at a separate storage device over a network that is hosted by a third party vendor;

rendering the remote AR content using the camera API, wherein rendering for display the first representation of the product is initiated by a third party application, the third party application provided by the third party vendor that is different from an entity that provides the camera API and the extension API, the third party application being separate and distinct from the camera API and the extension API; and

receiving a notification that the remote AR content was rendered for display from the extension API.

Assignments (1)

Continuity (2)

References Cited (19)