Granted Patent B2

US 12,417,593 · App. 18/170,271 · Granted Sep 16, 2025

Inventors: Rajan Vaish (Beverly Hills, CA); Sven Kratz (Mercer Island, WA); Andrés Monroy-Hernández (Princeton, NJ); Brian Anthony Smith (New York, NY)

Assignee: Snap Inc.

G06T19/006G06T15/08G06V10/26G06V10/945G06V20/20G06T2200/24G06V2201/10

Abstract

Claims (70)

1. A method, comprising:

identifying a two-dimensional element from one or more two-dimensional images;

generating a volumetric content item based on the two-dimensional element identified from the one or more two-dimensional images, the volumetric content item representing the two-dimensional element;

identifying a real-world element in a real-world environment;

associating the volumetric content item with the real-world element in the real-world environment;

presenting an interactive interface operable to receive an association between the volumetric content item and the real-world element;

receiving an input indicative of the association between the volumetric content item and the real-world element; and

causing presentation, by a display device, of the volumetric content item overlaid on the real-world environment at a location based on the association, the real-world environment being is within a field of view of a user of the display device.

2. The method of claim 1 , wherein the interactive interface is a second interactive interface, and the method further comprises:

providing a first interactive interface operable to receive user identification of the two-dimensional element from the one or more two-dimensional images; and

receiving an input indicative of the user identification of the two-dimensional element, wherein the identifying of the two-dimensional element is based on the input.

3. The method of claim 1 , wherein the identifying of the two-dimensional element from the one or more two-dimensional images comprises performing image segmentation on the one or more two-dimensional images.

4. The method of claim 1 , wherein the causing of presentation of the volumetric content item overlaid on the real-world environment comprises:

causing presentation of one or more virtual objects in conjunction with the volumetric content item.

5. The method of claim 4 , wherein the one or more virtual objects comprise one or more computer-generated objects that are imaginary.

6. The method of claim 1 , further comprising:

obtaining a metadata associated with the one or more two-dimensional images;

generating a visual effect based on the metadata, the visual effect includes one or more augmentations to be applied to the real-world environment; and

causing presentation, by the display device, of the visual effect applied to the real-world environment.

7. The method of claim 6 , wherein the causing of the presentation of the visual effect applied to the real-world environment comprises causing presentation of an animated effect in conjunction with the volumetric content item.

8. The method of claim 1 , further comprising:

obtaining a metadata associated with the one or more two-dimensional images;

determining a real-world effect based on the metadata, real-world effect being associated with functionality provided by a network-connected device; and

causing the network-connected device in the real-world environment to provide the real-world effect.

9. The method of claim 1 , further comprising:

generating volumetric content based on the presentation of the volumetric content item overlaid on the real-world environment; and

storing the volumetric content for subsequent presentation.

10. The method of claim 1 , wherein:

the one or more images depict a first location; and

the method further comprises:

determining a second location associated with the display device;

determining the second location is within a threshold distance of the first location; and

the causing of the presentation of the volumetric content item is in response to determining the second location is within the threshold distance of the first location.

11. A system comprising:

one or more hardware processors; and

at least one memory storing instructions that cause the one or more hardware processors to perform operations comprising:

identifying a two-dimensional element from one or more two-dimensional images;

generating a volumetric content item based on the two-dimensional element identified from the one or more two-dimensional images;

identifying a real-world element in a real-world environment;

associating the volumetric content item with the real-world element in the real-world environment;

presenting an interactive interface operable to receive an association between the volumetric content item and the real-world element;

receiving an input indicative of the association between the volumetric content item and the real-world element; and

causing presentation, by a display device, of the volumetric content item overlaid on the real-world environment at a location based on the association, the real-world environment being within a field of view of a user of the display device.

12. The system of claim 11 , wherein the interactive interface is a second interactive interface, and the operations further comprise:

providing a first interactive interface operable to receive user identification of the two-dimensional element from the one or more two-dimensional images; and

receiving an input indicative of the user identification of the two-dimensional element, wherein the identifying of the two-dimensional element is based on the input.

13. The system of claim 11 , wherein the identifying of the two-dimensional element from the one or more two-dimensional images comprises performing image segmentation on the one or more two-dimensional images.

14. The system of claim 11 , wherein the causing of presentation of the volumetric content item overlaid on the real-world environment comprises:

causing presentation of one or more virtual objects in conjunction with the volumetric content item.

15. The system of claim 14 , wherein the one or more virtual objects comprise one or more computer-generated objects that are imaginary.

16. The system of claim 11 , wherein the operations further comprising:

obtaining a metadata associated with the one or more two-dimensional images;

generating a visual effect based on the metadata, the visual effect includes one or more augmentations to be applied to the real-world environment; and

causing presentation, by the display device, of the visual effect applied to the real-world environment.

17. The system of claim 16 , wherein the causing of the presentation of the visual effect applied to the real-world environment comprises causing presentation of an animated effect in conjunction with the volumetric content item.

18. The system of claim 11 , wherein the operations further comprising:

obtaining a metadata associated with the one or more two-dimensional images;

determining a real-world effect based on the metadata, the real-world effect being associated with functionality provided by a network-connected device; and

causing the network-connected device in the real-world environment to provide the real-world effect.

19. The system of claim 11 , wherein the operations further comprising:

generating volumetric content based on the presentation of the volumetric content item overlaid on the real-world environment; and

storing the volumetric content for subsequent presentation.

20. A machine-readable medium storing instructions that, when executed by a computer system, cause the computer system to perform operations comprising:

identifying a two-dimensional element from one or more two-dimensional images;

generating a volumetric content item based on the two-dimensional element identified from the one or more two-dimensional images;

identifying a real-world element in a real-world environment;

associating the volumetric content item with the real-world element in the real-world environment;

presenting an interactive interface operable to receive an association between the volumetric content item and the real-world element;

receiving an input indicative of the association between the volumetric content item and the real-world element; and

causing presentation, by a display device, of the volumetric content item overlaid on the real-world environment at a location based on the association, the real-world environment being within a field of view of a user of the display device.

Assignments (1)

Continuity (2)

References Cited (400)