Granted Patent B2

US 12,322,052 · App. 18/058,175 · Granted Jun 3, 2025

Inventors: Sven Kratz (Mercer Island, WA); Andrés Monroy-Hernández (Princeton, NJ); Brian Anthony Smith (New York, NY); Rajan Vaish (Beverly Hills, CA)

Assignee: Snap Inc.

G06T19/006G06F3/04815

Abstract

Claims (59)

1. A method, comprising:

accessing, by at least one hardware processor, volumetric content comprising a plurality of volumetric content items, a volumetric content item from the plurality of volumetric content items comprising a volumetric representation of a first real-world element performing an action in a first real-world environment;

obtaining, by the at least one hardware processor, the volumetric content item from the volumetric content;

identifying a second real-world element in a second real-world environment;

causing presentation, by a display device, of the volumetric content item overlaid on the second real-world element in the second real-world environment in a visual field of a user of the display device, the presentation of the volumetric content item comprising displaying the volumetric content item performing the action in the second real-world environment;

detecting hand positions and hand movements of a real-world person in the visual field; and

causing presentation, by the display device, of an interaction between the real-world person and the overlaid volumetric content item based on the hand positions and hand movements.

2. The method of claim 1 , further comprising:

presenting an interactive interface operable to receive selection of the volumetric content item from the volumetric content for presentation; and

receiving input indicative of a selection of the volumetric content item from the interactive interface, wherein the causing of the presentation is in response to receiving the input.

3. The method of claim 1 , further comprising:

generating new volumetric content based on the presentation of the volumetric content item overlaid on the second real-world environment; and

storing the new volumetric content for subsequent presentation.

4. The method of claim 1 , wherein the action performed by the volumetric content item comprises moving from the hand positions to a location of a third real-world object.

5. The method of claim 1 , wherein:

the volumetric content item corresponds to a real-world object from the first real-world environment; and

the second real-world element from the second real-world environment corresponds to a real-world person.

6. The method of claim 1 , wherein:

the volumetric content item corresponds to a real-world person from the first real-world environment; and

the second real-world element from the second real-world environment corresponds to a real-world object.

7. The method of claim 1 , wherein:

the volumetric content item corresponds to a virtual object; and

the second real-world element from the second real-world environment corresponds to a real-world object or a real-world person.

8. The method of claim 1 , wherein:

the volumetric content item is a first volumetric content item; and

the method further comprises obtaining a second volumetric content item from the volumetric content; and

the causing of presentation of the volumetric content item overlaid on the second real-world environment comprises causing presentation of the first volumetric content item and the second volumetric content item overlaid on the second real-world environment in the visual field of the user of the display device.

9. A system, comprising:

one or more hardware processors; and

at least one memory storing instructions that cause the one or more hardware processors to perform operations comprising:

accessing, by at least one hardware processor, volumetric content comprising a plurality of volumetric content items, a volumetric content item from the plurality of volumetric content items comprising a volumetric representation of a first real-world element performing an action in a first real-world environment;

obtaining, by the at least one hardware processor, the volumetric content item from the volumetric content;

identifying a second real-world element in a second real-world environment;

causing presentation, by a display device, of the volumetric content item overlaid on the second real-world element in the second real-world environment in a visual field of a user of the display device, the presentation of the volumetric content item comprising displaying the volumetric content item performing the action in the second real-world environment;

detecting hand positions and hand movements of a real-world person in the visual field; and

causing presentation, by the display device, of an interaction between the real-world person and the overlaid volumetric content item based on the hand positions and movements.

10. The system of claim 9 , further comprising:

present an interactive interface operable to receive selection of the volumetric content item from the volumetric content for presentation; and

receive input indicative of a selection of the volumetric content item from the interactive interface, wherein the causing of the presentation is in response to receiving the input.

11. The system of claim 9 , further comprising:

generating new volumetric content based on the presentation of the volumetric content item overlaid on the second real-world environment; and

storing the new volumetric content for subsequent presentation.

12. The system of claim 9 , wherein the action performed by the volumetric content item comprises moving from the hand positions to a location of a third real-world object.

13. The system of claim 9 , wherein:

the volumetric content item corresponds to a real-world object from the first real-world environment; and

the second real-world element from the second real-world environment corresponds to a real-world person.

14. The system of claim 9 wherein:

the volumetric content item corresponds to a real-world person from the first real-world environment; and

the second real-world element from the second real-world environment corresponds to a real-world object.

15. The system of claim 9 , wherein:

the volumetric content item corresponds to a virtual object; and

the second real-world element from the second real-world environment corresponds to a real-world object or a real-world person.

16. A non-transitory machine-readable medium storing instructions that, when executed by a computer system, cause the computer system to perform operations comprising:

accessing, by at least one hardware processor, volumetric content comprising a plurality of volumetric content items, a volumetric content item from the plurality of volumetric content items comprising a volumetric representation of a first real-world element performing an action in a first real-world environment;

obtaining, by the at least one hardware processor, the volumetric content item from the volumetric content;

identifying a second real-world element in a second real-world environment;

causing presentation, by a display device, of the volumetric content item overlaid on the second real-world element in the second real-world environment in a visual field of a user of the display device, the presentation of the volumetric content item comprising displaying the volumetric content item performing the action in the second real-world environment;

detecting hand positions and hand movements of a real-world person in the visual field; and

causing presentation, by the display device, of an interaction between the real-world person and the overlaid volumetric content item based on the hand positions and movements.

Assignments (1)

Continuity (2)

References Cited (400)

Cited By (4)

US 12,449,891 US 12,519,924 US 12,675,962 US 12,718,494