IP Library › Granted Patent US 11,949,969
Granted Patent B1
US 11,949,969 · App. 17/956,603 · Granted Apr 2, 2024

Mixed reality media content

Inventors: Sharon Moll (Lachen, CH); Piotr Gurgul (Hergiswil, CH); Dawei Zhang (Seattle, WA)
Assignee: Snap Inc.
H04N21/8545G06F3/04817G06K19/06037
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,949,969
App. No.
17/956,603
Granted
Apr 2, 2024
Kind
B1
Abstract

A mixed-reality media content system may be configured to perform operations that include: causing display of image data at a client device, the image data comprising a depiction of an object that includes a graphical code at a position upon the object; detecting the graphical code at the position upon the depiction of the object based on the image data; accessing media content within a media repository based on the graphical code scanned by the client device; and causing display of a presentation of the media content at the position of the graphical code upon the depiction of the object at the client device.

Claims (53)

1. A method comprising:

causing display of image data at a client device, the image data comprising a depiction of an object that includes a graphical code at a position upon the object;

detecting the graphical code at the position upon the depiction of the object based on the image data;

accessing media content within a media repository based on the graphical code;

generating a depth map that describes a curvature of a surface of the object; and

causing display of a presentation of the media content at the position of the graphical code upon the depiction of the object at the client device, the presentation of the media content based on the curvature of the surface of the object.

2. The method of claim 1 , wherein the graphical code comprises a boundary, and wherein the causing display of the presentation of the media content at the position of the graphical code upon the depiction of the object further comprises:

causing display of the media content within the boundary of the graphical code.

3. The method of claim 1 , further comprising:

receiving an input that selects the presentation of the media content; and

executing the media content responsive to the input that selects the presentation of the media content.

4. The method of claim 3 , wherein the media content comprises video data.

5. The method of claim 3 , wherein the media content comprises interactive content that comprises a display of a set of interactive icons, the set of interactive icons including at least a first interactive icon that corresponds with a media action, wherein the input selects the first interactive icon, and wherein the executing the media content responsive to the input that selects the presentation of the media content includes:

executing the media action that corresponds with the first interactive icon responsive to the input that selects the first interactive icon.

6. The method of claim 1 , wherein the graphical code includes a QR code.

7. The method of claim 1 , wherein the causing display of the presentation of the media content at the position of the graphical code upon the depiction of the object at the client device further comprises:

determining an orientation of the object; and

causing display of the presentation of the media content based on the orientation of the object.

8. A system comprising:

one or more processors of a machine; and

a memory storing instructions that, when executed by at least one processor among the one or more processors, causes the machine to perform operations comprising:

causing display of image data at a client device, the image data comprising a depiction of an object that includes a graphical code at a position upon the object;

detecting the graphical code at the position upon the depiction of the object based on the image data;

accessing media content within a media repository based on the graphical code;

generating a depth map that describes a curvature of a surface of the object; and

causing display of a presentation of the media content at the position of the graphical code upon the depiction of the object at the client device, the presentation of the media content based on the curvature of the surface of the object.

9. The system of claim 8 , wherein the graphical code comprises a boundary, and wherein the causing display of the presentation of the media content at the position of the graphical code upon the depiction of the object further comprises:

causing display of the media content within the boundary of the graphical code.

10. The system of claim 8 , further comprising:

receiving an input that selects the presentation of the media content; and

executing the media content responsive to the input that selects the presentation of the media content.

11. The system of claim 10 , wherein the media content comprises video data.

12. The system of claim 10 , wherein the media content comprises interactive content that comprises a display of a set of interactive icons, the set of interactive icons including at least a first interactive icon that corresponds with a media action, wherein the input selects the first interactive icon, and wherein the executing the media content responsive to the input that selects the presentation of the media content includes:

executing the media action that corresponds with the first interactive icon responsive to the input that selects the first interactive icon.

13. The system of claim 8 , wherein the graphical code includes a QR code.

14. The system of claim 8 , wherein the causing display of the presentation of the media content at the position of the graphical code upon the depiction of the object at the client device further comprises:

determining an orientation of the object; and

causing display of the presentation of the media content based on the orientation of the object.

15. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

causing display of image data at a client device, the image data comprising a depiction of an object that includes a graphical code at a position upon the object;

detecting the graphical code at the position upon the depiction of the object based on the image data;

accessing media content within a media repository based on the graphical code;

generating a depth map that describes a curvature of a surface of the object; and

causing display of a presentation of the media content at the position of the graphical code upon the depiction of the object at the client device, the presentation of the media content based on the curvature of the surface of the object.

16. The non-transitory machine-readable storage medium of claim 15 , wherein the graphical code comprises a boundary, and wherein the causing display of the presentation of the media content at the position of the graphical code upon the depiction of the object further comprises:

causing display of the media content within the boundary of the graphical code.

17. The non-transitory machine-readable storage medium of claim 15 , further comprising:

receiving an input that selects the presentation of the media content; and

executing the media content responsive to the input that selects the presentation of the media content.

18. The non-transitory machine-readable storage medium of claim 17 , wherein the media content comprises video data.

19. The non-transitory machine-readable storage medium of claim 17 , wherein the media content comprises interactive content that comprises a display of a set of interactive icons, the set of interactive icons including at least a first interactive icon that corresponds with a media action, wherein the input selects the first interactive icon, and wherein the executing the media content responsive to the input that selects the presentation of the media content includes:

executing the media action that corresponds with the first interactive icon responsive to the input that selects the first interactive icon.

20. The non-transitory machine-readable storage medium of claim 15 , wherein the graphical code includes a QR code.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 17956502 PREVIOUSLY RECORDED AT REEL: 061260 FRAME: 0834. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT . Recorded Jun 21, 2023
From: MOLL, SHARON; GURGUL, PIOTR; ZHANG, DAWEI
To: SNAP INC.
Reel/Frame 064050/0062 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE APPLICATION NUMBER PREVIOUSLY RECORDED AT REEL: 061260 FRAME: 0834. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Oct 3, 2022
From: MOLL, SHARON; GURGUL, PIOTR; ZHANG, DAWEI
To: SNAP INC.
Reel/Frame 061589/0261 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2022
From: MOLL, SHARON; GURGUL, PIOTR; ZHANG, DAWEI
To: SNAP INC
Reel/Frame 061260/0834 →
Cited By (1)
US 12,205,594