IP Library Granted Patent US 11,893,301
Granted Patent B2
US 11,893,301 · App. 17/663,594 · Granted Feb 6, 2024

Colocated shared augmented reality without shared backend

Inventors: Ana Maria Cardenas Gasca (Pasadena, CA); Ella Dagan Peled (Santa Cruz, CA); Andrés Monroy-Hernández (Princeton, NJ); Ava Robinson (Solana Beach, CA); Yu Jiang Tham (Los Angeles, CA); Rajan Vaish (Beverly Hills, CA)
Assignee: Snap Inc.
G06F3/1454A63F13/213G06F3/011G06F3/0488G06K7/1439G06T7/20G06T19/006G06V40/10H04L67/52A63F2300/8082G06T2200/24G06T2207/10016G06T2207/30196G06T2219/024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,893,301
App. No.
17/663,594
Granted
Feb 6, 2024
Kind
B2
Abstract

Methods and systems are disclosed for creating a shared augmented reality (AR) session. The methods and systems perform operations comprising: receiving, by a client device, input that selects a shared augmented reality (AR) experience from a plurality of shared AR experiences; in response to receiving the input, determining one or more resources associated with the selected shared AR experience; determining, by the client device, that two or more users are located within a threshold proximity of the client device; and activating the selected shared AR experience in response to determining that the two or more users are located within the threshold proximity of the client device.

Claims (53)

1. A method comprising:

receiving, by a client device, input that selects a shared augmented reality (AR) experience from a plurality of shared AR experiences, the selected shared AR experience being configured to be operated independently of a server;

accessing a video feed captured in real-time by a camera of the client device during a selected AR experience;

detecting, in the selected shared AR experience, a presence of a real-world animal visible in the captured video feed;

displaying, in the selected shared AR experience, a plurality of first AR elements in the video feed together with the real-world animal;

in response to detecting a visual overlapping of a threshold number of the displayed plurality of AR elements based on movement of the real-world animal visible in the captured video feed, incrementing a score viewable in a UI of the client device; and

positioning a second AR element as a virtual reward for the real-world animal in association with the detected real-world animal based on the incremented score.

2. The method of claim 1 , further comprising:

displaying, by the client device, a user interface comprising a task timer, the task timer representing an amount of time remaining for a given user of the users to complete an assigned task.

3. The method of claim 2 , wherein:

the task timer indicates how much longer the user has left to complete a task of walking the real-world animal as well as a current score.

4. The method of claim 1 , wherein the selected shared AR experience comprises a shared device AR experience that is accessed one-at-a-time by each of two or more users on a same shared client device.

5. The method of claim 1 , wherein the client device is a first client device, and further comprising:

synchronizing the shared AR experience between the first client device and a second client device;

wherein a marker in a physical environment of the first and second client devices is also displayed on a third client device, the marker representing a value of a group timer; and

in response to both the second and the third client devices detecting the marker, initiating the selected shared AR experience concurrently on the first and second client devices.

6. The method of claim 1 , further comprising providing access to a second shared AR experience, the second shared AR experience being configured to perform operations comprising:

receiving a video feed from a camera of the client device;

detecting presence of real-world feet within the video feed captured by the camera; and

presenting a story on the client device in response to detecting presence of the real-world feet within the video feed.

7. The method of claim 6 , further comprising:

presenting a first AR puppet on a first foot to replace a depiction of the first foot in the video feed with a depiction of the first AR puppet;

controlling the first AR puppet based on detecting movement of the first foot; and

controlling a second AR puppet based on detecting movement of a second foot.

8. The method of claim 7 , further comprising:

detecting contact between the first foot and the second foot indicating tapping of the feet together; and

in response to detecting contact between the first foot and the second foot, presenting an AR effect.

9. The method of claim 1 , further comprising providing access to a second shared AR experience, the second shared AR experience being configured to perform operations comprising:

detecting presence of a whole body of a user of two or more users within a video feed captured by the client device;

receiving input that taps a screen of the client device at a position at which a portion of the whole body of the user is presented;

overlaying a first AR element on the video feed at the position in response to receiving input that taps the screen of the client device; and

ending the AR experience in response to determining that the whole body of the user has been overlaid by a plurality of AR elements.

10. A system comprising:

a processor; and

a memory component having instructions stored thereon, when executed by the processor, causes the processor to perform operations comprising:

receiving, by a client device, input that selects a shared augmented reality (AR) experience from a plurality of shared AR experiences, the selected shared AR experience being configured to be operated independently of a server;

accessing a video feed captured in real-time by a camera of the client device during a selected AR experience;

detecting, in the selected shared AR experience, a presence of a real-world animal within the captured video feed;

displaying, in the selected shared AR experience, a plurality of first AR elements in the video feed together with the real-world animal;

in response to detecting a visual overlapping of a threshold number of the displayed plurality of AR elements based on movement of the real-world animal visible in the captured video feed, incrementing a score viewable in a UI of the client device; and

positioning a second AR element as a virtual reward for the real-world animal in association with the detected real-world animal based on the incremented score.

11. The system of claim 10 , the operations further comprising:

displaying, by the client device, a user interface comprising a task timer, the task timer representing an amount of time remaining for a given user of the users to complete an assigned task.

12. The system of claim 11 , wherein:

the task timer indicates how much longer the user has left to complete a task of walking the real-world animal as well as a current score.

13. The system of claim 10 , wherein the selected shared AR experience comprises a shared device AR experience that is accessed one-at-a-time by each of two or more users on a same shared client device.

14. A non-transitory computer-readable storage medium having stored thereon, instructions when executed by a processor, causes the processor to perform operations comprising:

receiving, by a client device, input that selects a shared augmented reality (AR) experience from a plurality of shared AR experiences, the selected shared AR experience being configured to be operated independently of a server;

accessing a video feed captured in real-time by a camera of the client device during a selected AR experience;

detecting, in the selected shared AR experience, a presence of a real-world animal within the captured video feed;

displaying, in the selected shared AR experience, a plurality of first AR elements in the video feed together with the real-world animal;

in response to detecting a visual overlapping of a threshold number of the displayed plurality of AR elements based on movement of the real-world animal visible in the captured video feed, incrementing a score viewable in a UI of the client device; and

positioning a second AR element as a virtual reward for the real-world animal in association with the detected real-world animal based on the incremented score.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2023
From: CARDENAS GASCA, ANA MARIA; DAGAN PELED, ELLA; MONROY-HERNÁNDEZ, ANDRÉS; ROBINSON, AVA; THAM, YU JIANG; VAISH, RAJAN
To: SNAP INC.
Reel/Frame 064994/0212 →
Continuity (3)
Continuation 17248981 · Feb 16, 2021
Provisional Application 62706788 · Sep 10, 2020
Related Publication 20220276823A1 · Sep 1, 2022
Cited By (5)
US 12,229,901 US 12,236,512 US 12,284,698 US 12,472,435 US 12,482,131