IP Library › Granted Patent US 12,573,100
Granted Patent B2
US 12,573,100 · App. 17/697,425 · Granted Mar 10, 2026

User-defined contextual spaces

Inventor: Edmund Graves Brown (Los Angeles, CA)
Assignee: SNAP INC.
G06T11/00G06T7/62G06T19/006G06V20/20G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,573,100
App. No.
17/697,425
Filed
Mar 17, 2022
Granted
Mar 10, 2026
Kind
B2
Art Unit
2619
USPC
345/633
Abstract

Systems and methods herein describe generating user-defined contextual spaces by receiving, by an image of a view of a physical space from a camera, receiving a virtual boundary of a first portion of the physical space, determining a virtual volume of the first portion of the physical space based on the first input, receiving data associated with to the first portion of the physical space, and storing the virtual volume in association with the received data.

Claims (96)

1 . A method comprising:

accessing, by one or more processors, an image from a computing device, the image comprising a view of a physical space;

receiving, from the computing device, a first input associated with a virtual boundary of a first portion of the physical space, the virtual boundary being defined by two first points in the first portion of the physical space;

determining a position of a camera unit coupled to the computing device;

determining a first virtual volume of the first portion of the physical space based on at least two vectors generated based on at most the two first points;

causing presentation of a representation of the volume on a display of the computer device;

receiving a change in position of the computing device;

modifying the presentation of the representation of the volume on the display in real time as the change in position is being received;

receiving first data associated with the first portion of the physical space, the first data comprising a first room identification, a first set of room dimensions, and first user room preferences;

associating a set of augmented reality content items with the first portion of the physical space based on the first user room preferences, the set of augmented reality content items satisfying a threshold frequency of use by a user of the computing device; and

storing the first virtual volume in association with the first data

identifying an object within the first portion of the physical space;

determining a location of the identified object;

causing display of the set of augmented reality content items on a display of the computing device;

receiving a selection of a singular augmented reality content item from the set of augmented reality content items;

based on a category of the singular augmented reality content item and the location of the identified object, determining a display location for the singular augmented reality content item; and

causing display of the singular augmented reality content item at the display location.

2 . The method of claim 1 , wherein the computing device is a head-wearable apparatus comprising a camera.

3 . The method of claim 1 , wherein determining the first virtual volume further comprises:

generating a first vector representing a distance between the two first points;

generating a second vector representing a gravitational force;

generating a third vector based on an average of heights of the two first points; and

determining the first virtual volume using the first vector, the second vector and the third vector.

4 . The method of claim 2 , wherein the virtual boundary is displayed as an augmented reality content item on a display coupled to the head-wearable apparatus.

5 . The method of claim 2 , wherein receiving the first data associated with the first portion of the physical space comprises:

receiving a user input including the first data from the head-wearable apparatus.

6 . The method of claim 1 , further comprising:

receiving a second input associated with a second virtual boundary of a second portion of the physical space, the second virtual boundary being defined by two second points in the second portion of the physical space;

determining a second virtual volume of the second portion of the physical space based on the second input; and

receiving a second data associated with the second portion of the physical space, the second data comprising a second room identification, a second set of room dimensions, and second user room preferences.

7 . The method of claim 1 , further comprising:

selecting a placement for an augmented reality content item of the set of augmented reality content items in the first portion of the physical space at a location identified by a machine learning model, the machine learning model identifying the location based on a category of the augmented reality content item.

8 . A system comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, configure the system to perform operations comprising:

accessing an image from a computing device, the image comprising a view of a physical space;

receiving, from the computing device, a first input associated with a virtual boundary of a first portion of the physical space, the virtual boundary being defined by two first points in the first portion of the physical space;

determining a position of a camera unit coupled to the computing device;

determining a first virtual volume of the first portion of the physical space based on at least two vectors generated based on at most the two first points;

causing presentation of a representation of the volume on a display of the computer device;

receiving a change in position of the computing device;

modifying the presentation of the representation of the volume on the display in real time as the change in position is being received;

receiving first data associated with the first portion of the physical space, the first data comprising a first room identification, a first set of room dimensions, and first user room preferences;

associating a set of augmented reality content items with the first portion of the physical space based on the first user room preferences, the set of augmented reality content items satisfying a threshold frequency of use by a user of the computing device; and

storing the first virtual volume in association with the first data

identifying an object within the first portion of the physical space;

determining a location of the identified object;

causing display of the set of augmented reality content items on a display of the computing device;

receiving a selection of a singular augmented reality content item from the set of augmented reality content items;

based on a category of the singular augmented reality content item and the location of the identified object, determining a display location for the singular augmented reality content item; and

causing display of the singular augmented reality content item at the display location.

9 . The system of claim 8 , wherein the computing device is a head-wearable apparatus comprising a camera.

10 . The system of claim 8 , wherein determining the first virtual volume further comprises:

generating a first vector representing a distance between the two first points;

generating a second vector representing a gravitational force;

generating a third vector based on an average of heights of the two first points; and

determining the first virtual volume using the first vector, the second vector and the third vector.

11 . The system of claim 9 , wherein the virtual boundary is displayed as an augmented reality content item on a display coupled to the head-wearable apparatus.

12 . The system of claim 9 , wherein receiving the first data associated with the first portion of the physical space comprises:

receiving a user input including the first data from the head-wearable apparatus.

13 . The system of claim 8 , further comprising:

receiving a second input associated with a second virtual boundary of a second portion of the physical space, the second virtual boundary being defined by two second points in the second portion of the physical space;

determining a second virtual volume of the second portion of the physical space based on the second input; and

receiving a second data associated with the second portion of the physical space, the second data comprising a second room identification, a second set of room dimensions, and second user room preferences.

14 . The system of claim 8 , wherein the first user room preferences comprise:

a first set of augmented reality content items associated with the first portion.

15 . A non-transitory computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising:

accessing an image from a computing device, the image comprising a view of a physical space;

receiving, from the computing device, a first input associated with a virtual boundary of a first portion of the physical space, the virtual boundary being defined by two first points in the first portion of the physical space;

determining a position of a camera unit coupled to the computing device;

determining a first virtual volume of the first portion of the physical space based on at least two vectors generated based on at most the two first points;

causing presentation of a representation of the volume on a display of the computer device;

receiving a change in position of the computing device;

modifying the presentation of the representation of the volume on the display in real time as the change in position is being received;

receiving first data associated with the first portion of the physical space, the first data comprising a first room identification, a first set of room dimensions, and first user room preferences;

associating a set of augmented reality content items with the first portion of the physical space based on the first user room preferences, the set of augmented reality content items satisfying a threshold frequency of use by a user of the computing device; and

storing the first virtual volume in association with the first data

identifying an object within the first portion of the physical space;

determining a location of the identified object;

causing display of the set of augmented reality content items on a display of the computing device;

receiving a selection of a singular augmented reality content item from the set of augmented reality content items;

based on a category of the singular augmented reality content item and the location of the identified object, determining a display location for the singular augmented reality content item; and

causing display of the singular augmented reality content item at the display location.

16 . The non-transitory computer-readable storage medium of claim 15 , wherein the computing device is a head-wearable apparatus comprising a camera.

17 . The non-transitory computer-readable storage medium of claim 15 , wherein determining the first virtual volume further comprises:

generating a first vector representing a distance between the two first points;

generating a second vector representing a gravitational force;

generating a third vector based on an average of heights of the two first points; and

determining the first virtual volume using the first vector, the second vector and the third vector.

18 . The non-transitory computer-readable storage medium of claim 16 , wherein the virtual boundary is displayed as an augmented reality content item on a display coupled to the head-wearable apparatus.

19 . The non-transitory computer-readable storage medium of claim 16 , wherein receiving the first data associated with the first portion of the physical space comprises:

receiving a user input including the first data from the head-wearable apparatus.

20 . The non-transitory computer-readable storage medium of claim 15 , further comprising:

receiving a second input associated with a second virtual boundary of a second portion of the physical space, the second virtual boundary being defined by two second points in the second portion of the physical space;

determining a second virtual volume of the second portion of the physical space based on the second input; and

receiving a second data associated with the second portion of the physical space, the second data comprising a second room identification, a second set of room dimensions, and second user room preferences.

Assignments (2)
CORRECTIVE ASSIGNMENT TO CORRECT THE CONVEYING PARTY NAME PREVIOUSLY RECORDED ON REEL 66932 FRAME 837. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 30, 2026
From: BROWN, EDMUND GRAVES
To: SNAP INC.
Reel/Frame 074535/0437 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 28, 2024
From: GRAVES BROWN, EDMUND
To: SNAP INC.
Reel/Frame 066932/0837 →
Continuity (2)
Provisional Application 63168435 · Mar 31, 2021
Related Publication 20220319059A1 · Oct 6, 2022
References Cited (157)
US 6990228B1 · Wiles et al. · 2006 [cited by applicant]
US 7971156B2 · Albertson et al. · 2011 [cited by applicant]
US 8122370B2 · Hoguet · 2012 [cited by examiner]
US 8537156B2 · Sellem · 2013 [cited by examiner]
US 9225897B1 · Sehn et al. · 2015 [cited by applicant]
US 9276886B1 · Samaranayake · 2016 [cited by applicant]
US 9443353B2 · Vaddadi · 2016 [cited by examiner]
US 9705831B2 · Spiegel · 2017 [cited by applicant]
US 9742713B2 · Spiegel et al. · 2017 [cited by applicant]
US 9984510B1 · Kinstner · 2018 [cited by examiner]
US 10025473B2 · Sarao · 2018 [cited by examiner]
US 10102423B2 · Shaburov et al. · 2018 [cited by applicant]
US 10284508B1 · Allen et al. · 2019 [cited by applicant]
US 10304191B1 · Mousavian · 2019 [cited by examiner]
US 10439972B1 · Spiegel et al. · 2019 [cited by applicant]
US 10509466B1 · Miller et al. · 2019 [cited by applicant]
US 10514876B2 · Sehn · 2019 [cited by applicant]
US 10579869B1 · Xiong et al. · 2020 [cited by applicant]
US 10591730B2 · Rodriguez, II et al. · 2020 [cited by applicant]
US 10592973B1 · Eraker · 2020 [cited by examiner]
US 10614855B2 · Huang · 2020 [cited by applicant]
US 10748347B1 · Li et al. · 2020 [cited by applicant]
US 10832480B2 · Lo · 2020 [cited by examiner]
US 10902625B1 · Dunkley · 2021 [cited by examiner]
US 10943403B2 · Canada · 2021 [cited by examiner]
US 10958608B1 · Allen et al. · 2021 [cited by applicant]
US 10962809B1 · Castañeda · 2021 [cited by applicant]
US 10996846B2 · Robertson et al. · 2021 [cited by applicant]
US 10997787B2 · Ge et al. · 2021 [cited by applicant]
US 11003308B1 · Dryer · 2021 [cited by examiner]
US 11004270B2 · Rom · 2021 [cited by examiner]
US 11012390B1 · Al Majid et al. · 2021 [cited by applicant]
US 11024065B1 · Baron · 2021 [cited by examiner]
US 11030454B1 · Xiong et al. · 2021 [cited by applicant]
US 11036368B1 · Al Majid et al. · 2021 [cited by applicant]
US 11062498B1 · Voss et al. · 2021 [cited by applicant]
US 11087728B1 · Canberk et al. · 2021 [cited by applicant]
US 11092998B1 · Castañeda et al. · 2021 [cited by applicant]
US 11106342B1 · Al Majid et al. · 2021 [cited by applicant]
US 11126206B2 · Meisenholder et al. · 2021 [cited by applicant]
US 11126320B1 · Thompson · 2021 [cited by examiner]
US 11143867B2 · Rodriguez, II · 2021 [cited by applicant]
US 11169600B1 · Canberk et al. · 2021 [cited by applicant]
US 11227446B2 · Malia · 2022 [cited by examiner]
US 11227626B1 · Krishnan Gorumkonda et al. · 2022 [cited by applicant]
US 11307747B2 · Dancie et al. · 2022 [cited by applicant]
US 11417054B1 · Tanner · 2022 [cited by examiner]
US 11531402B1 · Stolzenberg · 2022 [cited by applicant]
US 11546505B2 · Canberk · 2023 [cited by applicant]
US 11588897B2 · Berliner et al. · 2023 [cited by applicant]
US 11704879B2 · Lee · 2023 [cited by examiner]
US 11797146B2 · Dryer · 2023 [cited by examiner]
US 11798201B2 · Eirinberg et al. · 2023 [cited by applicant]
US 11876883B2 · Li · 2024 [cited by examiner]
US 20050081161A1 · MacInnes · 2005 [cited by examiner]
US 20060111878A1 · Pendyala · 2006 [cited by examiner]
US 20060244820A1 · Morita et al. · 2006 [cited by applicant]
US 20140149083A1 · Sellem · 2014 [cited by examiner]
US 20140225918A1 · Mittal et al. · 2014 [cited by applicant]
US 20140287779A1 · O'Keefe et al. · 2014 [cited by applicant]
US 20160080732A1 · Pedley et al. · 2016 [cited by applicant]
US 20160147408A1 · Bevis · 2016 [cited by examiner]
US 20170075765A1 · Chen · 2017 [cited by applicant]
US 20170270711A1 · Schoenberg · 2017 [cited by examiner]
US 20170323488A1 · Mott · 2017 [cited by examiner]
US 20180047213A1 · Woo et al. · 2018 [cited by applicant]
US 20180096521A1 · Baumberg · 2018 [cited by applicant]
US 20180322706A1 · Drouin et al. · 2018 [cited by applicant]
US 20190012060A1 · Moore et al. · 2019 [cited by applicant]
US 20190026936A1 · Gorur Sheshagiri · 2019 [cited by examiner]
US 20190033989A1 · Wang · 2019 [cited by examiner]
US 20190060741A1 · Contreras · 2019 [cited by examiner]
US 20190130631A1 · Gebbie · 2019 [cited by examiner]
US 20190146219A1 · Rodriguez, II · 2019 [cited by applicant]
US 20190213389A1 · Peruch · 2019 [cited by examiner]
US 20190325653A1 · Yip · 2019 [cited by examiner]
US 20200105068A1 · Panse et al. · 2020 [cited by applicant]
US 20200258144A1 · Chaturvedi · 2020 [cited by examiner]
US 20210011612A1 · Dancie et al. · 2021 [cited by applicant]
US 20210074016A1 · Li et al. · 2021 [cited by applicant]
US 20210166473A1 · Smith et al. · 2021 [cited by applicant]
US 20210166732A1 · Shaburova et al. · 2021 [cited by applicant]
US 20210174034A1 · Retek et al. · 2021 [cited by applicant]
US 20210241529A1 · Cowburn et al. · 2021 [cited by applicant]
US 20210272537A1 · Mak · 2021 [cited by applicant]
US 20210279852A1 · Jakka · 2021 [cited by examiner]
US 20210303075A1 · Cowburn et al. · 2021 [cited by applicant]
US 20210303077A1 · Anvaripour et al. · 2021 [cited by applicant]
US 20210303140A1 · Mourkogiannis · 2021 [cited by applicant]
US 20210319220A1 · Ichim · 2021 [cited by examiner]
US 20210382564A1 · Blachly et al. · 2021 [cited by applicant]
US 20210389860A1 · Rosenberg · 2021 [cited by examiner]
US 20210397000A1 · Rodriguez, II · 2021 [cited by applicant]
US 20210405761A1 · Canberk · 2021 [cited by applicant]
US 20210409517A1 · Luo et al. · 2021 [cited by applicant]
US 20220100336A1 · Luo et al. · 2022 [cited by applicant]
US 20220188539A1 · Chan et al. · 2022 [cited by applicant]
US 20220206588A1 · Canberk et al. · 2022 [cited by applicant]
US 20220207838A1 · Anvaripour et al. · 2022 [cited by applicant]
US 20220229534A1 · Terre · 2022 [cited by examiner]
US 20220300730A1 · Eirinberg et al. · 2022 [cited by applicant]
US 20220300731A1 · Eirinberg et al. · 2022 [cited by applicant]
US 20220301231A1 · Eirinberg et al. · 2022 [cited by applicant]
US 20220319124A1 · Brown · 2022 [cited by applicant]
US 20220319125A1 · Brown · 2022 [cited by applicant]
US 20220326781A1 · Hwang et al. · 2022 [cited by applicant]
US 20220327608A1 · Assouline et al. · 2022 [cited by applicant]
US 20220334649A1 · Hwang et al. · 2022 [cited by applicant]
US 20220375174A1 · Arya et al. · 2022 [cited by applicant]
US 20220375183A1 · Fleischman · 2022 [cited by examiner]
US 20220382602A1 · Yamamoto · 2022 [cited by examiner]
US 20230004689A1 · Santarone · 2023 [cited by examiner]
US 20230007085A1 · Berliner et al. · 2023 [cited by applicant]
US 20230089061A1 · Hashimoto · 2023 [cited by examiner]
US 20240062490A1 · Maeder et al. · 2024 [cited by applicant]
US 20240143671A1 · Moyers · 2024 [cited by examiner]
US 20240242442A1 · Zhang et al. · 2024 [cited by applicant]
CN 117157608A · 2023 [cited by applicant]
EP 3707693A1 · 2020 [cited by applicant]
EP 4172726A1 · 2023 [cited by applicant]
EP 4172730A1 · 2023 [cited by applicant]
JO 109478124B · 2022 [cited by applicant]
JP 2020520498A · 2020 [cited by applicant]
KR 20220158824A · 2022 [cited by applicant]
WO WO2019094618A1 · 2019 [cited by applicant]
WO WO2022005687A1 · 2022 [cited by applicant]
WO WO2022005693A1 · 2022 [cited by applicant]
WO WO2022060549A2 · 2022 [cited by applicant]
WO WO2022066578A1 · 2022 [cited by applicant]
WO WO2022060549A3 · 2022 [cited by applicant]
WO WO2022132381A1 · 2022 [cited by applicant]
WO WO2022146678A1 · 2022 [cited by applicant]
WO WO2022198182A1 · 2022 [cited by applicant]
WO WO2022212144A1 · 2022 [cited by applicant]
WO WO2022216784A1 · 2022 [cited by applicant]
WO WO2022225761A1 · 2022 [cited by applicant]
WO WO2022245765A1 · 2022 [cited by applicant]
“International Application Serial No. PCT/US2022/021527, International Search Report mailed Jun. 21, 2022”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT/US2022/021527, Written Opinion mailed Jun. 21, 2022”, 8 pgs. [cited by applicant]
“U.S. Appl. No. 17/698,685, Non Final Office Action mailed Mar. 6, 2023”, 17 pgs. [cited by applicant]
“U.S. Appl. No. 17/698,697, Non Final Office Action mailed Mar. 23, 2023”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/698,685, Final Office Action mailed Jul. 25, 2023”, 19 pgs. [cited by applicant]
“U.S. Appl. No. 17/698,685, Non Final Office Action mailed Feb. 7, 2024”, 18 pgs. [cited by applicant]
“U.S. Appl. No. 17/698,685, Response filed Jul. 6, 2023 to Non Final Office Action mailed Mar. 6, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/698,685, Response filed Dec. 22, 2023 to Final Office Action mailed Jul. 25, 2023”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 17/698,697, Final Office Action mailed Sep. 8, 2023”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 17/698,697, Non Final Office Action mailed Mar. 26, 2024”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 17/698,697, Response filed Feb. 8, 2024 to Final Office Action mailed Sep. 8, 2023”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 17/698,697, Response filed Jun. 23, 2023 to Non Final Office Action mailed Mar. 23, 2023”, 9 pgs. [cited by applicant]
“International Application Serial No. PCT/US2022/021527, International Preliminary Report on Patentability mailed Oct. 12, 2023”, 10 pgs. [cited by applicant]
“U.S. Appl. No. 17/698,685, Examiner Interview Summary mailed Aug. 20, 2024”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 17/698,685, Final Office Action mailed Aug. 2, 2024”, 19 pgs. [cited by applicant]
“U.S. Appl. No. 17/698,685, Response filed Jul. 8, 2024 to Non Final Office Action mailed Feb. 7, 2024”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 17/698,697, Response filed Jul. 26, 2024 to Non Final Office Action mailed Mar. 26, 2024”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 17/698,685, Final Office Action mailed Mar. 19, 2025”, 16 pgs. [cited by applicant]
“Korean Application Serial No. 10-2023-7036970, Notice of Preliminary Rejection mailed Apr. 25, 2025”, w/ English Translation, 12 pgs. [cited by applicant]
“Korean Application Serial No. 10-2023-7036970, Response filed Jul. 25, 2025 to Notice of Preliminary Rejection mailed Apr. 25, 2025”, W/English Claims, 27 pgs. [cited by applicant]