IP Library › Granted Patent US 12,267,482
Granted Patent B2
US 12,267,482 · App. 17/900,407 · Granted Apr 1, 2025

Controlling and editing presentation of volumetric content

Inventors: Rajan Vaish (Beverly Hills, CA); Sven Kratz (Mercer Island, WA); Andrés Monroy-Hernández (Princeton, NJ); Brian Anthony Smith (New York, NY)
Assignee: Snap Inc.
H04N13/398G11B27/031H04N13/167H04N13/366H04N13/388
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,267,482
App. No.
17/900,407
Granted
Apr 1, 2025
Kind
B2
Abstract

A display device presents volumetric content comprising a volumetric video. The volumetric video comprises a volumetric representation of one or more elements a three-dimensional space. Input indicative of a control operation associated with the presentation of the volumetric video is received. The presentation of the volumetric video by the display device is controlled by executing the control operation. While the control operation is being executed, the volumetric representation of the one or more elements of the three-dimensional space are displayed from multiple perspectives based on movement of a user.

Claims (103)

1. A method comprising:

causing presentation, by a display device, of a volumetric content comprising a volumetric video, the volumetric video comprising a volumetric representation of one or more elements of a three-dimensional space, the causing of the presentation of the volumetric content comprising causing the display device to present the volumetric representation of the one or more elements overlaid on a real-world environment that is visible to a user of the display device, the presentation of the volumetric video comprising a display of an interactive interface comprising a set of interactive elements overlaid on the real-world environment, the set of interactive elements comprising:

a first interactive element to pause the presentation of the volumetric video;

a second interactive element to fast forward the presentation of the volumetric video; and

a third interactive element to rewind the presentation of the volumetric video;

receiving input indicative of a control operation associated with the presentation of the volumetric content based on an interaction with an interactive element from the set of interactive elements, the control operation comprising one of: a pause operation, a fast-forward operation, or a rewind operation; and

controlling the presentation of the volumetric content by the display device by executing the control operation, the controlling of the presentation of the volumetric content comprising:

tracking movement of the user of the display device within the real-world environment;

causing presentation, by the display device, of the volumetric representation of the one or more elements from multiple perspectives while the control operation is being executed based on the tracked movement of the user of the display device, the executing of the control operation comprising one of:

pausing the presentation of the volumetric video based on the input being indicative of an interaction with the first interactive element;

fast forwarding the presentation of the volumetric video based on the input being indicative of an interaction with the second interactive element; or

rewinding the presentation of the volumetric video based on the input being indicative of an interaction with the third interactive element.

2. The method of claim 1 , further comprising:

receiving an edit to the volumetric video;

editing the volumetric video based on the edit, the editing of the volumetric video resulting in an edited volumetric video; and

causing presentation, by the display device, of the edited volumetric video.

3. The method of claim 2 , wherein receiving the edit comprises receiving input indicative of at least one or more of:

a modification of a content item included in the volumetric video;

a removal of the content item included in the volumetric video;

an addition of a new content item to the volumetric video; and

an application of a filter to the content item in the volumetric video or a real-world object that is visible as part of the presentation of the volumetric content.

4. The method of claim 3 , wherein:

the volumetric video is a first volumetric video;

the receiving of the input indicative of the addition of the new content item to the first volumetric video comprises one of:

receiving a selection of the new content item from a library; and

receiving a selection of the new content item from a second volumetric video.

5. The method of claim 2 , wherein editing the volumetric video comprises at least one of:

modifying a content item included in the volumetric video;

removing the content item included in the volumetric video;

adding a new content item to the volumetric video; and

applying a filter to the content item in the volumetric video or a real-world object that is visible as part of the presentation of the volumetric content.

6. The method of claim 2 , further comprising:

detecting a selection of a content item from the presentation of the volumetric content, wherein the edit corresponds to the content item.

7. The method of claim 2 , further comprising:

causing display of an editing interface within the presentation of the volumetric video, wherein receiving the edit comprising detecting user interaction with the editing interface.

8. The method of claim 1 , wherein the receiving of the input comprises detecting a gesture by a user of the display device.

9. The method of claim 1 , wherein:

the receiving of the input comprises detecting the interaction by a user of the display device with one of the interactive elements of the interactive interface.

10. The method of claim 1 , wherein the control operation further comprises one of:

a stop operation, zoom-in operation, a zoom-out operation, and a playback speed modification.

11. The method of claim 1 , wherein controlling the presentation of the volumetric content by the display device in accordance with the control operation further comprises one of:

stopping the presentation of the volumetric video;

increasing a zoom level of the presentation of the volumetric video;

decreasing the zoom level of the presentation of the volumetric video;

increasing a playback speed of the presentation of the volumetric video; or

decreasing the playback speed of the presentation of the volumetric video.

12. A system comprising:

one or more hardware processors; and

at least one memory storing instructions that cause the one or more hardware processors to perform operations comprising:

causing presentation, by a display device, of a volumetric content comprising a volumetric video, the volumetric video comprising a volumetric representation of one or more elements of a three-dimensional space, the causing of the presentation of the volumetric content comprising causing the display device to present the volumetric representation of the one or more elements overlaid on a real-world environment that is visible to a user of the display device, the presentation of the volumetric video comprising a display of an interactive interface comprising a set of interactive elements overlaid on the real-world environment, the set of interactive elements comprising:

a first interactive element to pause the presentation of the volumetric video;

a second interactive element to fast forward the presentation of the volumetric video; and

a third interactive element to rewind the presentation of the volumetric video;

receiving input indicative of a control operation associated with the presentation of the volumetric content, the control operation comprising one of:

a pause operation, a fast-forward operation, or a rewind operation; and

controlling the presentation of the volumetric content by the display device by executing the control operation, the controlling of the presentation of the volumetric content comprising:

tracking movement of the user of the display device within the real-world environment;

causing presentation, by the display device, of the volumetric representation of the one or more elements from multiple perspectives while the control operation is being executed based on the tracked movement of the user of the display device, the executing of the control operation comprising one of:

pausing the presentation of the volumetric video based on the input being indicative of an interaction with the first interactive element;

fast forwarding the presentation of the volumetric video based on the input being indicative of an interaction with the second interactive element; or

rewinding the presentation of the volumetric video based on the input being indicative of an interaction with the third interactive element.

13. The system of claim 12 , further comprising:

receiving an edit to the volumetric video;

editing the volumetric video based on the edit, the editing of the volumetric video resulting in an edited volumetric video; and

causing presentation, by the display device, of the edited volumetric video.

14. The system of claim 13 , wherein receiving the edit comprises receiving input indicative of at least one or more of:

a modification of a content item included in the volumetric video;

a removal of the content item included in the volumetric video;

an addition of a new content item to the volumetric video; and

an application of a filter to the content item in the volumetric video or a real-world object that is visible as part of the presentation of the volumetric content.

15. The system of claim 13 , wherein editing the volumetric video comprises at least one of:

modifying a content item included in the volumetric video;

removing the content item included in the volumetric video;

adding a new content item to the volumetric video; and

applying a filter to the content item in the volumetric video or a real-world object that is visible as part of the presentation of the volumetric content.

16. The system of claim 13 , further comprising:

receiving a selection of a content item from the presentation of the volumetric content, wherein the edit corresponds to the content item.

17. The system of claim 12 , wherein the receiving of the input comprises at least one of:

detecting a gesture by a user of the display device;

detecting the interaction by a user of the display device with one of the interactive elements of the interactive interface provided with the presentation of the volumetric video; and

receiving an input signal from a physical input element that is communicatively coupled with the display device.

18. The system of claim 12 , wherein controlling the presentation of the volumetric content by the display device in accordance with the control operation further comprises one of:

stopping the presentation of the volumetric video;

increasing a zoom level of the presentation of the volumetric video;

decreasing the zoom level of the presentation of the volumetric video;

increasing a playback speed of the presentation of the volumetric video; or

decreasing the playback speed of the presentation of the volumetric video.

19. A machine-readable medium storing instructions that, when executed by a computer system, cause the computer system to perform operations comprising:

causing presentation, by a display device, of a volumetric content comprising a volumetric video, the volumetric video comprising a volumetric representation of one or more elements of a three-dimensional space, the causing of the presentation of the volumetric content comprising causing the display device to present the volumetric representation of the one or more elements overlaid on a real-world environment that is visible to a user of the display device, the presentation of the volumetric video comprising a display of an interactive interface comprising a set of interactive elements overlaid on the real-world environment, the set of interactive elements comprising:

a first interactive element to pause the presentation of the volumetric video;

a second interactive element to fast forward the presentation of the volumetric video; and

a third interactive element to rewind the presentation of the volumetric video;

receiving input indicative of a control operation associated with the presentation of the volumetric content based on an interaction with an interactive element from the set of interactive elements, the control operation comprising one of: a pause operation, a fast-forward operation, or a rewind operation; and

controlling the presentation of the volumetric content by the display device by executing the control operation, the controlling of the presentation of the volumetric content comprising:

tracking movement of the user of the display device within the real-world environment;

causing presentation, by the display device, of the volumetric representation of the one or more elements from multiple perspectives while the control operation is being executed based on the tracked movement of the user of the display device, the executing of the control operation comprising one of:

pausing the presentation of the volumetric video based on the input being indicative of an interaction with the first interactive element;

fast forwarding the presentation of the volumetric video based on the input being indicative of an interaction with the second interactive element; or

rewinding the presentation of the volumetric video based on the input being indicative of an interaction with the third interactive element.

20. The machine-readable medium of claim 19 , further comprising:

receiving an edit to the volumetric video;

editing the volumetric video based on the edit, the editing of the volumetric video resulting in an edited volumetric video; and

causing presentation, by the display device, of the edited volumetric video.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2022
From: VAISH, RAJAN; KRATZ, SVEN; MONROY-HERNÁNDEZ, ANDRÉS; SMITH, BRIAN ANTHONY
To: SNAP INC.
Reel/Frame 060958/0739 →
Continuity (1)
Related Publication 20240073404A1 · Feb 29, 2024
References Cited (395)
US 4807158A · Blanton et al. · 1989 [cited by applicant]
US 6038295A · Mattes · 2000 [cited by applicant]
US 6430997B1 · French et al. · 2002 [cited by applicant]
US 6819982B2 · Doane · 2004 [cited by applicant]
US 6980909B2 · Root et al. · 2005 [cited by applicant]
US 7173651B1 · Knowles · 2007 [cited by applicant]
US 7190496B2 · Klug et al. · 2007 [cited by applicant]
US 7411493B2 · Smith · 2008 [cited by applicant]
US 7535890B2 · Rojas · 2009 [cited by applicant]
US 7542073B2 · Li et al. · 2009 [cited by applicant]
US 8046719B2 · Skourup et al. · 2011 [cited by applicant]
US 8131597B2 · Hudetz · 2012 [cited by applicant]
US 8174562B2 · Hartman · 2012 [cited by applicant]
US 8199747B2 · Rojas et al. · 2012 [cited by applicant]
US 8274550B2 · Steuart, III · 2012 [cited by applicant]
US 8332475B2 · Rosen et al. · 2012 [cited by applicant]
US 8608563B2 · Miyazaki et al. · 2013 [cited by applicant]
US 8646720B2 · Shaw · 2014 [cited by applicant]
US 8718333B2 · Wolf et al. · 2014 [cited by applicant]
US 8724622B2 · Rojas · 2014 [cited by applicant]
US 8874677B2 · Rosen et al. · 2014 [cited by applicant]
US 8909679B2 · Root et al. · 2014 [cited by applicant]
US 8934015B1 · Chi et al. · 2015 [cited by applicant]
US 8995433B2 · Rojas · 2015 [cited by applicant]
US 9040574B2 · Wang et al. · 2015 [cited by applicant]
US 9055416B2 · Rosen et al. · 2015 [cited by applicant]
US 9100806B2 · Rosen et al. · 2015 [cited by applicant]
US 9100807B2 · Rosen et al. · 2015 [cited by applicant]
US 9186548B2 · House et al. · 2015 [cited by applicant]
US 9191776B2 · Root et al. · 2015 [cited by applicant]
US 9204252B2 · Root · 2015 [cited by applicant]
US 9235932B2 · Choi et al. · 2016 [cited by applicant]
US 9344642B2 · Niemi et al. · 2016 [cited by applicant]
US 9345711B2 · Friedhoff · 2016 [cited by applicant]
US 9443227B2 · Evans et al. · 2016 [cited by applicant]
US 9445081B1 · Kouperman et al. · 2016 [cited by applicant]
US 9471059B1 · Wilkins · 2016 [cited by applicant]
US 9489661B2 · Evans et al. · 2016 [cited by applicant]
US 9489937B1 · Beard et al. · 2016 [cited by applicant]
US 9491134B2 · Rosen et al. · 2016 [cited by applicant]
US 9576369B2 · Venkataraman et al. · 2017 [cited by applicant]
US 9589448B1 · Schneider et al. · 2017 [cited by applicant]
US 9681046B2 · Adsumilli et al. · 2017 [cited by applicant]
US 9703369B1 · Mullen · 2017 [cited by applicant]
US 9723272B2 · Lu et al. · 2017 [cited by applicant]
US 9747901B1 · Gentry · 2017 [cited by applicant]
US 9761057B2 · Salter et al. · 2017 [cited by applicant]
US 9779538B2 · Sanders et al. · 2017 [cited by applicant]
US 9794527B1 · Balez et al. · 2017 [cited by applicant]
US 9818225B2 · Wang et al. · 2017 [cited by applicant]
US 9916673B2 · Castro et al. · 2018 [cited by applicant]
US 9922659B2 · Bradlow et al. · 2018 [cited by applicant]
US 9989965B2 · Cuban et al. · 2018 [cited by applicant]
US 10061328B2 · Canoy et al. · 2018 [cited by applicant]
US 10109224B1 · Ratti et al. · 2018 [cited by applicant]
US 10140987B2 · Erickson et al. · 2018 [cited by applicant]
US 10168700B2 · Gordon et al. · 2019 [cited by applicant]
US 10282903B1 · Clark et al. · 2019 [cited by applicant]
US 10289193B2 · Hardy et al. · 2019 [cited by applicant]
US 10313481B2 · Kada · 2019 [cited by applicant]
US 10325410B1 · Smith et al. · 2019 [cited by applicant]
US 10365784B2 · Inomata · 2019 [cited by applicant]
US 10370118B1 · Nielsen et al. · 2019 [cited by applicant]
US 10403050B1 · Beall et al. · 2019 [cited by applicant]
US 10445925B2 · Tokubo · 2019 [cited by applicant]
US 10482665B2 · Copic et al. · 2019 [cited by applicant]
US 10501180B2 · Yu · 2019 [cited by applicant]
US 10504277B1 · Haitani et al. · 2019 [cited by applicant]
US 10581940B1 · Iyer et al. · 2020 [cited by applicant]
US 10599286B2 · Inomata · 2020 [cited by applicant]
US 10616663B2 · Davisson et al. · 2020 [cited by applicant]
US 10768639B1 · Meisenholder et al. · 2020 [cited by applicant]
US 10768776B1 · Roche et al. · 2020 [cited by applicant]
US 10796489B1 · Cordes et al. · 2020 [cited by applicant]
US 10819946B1 · Tanumihardja et al. · 2020 [cited by applicant]
US 10901215B1 · Newcombe et al. · 2021 [cited by applicant]
US 10937239B2 · Huston et al. · 2021 [cited by applicant]
US 11006095B2 · Holzer et al. · 2021 [cited by applicant]
US 11051049B2 · Bustamante et al. · 2021 [cited by applicant]
US 11062517B2 · Crews et al. · 2021 [cited by applicant]
US 11094127B2 · Mccall · 2021 [cited by applicant]
US 11126206B2 · Meisenholder et al. · 2021 [cited by applicant]
US 11156830B2 · Johnson et al. · 2021 [cited by applicant]
US 11194439B2 · Laaksonen et al. · 2021 [cited by applicant]
US 11200028B2 · Newell et al. · 2021 [cited by applicant]
US 11200742B1 · Post et al. · 2021 [cited by applicant]
US 11302077B2 · Kang et al. · 2022 [cited by applicant]
US 11372474B2 · Schweet et al. · 2022 [cited by applicant]
US 11413514B2 · Marty et al. · 2022 [cited by applicant]
US 11436806B1 · Katz · 2022 [cited by applicant]
US 11468605B2 · Corson · 2022 [cited by applicant]
US 11481423B1 · Singleton · 2022 [cited by applicant]
US 11481980B2 · Yerli · 2022 [cited by applicant]
US 11495004B1 · Henry · 2022 [cited by applicant]
US 11623138B2 · Yeh et al. · 2023 [cited by applicant]
US 11734905B1 · Henry · 2023 [cited by applicant]
US 11810259B2 · Ramani et al. · 2023 [cited by applicant]
US 11847749B2 · Lebeaupin et al. · 2023 [cited by applicant]
US 11941764B2 · Harding et al. · 2024 [cited by applicant]
US 11972521B2 · Vaish et al. · 2024 [cited by applicant]
US 20040135890A1 · Kaneko et al. · 2004 [cited by applicant]
US 20060287025A1 · French · 2006 [cited by applicant]
US 20070167689A1 · Ramadas et al. · 2007 [cited by applicant]
US 20070250526A1 · Hanna · 2007 [cited by applicant]
US 20080081676A1 · Chakraborty et al. · 2008 [cited by applicant]
US 20080158256A1 · Russell et al. · 2008 [cited by applicant]
US 20080186255A1 · Cohen et al. · 2008 [cited by applicant]
US 20080211771A1 · Richardson · 2008 [cited by applicant]
US 20080255842A1 · Simhi · 2008 [cited by applicant]
US 20090122133A1 · Hartman · 2009 [cited by applicant]
US 20090171902A1 · Maclaurin et al. · 2009 [cited by applicant]
US 20090187389A1 · Dobbins et al. · 2009 [cited by applicant]
US 20090213114A1 · Dobbins et al. · 2009 [cited by applicant]
US 20100026809A1 · Curry · 2010 [cited by applicant]
US 20100125799A1 · Roberts et al. · 2010 [cited by applicant]
US 20100185984A1 · Wright et al. · 2010 [cited by applicant]
US 20100260422A1 · Ito et al. · 2010 [cited by applicant]
US 20110179313A1 · Macdonald et al. · 2011 [cited by applicant]
US 20110202598A1 · Evans et al. · 2011 [cited by applicant]
US 20110242134A1 · Miller et al. · 2011 [cited by applicant]
US 20110261083A1 · Wilson · 2011 [cited by applicant]
US 20120052947A1 · Yun · 2012 [cited by applicant]
US 20120188452A1 · Keiser · 2012 [cited by examiner]
US 20120194420A1 · Osterhout et al. · 2012 [cited by applicant]
US 20120209924A1 · Evans et al. · 2012 [cited by applicant]
US 20120263154A1 · Blanchflower et al. · 2012 [cited by applicant]
US 20120281885A1 · Syrdal et al. · 2012 [cited by applicant]
US 20120287274A1 · Bevirt · 2012 [cited by applicant]
US 20120320169A1 · Bathiche · 2012 [cited by examiner]
US 20130056581A1 · Sparks · 2013 [cited by applicant]
US 20130072296A1 · Miyazaki et al. · 2013 [cited by applicant]
US 20130083009A1 · Geisner et al. · 2013 [cited by applicant]
US 20130083173A1 · Geisner et al. · 2013 [cited by applicant]
US 20130162632A1 · Varga et al. · 2013 [cited by applicant]
US 20130238168A1 · Reyes · 2013 [cited by applicant]
US 20140013228A1 · Hutten · 2014 [cited by applicant]
US 20140038708A1 · Davison et al. · 2014 [cited by applicant]
US 20140254896A1 · Zhou et al. · 2014 [cited by applicant]
US 20140357366A1 · Koganezawa et al. · 2014 [cited by applicant]
US 20150015486A1 · Osman et al. · 2015 [cited by applicant]
US 20150016777A1 · Abovitz · 2015 [cited by examiner]
US 20150022432A1 · Stewart et al. · 2015 [cited by applicant]
US 20150035862A1 · Fischer et al. · 2015 [cited by applicant]
US 20150070272A1 · Kim et al. · 2015 [cited by applicant]
US 20150175263A1 · Reyes · 2015 [cited by applicant]
US 20150193979A1 · Grek · 2015 [cited by applicant]
US 20150199022A1 · Gottesman et al. · 2015 [cited by applicant]
US 20150287246A1 · Huston et al. · 2015 [cited by applicant]
US 20150331490A1 · Yamada · 2015 [cited by applicant]
US 20150355711A1 · Rihn · 2015 [cited by applicant]
US 20150362917A1 · Wang et al. · 2015 [cited by applicant]
US 20150363034A1 · Hinckley et al. · 2015 [cited by applicant]
US 20160004390A1 · Laska et al. · 2016 [cited by applicant]
US 20160027218A1 · Salter et al. · 2016 [cited by applicant]
US 20160063987A1 · Xu et al. · 2016 [cited by applicant]
US 20160071548A1 · House et al. · 2016 [cited by applicant]
US 20160133230A1 · Daniels et al. · 2016 [cited by applicant]
US 20160161946A1 · Wuth Sepulveda et al. · 2016 [cited by applicant]
US 20160179096A1 · Bradlow et al. · 2016 [cited by applicant]
US 20160292575A1 · Weast et al. · 2016 [cited by applicant]
US 20160292886A1 · Erad et al. · 2016 [cited by applicant]
US 20160307335A1 · Perry et al. · 2016 [cited by applicant]
US 20160307573A1 · Wobrock · 2016 [cited by applicant]
US 20160330532A1 · Bostick et al. · 2016 [cited by applicant]
US 20160336020A1 · Bradlow et al. · 2016 [cited by applicant]
US 20160350973A1 · Shapira et al. · 2016 [cited by applicant]
US 20160357258A1 · Yeom et al. · 2016 [cited by applicant]
US 20170031369A1 · Liu et al. · 2017 [cited by applicant]
US 20170061700A1 · Urbach et al. · 2017 [cited by applicant]
US 20170084051A1 · Weising et al. · 2017 [cited by applicant]
US 20170094259A1 · Kouperman et al. · 2017 [cited by applicant]
US 20170099424A1 · Jones · 2017 [cited by applicant]
US 20170102699A1 · Anderson · 2017 [cited by applicant]
US 20170177925A1 · Volkart · 2017 [cited by applicant]
US 20170208103A1 · Sarmova · 2017 [cited by applicant]
US 20170225796A1 · Sun et al. · 2017 [cited by applicant]
US 20170228690A1 · Kohli · 2017 [cited by applicant]
US 20170237940A1 · Chaney et al. · 2017 [cited by applicant]
US 20170244937A1 · Meier et al. · 2017 [cited by applicant]
US 20170256040A1 · Grauer · 2017 [cited by applicant]
US 20170266554A1 · Marks et al. · 2017 [cited by applicant]
US 20170269685A1 · Marks et al. · 2017 [cited by applicant]
US 20170320564A1 · Kuzikov · 2017 [cited by applicant]
US 20170324841A1 · Clement et al. · 2017 [cited by applicant]
US 20170337791A1 · Gordon-carroll · 2017 [cited by applicant]
US 20170359624A1 · Englert et al. · 2017 [cited by applicant]
US 20170364153A1 · Kazansky et al. · 2017 [cited by applicant]
US 20170365098A1 · Auten et al. · 2017 [cited by applicant]
US 20170365102A1 · Huston et al. · 2017 [cited by applicant]
US 20170371353A1 · Millinger, III · 2017 [cited by applicant]
US 20180005429A1 · Osman et al. · 2018 [cited by applicant]
US 20180059783A1 · Van Hoff et al. · 2018 [cited by applicant]
US 20180082682A1 · Erickson et al. · 2018 [cited by applicant]
US 20180098059A1 · Valdivia et al. · 2018 [cited by applicant]
US 20180130257A1 · Moran · 2018 [cited by applicant]
US 20180154232A1 · Gentil · 2018 [cited by examiner]
US 20180246529A1 · Hu et al. · 2018 [cited by applicant]
US 20180270427A1 · Damstra et al. · 2018 [cited by applicant]
US 20180288364A1 · Virhiä · 2018 [cited by applicant]
US 20180311585A1 · Osman · 2018 [cited by applicant]
US 20180329486A1 · Williams et al. · 2018 [cited by applicant]
US 20190005728A1 · Leppanen · 2019 [cited by examiner]
US 20190011921A1 · Wang et al. · 2019 [cited by applicant]
US 20190054379A1 · Ackley et al. · 2019 [cited by applicant]
US 20190073831A1 · Kim · 2019 [cited by applicant]
US 20190073832A1 · Kim · 2019 [cited by applicant]
US 20190130599A1 · Gebbie et al. · 2019 [cited by applicant]
US 20190130631A1 · Gebbie et al. · 2019 [cited by applicant]
US 20190138260A1 · Rogers et al. · 2019 [cited by applicant]
US 20190172265A1 · Cossairt et al. · 2019 [cited by applicant]
US 20190182471A1 · Khalid et al. · 2019 [cited by applicant]
US 20190188895A1 · Miller, IV et al. · 2019 [cited by applicant]
US 20190199993A1 · Babu J D · 2019 [cited by examiner]
US 20190208189A1 · Lau et al. · 2019 [cited by applicant]
US 20190217189A1 · Gutierrez et al. · 2019 [cited by applicant]
US 20190278369A1 · Ballard · 2019 [cited by applicant]
US 20190325654A1 · Stisser et al. · 2019 [cited by applicant]
US 20190358547A1 · Mack et al. · 2019 [cited by applicant]
US 20200042160A1 · Gabbi et al. · 2020 [cited by applicant]
US 20200043235A1 · Chapman et al. · 2020 [cited by applicant]
US 20200066043A1 · Graham et al. · 2020 [cited by applicant]
US 20200097077A1 · Nguyen et al. · 2020 [cited by applicant]
US 20200098179A1 · Gough et al. · 2020 [cited by applicant]
US 20200098191A1 · Mccall · 2020 [cited by applicant]
US 20200101372A1 · Drake et al. · 2020 [cited by applicant]
US 20200126257A1 · Tauber · 2020 [cited by applicant]
US 20200134911A1 · Van Hoff et al. · 2020 [cited by applicant]
US 20200159361A1 · Rosenberg et al. · 2020 [cited by applicant]
US 20200169715A1 · Liu et al. · 2020 [cited by applicant]
US 20200171394A1 · Khan et al. · 2020 [cited by applicant]
US 20200241575A1 · Meisenholder et al. · 2020 [cited by applicant]
US 20200242840A1 · Logan et al. · 2020 [cited by applicant]
US 20200257367A1 · Rihn et al. · 2020 [cited by applicant]
US 20200260149A1 · Ding et al. · 2020 [cited by applicant]
US 20200273243A1 · Duffy · 2020 [cited by examiner]
US 20200279407A1 · Liljeroos · 2020 [cited by examiner]
US 20200289935A1 · Azmandian et al. · 2020 [cited by applicant]
US 20200314323A1 · Van Geel et al. · 2020 [cited by applicant]
US 20200341541A1 · Olah-Reiken et al. · 2020 [cited by applicant]
US 20200349751A1 · Bentovim et al. · 2020 [cited by applicant]
US 20200371737A1 · Leppänen et al. · 2020 [cited by applicant]
US 20200394012A1 · Wright, Jr. et al. · 2020 [cited by applicant]
US 20200409451A1 · Mukherjea et al. · 2020 [cited by applicant]
US 20210096543A1 · Stump et al. · 2021 [cited by applicant]
US 20210142578A1 · Weinheimer et al. · 2021 [cited by applicant]
US 20210159980A1 · Ben-Yehuda et al. · 2021 [cited by applicant]
US 20210232632A1 · Howard · 2021 [cited by applicant]
US 20210272367A1 · Richter · 2021 [cited by applicant]
US 20210279962A1 · Hutten et al. · 2021 [cited by applicant]
US 20210286179A1 · Miller, IV et al. · 2021 [cited by applicant]
US 20210287452A1 · Maruyama · 2021 [cited by applicant]
US 20210289317A1 · Son et al. · 2021 [cited by applicant]
US 20210312684A1 · Zimmermann et al. · 2021 [cited by applicant]
US 20210327145A1 · Noorkami et al. · 2021 [cited by applicant]
US 20210362848A1 · Spencer · 2021 [cited by applicant]
US 20210382503A1 · Meisenholder et al. · 2021 [cited by applicant]
US 20210390953A1 · Makker et al. · 2021 [cited by applicant]
US 20210405772A1 · Canberk et al. · 2021 [cited by applicant]
US 20210407178A1 · Zhou et al. · 2021 [cited by applicant]
US 20220014723A1 · Pandey et al. · 2022 [cited by applicant]
US 20220028108A1 · Haapoja et al. · 2022 [cited by applicant]
US 20220028170A1 · Haapoja et al. · 2022 [cited by applicant]
US 20220053219A1 · Bathory · 2022 [cited by applicant]
US 20220101593A1 · Rockel et al. · 2022 [cited by applicant]
US 20220103969A1 · Drummond et al. · 2022 [cited by applicant]
US 20220108539A1 · Nussbaum et al. · 2022 [cited by applicant]
US 20220116581A1 · Miyata et al. · 2022 [cited by applicant]
US 20220124143A1 · Rafkind et al. · 2022 [cited by applicant]
US 20220139055A1 · Palmaro · 2022 [cited by applicant]
US 20220146833A1 · Miller, IV et al. · 2022 [cited by applicant]
US 20220164491A1 · Palmaro · 2022 [cited by examiner]
US 20220189075A1 · Lynch et al. · 2022 [cited by applicant]
US 20220197485A1 · Goodrich et al. · 2022 [cited by applicant]
US 20220198603A1 · Goodrich et al. · 2022 [cited by applicant]
US 20220230663A1 · Sun et al. · 2022 [cited by applicant]
US 20220242450A1 · Sokolov et al. · 2022 [cited by applicant]
US 20220244835A1 · Faulkner et al. · 2022 [cited by applicant]
US 20220247929A1 · Yang et al. · 2022 [cited by applicant]
US 20220269336A1 · Lafontaine et al. · 2022 [cited by applicant]
US 20220274026A1 · Steigelfest et al. · 2022 [cited by applicant]
US 20220362631A1 · Hong · 2022 [cited by applicant]
US 20230063505A1 · Chastain et al. · 2023 [cited by applicant]
US 20230139337A1 · Noam et al. · 2023 [cited by applicant]
US 20230173367A1 · Marty et al. · 2023 [cited by applicant]
US 20230179641A1 · Bauer et al. · 2023 [cited by applicant]
US 20230237192A1 · Kahan et al. · 2023 [cited by applicant]
US 20230316681A1 · Dolev et al. · 2023 [cited by applicant]
US 20230334754A1 · Kirchmayer et al. · 2023 [cited by applicant]
US 20230341928A1 · Traynor et al. · 2023 [cited by applicant]
US 20230342989A1 · Lehtiniemi et al. · 2023 [cited by applicant]
US 20230409114A1 · Sun et al. · 2023 [cited by applicant]
US 20230412480A1 · Greyson et al. · 2023 [cited by applicant]
US 20240005623A1 · Cooper et al. · 2024 [cited by applicant]
US 20240069626A1 · Vaish et al. · 2024 [cited by applicant]
US 20240069627A1 · Vaish et al. · 2024 [cited by applicant]
US 20240069637A1 · Vaish et al. · 2024 [cited by applicant]
US 20240070969A1 · Vaish et al. · 2024 [cited by applicant]
US 20240071004A1 · Vaish et al. · 2024 [cited by applicant]
US 20240071006A1 · Kratz et al. · 2024 [cited by applicant]
US 20240071007A1 · Vaish et al. · 2024 [cited by applicant]
US 20240071008A1 · Vaish et al. · 2024 [cited by applicant]
US 20240073402A1 · Vaish et al. · 2024 [cited by applicant]
US 20240119679A1 · Canberk et al. · 2024 [cited by applicant]
US 20240119682A1 · Rudman et al. · 2024 [cited by applicant]
US 20240233224A1 · Fan et al. · 2024 [cited by applicant]
US 20240273832A1 · Newman et al. · 2024 [cited by applicant]
CA 2887596 · 2015 [cited by applicant]
CN 105912129 · 2016 [cited by applicant]
JP 2010061452 · 2010 [cited by applicant]
KR 20200014587 · 2020 [cited by applicant]
KR 20200109812 · 2020 [cited by applicant]
KR 20210065423 · 2021 [cited by applicant]
KR 20210135859 · 2021 [cited by applicant]
KR 20220064130 · 2022 [cited by applicant]
WO 2016105839 · 2016 [cited by applicant]
WO 2021002788 · 2021 [cited by applicant]
WO 2024049687 · 2024 [cited by applicant]
WO 2024049700 · 2024 [cited by applicant]
WO 2024050229 · 2024 [cited by applicant]
WO 2024050231 · 2024 [cited by applicant]
WO 2024050232 · 2024 [cited by applicant]
WO 2024050245 · 2024 [cited by applicant]
WO 2024050259 · 2024 [cited by applicant]
WO 2024050262 · 2024 [cited by applicant]
WO 2024050264 · 2024 [cited by applicant]
WO WO2024050246A1 · 2024 [cited by applicant]
US 10,656,660 B1, 05/2020, Meisenholder et al. (withdrawn) [cited by applicant]
Laput, Gierad, “PixelTone: A Multimodal Interface for Image Editing”, ACM, Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Paris, FR, (2013), 10 pgs. [cited by applicant]
Leyden, John, “This SMS will self-destruct in 40 seconds”, [Online] Retrieved from the Internet: URL: http: www.theregister.co.uk 2005 12 12 stealthtext , (Dec. 12, 2005), 1 pg. [cited by applicant]
Meisenholder, David, “Remoteless Control of Drone Behavior”, U.S. Appl. No. 15/640,143, filed Jun. 30, 2017, 108 pgs. [cited by applicant]
Pourmehr, Shokoofeh, “‘You two! Take off!’: Creating, Modifying, and Commanding Groups of Robots Using Face Engagement and Indirect Speech in Voice Commands”, IEEE RSJ International Conference on Intelligent Robots and … [cited by applicant]
Yamada, Wataru, “iSphere: Self-Luminous Spherical Drone Display”, Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST), Quebec City, CA, (Oct. 22-25, 2017), 635-343. [cited by applicant]
“International Application Serial No. PCT/US2023/072568, International Search Report mailed Dec. 5, 2023”, 3 pgs. [cited by applicant]
“International Application Serial No. PCT/US2023/072568, Written Opinion mailed Dec. 5, 2023”, 4 pgs. [cited by applicant]
“U.S. Appl. No. 17/899,970, Non Final Office Action mailed Jul. 3, 2023”, 22 pgs. [cited by applicant]
“U.S. Appl. No. 18/056,142, Non Final Office Action mailed Aug. 7, 2023”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 17/899,970, Response filed Oct. 3, 2023 to Non Final Office Action mailed Jul. 3, 2023”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 18/056,142, Response filed Nov. 7, 2023 to Non Final Office Action mailed Aug. 7, 2023”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/900,200, Non Final Office Action mailed Nov. 8, 2023”, 26 pgs. [cited by applicant]
“U.S. Appl. No. 18/056,142, Examiner Interview Summary mailed Nov. 7, 2023”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 18/056,142, Notice of Non-Compliant Amendment mailed Nov. 16, 2023”, 2 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 072274, International Search Report mailed Nov. 28, 2023”, 3 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 072274, Written Opinion mailed Nov. 28, 2023”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 072701, International Search Report mailed Dec. 1, 2023”, 3 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 072701, Written Opinion mailed Dec. 1, 2023”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 072718, International Search Report mailed Dec. 1, 2023”, 3 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 072718, Written Opinion mailed Dec. 1, 2023”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 072282, International Search Report mailed Dec. 1, 2023”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 072282, Written Opinion mailed Dec. 1, 2023”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 072277, International Search Report mailed Dec. 8, 2023”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 072277, Written Opinion mailed Dec. 8, 2023”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 030926, International Search Report mailed Dec. 12, 2023”, 3 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 030926, Written Opinion mailed Dec. 12, 2023”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 072557, International Search Report mailed Dec. 12, 2023”, 3 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 072557, Written Opinion mailed Dec. 12, 2023”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 072726, International Search Report mailed Dec. 12, 2023”, 3 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 072726, Written Opinion mailed Dec. 12, 2023”, 4 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 031066, International Search Report mailed Dec. 15, 2023”, 3 pgs. [cited by applicant]
“International Application Serial No. PCT US2023 031066, Written Opinion mailed Dec. 15, 2023”, 3 pgs. [cited by applicant]
“U.S. Appl. No. 17/899,970, Notice of Allowance mailed Dec. 20, 2023”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 17/899,970, Corrected Notice of Allowability mailed Jan. 3, 2024”, 5 pgs. [cited by applicant]
“U.S. Appl. No. 18/056,142, Response filed Jan. 3, 2024 to Notice of Non-Compliant Amendment mailed Nov. 16, 2023”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/900,200, Response filed Jan. 31, 2024 to Non Final Office Action mailed Nov. 8, 2023”, 14 pgs. [cited by applicant]
“U.S. Appl. No. 18/058,175, Non Final Office Action mailed Mar. 11, 2024”, 14 pgs. [cited by applicant]
“U.S. Appl. No. 17/899,970, 312 Amendment filed Mar. 20, 2024”, 7 pgs. [cited by applicant]
“U.S. Appl. No. 17/899,970, PTO Response to Rule 312 Communication mailed Mar. 27, 2024”, 1 page. [cited by applicant]
“U.S. Appl. No. 17/899,970, Supplemental Notice of Allowability mailed Mar. 27, 2024”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 18/056,142, Final Office Action mailed Apr. 8, 2024”, 15 pgs. [cited by applicant]
“U.S. Appl. No. 17/900,200, Final Office Action mailed May 6, 2024”, 32 pgs. [cited by applicant]
“U.S. Appl. No. 17/899,935, Non Final Office Action mailed Jun. 6, 2024”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 18/058,175, Examiner Interview Summary mailed Jun. 7, 2024”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 18/058,175, Response filed Jun. 11, 2024 to Non Final Office Action mailed Mar. 11, 2024”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 18/056,142, Response filed Jul. 8, 2024 to Final Office Action mailed Apr. 8, 2024”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 17/900,200, Response filed Aug. 6, 2024 to Final Office Action mailed May 6, 2024”, 13 pgs. [cited by applicant]
“U.S. Appl. No. 18/056,142, Notice of Allowance mailed Aug. 16, 2024”, 9 pgs. [cited by applicant]
Ko, Jonggook, “Hybrid Camera Based Real-Time Human Body Segmentation for Virtual Reality E-learning System”, First ACIS JNU International Conference on Computers Networks Systems and Industrial Engineering Jeju Korea So… [cited by applicant]
Langa, Sergi Fernandez, “Multiparty Holomeetings Toward a New Era of Low Cost Volumetric Holographic Meetings in Virtual Reality”, IEEE Access vol. 10, (Aug. 3, 2022), 21 pgs. [cited by applicant]
U.S. Appl. No. 17/900,200, filed Aug. 31, 2022, Multi-Perspective Augmented Reality Experience. [cited by applicant]
U.S. Appl. No. 17/900,436, filed Aug. 31, 2022, Contextual Memory Experience Triggers System. [cited by applicant]
U.S. Appl. No. 17/899,970 U.S. Pat. No. 11,972,521, filed Aug. 31, 2022, Multisensorial Presentation of Volumetric Content. [cited by applicant]
U.S. Appl. No. 18/056,142, filed Nov. 16, 2022, Touch-Based Augmented Reality Experience. [cited by applicant]
U.S. Appl. No. 18/058,175, filed Nov. 22, 2022, Mixing and Matching Volumetric Contents for New Augmented Reality Experiences. [cited by applicant]
U.S. Appl. No. 17/899,935, filed Aug. 31, 2022, Social Memory Re-Experiencing System. [cited by applicant]
U.S. Appl. No. 18/169,631, filed Feb. 15, 2023, Multi-Dimensional Experience Presentation Using Augmented Reality. [cited by applicant]
U.S. Appl. No. 17/900,354, filed Aug. 31, 2022, Timelapse Re-Experiencing System. [cited by applicant]
U.S. Appl. No. 18/170,271, filed Feb. 16, 2023, Generating Immersive Augmented Reality Experiences From Existing Images and Videos. [cited by applicant]
“U.S. Appl. No. 17/899,935, Response filed Oct. 7, 2024 to Non Final Office Action mailed Jun. 6, 2024”, 11 pgs. [cited by applicant]
“U.S. Appl. No. 17/900,200, Non Final Office Action mailed Aug. 29, 2024”, 35 pgs. [cited by applicant]
“U.S. Appl. No. 17/900,436, Non Final Office Action mailed Sep. 23, 2024”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 18/056,142, Corrected Notice of Allowability mailed Sep. 4, 2024”, 2 pgs. [cited by applicant]
“U.S. Appl. No. 18/058,175, Final Office Action mailed Sep. 19, 2024”, 12 pgs. [cited by applicant]
“U.S. Appl. No. 18/058,175, Response filed Oct. 30, 2024 to Final Office Action mailed Sep. 19, 2024”, 9 pgs. [cited by applicant]
“U.S. Appl. No. 18/169,631, Non Final Office Action mailed Sep. 17, 2024”, 28 pgs. [cited by applicant]
S. A., Aseeri, et al., “The Influence of Avatar Representation and Behavior on Communication in Social Immersive Virtual Environments”, IEEE Conference on Virtual Reality and 3D User Interfaces VR Tuebingen Reutlingen G… [cited by applicant]
Yanbin, Wang, et al., “Real Time Stereoscopic Rendering of Realistic Avatar for Interactive 3D Telepresence System”, 2nd International Conference on Image Vision and Computing ICIVC Chengdu, (2017), 5 pgs. [cited by applicant]
Cited By (5)
US 12,322,052 US 12,417,593 US 12,449,891 US 12,519,924 US 12,718,494