IP Library Granted Patent US 12,633,047
Granted Patent B2
US 12,633,047 · App. 18/152,437 · Granted May 19, 2026

Multi-modal method for interacting with 3D models

Inventors: Matthew Bell (Palo Alto, CA); Michael Beebe (San Carlos, CA)
Assignee: CoStar Realty Information, Inc.
G06T17/00G06T19/003G06T2210/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,633,047
App. No.
18/152,437
Granted
May 19, 2026
Kind
B2
Abstract

The present disclosure concerns a methodology that allows a user to “orbit” around a model on a specific axis of rotation and view an orthographic floor plan of the model. A user may view and “walk through” the model while staying at a specific height above the ground with smooth transitions between orbiting, floor plan, and walking modes.

Claims (73)

1 . A system, comprising:

a processor; and

a memory communicatively coupled to the processor, the memory having stored therein computer-executable instructions, the memory comprising one or more components configured to:

receive a graphical user interface that facilitates viewing and navigating a three-dimensional model from different perspectives of a virtual camera in different navigation modes, the different navigation modes including a walking mode that provides one or more perspectives of the different perspectives from the virtual camera representative of walking in the three-dimensional model and a floor plan mode that provides perspectives of the three-dimensional model from the virtual camera positioned outside and above the three-dimensional model and with a view of the three-dimensional model that has a pitch direction of the view locked substantially orthogonally oriented relative to a horizontal surface of the three-dimensional model, wherein the floor plan mode enables spatial motion of the virtual camera while maintaining a substantially orthogonal orientation of the view relative to the horizontal surface;

receive at least one representation of the three-dimensional model from at least one of the different perspectives in a particular navigation mode of the different navigation modes;

receive a request to activate a measurement mode that allows for dimensions on the three-dimensional model to be measured in the particular navigation mode;

activate the measurement mode;

receive first input indicating a first endpoint for a measurement;

receive second input indicating a second endpoint for the measurement;

determine a method of computing the measurement between the first endpoint and the second endpoint based on whether the particular navigation mode of the different navigation modes is the walking mode or the floor plan mode, wherein when the particular navigation mode is the walking mode, the method of computing uses Z-buffer coordinates from a render of the graphical user interface and wherein when the particular navigation mode is the floor plan mode, the method of computing uses raycasting along vectors defined by parameters of the virtual camera and screen coordinates of the first endpoint and the second endpoint;

compute the measurement between the first endpoint and the second endpoint using the method of computing the measurement between the first endpoint and the second endpoint; and

generate a visual representation of the measurement between the first endpoint and the second endpoint in the graphical user interface.

2 . The system of claim 1 , wherein the one or more components are further configured to:

generate a visual representation of the measurement in the graphical user interface, wherein the measurement is a distance between the first endpoint and the second endpoint.

3 . The system of claim 1 , wherein the one or more components are further configured to:

generate a first shape for the first endpoint for the measurement; and

generate a second shape for the second endpoint for the measurement.

4 . The system of claim 1 , wherein the one or more components are further configured to:

determine that the first endpoint is within a specified distance of a first edge or a first corner in the three-dimensional model;

snap the first endpoint to the first edge or the first corner;

determine that the second endpoint is within a specified distance of a second edge or a second corner in the three-dimensional model; and

snap the second endpoint to the second edge or the second corner.

5 . The system of claim 1 , wherein the one or more components are further configured to generate the visual representation of the measurement between the first endpoint and the second endpoint in the graphical user interface by determining a first location of the first endpoint in the three-dimensional model by raycasting along a first vector defined by parameters of the virtual camera and first screen coordinates of the first endpoint and determining a second location of the second endpoint in the three-dimensional model by raycasting along a second vector defined by the parameters of the virtual camera and second screen coordinates of the second endpoint.

6 . The system of claim 1 , wherein the one or more components are further configured to generate the visual representation of the measurement between the first endpoint and the second endpoint in the graphical user interface by examining a Z buffer from a rendering of the graphical user interface, determining a first location of the first endpoint in the three-dimensional model based on the Z buffer, and determining a second location of the second endpoint in the three-dimensional model based on the Z buffer.

7 . The system of claim 1 , wherein the one or more components are further configured to generate visual representations of measurements differently in the walking mode than in the floor plan mode.

8 . The system of claim 1 , wherein the visual representation of the measurement includes a first object that is at least partially transparent and is positioned in front of the three-dimensional model and a second object that is opaquer than the first object and is positioned at or near a correct depth in the graphical user interface.

9 . The system of claim 1 , wherein the visual representation of the measurement is positioned at or near a correct depth in the graphical user interface.

10 . The system of claim 1 , wherein the one or more components are further configured to:

receive third input indicating an updated second endpoint for the measurement; and

generate an updated visual representation of the measurement between the first endpoint and the updated second endpoint in the graphical user interface.

11 . A non-transitory computer-readable medium comprising executable instructions, the executable instructions being executable by one or more processors to perform a method, the method comprising:

receiving a graphical user interface that facilitates viewing and navigating a three-dimensional model from different perspectives of a virtual camera in different navigation modes, the different navigation modes including a walking mode that provides one or more perspectives of the different perspectives from the virtual camera representative of walking in the three-dimensional model, and a floor plan mode that provides perspectives of the three-dimensional model from the virtual camera positioned outside and above the three-dimensional model and with a view of the three-dimensional model that has a pitch direction of the view locked substantially orthogonally oriented relative to a horizontal surface of the three-dimensional model, wherein the floor plan mode enables spatial motion of the virtual camera while maintaining a substantially orthogonal orientation of the view relative to the horizontal surface;

receiving at least one representation of the three-dimensional model from at least one of the different perspectives in a particular navigation mode of the different navigation modes;

receiving a request to activate a measurement mode that allows for dimensions on the three-dimensional model to be measured in the particular navigation mode;

activating the measurement mode;

receiving first input indicating a first endpoint for a measurement;

receiving second input indicating a second endpoint for the measurement;

determining a method of computing the measurement between the first endpoint and the second endpoint based on whether the particular navigation mode of the different navigation modes is the walking mode or the floor plan mode, wherein when the particular navigation mode is the walking mode, the method of computing uses Z-buffer coordinates from a render of the graphical user interface and wherein when the particular navigation mode is the floor plan mode, the method of computing uses raycasting along vectors defined by parameters of the virtual camera and screen coordinates of the first endpoint and the second endpoint;

computing the measurement between the first endpoint and the second endpoint using the method of computing the measurement between the first endpoint and the second endpoint; and

generating a visual representation of the measurement between the first endpoint and the second endpoint in the graphical user interface.

12 . The non-transitory computer-readable medium of claim 11 , the method further comprising:

generating a visual representation of the measurement in the graphical user interface, wherein the measurement is a distance between the first endpoint and the second endpoint.

13 . The non-transitory computer-readable medium of claim 11 , the method further comprising:

generating a first shape for the first endpoint for the measurement; and

generating a second shape for the second endpoint for the measurement.

14 . The non-transitory computer-readable medium of claim 11 , the method further comprising:

determining that the first endpoint is within a specified distance of a first edge or a first corner in the three-dimensional model;

snapping the first endpoint to the first edge or the first corner;

determining that the second endpoint is within a specified distance of a second edge or a second corner in the three-dimensional model; and

snapping the second endpoint to the second edge or the second corner.

15 . The non-transitory computer-readable medium of claim 11 , the method further comprising:

determining a first location of the first endpoint in the three-dimensional model by raycasting along a first vector defined by parameters of the virtual camera and first screen coordinates of the first endpoint; and

determining a second location of the second endpoint in the three-dimensional model by raycasting along a second vector defined by the parameters of the virtual camera and second screen coordinates of the second endpoint.

16 . The non-transitory computer-readable medium of claim 11 , the method further comprising:

examining a Z buffer from a rendering of the graphical user interface;

determining a first location of the first endpoint in the three-dimensional model based on the Z buffer; and

determining a second location of the second endpoint in the three-dimensional model based on the Z buffer.

17 . The non-transitory computer-readable medium of claim 11 , the method further comprising generating visual representations of measurements differently in the walking mode than in the floor plan mode.

18 . The non-transitory computer-readable medium of claim 11 wherein the visual representation of the measurement includes a first object that is at least partially transparent and is positioned in front of the three-dimensional model and a second object that is opaquer than the first object and is positioned at or near a correct depth in the graphical user interface.

19 . The non-transitory computer-readable medium of claim 11 wherein the visual representation of the measurement is positioned at or near a correct depth in the graphical user interface.

20 . The non-transitory computer-readable medium of claim 11 , the method further comprising:

receiving third input indicating an updated second endpoint for the measurement; and

generating an updated visual representation of the measurement between the first endpoint and the updated second endpoint in the graphical user interface.

21 . A method comprising:

receiving a graphical user interface that facilitates viewing and navigating a three-dimensional model from different perspectives of a virtual camera in different navigation modes, the different navigation modes including a walking mode that provides one or more perspectives of the different perspectives from the virtual camera representative of walking in the three-dimensional model, and a floor plan mode that provides perspectives of the three-dimensional model from the virtual camera positioned outside and above the three-dimensional model and with a view of the three-dimensional model that has a pitch direction of the view locked substantially orthogonally oriented relative to a horizontal surface of the three-dimensional model, wherein the floor plan mode enables spatial motion of the virtual camera while maintaining a substantially orthogonal orientation of the view relative to the horizontal surface;

receiving at least one representation of the three-dimensional model from at least one of the different perspectives in a particular navigation mode of the different navigation modes;

receiving a request to activate a measurement mode that allows for dimensions on the three-dimensional model to be measured in the particular navigation mode;

activating the measurement mode;

receiving first input indicating a first endpoint for a measurement;

receiving second input indicating a second endpoint for the measurement;

determining a method of computing the measurement between the first endpoint and the second endpoint based on whether the particular navigation mode of the different navigation modes is the walking mode or the floor plan mode, wherein when the particular navigation mode is the walking mode, the method of computing uses Z-buffer coordinates from a render of the graphical user interface and wherein when the particular navigation mode is the floor plan mode, the method of computing uses raycasting along vectors defined by parameters of the virtual camera and screen coordinates of the first endpoint and the second endpoint;

computing the measurement between the first endpoint and the second endpoint using the method of computing the measurement between the first endpoint and the second endpoint; and

generating a visual representation of the measurement between the first endpoint and the second endpoint in the graphical user interface.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 25, 2025
From: MATTERPORT, LLC
To: COSTAR REALTY INFORMATION, INC.
Reel/Frame 072938/0425 →
MERGER AND CHANGE OF NAME Recorded Sep 10, 2025
From: MATTERPORT, INC.; MATRIX MERGER SUB II LLC
To: MATTERPORT, LLC
Reel/Frame 072827/0559 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2023
From: BELL, MATTHEW; BEEBE, MICHAEL
To: MATTERPORT, INC.
Reel/Frame 062630/0877 →
Continuity (6)
Continuation 17372333 · Jul 9, 2021
Continuation 16386910 · Apr 17, 2019
Continuation 15722269 · Oct 2, 2017
Continuation 13925772 · Jun 24, 2013
Provisional Application 61663265 · Jun 22, 2012
Related Publication 20230274499A1 · Aug 31, 2023
References Cited (237)
US 4578757A · Strark · 1986 [cited by applicant]
US 5056031A · Nakano et al. · 1991 [cited by applicant]
US 5276785A · Mackinlay · 1994 [cited by applicant]
US 5347459A · Greenspan et al. · 1994 [cited by applicant]
US 5552806A · Lenchik · 1996 [cited by applicant]
US 5611025A · Lorensen · 1997 [cited by applicant]
US 5671381A · Strasnick et al. · 1997 [cited by applicant]
US 5734884A · Eberhard et al. · 1998 [cited by applicant]
US 5999881A · Law et al. · 1999 [cited by applicant]
US 6130670A · Porter · 2000 [cited by applicant]
US 6346938B1 · Chan et al. · 2002 [cited by applicant]
US 6525731B1 · Suits · 2003 [cited by applicant]
US 6734884B1 · Berry · 2004 [cited by applicant]
US 6907579B2 · Chang · 2005 [cited by applicant]
US 7111009B1 · Gupta et al. · 2006 [cited by applicant]
US 7242408B1 · Dunn · 2007 [cited by applicant]
US 7933395B1 · Bailly · 2011 [cited by applicant]
US 8200594B1 · Bleiweiss · 2012 [cited by applicant]
US 8327260B2 · Bays et al. · 2012 [cited by applicant]
US 8339394B1 · Lininger · 2012 [cited by applicant]
US 8788968B1 · Filip et al. · 2014 [cited by applicant]
US 8823732B2 · Adams · 2014 [cited by examiner]
US 8902288B1 · Fan et al. · 2014 [cited by applicant]
US 9046996B2 · Gallup · 2015 [cited by applicant]
US 9179252B1 · Liu · 2015 [cited by applicant]
US 9244940B1 · Donsbach · 2016 [cited by applicant]
US 9437045B2 · Arendash · 2016 [cited by applicant]
US 9671938B2 · Seitz · 2017 [cited by applicant]
US 10163271B1 · Powers et al. · 2018 [cited by applicant]
US 10775959B2 · Mildrew et al. · 2020 [cited by applicant]
US 10909758B2 · Bell et al. · 2021 [cited by applicant]
US 11062509B2 · Bell et al. · 2021 [cited by applicant]
US D945802S · Bell et al. · 2022 [cited by applicant]
US 11422671B2 · Mildrew et al. · 2022 [cited by applicant]
US 20020113865A1 · Yano · 2002 [cited by applicant]
US 20020140698A1 · Robertson et al. · 2002 [cited by applicant]
US 20020175912A1 · Nishitani · 2002 [cited by examiner]
US 20030038799A1 · Smith · 2003 [cited by examiner]
US 20030052877A1 · Schwegler et al. · 2003 [cited by applicant]
US 20040041812A1 · Roberts et al. · 2004 [cited by applicant]
US 20040046760A1 · Roberts et al. · 2004 [cited by applicant]
US 20040085335A1 · Burlnyk et al. · 2004 [cited by applicant]
US 20040209234A1 · Geiger · 2004 [cited by applicant]
US 20050125428A1 · Kang et al. · 2005 [cited by applicant]
US 20050128196A1 · Popescu · 2005 [cited by examiner]
US 20050151751A1 · Hong · 2005 [cited by applicant]
US 20060004512A1 · Herbst · 2006 [cited by applicant]
US 20060041564A1 · Jain et al. · 2006 [cited by applicant]
US 20060066612A1 · Yang · 2006 [cited by applicant]
US 20060085123A1 · Sugita · 2006 [cited by examiner]
US 20060085755A1 · Arai · 2006 [cited by applicant]
US 20060114251A1 · Miller · 2006 [cited by applicant]
US 20060132482A1 · Oh · 2006 [cited by applicant]
US 20060176297A1 · Kim · 2006 [cited by applicant]
US 20060190285A1 · Harris · 2006 [cited by examiner]
US 20060227134A1 · Khan et al. · 2006 [cited by applicant]
US 20070024612A1 · Balfour · 2007 [cited by applicant]
US 20070110338A1 · Snavely et al. · 2007 [cited by applicant]
US 20070171221A1 · Miyamoto · 2007 [cited by applicant]
US 20070203545A1 · Stone et al. · 2007 [cited by applicant]
US 20080024484A1 · Naimark · 2008 [cited by applicant]
US 20080028341A1 · Szeliski · 2008 [cited by applicant]
US 20080088621A1 · Grimaud et al. · 2008 [cited by applicant]
US 20080106594A1 · Thrun · 2008 [cited by applicant]
US 20080143727A1 · Oh · 2008 [cited by applicant]
US 20080208547A1 · Kim et al. · 2008 [cited by applicant]
US 20080247636A1 · Davis · 2008 [cited by applicant]
US 20080291217A1 · Vincent · 2008 [cited by applicant]
US 20090005981A1 · Forstall · 2009 [cited by applicant]
US 20090079732A1 · Fitzmaurice et al. · 2009 [cited by applicant]
US 20090083671A1 · Fitzmaurice et al. · 2009 [cited by applicant]
US 20090129690A1 · Marcellin · 2009 [cited by applicant]
US 20090153549A1 · Lynch et al. · 2009 [cited by applicant]
US 20090216435A1 · Zheng et al. · 2009 [cited by applicant]
US 20090274391A1 · Arcas et al. · 2009 [cited by applicant]
US 20090276445A1 · Flake et al. · 2009 [cited by applicant]
US 20090281728A1 · Mishra · 2009 [cited by applicant]
US 20090289937A1 · Flake et al. · 2009 [cited by applicant]
US 20100045666A1 · Kommann et al. · 2010 [cited by applicant]
US 20100045678A1 · Reid · 2010 [cited by applicant]
US 20100077311A1 · Santoro · 2010 [cited by applicant]
US 20100087257A1 · Deb · 2010 [cited by applicant]
US 20100171741A1 · Brill · 2010 [cited by applicant]
US 20100182400A1 · Nelson · 2010 [cited by applicant]
US 20100188503A1 · Tsai · 2010 [cited by applicant]
US 20100201684A1 · Yadav · 2010 [cited by applicant]
US 20100214284A1 · Rieffel et al. · 2010 [cited by applicant]
US 20100265248A1 · McCrae et al. · 2010 [cited by applicant]
US 20100268457A1 · McCrae · 2010 [cited by applicant]
US 20100283781A1 · Kriveshko et al. · 2010 [cited by applicant]
US 20100315416A1 · Pretlove · 2010 [cited by applicant]
US 20110007962A1 · Johnson et al. · 2011 [cited by applicant]
US 20110010650A1 · Hess · 2011 [cited by applicant]
US 20110115885A1 · Wernersson · 2011 [cited by examiner]
US 20110187723A1 · Chen et al. · 2011 [cited by applicant]
US 20110199302A1 · Tossell · 2011 [cited by applicant]
US 20110249757A1 · Newton et al. · 2011 [cited by applicant]
US 20110283223A1 · Vaittinen · 2011 [cited by applicant]
US 20110310087A1 · Wright, Jr. et al. · 2011 [cited by applicant]
US 20110310088A1 · Adabala · 2011 [cited by applicant]
US 20110316860A1 · Mukai · 2011 [cited by applicant]
US 20110316976A1 · Nakajima · 2011 [cited by applicant]
US 20110320116A1 · DeMaio · 2011 [cited by applicant]
US 20120019522A1 · Lawrence · 2012 [cited by applicant]
US 20120030630A1 · Grossman et al. · 2012 [cited by applicant]
US 20120044247A1 · Naimark · 2012 [cited by applicant]
US 20120050288A1 · Crucs · 2012 [cited by applicant]
US 20120099804A1 · Aguilera et al. · 2012 [cited by applicant]
US 20120116728A1 · Shear · 2012 [cited by applicant]
US 20120127169A1 · Barcay · 2012 [cited by applicant]
US 20120127170A1 · Varadhan · 2012 [cited by applicant]
US 20120133640A1 · Chin · 2012 [cited by applicant]
US 20120139915A1 · Muikaichi · 2012 [cited by applicant]
US 20120154446A1 · Adams · 2012 [cited by examiner]
US 20120155744A1 · Kennedy · 2012 [cited by applicant]
US 20120209574A1 · Moreau et al. · 2012 [cited by applicant]
US 20120316441A1 · Toma et al. · 2012 [cited by applicant]
US 20120327184A1 · Zhu et al. · 2012 [cited by applicant]
US 20130009954A1 · Ofek · 2013 [cited by applicant]
US 20130016896A1 · Seida · 2013 [cited by applicant]
US 20130044139A1 · Hernandez · 2013 [cited by applicant]
US 20130085823A1 · Gibson · 2013 [cited by applicant]
US 20130135292A1 · Lee et al. · 2013 [cited by applicant]
US 20130179841A1 · Mutton et al. · 2013 [cited by applicant]
US 20130187905A1 · Vaddadi · 2013 [cited by examiner]
US 20130187952A1 · Berkovich · 2013 [cited by applicant]
US 20130207963A1 · Stirbu · 2013 [cited by applicant]
US 20130212537A1 · Hall · 2013 [cited by examiner]
US 20130271457A1 · Haswell · 2013 [cited by applicant]
US 20130271462A1 · Frank · 2013 [cited by applicant]
US 20130300656A1 · Roegelein · 2013 [cited by applicant]
US 20130321392A1 · Van Der et al. · 2013 [cited by applicant]
US 20130321395A1 · Chen · 2013 [cited by examiner]
US 20130321397A1 · Chen · 2013 [cited by applicant]
US 20130321401A1 · Piemonte et al. · 2013 [cited by applicant]
US 20130342533A1 · Bell et al. · 2013 [cited by applicant]
US 20140002439A1 · Lynch · 2014 [cited by applicant]
US 20140002440A1 · Lynch · 2014 [cited by applicant]
US 20140062998A1 · Ofstad · 2014 [cited by applicant]
US 20140071119A1 · Piemonte et al. · 2014 [cited by applicant]
US 20140093187A1 · Yehezkel et al. · 2014 [cited by applicant]
US 20140095122A1 · Appleman · 2014 [cited by examiner]
US 20140104280A1 · Ofstad · 2014 [cited by applicant]
US 20140218360A1 · Dalgaard Larsen · 2014 [cited by applicant]
US 20140240318A1 · Coombe · 2014 [cited by applicant]
US 20140253541A1 · Schmidt · 2014 [cited by applicant]
US 20140314322A1 · Snavely · 2014 [cited by applicant]
US 20140320484A1 · Rane · 2014 [cited by applicant]
US 20150009327A1 · Love · 2015 [cited by applicant]
US 20150049086A1 · Morato et al. · 2015 [cited by applicant]
US 20150085068A1 · Becker · 2015 [cited by applicant]
US 20150130894A1 · Holzer · 2015 [cited by applicant]
US 20150154798A1 · Simpson et al. · 2015 [cited by applicant]
US 20150213642A1 · Tange et al. · 2015 [cited by applicant]
US 20150269785A1 · Bell · 2015 [cited by applicant]
US 20150293354A1 · Oishi · 2015 [cited by applicant]
US 20150335303A1 · Chandelier et al. · 2015 [cited by applicant]
US 20160012160A1 · Mohacsi et al. · 2016 [cited by applicant]
US 20160127690A1 · Kaehler et al. · 2016 [cited by applicant]
US 20160210788A1 · Kasahara · 2016 [cited by applicant]
US 20160267067A1 · Mays · 2016 [cited by applicant]
US 20160328373A1 · Rhoades · 2016 [cited by applicant]
US 20170075536A1 · Cho et al. · 2017 [cited by applicant]
US 20170352196A1 · Chen · 2017 [cited by applicant]
US 20180143756A1 · Mildrew · 2018 [cited by examiner]
US 20190050137A1 · Mildrew et al. · 2019 [cited by applicant]
US 20190051050A1 · Bell et al. · 2019 [cited by applicant]
US 20190244419A1 · Bell et al. · 2019 [cited by applicant]
US 20210158618A1 · Bell et al. · 2021 [cited by applicant]
US 20210335034A1 · Bell et al. · 2021 [cited by applicant]
US 20220264239A1 · Kanemaru · 2022 [cited by applicant]
US 20230274499A1 · Bell · 2023 [cited by examiner]
US 20230306688A1 · Bell et al. · 2023 [cited by applicant]
EP 3120329A1 · 2017 [cited by applicant]
Yan et al., Integrating BIM and gaming for real-time interactive architectural visualization, 2011 (Year: 2011). [cited by examiner]
Imaris, Quick Start Tutorials, 2009 (Year: 2009). [cited by examiner]
Salomon et al., Interactive Navigation in Complex Environments Using Path Planning, 2003 (Year: 2003). [cited by examiner]
Mccrae et al., Multiscale 3D Navigation, 2009 (Year: 2009). [cited by examiner]
Tammik, Pick a Point in 3D, 2011 (Year: 2011). [cited by examiner]
Bourke, “Interpolation Methods,” 1999, available at http://paulbourke.net/miscellaneous/interpolation/, pp. 1-12. [cited by applicant]
Bredif, Image-Based Rendering of LOD1 3D City Models for Traffic-Augmented Immersive Street-View Navigation, 2013 (Year: 2013). [cited by applicant]
European Office Action from EP Application Serial No. 15764342.0, dated Oct. 28, 2016, 2 pages. [cited by applicant]
Extended European Search Report Issued in EP Patent application No. 15764342.0 dated Aug. 11, 2017, 9 Pages. [cited by applicant]
Final Office Action for U.S. Appl. No. 17/165,830 dated Apr. 19, 2022, 14 pages. [cited by applicant]
Final Office Action for U.S. Appl. No. 13/925,772 dated Aug. 16, 2016, 41 pages. [cited by applicant]
Final Office Action for U.S. Appl. No. 13/925,772 dated May 5, 2015, 31 pages. [cited by applicant]
Final Office Action for U.S. Appl. No. 14/219,906 dated Jun. 21, 2016, 35 pages. [cited by applicant]
Final Office Action for U.S. Appl. No. 14/219,906 dated Oct. 19, 2017, 43 pages. [cited by applicant]
Final Office Action for U.S. Appl. No. 15/199,853 dated Apr. 25, 2018, 31 pages. [cited by applicant]
Final Office Action for U.S. Appl. No. 16/155,151 dated May 4, 2020, 19 pages. [cited by applicant]
Final Office Action for U.S. Appl. No. 16/386,910 dated Sep. 17, 2020, 13 pages. [cited by applicant]
Fitzmaurice, George et al., “Safe 3D Navigation,” Feb. 2008, 13D '08, Proceedings of the 2008 Symposium on Interactive 3D Graphics and Games, pp. 7-15. [cited by applicant]
Geraerts, Roland, “Camera Planning in Virtual Environments Using the Corridor Map Method,” Nov. 2009, Second International Workshop on Motion in Games, pp. 194-209. [cited by applicant]
Hsieh, Chi-Chang et al., “Photo Navigator,” 2008, MM '08 Proceedings of the 16th ACM international conference on Multimedia, pp. 419-428. [cited by applicant]
International Search Report & Written Opinion for International Patent Application Serial No. PCT/US15/20453, dated Jun. 25, 2015, 11 pages. [cited by applicant]
Lala et al., “Towards a Virtual Environment for Capturing Behavior in Cultural Crowds”, 2011 (Year: 2011). [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 13/925,772 dated Feb. 3, 2016, 37 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 13/925,772 dated Nov. 28, 2014, 10 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 14/219,906 dated Apr. 4, 2018, 22 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 14/219,906 dated Nov. 18, 2015, 29 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 14/219,906, dated Mar. 2, 2017, 40 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 15/199,853, dated Oct. 31, 2017, 31 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 15/272,337 dated Feb. 2, 2018, 66 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 15/722,269 dated Oct. 17, 2018, 55 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/155,151 dated Oct. 31, 2019, 18 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/162,683 dated Dec. 30, 2019, 18 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/386,910 dated Apr. 21, 2020, 11 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/165,830 dated Nov. 5, 2021, 7 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/372,333 dated Apr. 25, 2022, 47 pages. [cited by applicant]
Non-Final Office Action from U.S. Appl. No. 14/219,906, dated Nov. 18, 2015, 29 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 13/925,772, dated Jun. 1, 2017, 32 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 14/219,906 dated Jul. 10, 2018, 55 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 15/272,337 dated Jul. 17, 2018, 46 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 15/722,269 dated Jan. 29, 2019, 24 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/155, 151 dated Oct. 1, 2020, 13 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/162,683 dated May 14, 2020, 20 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/021,848 dated Apr. 22, 2022, 11 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/165,830 dated Nov. 4, 2022, 9 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/372,333 dated Dec. 9, 2022, 2 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/372,333, dated Dec. 12, 2022, 2 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/372,333, dated Sept. 1, 2022, 9 pages. [cited by applicant]
Raja et al., “Dynamic Inversion-Based Nonlinear Aiming Point Guidance of Unmanned Aerial Vehicles for Reactive Obstacle Avoidance”, 2013 (Year: 2013). [cited by applicant]
Snavely, Noah et al., “Photo Tourism: Exploring Photo Collections in 3D,” 2006, SIGGRAPH '06 ACM SIGRRAPH, pp. 835-846. [cited by applicant]
Tan et al., Exploring 3D Navigation: Combining Speed-Coupled Flying with Orbiting, 2001 (Year: 2001). [cited by applicant]
TU Wien Institute of Computer Engineering, “Computer-Assisted Animation,” 2002, available at https://www.cg.tuwien.ac.at/courses/Animation/B_Computer_Assisted_Animation.pdf, pp. 1-20. [cited by applicant]
Wien, Tu, “Computer-Assisted Animation”, URL: https://www.cg.tuwien.ac.at/courses/Animation/B_ComputerAssisted_Animation.pdf, 2002, pp. 1-20. [cited by applicant]
WilloxH: “Microsoft Photosynth,” Jul. 27, 2006, Retrieved from the Internet: URL:https://www.youtube.com/watch?v=p16frKJLVi0 [retrieved on Dec. 2, 2015], 1 page. [cited by applicant]
Yan, Wei et al., “Integrating BIM and Gaming for Real-Time Interactive Architectural Visualization,” Jul. 2011, Automation in Construction, vol. 20, No. 4, pp. 446-458. [cited by applicant]
Anand et al., “Contextually guided semantic labelling and search for three-dimensional point clouds,” 2013 (Year: 2013). [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/820,237, dated May 8, 2024, 8 pages. [cited by applicant]
Vaaraniemi et al., “Enhancing the visibility of labels in 3D navigation maps,” 2013 (Year: 2013). [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/820,237 dated Jan. 4, 2024, 7 pages. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 18/171,053 dated Jul. 1, 2025, 8 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/171,053 dated Feb. 20, 2025, 16 pages. [cited by applicant]
Ballegooij et al., Navigation by Query in Virtual World, 2001. [cited by applicant]
Jankowski et al., A Dual-Mode User Interface for Accessing 3D Content on the World Wide Web, 2012. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/807,897 dated Apr. 9, 2026, 11 pages. [cited by applicant]