IP Library Granted Patent US 12,647,753
Granted Patent B2
US 12,647,753 · App. 16/580,741 · Granted Jun 2, 2026

System and method for generating floor plans using user device sensors

Inventors: Jeffery D. Lewis (Orem, UT); Jeffrey C. Taylor (Alpine, UT)
Assignee: Xactware Solutions, Inc.
H04W4/029H04M1/724H04W4/33
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,647,753
App. No.
16/580,741
Filed
Sep 24, 2019
Granted
Jun 2, 2026
Kind
B2
Examiner
PHUONG, DAI
Art Unit
2644
USPC
455/456.3
Abstract

A system and method for generating floor plans using a mobile device, comprising a memory and a processor in communication with the memory. The processor captures a plurality of walls in a room using one or more sensors of the mobile device. The processor then captures one or more openings in the room. The processor then generates a floor plan based on the walls and the openings.

Claims (30)

1 . A system for generating a floor plan using a mobile device, comprising:

a memory; and

a processor in communication with the memory, the processor:

capturing a plurality of walls in a room using one or more sensors of the mobile device, wherein, for each wall of the plurality of walls in the room, a surface of the mobile device is positioned against the wall and at least one point is captured for the wall when the mobile device is positioned against the wall;

capturing one or more openings in the room using the one or more sensors of the mobile device by capturing at least two points corresponding to the one or more openings when the mobile device is positioned on or next to ends of the opening;

causing the mobile device to display an overhead view of the plurality of walls, the overhead view updated to show user movement and wall points when the mobile device is moved from one location in space to another location in space to allow a user to monitor positional tracking; and

generating a floor plan based on the plurality of walls and the one or more openings.

2 . The system of claim 1 , wherein the processor captures a wall by capturing a first point on the wall and a second point on the wall, and defines a first line between the first point and the second point.

3 . The system of claim 2 , wherein the first point and the second point are at least six inches apart from one another.

4 . The system of claim 2 , wherein the processor tracks a movement of a user to determine a location of the second point relative to the first point.

5 . The system of claim 2 , wherein the processor determines a corner by calculating intersecting points of the first line and a second line.

6 . The system of claim 1 , wherein the one or more openings comprises at least one of a doorway, a window, or a closet.

7 . The system of claim 1 , wherein the processor generates a prompt that is displayed on the mobile device to inquire whether further rooms need to be captured.

8 . The system of claim 1 , wherein the processor displays the overhead view on the mobile device while capturing the plurality of walls in the room and the one or more openings in the room.

9 . The system of claim 1 , wherein the processor determines whether more walls need to be captured by comparing an amount of walls captured to a predetermined threshold.

10 . The system of claim 1 , wherein the processor determines whether more openings need to be captured by comparing an amount of openings captured to a predetermined threshold.

11 . A method for generating floor plans using a mobile device, comprising:

capturing a plurality of walls in a room using one or more sensors of the mobile device, wherein, for each wall of the plurality of walls in the room, a surface of the mobile device is positioned against the wall and at least one point is captured for the wall when the mobile device is positioned against the wall;

capturing one or more openings in the room using the one or more sensors of the mobile device by capturing at least two points corresponding to the one or more openings when the mobile device is positioned on or next to ends of the opening;

causing the mobile device to display an overhead view of the plurality of walls, the overhead view updated to show user movement and wall points when the mobile device is moved from one location in space to another location in space to allow a user to monitor positional tracking; and

generating a floor plan based on the plurality of walls and the one or more openings.

12 . The method of claim 11 , further comprising capturing a wall by capturing a first point on the wall and a second point on the wall, and defining a first line between the first point and the second point.

13 . The method of claim 12 , wherein the first point and the second point are at least six inches apart from one another.

14 . The method of claim 12 , further comprising tracking a movement of a user to determine a location of the second point relative to the first point.

15 . The method of claim 12 , further comprising determining a corner by calculating intersecting points of the first line and a second line.

16 . The method of claim 11 , wherein the one or more openings comprises at least one of a doorway, a window, or a closet.

17 . The method of claim 11 , further comprising generating a prompt that is displayed on the mobile device to inquire whether further rooms need to be captured.

18 . The method of claim 11 , further comprising displaying the overhead view on the mobile device while performing steps of capturing the plurality of walls in the room and capturing the one or more openings in the room.

19 . The method of claim 11 , further comprising determining whether more walls need to be captured by comparing an amount of walls captured to a predetermined threshold.

20 . The method of claim 11 , further comprising determining whether more openings need to be captured by comparing an amount of openings captured to a predetermined threshold.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 3, 2025
From: GEOMNI, INC.
To: XACTWARE SOLUTIONS, INC.
Reel/Frame 069732/0295 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 21, 2019
From: LEWIS, JEFFERY D.; TAYLOR, JEFFREY C.
To: GEOMNI, INC.
Reel/Frame 051073/0857 →
Continuity (2)
Provisional Application 62735260 · Sep 24, 2018
Related Publication 20200100066A1 · Mar 26, 2020
References Cited (131)
US 5701403A · Watanabe et al. · 1997 [cited by applicant]
US 6446030B1 · Hoffman et al. · 2002 [cited by applicant]
US 6448964B1 · Isaacs et al. · 2002 [cited by applicant]
US 8533063B2 · Erickson · 2013 [cited by applicant]
US 8843304B1 · Dupont et al. · 2014 [cited by applicant]
US 8868375B1 · Christian · 2014 [cited by examiner]
US 8983806B2 · Labrie et al. · 2015 [cited by applicant]
US 9158869B2 · Labrie et al. · 2015 [cited by applicant]
US 9501700B2 · Loveland et al. · 2016 [cited by applicant]
US 9679227B2 · Taylor et al. · 2017 [cited by applicant]
US 10127670B2 · Lewis et al. · 2018 [cited by applicant]
US 10181079B2 · Labrie et al. · 2019 [cited by applicant]
US 10387582B2 · Lewis et al. · 2019 [cited by applicant]
US 10445438B1 · Motonaga · 2019 [cited by examiner]
US 10529028B1 · Davis et al. · 2020 [cited by applicant]
US 11314905B2 · Childs et al. · 2022 [cited by applicant]
US 20020116254A1 · Stein et al. · 2002 [cited by applicant]
US 20030009315A1 · Thomas et al. · 2003 [cited by applicant]
US 20070080961A1 · Inzinga et al. · 2007 [cited by applicant]
US 20070276626A1 · Bruffey · 2007 [cited by applicant]
US 20090179895A1 · Zhu et al. · 2009 [cited by applicant]
US 20100110074A1 · Pershing · 2010 [cited by applicant]
US 20100114537A1 · Pershing · 2010 [cited by applicant]
US 20100296693A1 · Thornberry et al. · 2010 [cited by applicant]
US 20110056286A1 · Jansen · 2011 [cited by applicant]
US 20110157213A1 · Takeyama et al. · 2011 [cited by applicant]
US 20110191738A1 · Walker et al. · 2011 [cited by applicant]
US 20120026322A1 · Malka et al. · 2012 [cited by applicant]
US 20120179431A1 · Labrie et al. · 2012 [cited by applicant]
US 20120253725A1 · Malka et al. · 2012 [cited by applicant]
US 20120253751A1 · Malka et al. · 2012 [cited by applicant]
US 20130201167A1 · Oh et al. · 2013 [cited by applicant]
US 20130226451A1 · O'Neill et al. · 2013 [cited by applicant]
US 20130262029A1 · Pershing · 2013 [cited by applicant]
US 20130267260A1 · Chao et al. · 2013 [cited by applicant]
US 20130314688A1 · Likholyot · 2013 [cited by applicant]
US 20140032179A1 · Solihin · 2014 [cited by examiner]
US 20140043436A1 · Bell et al. · 2014 [cited by applicant]
US 20140301633A1 · Furukawa et al. · 2014 [cited by applicant]
US 20140320661A1 · Sankar · 2014 [cited by examiner]
US 20150029182A1 · Sun et al. · 2015 [cited by applicant]
US 20150073864A1 · Labrie et al. · 2015 [cited by applicant]
US 20150093047A1 · Battcher et al. · 2015 [cited by applicant]
US 20150116509A1 · Birkler et al. · 2015 [cited by applicant]
US 20150153172A1 · Starns · 2015 [cited by examiner]
US 20150193971A1 · Dryanovski et al. · 2015 [cited by applicant]
US 20150213558A1 · Nelson · 2015 [cited by applicant]
US 20150227645A1 · Childs et al. · 2015 [cited by applicant]
US 20150269438A1 · Samarasekera et al. · 2015 [cited by applicant]
US 20150302529A1 · Jagannathan · 2015 [cited by applicant]
US 20160098802A1 · Bruffey et al. · 2016 [cited by applicant]
US 20160110480A1 · Randolph · 2016 [cited by applicant]
US 20160246767A1 · Makadia et al. · 2016 [cited by applicant]
US 20160282107A1 · Roland et al. · 2016 [cited by applicant]
US 20170124713A1 · Jurgenson et al. · 2017 [cited by applicant]
US 20170132711A1 · Bruffey et al. · 2017 [cited by applicant]
US 20170132835A1 · Halliday et al. · 2017 [cited by applicant]
US 20170169459A1 · Bruffey et al. · 2017 [cited by applicant]
US 20170193297A1 · Michini et al. · 2017 [cited by applicant]
US 20170206648A1 · Marra et al. · 2017 [cited by applicant]
US 20170221152A1 · Nelson et al. · 2017 [cited by applicant]
US 20170316115A1 · Lewis et al. · 2017 [cited by applicant]
US 20170330207A1 · Labrie et al. · 2017 [cited by applicant]
US 20170345069A1 · Labrie et al. · 2017 [cited by applicant]
US 20180053329A1 · Roberts et al. · 2018 [cited by applicant]
US 20180067593A1 · Tiwari · 2018 [cited by examiner]
US 20180075168A1 · Tiwari et al. · 2018 [cited by applicant]
US 20180089833A1 · Lewis et al. · 2018 [cited by applicant]
US 20180286098A1 · Lorenzo · 2018 [cited by examiner]
US 20180330528A1 · Loveland et al. · 2018 [cited by applicant]
US 20180357819A1 · Oprea · 2018 [cited by applicant]
US 20180373931A1 · Li · 2018 [cited by applicant]
US 20190114717A1 · Labrie et al. · 2019 [cited by applicant]
US 20190147247A1 · Harris et al. · 2019 [cited by applicant]
US 20190228370A1 · Lien · 2019 [cited by examiner]
US 20190340692A1 · Labrie et al. · 2019 [cited by applicant]
US 20190377837A1 · Lewis et al. · 2019 [cited by applicant]
US 20200143481A1 · Brown et al. · 2020 [cited by applicant]
US 20210076162A1 · Wang · 2021 [cited by examiner]
US 20210103687A1 · Harris et al. · 2021 [cited by applicant]
US 20210350038A1 · Jenson et al. · 2021 [cited by applicant]
WO 2014151122A1 · 2014 [cited by applicant]
WO 2016154306A1 · 2016 [cited by applicant]
WO 2017100658A1 · 2017 [cited by applicant]
International Search Report of the International Searching Authority mailed on Mar. 27, 2017, issued in connection with International Application No. PCT/US2016/65947 (3 pages). [cited by applicant]
Written Opinion of the International Searching Authority mailed on Mar. 27, 2017, issued in connection with International Application No. PCT/US2016/65947 (7 pages). [cited by applicant]
Office Action mailed Sep. 26, 2018, issued in connection with U.S. Appl. No. 15/374,695 (33 pages). [cited by applicant]
Notice of Allowance mailed May 13, 2019, issued in connection with U.S. Appl. No. 15/374,695 (7 pages). [cited by applicant]
Extended European Search Report mailed Jun. 11, 2019, issued in connection with European Patent Application No. 16873975.3 (8 pages). [cited by applicant]
Communication Pursuant to Article 94(3) EPC issued by the European Patent Office mailed on Apr. 22, 2020, issued In connection with European Patent Application No. 16873975.3 (6 pages). [cited by applicant]
International Search Report of the International Searching Authority mailed on May 14, 2015, issued in connection with International Application No. PCT/US15/015491(3 pages). [cited by applicant]
Written Opinion of the International Searching Authority mailed on May 14, 2015, issued in connection with International Application No. PCT/US15/015491 (9 pages). [cited by applicant]
Fung, et al., “A Mobile Assisted Localization Scheme for Augmented Reality,” Department of Computer Science and Engineering, The Chinese University of Hong Kong, 2012 (76 pages). [cited by applicant]
Sankar, et al., “Capturing Indoor Scenes With Smartphones,” UIST 12, Oct. 7-10, 2012, Cambridge, Massachusetts (9 pages). [cited by applicant]
Office Action mailed Aug. 8, 2017, issued in connection with U.S. Appl. No. 14/620,004 (26 pages). [cited by applicant]
Office Action mailed Aug. 28, 2018, issued in connection with U.S. Appl. No. 14/620,004 (33 pages). [cited by applicant]
Farin, et al., “Floor-Plan Reconstruction from Panoramic Images,” Sep. 23-28, 2007, MM '07, ACM (4 pages). [cited by applicant]
Office Action mailed Mar. 29, 2019, issued in connection with U.S. Appl. No. 14/620,004 (22 pages). [cited by applicant]
Office Action mailed Dec. 10, 2019, issued in connection with U.S. Appl. No. 14/620,004 (27 pages). [cited by applicant]
Zhang, et al., “Wallk&Sketch: Create Floor Plans with an RGB-D Camera,” Sep. 5-8, 2012, UbiComp '12, ACM (10 pages). [cited by applicant]
Office Action mailed Jul. 8, 2020, issued in connection with U.S. Appl. No. 14/620,004 (27 pages). [cited by applicant]
Office Action mailed Feb. 2, 2021, issued in connection with U.S. Appl. No. 14/620,004 (28 pages). [cited by applicant]
Communication Pursuant to Article 94(3) EPC issued by the European Patent Office mailed on Feb. 18, 2021, Issued in connection with European Patent Application No. 16873975.3 (5 pages). [cited by applicant]
Notice of Allowance mailed Aug. 19, 2021, issued in connection with U.S. Appl. No. 14/620,004 (11 pages). [cited by applicant]
Examiner-Initiated Interview Summary dated Aug. 10, 2021, issued in connection with U.S. Appl. No. 14/620,004 (1 page). [cited by applicant]
International Search Report of the International Searching Authority mailed on Feb. 11, 2019, issued in connection with International Application No. PCT/US18/60762 (3 pages). [cited by applicant]
Written Opinion of the International Searching Authority mailed on Feb. 11, 2019, issued in connection with International Application No. PCT/US18/60762 (7 pages). [cited by applicant]
Office Action mailed Apr. 16, 2020, issued in connection with U.S. Appl. No. 16/189,512 (10 pages). [cited by applicant]
U.S. Appl. No. 62/512,989, filed May 31, 2017 entitled, “Systems and Methods for Rapidly Developing Annotated Computer Models of Structures” (47 pages). [cited by applicant]
Office Action mailed Dec. 14, 2020, issued in connection with U.S. Appl. No. 16/189,512 (10 pages). [cited by applicant]
Extended European Search Report dated Jul. 1, 2021, issued by the European Patent Office in connection with European Application No. 18876121.7 (8 pages). [cited by applicant]
Office Action mailed Jul. 20, 2021, issued in connection with U.S. Appl. No. 16/189,512 (11 pages). [cited by applicant]
International Search Report of the International Searching Authority mailed on Apr. 8, 2022, issued in connection with International Application No. PCT/US21/63469 (5 pages). [cited by applicant]
Written Opinion of the International Searching Authority mailed on Apr. 8, 2022, issued in connection with International Application No. PCT/US21/63469 (6 pages). [cited by applicant]
Office Action mailed Mar. 25, 2022, issued in connection with U.S. Appl. No. 16/545,607 (56 pages). [cited by applicant]
Notice of Allowance mailed Apr. 8, 2022, issued in connection with U.S. Appl. No. 16/189,512 (8 pages). [cited by applicant]
Notice of Allowance mailed Dec. 16, 2021, issued in connection with U.S. Appl. No. 14/620,004 (12 pages). [cited by applicant]
Invitation to Pay Additional Fees issued by the International Searching Authority mailed on Feb. 2, 2022, issued in connection with International Application No. PCT/US21/63469 (2 pages). [cited by applicant]
Extended European Search Report dated Feb. 18, 2022, issued in connection with European Patent Application No. 19866788.3 (9 pages). [cited by applicant]
Notice of Allowance mailed Jun. 21, 2022, issued in connection with U.S. Appl. No. 16/189,512 (7 pages). [cited by applicant]
Dino, et al., “Image-Based Construction of Building Energy Models Using Computer Vision,” Automation in Construction (2020) (15 pages). [cited by applicant]
Fathi, et al., “Automated As-Built 3D Reconstruction of Civil Infrastructure Using Computer Vision: Achievements, Opportunities, and Challenges,” Advanced Engineering Informatics (2015) (13 pages). [cited by applicant]
International Search Report of the International Searching Authority mailed on Jul. 25, 2022, issued in connection with International Application No. PCT/US22/22024 (3 pages). [cited by applicant]
Written Opinion of the International Searching Authority mailed on Jul. 25, 2022, issued in connection with International Application No. PCT/US22/22024 (5 pages). [cited by applicant]
Communication Pursuant to Article 94(3) EPC issued by the European Patent Office mailed on Apr. 28, 2023, issued in connection with European Patent Application No. 19866788.3 (5 pages). [cited by applicant]
Communication Pursuant to Article 94(3) EPC mailed Jan. 23, 2024, issued by the European Patent Office in connection with European Patent Application No. 19866788.3 (5 pages). [cited by applicant]
Examination Report No. 1 mailed Jan. 24, 2024, issued by the Australian Patent Office in connection with Australian Patent Application No. 2019350710 (3 pages). [cited by applicant]
Office Action dated Oct. 22, 2025, issued by the Canadian Intellectual Property Office in connection with Canadian Patent Application No. 3,112,435 (7 pages). [cited by applicant]
International Search Report of the International Searching Authority mailed on Dec. 12, 2019, issued in connection with International Application No. PCT/US2019/52670 (3 pages). [cited by applicant]
Written Opinion of the International Searching Authority mailed on Dec. 12, 2019, issued in connection with International Application No. PCT/US2019/52670 (5 pages). [cited by applicant]
Examination Report No. 1 mailed Mar. 30, 2021, issued by the Australian Patent Office in connection with Australian Patent Application No. 2016366537 (6 pages). [cited by applicant]