IP Library Granted Patent US 11,682,174
Granted Patent B1
US 11,682,174 · App. 17/403,383 · Granted Jun 20, 2023

Automated measurement of interior spaces through guided modeling of dimensions

Inventors: Victor Palmer (College Station, TX); Cole Winans (Brighton, MO)
Assignee: Flyreel, Inc.
G06T19/006G06F3/167G06F9/547G06T7/50
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,682,174
App. No.
17/403,383
Granted
Jun 20, 2023
Kind
B1
Abstract

Introduced here computer programs and associated computer-implemented techniques for establishing the dimensions of interior spaces. These computer programs are able to accomplish this by combining knowledge of these interior spaces with spatial information that is output by an augmented reality (AR) framework. Such an approach allows two-dimensional (2D) layouts to be seamlessly created through guided corner-to-corner measurement of interior spaces.

Claims (67)

1. A non-transitory medium with instructions stored thereon that, when executed by a processor of a computing device, cause the computing device to perform operations comprising:

receiving a first input that represents a request to establish dimensions of an interior space;

presenting an instruction to locate the computing device proximate to a juncture corresponding to a periphery of the interior space;

receiving a second input that indicates the computing device is located proximate to the juncture,

wherein the second input is representative of a pattern of measurements produced by a motion sensor that indicates contact was initiated by the computing device with at least one wall that forms the juncture;

in response to receiving the second input, acquiring a spatial coordinate from an augmented reality (AR) framework that is executing on the computing device; and

storing the spatial coordinate in a data structure that is associated with the interior space.

2. The non-transitory medium of claim 1 , wherein the operations further comprise:

presenting a second instruction to locate the computing device proximate to a second juncture of the interior space;

receiving a third input that indicates the computing device is located proximate to the second juncture,

wherein the third input is representative of another pattern of measurements produced by the motion sensor that indicates contact was initiated by the computing device with at least one wall that forms the second juncture;

in response to receiving the third input, acquiring a second spatial coordinate from the AR framework that is executing on the computing device; and

storing the second spatial coordinate in the data structure.

3. The non-transitory medium of claim 2 , wherein the operations further comprise:

defining a dimension of the interior space based on a comparison of the spatial coordinate corresponding to the juncture and the second spatial coordinate corresponding to the second juncture; and

storing the dimension in the data structure.

4. The non-transitory medium of claim 1 , wherein the operations further comprise:

in response to receiving the first input, invoking the AR framework so as to allow digital images captured by a camera as the computing device moves toward the juncture to be provided to the AR framework as input.

5. The non-transitory medium of claim 1 , wherein the spatial coordinate is acquired from the AR framework via an application programming interface.

6. The non-transitory medium of claim 1 , wherein the motion sensor is an accelerometer or a gyroscope.

7. The non-transitory medium of claim 1 , wherein the operations further comprise:

in response to receiving the first input,

presenting a second instruction to position the computing device in a predetermined orientation; and

invoking the AR framework so as to allow digital images captured by a camera of the computing device as the computing device moves toward the juncture to be provided to the AR framework as input.

8. The non-transitory medium of claim 7 , wherein the operations further comprise:

presenting the digital images on a display of the computing device in the form of a video feed; and

in response to acquiring the spatial coordinate, overlaying a graphical element on the video feed to visually indicate a location of the juncture.

9. A method implemented by a computer program executing on a computing device, the method comprising:

receiving input that is indicative of a request to establish dimensions of an interior space that includes multiple junctures, each of which represents a point at which a different pair of walls are joined;

instructing a user to locate the computing device proximate to the multiple junctures in succession while a camera generates a video feed of the interior space;

obtaining multiple spatial coordinates for the multiple junctures by acquiring, from an augmented reality (AR) framework to which the video feed is provided as input, a spatial coordinate whenever the computing device is determined to be proximate to one of the multiple junctures; and

calculating the dimensions of the interior space based on the multiple spatial coordinates.

10. The method of claim 9 , further comprising:

providing audio feedback to indicate when each of the multiple spatial coordinates is acquired from the AR framework.

11. The method of claim 9 , further comprising:

causing display of the video feed while the computing device traverses the interior space.

12. The method of claim 11 , further comprising:

for each of the multiple spatial coordinates,

overlaying a graphical element on the video feed to visually indicate a location of a corresponding juncture.

13. The method of claim 9 , further comprising:

causing display of a two-dimensional (2D) layout of the interior space that is based on the dimensions.

14. The method of claim 9 , wherein proximity of the computing device to the multiple junctures is inferred by the computer program based on outputs produced by a sensor of the computing device, such that locations of the multiple junctures are determined without requiring the user expressly specify the locations of the multiple junctures.

15. A method comprising:

instructing a user to locate a computing device that includes a sensor proximate to a first juncture along a periphery of an interior space;

determining that the computing device is located proximate to the first juncture based on analysis of a first output produced by the sensor at a first point in time;

acquiring, in response to said determining, a first spatial coordinate from an augmented reality (AR) framework executing on the computing device;

instructing the user to locate the computing device proximate to a second juncture along the periphery of the interior space;

determining that the computing device is located proximate to the second juncture based on analysis of a second output produced by the sensor at a second point in time;

acquiring, in response to said determining, a second spatial coordinate from the AR framework executing on the computing device; and

defining a dimension of the interior space based on a comparison of the first and second spatial coordinates.

16. The method of claim 15 ,

wherein the sensor is a motion sensor that generates values indicative of motion of the computing device,

wherein the first output is representative of one or more values that indicate contact was initiated by the computing device with at least one wall that forms the first juncture, and

wherein the second output is representative of one or more values that indicate contact was initiated by the computing device with at least one wall that forms the second juncture.

17. The method of claim 15 ,

wherein the sensor is a proximity sensor that generates values indicative of proximity of the computing device to a nearest obstruction within a field of view of the proximity sensor,

wherein the first output is representative of one or more values that indicate the computing device is within a predetermined proximity of the first juncture, and

wherein the second output is representative of one or more values that indicate the computing device is within the predetermined proximity of the second juncture.

18. The method of claim 17 , wherein the proximity sensor includes (i) an emitter that is able to emit infrared light and (ii) a detector that is able to detect reflected infrared light that is returned toward the computing device.

19. The method of claim 15 ,

wherein the sensor is an image sensor that digital images as the computing device traverses the interior space,

wherein the first output is representative of a first determination of proximity made by an algorithm upon examining a first digital image of the first juncture, and

wherein the second output is representative of a second determination of proximity made by the algorithm upon examining a second digital image of the second juncture.

20. The method of claim 15 ,

wherein the sensor is an ambient light sensor that generates values indicative of light in an ambient environment,

wherein the first output is representative of one or more values that indicate the computing device is proximate to the first juncture due to low light, and

wherein the second output is representative of one or more values that indicate the computing device is proximate to the second juncture due to low light.

Assignments (2)
MERGER Recorded Aug 5, 2024
From: FLYREEL, INC.; LEXISNEXIS RISK SOLUTIONS FL INC.
To: LEXISNEXIS RISK SOLUTIONS FL INC.
Reel/Frame 068177/0841 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 16, 2021
From: PALMER, VICTOR; WINANS, COLE
To: FLYREEL, INC.
Reel/Frame 057192/0651 →
Continuity (1)
Continuation 17193889 · Mar 5, 2021
Cited By (1)
US 12,586,321