IP Library Granted Patent US 11,062,059
Granted Patent B2
US 11,062,059 · App. 15/959,877 · Granted Jul 13, 2021

Method and system for displaying room interiors on a floor plan

Inventor: Stephen L. Schultz (West Henrietta, NY)
Assignee: Pictometry International Corp.
G06F30/13G01C15/002G06T19/00H04W4/023
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,062,059
App. No.
15/959,877
Granted
Jul 13, 2021
Kind
B2
Abstract

A system and method for generating multi-3D perspective floor plans having real-life physical characteristics. The multi-3D perspective floor plans may be generated using image data and related to a floor plan of a structure.

Claims (45)

1. A computer system, comprising:

one or more processors; and,

one or more non-transitory computer readable medium accessible by the one or more processors and storing instructions that when executed by the one or more processors cause the one or more processors to:

access data indicative of a floor plan of a structure, the floor plan having a first room comprising a first set of walls and a first floor between the walls in the first set of walls, a second room comprising a second set of walls and a second floor between the walls in the second set of walls; and

access a set of data indicative of three-dimensional data points depicting the first set of walls and the first floor of the first room and the second set of walls and the second floor of the second room;

wherein the instructions, when executed by the processor, further cause the processor to:

extract each wall of the first set of walls a distance inward from an outline of the first room from the floor plan and the three-dimensional data points;

resize the first floor to accommodate the extracted walls such that real life physical characteristics within and on each wall of the first set of walls is visually represented without obscuring the first floor when viewed from a first perspective having a first viewing direction extending from a first viewing location;

generate a first 3D fitted representation of real-life physical characteristics of the first set of walls and the first floor of the first room when viewed from a first perspective having a first viewing direction extending from a first viewing location using the extracted walls of the first set of walls and the resized first floor;

extract each wall of the second set of walls a distance inward from an outline of the second room from the floor plan and the three-dimensional data points;

resize the second floor to accommodate the extracted walls such that real life physical characteristics within and on each wall of the second set of walls is visually represented without obscuring the second floor when viewed from a second perspective having a second viewing direction extending from a second viewing location;

generate a second 3D fitted representation of real-life physical characteristics of the second set of walls and the second floor of the second room when viewed from a second perspective having a second viewing direction extending from a second viewing location using the extracted walls of the second set of walls and the resized second floor; and

generate a multi-3D perspective floor plan using the generated first 3D fitted representation of real-life physical characteristics of the first set of walls and the first floor of the first room when viewed from a first perspective having a first viewing direction extending from a first viewing location and using the generated second 3D fitted representation of real-life physical characteristics of the second set of walls and the second floor of the second room when viewed from a second perspective having a second viewing direction extending from a second viewing location;

wherein at least one of the first viewing direction differs from the second viewing direction, and the first viewing location differs from the second viewing location.

2. The computer system of claim 1 , wherein the data indicative of three-dimensional data points was captured by one or more of a camera, a digital sensor, a charge-coupled device, and a scanner.

3. The computer system of claim 1 , wherein the first perspective is an overhead perspective.

4. The computer system of claim 1 , wherein the first viewing direction is a nadir direction.

5. The computer system of claim 1 , wherein the second perspective is an overhead perspective.

6. The computer system of claim 1 , wherein the second viewing direction is a nadir direction.

7. The computer system of claim 1 , wherein the computer system comprises at least one processor in communication with an image capturing system.

8. The computer system of claim 7 , wherein the image capturing system comprises a scanner, and the data includes data points obtained by the scanner forming a three-dimensional model floor plan of the walls and the floors.

9. The computer system of claim 8 , wherein the instructions, when executed by the processor, relate the three-dimensional model floor plan of the room and render the multi-3D perspective floor plan.

10. The computer system of claim 7 , wherein the data is at least partially based on at least one image captured by the image capturing system.

11. The computer system of claim 1 , wherein the instructions, when executed by the one or more processors, further fill the floor plan with a first color and relating the data to the room includes positioning data of the floor and data of the wall such that the first color is visible within the multi-3D perspective floor plan.

12. The computer system of claim 1 , wherein the instructions, when executed by the processor, generate the first 3D fitted representation of real-life physical characteristics of the first set of walls of the first room from operator input and a plurality of data which collectively shows the real-life physical characteristics of the first set of walls of the first room.

13. The computer system of claim 1 , wherein the instructions, when executed by the one or more processors, generate the first 3D fitted representation of real-life physical characteristics of the first set of walls of the first room in an automated process using a plurality of data which collectively shows the real-life physical characteristics of the first set of walls of the first room.

14. A method, comprising:

accessing, with one or more processors, data indicative of a floor plan of a structure, the floor plan having a first room comprising a first set of walls and a first floor between the walls in the first set of walls, a second room comprising a second set of walls and a second floor between the walls in the second set of walls; and

accessing, with the one or more processors a set of data indicative of three dimensional data points depicting the first set of walls and the first floor of the first room and the second set of walls and the second floor of the second room;

extracting each wall of the first set of walls a distance inward from an outline of the first room from the floor plan and the three-dimensional data points;

resizing the first floor to accommodate the extracted walls such that real life physical characteristics within and on each wall of the first set of walls is visually represented without obscuring the first floor when viewed from a first perspective having a first viewing direction extending from a first viewing location;

generating a first 3D fitted representation of real-life physical characteristics of the first set of walls and the first floor of the first room when viewed from a first perspective having a first viewing direction extending from a first viewing location using the extracted walls of the first set of walls and the resized first floor;

extracting each wall of the second set of walls a distance inward from an outline of the second room from the floor plan and the three-dimensional data points;

resizing the second floor to accommodate the extracted walls such that real life physical characteristics within and on each wall of the second set of walls is visually represented without obscuring the second floor when viewed from a second perspective having a second viewing direction extending from a second viewing location;

generating a second 3D fitted representation of real-life physical characteristics of the second set of walls and the second floor of the second room when viewed from a second perspective having a second viewing direction extending from a second viewing location using the extracted walls of the second set of walls and the resized second floor; and

generating a multi-3D perspective floor plan using the generated first 3D fitted representation of real-life physical characteristics of the first set of walls and the first floor of the first room when viewed from a first perspective having a first viewing direction extending from a first viewing location and using the generated second 3D fitted representation of real-life physical characteristics of the second set of walls and the second floor of the second room when viewed from a second perspective having a second viewing direction extending from a second viewing location;

wherein at least one of the first viewing direction differs from the second viewing direction, and the first viewing location differs from the second viewing location.

15. The method of claim 14 , wherein the data indicative of three-dimensional data points was captured by one or more of a camera, a digital sensor, a charge-coupled device, and a scanner.

16. The method of claim 14 , wherein the first perspective is an overhead perspective.

17. The method of claim 14 , wherein the first viewing direction is a nadir direction.

18. The method of claim 14 , wherein the second perspective is an overhead perspective.

19. The method of claim 14 , wherein the second viewing direction is a nadir direction.

20. The method of claim 14 , wherein the data includes data points obtained by a scanner forming a three-dimensional model floor plan of the walls and the floors.

21. The method of claim 20 , further comprising relating the three-dimensional model floor plan of the room and rendering the multi-3D perspective floor plan.

22. The method of claim 14 , wherein the data is at least partially based on at least one image captured by the image capturing system.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded Apr 14, 2025
From: HPS INVESTMENT PARTNERS, LLC
To: PICTOMETRY INTERNATIONAL CORP.
Reel/Frame 070828/0266 →
RELEASE OF FIRST LIEN SECURITY INTEREST IN PATENTS Recorded Apr 9, 2025
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.; OMNIEARTH, INC.
Reel/Frame 070786/0022 →
FIRST LIEN SECURITY AGREEMENT Recorded Mar 28, 2025
From: EAGLE VIEW TECHNOLOGIES, INC.; PICTOMETRY INTERNATIONAL CORP.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 070671/0078 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Aug 23, 2018
From: PICTOMETRY INTERNATIONAL CORP.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 046919/0065 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Aug 14, 2018
From: PICTOMETRY INTERNATIONAL CORP.
To: HPS INVESTMENT PARTNERS, LLC,
Reel/Frame 046823/0755 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 23, 2018
From: SCHULTZ, STEPHEN L.
To: PICTOMETRY INTERNATIONAL CORP.
Reel/Frame 045612/0270 →
Continuity (3)
Continuation 14617575 · Feb 9, 2015
Provisional Application 61937488 · Feb 8, 2014
Related Publication 20180239842A1 · Aug 23, 2018