IP Library Granted Patent US 9,953,112
Granted Patent B2
US 9,953,112 · App. 14/617,575 · Granted Apr 24, 2018

Method and system for displaying room interiors on a floor plan

Inventor: Stephen L. Schultz (West Henrietta, NY)
Assignee: Pictometry International Corp.
G06F17/5004G01C15/002G06T19/00H04W4/023
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,953,112
App. No.
14/617,575
Granted
Apr 24, 2018
Kind
B2
Abstract

A system and method for generating multi-3D perspective floor plans having real-life physical characteristics. The multi-3D perspective floor plans may be generated using image data and related to a floor plan of a structure.

Claims (35)

1. A computer system, comprising:

one or more processors; and,

one or more non-transitory computer readable medium accessible by the one or more processors and storing instructions that when executed by the one or more processors cause the one or more processors to:

access data indicative of a floor plan of a structure, the floor plan having a first room comprising a first set of walls and a first floor between the walls in the first set of walls, a second room comprising a second set of walls and a second floor between the walls in the second set of walls; and

access a set of image data depicting the first set of walls and the first floor of the first room and the second set of walls and the second floor of the second room;

wherein the instructions, when executed by the processor, further cause the processor to generate one or more output signals indicative of a multi-3D perspective floor plan created from the floor plan and portions of the set of image data, the multi-3D perspective floor plan having:

a first 3D fitted representation of real-life physical characteristics of the first set of walls and the first floor of the first room, the first 3D fitted representation generated by extracting each wall of the first set of walls a distance inward from an outline of the first room and resizing the first floor to accommodate the extracted walls such that real life physical characteristics within and on each wall of the first set of walls is visually represented without obscuring the first floor when viewed from a first perspective having a first viewing direction extending from a first viewing location; and,

a second 3D fitted representation of real-life physical characteristics of the second set of walls and the second floor of the second room, the second 3D fitted representation generated by extracting each wall of the second set of walls a distance inward from an outline of the second room and resizing the second floor to accommodate the extracted walls such that real life physical characteristics within and on each wall of the second set of walls is visually represented without obscuring the second floor when viewed from a second perspective having a second viewing direction extending from a second viewing location,

wherein at least one of the first viewing direction differs from the second viewing direction, and the first viewing location differs from the second viewing location.

2. The computer system of claim 1 , wherein the image data includes CAD drawings.

3. The computer system of claim 2 , wherein the first perspective is an overhead perspective.

4. The computer system of claim 3 , wherein the first viewing direction is a nadir direction.

5. The computer system of claim 4 , wherein the second perspective is an overhead perspective.

6. The computer system of claim 5 , wherein the second viewing direction is a nadir direction.

7. The computer system of claim 1 , wherein the computer system comprises at least one processor in communication with an image capturing system.

8. The computer system of claim 7 , wherein the image capturing system comprises a LiDAR scanner, and the image data includes data points obtained by the LiDAR scanner forming a three-dimensional model floor plan of the walls and the floor.

9. The computer system of claim 8 , wherein the instructions, when executed by the processor, relate the three-dimensional model floor plan of the room and render the multi-3D perspective floor plan.

10. The computer system of claim 7 , wherein the image data includes at least one image captured by the image capturing system.

11. The computer system of claim 1 , wherein the instructions, when executed by the processor, further fill the floor plan with a first color and relating the image data to the room includes positioning images of the floor and images of the wall such that the first color is visible within the multi-3D perspective floor plan.

12. The computer system of claim 1 , wherein the instructions, when executed by the processor, generate the first 3D fitted representation of real-life physical characteristics of the first set of walls of the first room from operator input and a plurality of image data which collectively shows the real-life physical characteristics of the first set of walls of the first room.

13. The computer system of claim 1 , wherein the instructions, when executed by the processor, generate the first 3D fitted representation of real-life physical characteristics of the first set of walls of the first room in an automated process using a plurality of image data which collectively shows the real-life physical characteristics of the first set of walls of the first room.

14. An automated method of generating a multi-3D perspective floor plan of a structure performed by a processor of a computer system, comprising:

generating a first 3D fitted representation of real-life physical characteristics of a first set of walls and the first floor of a first room, the first 3D fitted representation generated by extracting each wall of the first set of walls a distance inward from an outline of the first room and resizing a first floor to accommodate the extracted walls such that real life physical characteristics within and on each wall of the first set of walls is visually represented without obscuring the first floor when viewed from a first perspective having a first viewing direction extending from a first viewing location; and

generating a second 3D fitted representation of real-life physical characteristics of a second set of walls and a second floor of a second room, the second 3D fitted representation generated by extracting each wall of the second set of walls a distance inward from an outline of the second room and resizing the second floor to accommodate the extracted walls such that real life physical characteristics within and on each wall of the second set of walls is visually represented without obscuring the second floor when viewed from a second perspective having a second viewing direction extending from a second viewing location;

wherein at least one of the first viewing direction differs from the second viewing direction, and the first viewing location differs from the second viewing location.

15. The method of claim 14 , wherein the first perspective is an overhead perspective.

16. The method of claim 15 , wherein the second perspective is an overhead perspective.

17. The method of claim 16 , wherein the first viewing direction is nadir direction.

18. A computerized system, comprising:

a computer system storing a database of multi-3D perspective floor plans of structures with corresponding geo-location data identifying the structures within the database, the structures having one or more room(s) comprising a set of walls and a floor between the walls and the multi-3D perspective floor plans are generated by extracting each wall of the set of walls a distance inward from an outline of a room and resizing the floor to accommodate the extracted walls such that real life physical characteristics within and on each wall of the set of walls is visually represented without obscuring the floor when viewed from a perspective having a viewing direction extending from a viewing location, the computer system further having computer executable logic that when executed by a processor causes the computer system to receive a geographic point from a user, search the database to find at least one multi-3D perspective floor plan that corresponds to the geographic point, and make the multi-3D perspective floor plan that contains the geographic point available to the user.

19. A method of providing a multi-3D perspective floor plan to a user, comprising the steps of:

storing a database of multi-3D perspective floor plans of structures with corresponding geo-location data identifying the structures within the database, the multi-3D perspective floor plans having one or more room(s) comprising a set of walls and a floor between the walls in the set, and a set of image data depicting the walls and the floor of the room(s), the multi-3D perspective floor plans generated by extracting each wall of the set of walls a distance inward from an outline of each room of the one or more room(s) and resizing the floor to accommodate the extracted walls such that real life physical characteristics within and on each wall of the set of walls is visually represented without obscuring the floor when viewed from a perspective having a viewing direction extending from a viewing location;

receiving, via one or more I/O port, a geographic point from the user;

searching the database to find at least one multi-3D perspective floor plan that contains the geographic point and the set of image data depicting the walls and the floor images that contain the geographic point; and

making the floor plans and the set of image data depicting the walls and the floor of the multi-3D perspective floor plan that contains the geographic point available to the user.

Assignments (10)
RELEASE OF SECURITY INTEREST Recorded Apr 14, 2025
From: HPS INVESTMENT PARTNERS, LLC
To: PICTOMETRY INTERNATIONAL CORP.
Reel/Frame 070828/0266 →
RELEASE OF FIRST LIEN SECURITY INTEREST IN PATENTS Recorded Apr 9, 2025
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.; OMNIEARTH, INC.
Reel/Frame 070786/0022 →
FIRST LIEN SECURITY AGREEMENT Recorded Mar 28, 2025
From: EAGLE VIEW TECHNOLOGIES, INC.; PICTOMETRY INTERNATIONAL CORP.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 070671/0078 →
RELEASE OF FIRST LIEN SECURITY INTEREST IN PATENTS Recorded Aug 29, 2018
From: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
To: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.; OMNIEARTH, INC.
Reel/Frame 046970/0875 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Aug 23, 2018
From: PICTOMETRY INTERNATIONAL CORP.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 046919/0065 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Aug 14, 2018
From: PICTOMETRY INTERNATIONAL CORP.
To: HPS INVESTMENT PARTNERS, LLC,
Reel/Frame 046823/0755 →
RELEASE OF SECOND LIEN SECURITY INTEREST Recorded Sep 22, 2017
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.; OMNIEARTH, INC.
Reel/Frame 043955/0128 →
SECOND LIEN PATENT SECURITY AGREEMENT Recorded Jul 20, 2015
From: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 036130/0873 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Jul 20, 2015
From: PICTOMETRY INTERNATIONAL CORP.; EAGLE VIEW TECHNOLOGIES, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 036130/0899 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2015
From: SCHULTZ, STEPHEN L.
To: PICTOMETRY INTERNATIONAL CORPORATION
Reel/Frame 035971/0847 →
Continuity (2)
Provisional Application 61937488 · Feb 8, 2014
Related Publication 20150227644A1 · Aug 13, 2015