IP Library Granted Patent US 12,148,209
Granted Patent B2
US 12,148,209 · App. 17/892,032 · Granted Nov 19, 2024

Systems and methods for a 3D home model for visualizing proposed changes to home

Inventors: Nicholas Carmelo Marotta (Scottsdale, AZ); Laura Kennedy (Gilbert, AZ); J D Johnson Willingham (Phoenix, AZ)
Assignee: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
G06V20/20B64C39/024G01S7/4808G01S7/51G01S17/89G02B27/0172G06F16/29G06F30/13G06N3/049G06N3/08G06N5/04G06N20/00G06Q10/087G06Q20/085G06Q20/12G06Q30/0633G06Q30/0639G06T7/75G06T7/90G06T17/00G06T17/05G06T19/003G06T19/006G06T19/20B64U2101/30G02B2027/0138G02B2027/014G02B2027/0178G06T2207/10028G06T2207/10044G06T2207/30184G06T2219/2012H04W84/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,148,209
App. No.
17/892,032
Filed
Aug 19, 2022
Granted
Nov 19, 2024
Kind
B2
Art Unit
2617
USPC
345/419
Abstract

The following relates generally to light detection and ranging (LIDAR) and artificial intelligence (AI). In some embodiments, a system: receives LIDAR data generated from a LIDAR camera; measures a plurality of dimensions of a room of the home based upon processor analysis of the LIDAR data; builds a 3D model of the room based upon the measured plurality of dimensions; receives an indication of a proposed change to the room; modifies the 3D model to include the proposed change to the room; and displays a representation of the modified 3D model.

Claims (65)

1. A computer-implemented method for visualizing proposed changes to a home, the method comprising, via one or more processors, sensors, servers, and/or transceivers:

receiving light detection and ranging (LIDAR) data generated from a LIDAR camera;

measuring a plurality of dimensions of a room of the home based upon processor analysis of the LIDAR data;

building a 3D model of the room based upon the measured plurality of dimensions;

receiving an indication of a proposed change to the room, wherein the proposed change to the room comprises a remodel of a kitchen or bathroom;

modifying the 3D model to include the proposed change to the room;

receiving object data comprising: (i) dimensional data of an object; (ii) a type of the object; and/or (iii) color data of the object;

with a trained machine learning algorithm, generating a recommendation for placement of the object in the room based upon: (i) the measured plurality of dimensions, and (ii) the received object data; and

displaying a representation of the modified 3D model including a representation of the recommendation for placement of the object.

2. The computer-implemented method of claim 1 , wherein the proposed change to the room comprises addition or removal of a wall.

3. The computer-implemented method of claim 1 , wherein the proposed change to the room comprises a remodel of a kitchen, and includes a different size or color of a countertop or cabinet.

4. The computer-implemented method of claim 1 , wherein the displaying the representation of the modified 3D model comprises displaying a 2D image generated from the 3D model.

5. The computer-implemented method of claim 1 , further comprising, via the one or more processors, transceivers, sensors, and/or servers, receiving navigation input;

wherein the displaying the representation of the modified 3D model comprises visually navigating through the 3D model based upon the received navigation input.

6. The computer-implemented method of claim 1 , wherein the proposed change to the room comprises a repair to at least one of a window or a wall.

7. The computer-implemented method of claim 1 , wherein the building of the 3D model further comprises building the 3D model further based upon preexisting home structural data.

8. The computer-implemented method of claim 1 , further comprising, via the one or more processors, transceivers, sensors, and/or servers, receiving camera data including color data;

wherein the building of the 3D model further comprises:

deriving dimensions of a wall based upon processor analysis of the LIDAR data;

deriving a color of the wall based upon processor analysis of the camera data; and

filling, into the 3D model, the wall including the derived dimensions of the wall and the derived color of the wall.

9. The computer-implemented method of claim 1 , wherein the proposed change to the room comprises addition or removal of a skylight.

10. The computer-implemented method of claim 1 , wherein the proposed change to a room is received from a computing device of a human user, the computing device comprising: a computer, a smartphone, or a tablet.

11. A computer system configured to visualize proposed changes to a home, the computer system comprising one or more processors, sensors, servers, and/or transceivers configured to:

receive light detection and ranging (LIDAR) data generated from a LIDAR camera;

measure a plurality of dimensions of a room of the home based upon processor analysis of the LIDAR data;

build a 3D model of the room based upon the measured plurality of dimensions;

receive an indication of a proposed change to the room, wherein the proposed change to the room comprises a remodel of a kitchen or bathroom;

modify the 3D model to include the proposed change to the room;

receive object data comprising: (i) dimensional data of an object; (ii) a type of the object; and/or (iii) color data of the object;

with a trained machine learning algorithm, generate a recommendation for placement of the object in the room based upon: (i) the measured plurality of dimensions, and (ii) the received object data; and

display a representation of the modified 3D model including a representation of the recommendation for placement of the object.

12. The computer system of claim 11 , wherein the proposed change to the room comprises addition or removal of a wall.

13. The computer system of claim 11 , the system further configured, via the one or more processors, sensors, servers, and/or transceivers, to display a 2D image generated from the 3D model.

14. The computer system of claim 11 , the system further configured, via the one or more processors, sensors, servers, and/or transceivers, to:

receive navigation input; and

display the representation of the modified 3D model by visually navigating through the 3D model based upon the received navigation input.

15. The computer system of claim 11 , the system further configured, via the one or more processors, sensors, servers, and/or transceivers, to:

receive camera data including color data; and

build the 3D model by:

deriving dimensions of a wall based upon processor analysis of the LIDAR data;

deriving a color of the wall based upon processor analysis of the camera data; and

filling, into the 3D model, the wall including the derived dimensions of the wall and the derived color of the wall.

16. A computer system configured to visualize proposed changes to a home, comprising:

one or more processors; and

a non-transitory program memory coupled to the one or more processors and storing executable instructions that when executed by the one or more processors cause the computer system to:

receive light detection and ranging (LIDAR) data generated from a LIDAR camera;

measure a plurality of dimensions of a room of the home based upon processor analysis of the LIDAR data;

build a 3D model of the room based upon the measured plurality of dimensions;

receive an indication of a proposed change to the room, wherein the proposed change to the room comprises a remodel of a kitchen or bathroom;

modify the 3D model to include the proposed change to the room; and

receive object data comprising: (i) dimensional data of an object; (ii) a type of the object; and/or (iii) color data of the object;

with a trained machine learning algorithm, generate a recommendation for placement of the object in the room based upon: (i) the measured plurality of dimensions, and (ii) the received object data; and

display a representation of the modified 3D model including a representation of the recommendation for placement of the object.

17. The computer system of claim 16 , wherein the proposed change to the room comprises addition or removal of a wall.

18. The computer system of claim 16 , wherein the executable instructions further cause the computer system to display a 2D image generated from the 3D model.

19. The computer system of claim 16 , wherein the executable instructions further cause the computer system to:

receive navigation input; and

display the representation of the modified 3D model by visually navigating through the 3D model based upon the received navigation input.

20. The computer system of claim 16 , wherein the executable instructions further cause the computer system to:

receive camera data including color data; and

build the 3D model by:

deriving dimensions of a wall based upon processor analysis of the LIDAR data;

deriving a color of the wall based upon processor analysis of the camera data; and

filling, into the 3D model, the wall including the derived dimensions of the wall and the derived color of the wall.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 5, 2023
From: MAROTTA, NICHOLAS CARMELO; KENNEDY, LAURA; WILLINGHAM, JD JOHNSON
To: STATE FARM MUTUAL AUTOMOBILE INSURANCE COMPANY
Reel/Frame 063850/0296 →
Continuity (5)
Continuation 17240970 · Apr 26, 2021
Provisional Application 63027201 · May 19, 2020
Provisional Application 63016168 · Apr 27, 2020
Provisional Application 63025600 · May 15, 2020
Related Publication 20220406026A1 · Dec 22, 2022
Cited By (5)
US 12,361,376 US 12,530,727 US 12,541,682 US 12,572,892 US 12,586,135