IP Library › Granted Patent US 10,580,207
Granted Patent B2
US 10,580,207 · App. 15/822,070 · Granted Mar 3, 2020

Augmented reality method and system for design

Inventors: Petar Pejic (Surdulica, RS); Frederic Bavastro (Monaco, MC)
Assignee: Frederic Bavastro
G06T17/05G06F17/5004G06K9/00476G06T7/543G06T19/006G06T19/20G06T2200/24G06T2210/04G06T2219/2004G06T2219/2012G06T2219/2024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,580,207
App. No.
15/822,070
Filed
Nov 24, 2017
Granted
Mar 3, 2020
Kind
B2
Art Unit
2619
USPC
345/419
Abstract

A system for generating formal premises designs is discussed. The system begins by inputting an informal two-dimensional rendering of the premises. The system continues by analyzing the informal two-dimensional rendering and determining features found on the premises depicted by the two-dimensional rendering. The system then generates a three-dimensional model of the premises and populates it with interactive objects. Finally, the system provides multiple views of the three-dimensional rendering containing interactive objects.

Claims (34)

1. A system for generating formal premises designs comprising:

inputting into the system an informal two-dimensional rendering of the premises by only by photographing an informal two-dimensional sketch of the premises and not by entering information about the premises directly in the system;

analyzing said informal two-dimensional rendering and converting said informal two-dimensional rendering into a numerical matrix;

determining features, wherein said features comprise determining layout of walls, locations of doors along with windows, found on the premises depicted by the two-dimensional rendering further automatically assigning names to each room detected in the premises wherein said determining features step comprises the system calculating an area of each room and wherein said names reflect a type of room detected by the system based on calculated room size and expected room sizes of possible rooms and wherein said determining features uses only the informal drawing as input;

generating a three-dimensional model of the premises;

populating said three-dimensional rendering with interactive objects; and

providing multiple views of the three-dimensional rendering containing interactive objects.

2. The system of claim 1 wherein said inputting into the system comprises taking a photograph of a two-dimensional hand drawn sketch of the premises.

3. The system of claim 1 wherein said analysis occurs in a distributed computing platform.

4. The system of claim 1 wherein said analysis further comprises an augmented reality preview of the three dimensional model.

5. The system of claim 1 wherein said interactive objects comprise virtual versions of furniture, household fixtures, and decorative items.

6. The system of claim 1 wherein said three-dimensional rendering comprises defining windows and doors in the three-dimensional model wherein said rendering is shown in an augmented reality presentation.

7. A system for generating formal premises designs comprising:

reading initial data into the system;

inputting into the system data to represent one or more premises; wherein said inputting step comprises only photographing of an informal sketch of the premises and not entering information about the premises directly in the system;

converting said input data into a numerical matrix;

analyzing said numerical matrix to generate a three-dimensional model;

modifying the three-dimensional model using augmented reality;

determining features found on the premises wherein said features comprise determining layout of walls, locations of doors along with windows, along with automatically assigning names to each room detected in the premises; wherein said determining features step comprises the system calculating an area of each room and wherein said names reflect a type of room detected by the system based on calculated room size and expected room sizes of possible rooms and wherein said determining features uses only the informal drawing as input;

generating a final three-dimensional model of the premises;

generating a photorealistic visualization of the premises; and

previewing the photorealistic visualization of the premises.

8. The system of claim 7 wherein said inputting step comprises providing the system a video of a 2-dimensional sketch on paper.

9. The system of claim 7 wherein said inputting step further comprises reading an existing three-dimensional model as a baseline.

10. The system of claim 7 wherein said inputting step comprises importing a completed three-dimensional model.

11. The system of claim 7 wherein said modification of input step further comprises use of artificial intelligence to generate the three-dimensional model.

12. The system of claim 7 wherein said final three-dimensional model is populated by one or more interactive objects.

13. The system of claim 12 wherein said interactive objects comprise furniture and surface finishes to be customized by an end user of the system.

14. The system of claim 7 wherein said previewing of the photorealistic visualization occurs using augmented reality.

15. The system of claim 7 wherein said previewing of the photorealistic visualization occurs using virtual reality.

16. The system of claim 7 wherein said analysis of input determines the type of each room depicted on the premises.

17. The system of claim 7 wherein said analysis of input confirms that each room depicted in the premises is a valid room.

18. The system of claim 7 wherein said analysis step requests user input to ensure proper detection of rooms within depicted premises.

19. The system of claim 7 wherein said analysis step comprises detection of doors and windows within the input design.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2017
From: PEJIC, PETAR
To: BAVASTRO, FREDERIC
Reel/Frame 044919/0784 →
ASSIGNMENT OF PROFITS Recorded Dec 20, 2017
From: BAVASTRO, FREDERIC
To: PEJIC, PETAR
Reel/Frame 044919/0791 →
Continuity (1)
Related Publication 20190164340A1 · May 30, 2019
Cited By (5)
US 12,205,232 US 12,205,233 US 12,236,545 US 12,254,583 US 12,731,356