IP Library Granted Patent US 11,144,680
Granted Patent B2
US 11,144,680 · App. 16/862,796 · Granted Oct 12, 2021

Methods for determining environmental parameter data of a real object in an image

Inventor: Milos Jovanovic (Portland, OR)
Assignee: Atheer, Inc.
G06F30/00G06F3/0486G06F3/0488G06F3/04815G06F3/04845G06F30/13G06T13/205G06T15/10G06T15/20G06T19/006G06T19/20G06F2203/04802G06T2215/12G06T2215/16G06T2219/004G06T2219/008G06T2219/012G06T2219/2004G06T2219/2008G06T2219/2012G06T2219/2016G06T2219/2024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,144,680
App. No.
16/862,796
Granted
Oct 12, 2021
Kind
B2
Abstract

Example systems and methods for virtual visualization of a three-dimensional (3D) model of an object in a two-dimensional (2D) environment. The method may include capturing the 2D environment and adding scale and perspective to the 2D environment. Further, a user may select intersection points on a ground plane of the 2D environment to form walls, thereby converting the 2D environment into a 3D space. The user may further add 3D models of objects on the wall plane such that the objects may remain flush with the wall plane.

Claims (67)

1. A method, comprising:

receiving, at a processing device coupled to a display device, two-dimensional environment data that corresponds to an image of a real environment;

generating, by the processing device, three-dimensional environment data based on the two-dimensional environment data, the three-dimensional environment data corresponding to a three-dimensional model of the real environment;

determining, by the processing device, environmental parameter data that corresponds to a first rule for placement or orientation of a real object in the real environment based on a feature of the real environment, the feature of the real environment corresponding to:

a placement or orientation of other objects in the real environment based on the two-dimensional environment data;

a practical standard for usability of the real environment;

an access regulation established by a government or regulatory authority; or

a safety standard established by the government or regulatory authority;

determining, by the processing device, object parameter data that corresponds to a second rule for placement or orientation of the real object in the real environment based on a feature of the real object, the feature of the real object corresponding to:

a spatial standard that exceeds a geometric dimension of the real object; or

a proximity standard for placement of the real object within a maximum proximity of another feature of the real environment;

receiving, by the processing device, input data that corresponds to placement of a three-dimensional object in the three-dimensional environment, the three-dimensional object being a virtual rendering of the real object; and

in response to receiving the input data, displaying, by a display device coupled to the processing device, the three-dimensional environment with the three-dimensional object, wherein the three-dimensional object is displayed in the three-dimensional environment according to the environment parameter data and the object parameter data.

2. The method of claim 1 , wherein the feature of the real environment further corresponds to a minimum clearance around the other objects in the real environment.

3. The method of claim 1 , wherein the feature of the real environment further corresponds to maintaining a pathway for traversal of the real environment.

4. The method of claim 1 , wherein the feature of the real environment further corresponds to a retail merchandising plan.

5. The method of claim 1 , further comprising:

receiving, by the processing device, safety or regulation data, the safety or regulation data received via manual input by a user or from a regulatory database, the safety or regulation data corresponding to:

an access regulation; or

a fire code; and

determine the environmental parameter data based on the safety or regulation data.

6. The method of claim 1 , further comprising:

receiving, by the processing device, manufacturer data that corresponds to a manufacturer specification for the real object, the manufacturing data received via manual input by a user or from a manufacturer database; and

determining the object parameter data based on the manufacturer data.

7. The method of claim 1 , wherein the other feature corresponding to the proximity standard comprises:

an electrical panel; or

an air vent.

8. A method, comprising:

receiving, at a processing device coupled to a display device, two-dimensional environment data that corresponds to an image of a real environment;

generating, by the processing device, three-dimensional environment data based on the two-dimensional environment data, the three-dimensional environment data corresponding to a three-dimensional model of the real environment;

determining, by the processing device, environmental parameter data that corresponds to a first rule for placement or orientation of a real object in the real environment based on a feature of the real environment other than an architectural feature of the real environment;

determining, by the processing device, object parameter data that corresponds to a second rule for placement or orientation of the real object in the real environment based on a feature of the real object other than a geometric dimension of the real object;

receiving, by the processing device, input data that corresponds to placement of a three-dimensional object in the three-dimensional environment, the three-dimensional object being a virtual rendering of the real object; and

in response to receiving the input data, displaying, by a display device coupled to the processing device, the three-dimensional environment with the three-dimensional object, wherein the three-dimensional object is displayed in the three-dimensional environment according to the environment parameter data and the object parameter data.

9. The method of claim 8 , wherein the environmental parameter data corresponds to:

a placement or orientation of another object in the real environment; and

a minimum or maximum spacing in the real environment between the real object and the other object, the spacing corresponding to a rule for traversal of the real environment.

10. The method of claim 8 , wherein the environmental parameter data corresponds to a rule established by a government or regulatory authority.

11. The method of claim 8 , wherein the object parameter data corresponds to a spatial standard for a minimum amount of clearance around the real object.

12. The method of claim 8 , wherein the object parameter data corresponds to a proximity standard for placement of the real object within a maximum proximity of:

an electrical panel;

an air vent; or

an architectural feature of the real environment.

13. The method of claim 8 , wherein the real environment is:

an industrial environment and the environmental parameter data is based on occupational safety and health regulations;

a retail environment and the environmental parameter data is based on a merchandising plan for the retail environment; or

a restaurant environment and the environmental parameter data is based on a traversal plan for the restaurant environment.

14. The method of claim 8 , wherein the object parameter data is based on an interaction between the real object and another object in the real environment.

15. A method, comprising:

receiving, at a processing device, two-dimensional environment data that corresponds to a digital image of a real environment;

generating, by the processing device, three-dimensional environment data based on the two-dimensional environment data, the three-dimensional environment data corresponding to a three-dimensional model of the real environment;

determining, by the processing device, parameter data that corresponds to a parameter for placing a three-dimensional object in a three-dimensional environment defined by the three-dimensional environment data, wherein the parameter defines a limitation on position or orientation of a real object in the real environment, the three-dimensional object being a virtual model of a real object;

receiving, by the processing device, input data that corresponds to placing a three-dimensional object in the three-dimensional environment, the three-dimensional object being a virtual rendering of the real object;

in response to receiving the input data, displaying, by a display device coupled to the processing device, the three-dimensional environment with the three-dimensional object, wherein the three-dimensional object is displayed in the three-dimensional environment according to the parameter data; and

in response to receiving the input data, altering, by the processing device for display by the display device, a brightness or a contrast of an element of the three-dimensional environment, wherein altering the brightness or the contrast is further in response to the input data indicating a position of the three-dimensional object in the three-dimensional environment:

violates a rule associated with the parameter data for placement of the real object in the real environment; or

is permissible under the rule associated with the parameter data for placement of the real object in the real environment.

16. The method of claim 15 , wherein the parameter data is environmental parameter data or object parameter data.

17. The method of claim 16 , wherein the environmental parameter data corresponds to:

a rule established by a government or regulatory authority; or

a layout for other objects in the real environment.

18. The method of claim 16 , wherein the object parameter data corresponds to:

a minimum clearance around the real object as established by a manufacturer or safety specification; or

a minimum or maximum proximity for the real object to another object in the real environment.

19. The method of claim 15 , further comprising, in response to receiving the input data, altering, by the processing device for display by the display device, a brightness or a contrast of the three-dimensional object, wherein altering the brightness or the contrast is further in response to the input data indicating a position of the three-dimensional object in the three-dimensional environment:

violates a rule associated with the parameter data for placement of the real object in the real environment; or

is permissible under the rule associated with the parameter data for placement of the real object in the real environment.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2022
From: ATHEER, INC.
To: WEST TEXAS TECHNOLOGY PARTNERS, LLC
Reel/Frame 058962/0067 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2020
From: JOVANOVIC, MILOS
To: SPACEVIEW, INC.
Reel/Frame 054755/0536 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2020
From: SPACEVIEW, INC.
To: ATHEER, INC.
Reel/Frame 054755/0577 →
Continuity (9)
Continuation 15948901 · Apr 9, 2018
Continuation 14710557 · May 12, 2015
Provisional Application 61992759 · May 13, 2014
Provisional Application 61992629 · May 13, 2014
Provisional Application 61992719 · May 13, 2014
Provisional Application 61992774 · May 13, 2014
Provisional Application 61992746 · May 13, 2014
Provisional Application 61992665 · May 13, 2014
Related Publication 20200257830A1 · Aug 13, 2020
Cited By (4)
US 1,142,414 US 12,293,459 US 12,614,218 US 12,626,298