IP Library Granted Patent US 9,971,853
Granted Patent B2
US 9,971,853 · App. 14/710,565 · Granted May 15, 2018

Method for replacing 3D objects in 2D environment

Inventor: Milos Jovanovic (Portland, OR)
Assignee: Atheer, Inc.
G06F17/50G06F3/0486G06F3/0488G06F3/04815G06F3/04845G06F17/5004G06T13/205G06T15/10G06T15/20G06T19/006G06T19/20G06F2203/04802G06T2215/12G06T2215/16G06T2219/004G06T2219/008G06T2219/012G06T2219/2004G06T2219/2008G06T2219/2012G06T2219/2016G06T2219/2024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,971,853
App. No.
14/710,565
Granted
May 15, 2018
Kind
B2
Abstract

Example systems and methods for virtual visualization of a three-dimensional (3D) model of an object in a two-dimensional (2D) environment. The method may include superimposing a first 3D model of an object onto the 2D environment, and replacing the first 3D model of the object with a second 3D model of an object. Further, the method may include superimposing a smart 3D model of an object onto the 2D environment. Additionally, the method may include a code or mark to identify images of the 2D environment to which 3D models of objects have been superimposed.

Claims (54)

1. A method for visualizing a three-dimensional model of an object in a two-dimensional environment, the method comprising:

receiving, with a processor, from a user, an import request to import the two-dimensional environment to be used as a background for the three-dimensional model;

importing, with the processor, based on the import request, the two-dimensional environment;

receiving, with the processor, from the user, a superimposing request to superimpose a three-dimensional model of a smart object onto the two-dimensional environment;

superimposing, with the processor, the three-dimensional model of the smart object onto the two-dimensional environment based on the superimposing request with a scale and a perspective based on the two-dimensional environment, where the smart object includes a playback animation;

saving, with the processor, a resulting image in a storage device communicatively coupled to the processor, the resulting image including the three-dimensional model of the smart object superimposed onto the two-dimensional environment; and

visualizing, via a video display unit communicatively coupled to the processor, the resulting image including the three-dimensional model of the smart object, wherein the playback animation of the smart object is displayed with a scale and a perspective based on the scale and the perspective of the three-dimensional model of the smart object and a position of the three-dimensional model of the smart object within the two-dimensional environment.

2. The method of claim 1 , wherein the playback animation comprises a video.

3. The method of claim 1 , wherein the playback animation is displayed in accordance with a location of the smart object.

4. The method of claim 1 , wherein the position of the smart object is changed from a first position to a second position, where the first and second positions are in different planes and where the playback animation adjusts accordingly.

5. The method of claim 1 , wherein the playback animation is a representative image of an audio or visual display.

6. The method of claim 1 , further comprising:

receiving a request to replace a first three-dimensional model of a first smart object with a second three-dimensional model of a second smart object within the two-dimensional environment;

removing the first three-dimensional model of the first smart object from the two-dimensional environment; and

superimposing the second three-dimensional model of the second smart object at a same position as the first three-dimensional model within the two-dimensional environment, wherein the second three-dimensional model of the second smart object includes a second playback animation.

7. The method of claim 1 , further comprising:

determining, from the two-dimensional environment, a presence of scale data and perspective data added to the two-dimensional environment; and

displaying an object indicating the presence of the scale data and perspective data of the two-dimensional environment.

8. A system for visualization of a three-dimensional model of a smart object in a two-dimensional environment, the system comprising:

a processor; and

a storage device, the storage device containing instructions executable by the processor comprising:

a receiving module configured to receive one or more requests from a user, the requests including one or more of an import request, a scale data request, a superimposing request, and a request to save a resulting image;

an importing module configured to import, based on the import request of the user, the two-dimensional environment;

a superimposing module configured to superimpose, based on the superimposing request, the three-dimensional model of the smart object onto the two-dimensional environment with a scale and a perspective based on the two-dimensional environment;

a visualizing module configured to display playback animation of the smart object wherein a scale and a perspective of the playback animation is based on a position of the three-dimensional model of the smart object in the two-dimensional environment, wherein the playback animation of the smart object corresponds to a type of the smart object, the type of the smart object including one or more of a video playback smart object, an audio playback smart object, and an environment playback smart object; and

a saving module configured to save the resulting image, based on the request to save the resulting image, wherein the resulting image includes the three-dimensional model of the smart object superimposed onto the two-dimensional environment.

9. The system of claim 8 , wherein the playback animation comprises a video.

10. The system of claim 8 , wherein the playback animation is displayed in accordance with a location of the smart object.

11. The system of claim 8 , wherein the storage device further contains instructions executable by the processor comprising a moving module configured to move the position of the smart object from a first position to a second position, where the first and second positions are in different planes.

12. The system of claim 11 , wherein the visualizing module is further configured to display the playback animation according to a perspective of the second position.

13. The system of claim 8 , wherein the playback animation is a representative image of an audio or visual display.

14. The system of claim 8 , wherein the storage device further contains instructions executable by the processor comprising a replacement module configured to, upon receiving a request at the receiving module to replace a first three-dimensional model of a first smart object with a second three-dimensional model of a second smart object within the two-dimensional environment:

remove the first three-dimensional model of the first smart object from the two-dimensional environment; and

superimpose the second three-dimensional model of the second smart object at a same position as the first three-dimensional model within the two-dimensional environment, wherein the second three-dimensional model of the second smart object includes a second playback animation.

15. The system of claim 8 , wherein the visualizing module is further configured to:

determine, from the two-dimensional environment, a presence of scale data and perspective data added to the two-dimensional environment; and

display an object indicating the presence of the scale data and perspective data of the two-dimensional environment.

16. A system for visualization of a three-dimensional model of a smart object in a two-dimensional environment, the system comprising:

a processor; and

a storage device, the storage device containing instructions executable by the processor comprising:

a receiving module configured to receive one or more requests from a user, the requests including one or more of an import request, a scale data request, a superimposing request, a replacement request, and a request to save a resulting image;

an importing module configured to import, based on the import request of the user, the two-dimensional environment;

a superimposing module configured to superimpose, based on the superimposing request, the three-dimensional model of the smart object onto the two-dimensional environment with a scale and a perspective based on the two-dimensional environment;

a replacement module configured to remove, based upon the replacement request, the three-dimensional model of the smart object and superimpose a second three-dimensional model of a second smart object at a same position as the first three-dimensional model within the two-dimensional environment;

a visualizing module configured to display a video playback animation of the smart object wherein a scale and a perspective of the video playback animation is based on a position of the three-dimensional model of the smart object in the two-dimensional environment;

a saving module configured to save the resulting image, based on the request to save the resulting image, wherein the resulting image includes the three-dimensional model of the smart object superimposed onto the two-dimensional environment;

an uploading module configured to upload the resulting image to a social network; and

a purchasing module configured to receive a purchasing request for the smart object.

17. The system of claim 16 , wherein the storage device further contains instructions executable by the processor comprising a moving module configured to move the position of the smart object from a first position to a second position, where the first and second positions are in different planes.

18. The system of claim 17 , wherein the visualizing module is further configured to display the video playback animation according to a perspective of the second position of the smart object within the two-dimensional environment.

19. The system of claim 16 , wherein the visualizing module is further configured to:

determine, from the two-dimensional environment, a presence of scale data and perspective data added to the two-dimensional environment; and

display an object indicating the presence of the scale data and perspective data of the two-dimensional environment.

20. The system of claim 16 , wherein the visualizing module is configured to generate an audio signal, the audio signal generated according to the perspective of the smart object within the two-dimensional environment.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2022
From: ATHEER, INC.
To: WEST TEXAS TECHNOLOGY PARTNERS, LLC
Reel/Frame 058962/0067 →
SECURITY INTEREST Recorded Nov 20, 2018
From: ATHEER, INC.
To: COTA CAPITAL MASTER FUND, L.P., AS COLLATERAL AGENT
Reel/Frame 048154/0759 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 21, 2017
From: SPACEVIEW, INC.
To: ATHEER, INC.
Reel/Frame 042774/0485 →
RELEASE OF SECURITY INTEREST Recorded Jun 7, 2017
From: SPACEVIEW INC.
To: PORTLAND SEED FUND, LP
Reel/Frame 042634/0761 →
SECURITY INTEREST Recorded Oct 12, 2016
From: SPACEVIEW, INC.
To: PORTLAND SEED FUND, LP
Reel/Frame 039996/0829 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2015
From: JOVANOVIC, MILOS
To: SPACEVIEW INC.
Reel/Frame 035825/0488 →
Continuity (7)
Provisional Application 61992629 · May 13, 2014
Provisional Application 61992665 · May 13, 2014
Provisional Application 61992719 · May 13, 2014
Provisional Application 61992759 · May 13, 2014
Provisional Application 61992746 · May 13, 2014
Provisional Application 61992774 · May 13, 2014
Related Publication 20150332510A1 · Nov 19, 2015