IP Library Granted Patent US 10,620,807
Granted Patent B2
US 10,620,807 · App. 14/856,222 · Granted Apr 14, 2020

Association of objects in a three-dimensional model with time-related metadata

Inventors: Russell Speight VanBlon (Raleigh, NC); David Alexander Schwarz (Morrisville, NC); Axel Ramirez Flores (Cary, NC); Suzanne Marion Beaumont (Wake Forest, NC); Ming Qian (Cary, NC)
Assignee: Lenovo (Singapore) Pte. Ltd.
G06F3/04845G06T19/00G09G5/006H04N13/178H04N13/20G06F2203/04802G09G2370/14
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,620,807
App. No.
14/856,222
Granted
Apr 14, 2020
Kind
B2
Abstract

In one aspect, a device includes a processor, a camera accessible to the processor, and storage accessible to the processor. The storage bears instructions executable by the processor to receive data from the camera, establish a three-dimensional (3D) model of at least a portion of a location based at least in part on the data from the camera, identify at least one object at the location from the data from the camera, and associate the at least one object with time-related metadata.

Claims (70)

1. A device, comprising:

at least one processor;

a camera accessible to the at least one processor; and

storage accessible to the at least one processor and bearing instructions executable by the at least one processor to:

receive at least one image from the camera;

based at least in part on the at least one image from the camera, establish a three-dimensional (3D) model of at least a portion of a location shown in the at least one image, the 3D model being different from the location itself that is shown in the at least one image;

identify at least one object shown in the at least one image from the camera; and

associate the at least one object shown in the at least one image with time-related metadata;

wherein the time-related metadata comprises metadata regarding the permanence of the at least one object; and

wherein the instructions are executable by the at least one processor to:

determine that the at least one object is a permanent object; and

represent the at least one object in the 3D model at least in part based on the determination.

2. The device of claim 1 , wherein the time-related metadata comprises metadata regarding a likelihood that the at least one object will be located at a different place at a future time than as represented in the model.

3. The device of claim 1 , wherein the at least one object is a first object, and wherein the instructions are executable by the at least one processor to:

determine that a second object is a transient object; and

decline to represent the second object in the 3D model at least in part based on the determination that the second object is a transient object.

4. The device of claim 1 , wherein the at least one object is a first object, and wherein the instructions are executable by the at least one processor to:

determine that a second object is a readily-mobile object; and

decline to represent the second object in the 3D model at least in part based on the determination that the second object is a readily-mobile object.

5. The device of claim 1 , wherein the at least one object is a first object, and wherein the instructions are executable by the at least one processor to:

determine that a second object is an at least semi-permanent object; and

represent the second object in the 3D model at least in part based on the determination that the second object is an at least semi-permanent object.

6. The device of claim 1 , wherein the instructions are executable by the at least one processor to:

access a database at which data is stored that respectively associates types of objects with time-related metadata; and

associate the at least one object with time-related metadata based at least in part on data in the database.

7. A method, comprising:

generating a three-dimensional (3D) model of an area;

determining whether objects recognized from the area are transient in the area;

associating the objects recognized from the area with metadata related to whether the objects are transient in the area; and

based on determining that at least a first object from the area is not transient, including a representation of the first object in the 3D model, the determining that the first object is not transient being based at least in part on identifying a first object type for the first object;

wherein the determining that the first object from the area is not transient is performed at least in part by processing metadata associated with the first object type from a database that associates respective object types with metadata related to whether objects of the respective object type are transient.

8. The method of claim 7 , wherein the method comprises:

responsive to receiving input from a user to show, in the 3D model, representations of objects from the area that are transient, including in the 3D model representations of objects from the area that are transient and presenting the 3D model on a display.

9. The method of claim 7 , wherein the method comprises:

responsive to receiving input from a user to not show, in the 3D model, representations of objects from the area that are transient, presenting the 3D model on a display without showing representations of objects from the area that are transient.

10. The method of claim 7 , comprising:

based on determining that at least a second object from the area is transient, declining to include a representation of the second object in the 3D model.

11. The method of claim 10 , comprising:

determining that the second object from the area is transient at least in part by processing metadata from a database that associates respective object types with metadata related to whether objects of the respective object type are transient.

12. The device of claim 1 , wherein the at least one the object is associated with time-related metadata based on a comparison of images that are generated at different times.

13. The device of claim 1 , wherein the establishing of the 3D model and the associating of the at least one object is performed responsive to receipt of user input directed to a selector presented on a user interface (UI), the UI presented on a display.

14. The method of claim 7 , wherein the generating of the 3D model and the associating of the objects is performed responsive to receipt of user input directed to a selector presented on a user interface (UI), the UI presented on a display.

15. A device, comprising:

at least one computer readable storage medium that is not a transitory signal, the computer readable storage medium comprising instructions executable by at least one processor to:

generate a three-dimensional (3D) model of an area;

determine whether objects recognized from the area are transient in the area;

associate the objects recognized from the area with metadata related to whether the objects are transient in the area; and

based on determining that at least a first object from the area is not transient, include a representation of the first object in the 3D model, the determining that the first object is not transient being based at least in part on identifying a first object type for the first object;

wherein the determining that the first object from the area is not transient is performed at least in part by processing metadata associated with the first object type from a database that associates respective object types with metadata related to whether objects of the respective object type are transient.

16. The device of claim 15 , comprising the at least one processor.

17. The device of claim 16 , comprising a camera accessible to the at least one processor, wherein the 3D model of the area is generated based at least in part on at least one image from the camera.

18. The device of claim 15 , wherein the instructions are executable to:

responsive to receipt of input from a user to show, in the 3D model, representations of objects from the area that are transient, include in the 3D model representations of objects from the area that are transient and present the 3D model on a display.

19. A method, comprising:

receiving at least one image from a camera;

based at least in part on the at least one image from the camera, establishing a three-dimensional (3D) model of at least a portion of a location shown in the at least one image, the 3D model being different from the location itself that is shown in the at least one image;

identifying at least a first object shown in the at least one image from the camera; and

associating the first object shown in the at least one image with time-related metadata;

wherein the time-related metadata comprises metadata regarding the permanence of the first object; and

wherein the method comprises:

determining that the first object is a permanent object; and

representing the first object in the 3D model at least in part based on the determining.

20. The method of claim 19 , comprising:

determining that a second object shown in the at least one image from the camera is a transient object; and

declining to represent the second object in the 3D model at least in part based on the determining that the second object is a transient object.

21. The method of claim 19 , comprising:

accessing a database at which data is stored that respectively associates types of objects with time-related metadata; and

associating the first object with time-related metadata based at least in part on data in the database.

22. The method of claim 19 , comprising:

in response to receiving user input to show transient and/or mobile objects, showing in the 3D model representations of objects recognized from the area that are determined to be transient and/or mobile in the area.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2025
From: LENOVO PC INTERNATIONAL LIMITED
To: LENOVO SWITZERLAND INTERNATIONAL GMBH
Reel/Frame 069870/0670 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2021
From: LENOVO (SINGAPORE) PTE LTD
To: LENOVO PC INTERNATIONAL LTD
Reel/Frame 055110/0378 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 16, 2015
From: VANBLON, RUSSELL SPEIGHT; SCHWARZ, DAVID ALEXANDER; RAMIREZ FLORES, AXEL; BEAUMONT, SUZANNE MARION; QIAN, MING
To: LENOVO (SINGAPORE) PTE. LTD.
Reel/Frame 036620/0118 →