Real world object tagging in digital twins

1 . A method for real-world object tagging performed by a processor, comprising:

receiving, from a user, a command to tag an object currently in view of a camera and located within a physical space;

in response to the command, determining a distance from a location of the camera to a location of the object;

determining the location of the object based on the determined distance;

storing the location of the object and a label together as a tag in a digital twin representing the physical space;

displaying a representation of the physical space; and

displaying an indicator of the tag at a location in the representation of the physical space corresponding to the location of the object;

performing a new scanning process on a previously created object tag during a current scanning process comprising:

receiving notice that additional information about the object is to be tagged during a scanning process;

obtaining depth data from the physical space, and

translating depth data to structure data for storage in the digital twin;

wherein:

the current scanning process is paused during the steps of determining the location and storing the tag in the digital twin, and

the current scanning process is resumed after the step of storing the tag in the digital twin.

2 . The method of claim 1 , wherein the representation of the physical space is a live image captured by the camera.

3 . The method of claim 1 , wherein the representation of the physical space is a rendering of the digital twin.

4 . The method of claim 1 further comprising:

in response to the command, capturing an image from image data produced by the camera; and

storing the image in the digital twin together with the location of the object and the label.

5 . The method of claim 1 , wherein:

the digital twin comprises a graph of a plurality of nodes; and

storing the location of the object and a label together as a tag in a digital twin representing the physical space comprises:

identifying a node of the plurality of nodes corresponding to at least one of:

an area of the physical space within which the object is located, and

a structure of the physical space with which the object is in contact, and

storing the tag in association with the identified node.

6 . The method of claim 1 , wherein displaying the indicator of the tag comprises displaying at least one piece of information previously associated with the tag in the digital twin by a separate device having access to the digital twin.

7 . A device for real-world object tagging, comprising:

a user interface;

a camera;

a depth sensor;

a memory storing a digital twin representing a physical space; and

a processor configured to:

receive, via the user interface, a command to tag an object currently in view of the camera and located within the physical space;

in response to the command, determine a distance from a location of the camera to a location of the object using the depth sensor;

determine the location of the object based on the determined distance;

store the location of the object and a label together as a tag in the digital twin;

display a representation of the physical space; and

display an indicator of the tag at a location in the representation of the physical space corresponding to the location of the object;

perform a new scanning process on a previously created object tag during a current scanning process comprising:

obtain depth data from the physical space, and

translate depth data to structure data for storage in the digital twin;

wherein:

the current scanning process is paused during the steps of determining the location and storing the tag in the digital twin, and

the current scanning process is resumed after the step of storing the tag in the digital twin.

8 . The device of claim 7 , wherein the representation of the physical space is a live image captured by the camera.

9 . The device of claim 7 , wherein the representation of the physical space is a rendering of the digital twin.

10 . The device of claim 7 , wherein the processor is further configured to:

in response to the command, capture an image from image data produced by the camera; and

store the image in the digital twin together with the location of the object and the label.

11 . The device of claim 7 , wherein:

the digital twin comprises a graph of a plurality of nodes; and

in storing the location of the object and a label together as a tag in a digital twin representing the physical space, the processor is configured to:

identify a node of the plurality of nodes corresponding to at least one of:

an area of the physical space within which the object is located, and

a structure of the physical space with which the object is in contact, and

store the tag in association with the identified node.

12 . The device of claim 7 , further comprising:

in response to the command, capturing an image from image data produced by the camera; and

storing the image in the digital twin together with the location of the object and the label.

13 . The device of claim 7 , wherein, in displaying the indicator of the tag, the processor is configured to display at least one piece of information previously associated with the tag in the digital twin by a separate device having access to the digital twin.

14 . A non-transitory machine-readable medium encoded with instructions for execution by a processor for real-world object tagging performed by a processor, the non-transitory machine-readable medium comprising:

instructions for receiving, from a user, a command to tag an object currently in view of a camera and located within a physical space;

instructions for in response to the command, determining a distance from a location of the camera to a location of the object;

instructions for determining the location of the object based on the determined distance;

instructions for storing the location of the object and a label together as a tag in a digital twin representing the physical space;

instructions for displaying a representation of the physical space; and

instructions for displaying an indicator of the tag at a location in the representation of the physical space corresponding to the location of the object;

instructions for performing a new scanning process during a current scanning process on a previously created object tag comprising:

instructions for receiving a notice that additional information about the object is to be tagged during a scanning process;

instructions for obtaining depth data from the physical space,

instructions for translating depth data to structure data for storage in the digital twin; and

instructions for pausing the current scanning process during execution of the instructions for determining the location and storing the tag in the digital twin, and

instructions for resuming the current scanning process after execution of the instructions for storing the tag in the digital twin.

15 . The non-transitory machine-readable medium of claim 14 , wherein the representation of the physical space is a live image captured by the camera.

16 . The non-transitory machine-readable medium of claim 14 , wherein the representation of the physical space is a rendering of the digital twin.

17 . The non-transitory machine-readable medium of claim 14 , further comprising

instructions for, in response to the command, capturing an image from image data produced by the camera.

18 . The non-transitory machine-readable medium of claim 14 , wherein the instructions for displaying the indicator of the tag comprise instructions for displaying at least one piece of information previously associated with the tag in the digital twin by a separate device having access to the digital twin.

19 . The non-transitory machine-readable medium of claim 17 wherein the instructions for storing the location of the object and a label together as a tag in the digital twin comprises instructions for additionally storing the image in the digital twin together with the location of the object and the label.

20 . The non-transitory machine-readable medium of claim 14 , further comprising locating a zone node for a current room.