Interacting with real-world items and corresponding databases through a virtual twin reality
A system comprises at least one cloud server of a cloud server computer system comprising at least one processor and memory storing a persistent virtual world system comprising one or more virtual objects including virtual data and models. The virtual objects comprise one or more of a virtual twin, a pure virtual object, or an application, wherein at least one of the virtual objects represents a store of real-world items connected to a periodically-updated database associated to the products of the at least one store. Users may access the store through the persistent virtual world system via a user device enabling interactions with and between elements within the store.
1 . A system for providing at least one virtual object in a persistent three-dimensional (3D) virtual world system, the system comprising:
at least one server comprising at least one processor and memory storing the persistent 3D virtual world system comprising the at least one virtual object,
wherein the at least one virtual object comprises at least one virtual twin,
wherein the at least one virtual twin is a 3D representation of at least one of real-world items;
wherein the at least one virtual twin communicates with a plurality of connected devices configured to identify a user interaction with the at least one real-world item;
wherein the at least one virtual twin exhibits autonomous behavior based on the identified user interaction with the at least one real-world item,
wherein the at least one virtual twin uses training data to exhibit the autonomous behavior, the training data including data from the identified user interaction with the at least one real-world item; and
wherein the at least one virtual object is accessible in an augmented reality or a virtual reality.
2 . The system of claim 1 , wherein the at least one virtual object is accessible in the virtual reality from a remote physical location, wherein the remote physical location comprises additional connected devices capturing data of a user that is transferred to an avatar through the persistent 3D virtual world system.
3 . The system of claim 1 ,
wherein the plurality of connected devices includes one or more cameras, and
wherein the system uses artificial intelligence-based machine vision to identify the real-world items or the user interactions with the real-world items.
4 . The system of claim 1 , wherein the plurality of connected devices includes sensors comprising at least one of temperature sensors, humidity sensors, moisture sensors, mass sensors, proximity sensors, inertial sensors, light sensors, gas and chemical sensors, pressure sensors, touch sensors, or electrical sensors, or a combination thereof.
5 . The system of claim 1 , wherein the at least one server stores separate layers for the augmented reality or the virtual reality that is activated by a user device connected to the at least one server, and each layer of the separate layers comprising separate virtual twins corresponding to each layer of the separate layers.
6 . The system of claim 1 ,
wherein the at least one virtual object has an associated digital identifier stored in the at least one server, and
wherein the digital identifier is retrieved by a user device from the at least one server in order to access the at least one virtual object through the persistent virtual 3D world system.
7 . The system of claim 1 , wherein the at least one virtual object further comprises a personal assistant, and
wherein the personal assistant is an artificial intelligence agent.
8 . The system of claim 1 , further comprising:
a user device,
wherein the user device comprises a personal identifier associated with a personal profile, and
wherein a transaction or interaction performed by a user of the user device is recorded under the personal identifier.
9 . The system of claim 1 , wherein the at least one virtual object further comprises a 3D representation of a store of the real-world items.
10 . The system of claim 9 , wherein a user entering or leaving a predetermined area of the store signals the at least one server to complete a transaction.
11 . The system of claim 1 , wherein the plurality of connected devices are further configured to detect the real-world condition.
12 . The system of claim 1 , wherein the persistent 3D virtual world system comprises a machine-learning platform configured to provide the at least one virtual twin with access to a machine-learning model, a machine-learning algorithm, and the training data.
13 . The system of claim 12 ,
wherein the machine-learning model employs the machine-learning algorithm to train the at least one virtual twin using the training data to simulate the behavior of the at least one real-world item in the absence of at least one of the plurality of connected devices, and
wherein the training data includes actual or simulated behavior data of the at least one real-world item.
14 . The system of claim 12 , wherein the machine-learning model employs the machine-learning algorithm to process the identified user interaction with the at least one virtual twin in the persistent 3D virtual world system, and in response to the interaction with the at least one virtual twin, the at least one virtual twin virtually recreates the behavior of the at least one real-world item.
15 . A method for providing at least one virtual object in a persistent three-dimensional (3D) virtual world system, the method comprising:
storing the persistent 3D virtual world system comprising the at least one virtual object, wherein the at least one virtual object is a 3D representation of real-world items,
wherein the at least one virtual object comprises at least one virtual twin that is a 3D representation of at least one of the real-world items,
wherein the at least one virtual twin communicates with a plurality of connected devices configured to identify a user interaction with the at least one real-world item;
wherein the at least one virtual twin exhibits autonomous behavior based on the identified user interaction with the at least one real-world item, and
wherein the at least one virtual twin uses training data to exhibit the autonomous behavior, the training data including data from the identified user interaction with the at least one real-world item;
receiving communication from the plurality of connected devices;
updating a database based on the received communication; and
providing access to the at least one virtual object in an augmented reality or a virtual reality.
16 . The method of claim 15 , further comprising:
receiving, from additional connected devices in a remote physical location, user data associated with a user of a user device, the user data comprising user movements, position and/or orientation in the remote physical location; and
updating a user avatar within the persistent 3D virtual world system.
17 . The method of claim 15 , the method further comprising providing corresponding virtual twins of each of the real-world items.
18 . The method of claim 15 , further comprising providing in at least one server a digital identifier associated with the at least one virtual object that is retrieved by a user device in order to access the at least one virtual object through the persistent 3D virtual world system.
19 . The method of claim 15 , further comprising:
storing in at least one server a user device personal identifier enabling identification of a user;
recording, in the at least one server, a transaction performed by the user under the user device personal identifier;
detecting, through one or more sensors configured in at least one pre-determined area, a user entering or leaving the at least one pre-determined area;
completing a transaction for a product based on detecting the user entering or leaving the at least one pre-determined area; and
initiating an automated retrieval and delivery system to retrieve and deliver the product.
20 . The method of claim 15 , wherein the at least one virtual object further comprises a 3D representation of a store of the real-world items.
21 . The method of claim 15 , wherein the persistent 3D virtual world system comprises a machine-learning platform configured to provide the at least one virtual twin with access to a machine-learning model, a machine-learning algorithm, and the training data.
22 . The system of claim 21 ,
wherein the machine-learning model employs the machine-learning algorithm to train the at least one virtual twin using the training data to simulate the behavior of the at least one real-world item in the absence of at least one of the plurality of connected devices, and
wherein the training data includes actual or simulated behavior data of the at least one real-world item.
23 . The system of claim 21 , wherein the machine-learning model employs the machine-learning algorithm to process the identified user interaction with the at least one virtual twin in the persistent 3D virtual world system, and in response to the interaction with the at least one virtual twin, the at least one virtual twin virtually recreates the behavior of the at least one real-world item.
24 . A non-transitory computer-readable medium having stored thereon executable instructions configured to cause at least one server comprising at least one processor and memory to perform steps comprising:
storing a persistent three-dimensional (3D) virtual world system comprising at least one virtual object,
wherein the at least one virtual object is a 3D representation of real-world items;
wherein the at least one virtual object comprises at least one virtual twin that is a 3D representation of at least one of the real-world items;
wherein the at least one virtual twin communicates with a plurality of connected devices configured to identify a user interaction with the at least one real-world item;
wherein the at least one virtual twin exhibits autonomous behavior based on the identified user interaction with the at least one real-world item, and
wherein the at least one virtual twin uses training data to exhibit the autonomous behavior, the training data including data from the identified user interaction with the at least one real-world item;
receiving communication from the plurality of connected devices;
updating a database based on the received communication; and
providing access to the at least one virtual object in an augmented reality or a virtual reality.
25 . The non-transitory computer-readable medium of claim 24 , wherein the at least one virtual object further comprises a 3D representation of a store of the real-world items.