Granted Patent B2

US 12,554,318 · App. 18/741,141 · Granted Feb 17, 2026

Inventors: Karthikeyan Subramani (Bangalore, IN); Gokul Govindaraj (Bangalore, IN)

Assignee: Samsung Electronics Co., Ltd.

G06F3/011G06F3/017G16Y40/10G16Y40/30

Abstract

Claims (78)

1 . A method for managing one or more internet of things (IoT) devices performed by an electronic device in a metaverse environment, the method comprising:

detecting that a user is engaged in the metaverse environment;

monitoring, upon detecting that the user is engaged in the metaverse environment, an operating state of each of the one or more IoT devices in a real-world environment;

determining at least one IoT device, from the one or more IoT devices, being in a state that requires attention of the user, based on the monitored operating state of each of the one or more IoT devices; and

in response to the determining of the at least one IoT device being in the state that requires the attention of the user, generating, within the metaverse environment, an interactable avatar of the determined at least one IoT device being in the state that requires the attention of the user, wherein the interactable avatar is a representative of an operating state of the at least one IoT device.

2 . The method of claim 1 , further comprising:

receiving, within the metaverse environment, one or more inputs from the user in a form of real-time interactions with the generated interactable avatar; and

updating the operating state of the at least one IoT device in the real-world environment based on the received one or more inputs.

3 . The method of claim 2 , wherein the receiving of the one or more inputs from the user in the form of real-time interactions with the generated interactable avatar comprises:

monitoring one or more avatar movements and one or more avatar actions of the generated interactable avatar in the metaverse environment; and

monitoring one or more user movements and one or more user actions in the metaverse environment, wherein the one or more user actions correspond to multi-modal actions.

4 . The method of claim 3 , wherein the receiving of the one or more inputs from the user in the form of real-time interactions with the generated interactable avatar comprises:

identifying, by using a gesture detection-based artificial intelligence (AI) model, one or more gestures of the user by correlating the one or more avatar movements, the one or more avatar actions, the one or more user movements, and the one or more user actions; and

detecting one or more IoT commands by correlating the identified one or more gestures with a predefined IoT command library.

5 . The method of claim 4 , wherein the updating of the operating state of the at least one IoT device comprises:

transmitting the detected one or more IoT commands to each of the at least one IoT device, wherein the one or more IoT commands are executed by the at least one IoT device to update the operating state.

6 . The method of claim 1 , wherein the detecting that the user is engaged in the metaverse environment comprises:

determining if a user action is required to change the operating state of the one or more IoT devices based on the determined operating state; and

detecting, upon determining that the user action is required, that the user is engaged in the metaverse environment.

7 . The method of claim 1 , further comprising:

determining, upon detecting that the user is engaged in the metaverse environment, if a current task that the user is performing in the metaverse environment is one of a critical task or a non-critical task by analyzing one or more metaverse tasks; and

determining one or more required user actions for changing the operating state of the at least one IoT device upon determining that the current task is the non-critical task.

8 . The method of claim 7 , further comprising:

generating a compatibility score associated with each of the one or more required user actions based on a predefined priority list and the monitored operating state, wherein the compatibility score represents a priority of performing the one or more user required actions with respect to a criticality of the current task;

determining if the generated compatibility score is greater than a predefined threshold score; and

initiating, upon determining that the generated compatibility score is greater than the predefined threshold score, a metaverse session for changing the operating state of the at least one IoT device.

9 . The method of claim 1 , wherein the generating of the interactable avatar of the determined at least one IoT device being in the state that requires the attention of the user, the method comprises:

determining one or more device parameters associated with each of the at least one IoT device; and

generating, by using a virtual generation-based artificial intelligence (AI) model, the interactable avatar of at least one IoT device based on the determined one or more device parameters, required one or more actions, a predefined three-dimension (3D) model library, and a predefined gesture library.

10 . The method of claim 9 , further comprising:

generating, by using the virtual generation-based AI model, a metaverse representation of the operating state in the metaverse environment based on the determined one or more device parameters, the required one or more actions, the predefined 3D model library, and the predefined gesture library, wherein the operating state represents one or more actions to be performed by each of the at least one IoT device in the metaverse environment;

correlating the generated interactable avatar and the generated metaverse representation of the operating state; and

displaying the generated interactable avatar and the metaverse representation of the operating state upon correlation.

11 . An electronic device for managing one or more internet of things (IoT) devices in a metaverse environment, the electronic device comprising:

memory storing instructions; and

one or more processors communicably coupled to the memory,

wherein the instructions, when executed by the one or more processors individually or collectively, cause electronic device to:

detect that a user is engaged in the metaverse environment,

monitor, upon detecting that the user is engaged in the metaverse environment, an operating state of each of the one or more IoT devices in a real-world environment,

determine at least one IoT device from the one or more IoT devices, being in a state that requires attention of the user, based on the monitored operating state of each of the one or more IoT devices, and

in response to the determining of the at least one IoT device being in the state that requires the attention of the user, generate, within the metaverse environment, an interactable avatar of the determined at least one IoT device being in the state that requires the attention of the user, wherein the interactable avatar is a representative of an operating state of the at least one IoT device.

12 . The electronic device of claim 11 , wherein the instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:

receive, within the metaverse environment, one or more inputs from the user in a form of real-time interactions with the generated interactable avatar, and

update the operating state of the at least one IoT device in the real-world environment based on the received one or more inputs.

13 . The electronic device of claim 12 , wherein for receiving the one or more inputs from the user in the form of real-time interactions with the generated interactable avatar, the instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:

monitor one or more avatar movements and one or more avatar actions of the generated interactable avatar in the metaverse environment, and

monitor one or more user movements and one or more user actions in the metaverse environment, wherein the one or more user actions correspond to multi-modal actions.

14 . The electronic device of claim 13 , wherein the instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:

identify, by using a gesture detection-based artificial intelligence (AI) model, one or more gestures of the user by correlating the one or more avatar movements, the one or more avatar actions, the one or more user movements, and the one or more user actions, and

detect one or more IoT commands by correlating the identified one or more gestures with a predefined IoT command library.

15 . The electronic device of claim 11 , wherein for detecting that the user is immersed engaged in the metaverse environment, the instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:

determine if a user action is required to change the operating state of the one or more IoT devices based on the determined operating state, and

detect, upon determining that the user action is required, that the user is engaged in the metaverse environment.

16 . The electronic device of claim 11 , wherein the instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:

determine, upon detecting that the user is engaged in the metaverse environment, if a current task that the user is performing in the metaverse environment is one of a critical task or a non-critical task by analyzing one or more metaverse tasks, and

determine one or more required user actions for changing the operating state of the at least one IoT device upon determining that the current task is the non-critical task.

17 . The electronic device of claim 16 , wherein the instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:

generate a compatibility score associated with each of the one or more required user actions based on a predefined priority list and the monitored operating state, wherein the compatibility score represents a priority of performing the one or more user required actions with respect to a criticality of the current task,

determine if the generated compatibility score is greater than a predefined threshold score, and

initiate, upon determining that the generated compatibility score is greater than the predefined threshold score, a metaverse session for changing the operating state of the at least one IoT device.

18 . The electronic device of claim 11 wherein the instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:

determine one or more device parameters associated with each of the at least one IoT device, and

generate, by using a virtual generation-based Artificial Intelligence (AI) model, the interactable avatar of at least one IoT device based on the determined one or more device parameters, required one or more actions, a predefined three-dimension (3D) model library, and a predefined gesture library.

19 . The electronic device of claim 18 ,

wherein the instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:

generate, by using the virtual generation-based AI model, a metaverse representation of the operating state in the metaverse environment based on the determined one or more device parameters, the required one or more actions, the predefined 3D model library, and the predefined gesture library, wherein the operating state represents one or more actions to be performed by each of the at least one IoT device in the metaverse environment,

correlate the generated interactable avatar and the generated metaverse representation of the operating state, and

display the generated interactable avatar and the metaverse representation of the operating state upon correlation,

wherein the instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:

map device capabilities of the at least one IoT device to relevant attributes and relevant behavior of the at least one IoT device, and

select, based on the mapping, an interactable avatar to be generated, and

wherein the instructions that, when executed by the one or more processors individually or collectively, cause the electronic device to:

update an avatar skeleton based on interactions between the user and the generated interactable avatar.

20 . One or more non-transitory computer-readable storage media storing instructions that, when executed by one or more processors of an electronic device individually or collectively, cause the electronic device to perform operations, the operations comprising:

detecting that a user is engaged in a metaverse environment;

monitoring, upon detecting that the user is engaged in the metaverse environment, an operating state of each of one or more internet of things (IoT) devices in a real-world environment;

determining at least one IoT device from the one or more IoT devices being in a state that requires attention of the user, based on the monitored operating state of each of the one or more IoT devices; and

in response to the determining of the at least one IoT device being in the state that requires the attention of the user, generating, within the metaverse environment, an interactable avatar of the determined at least one IoT device being in the state that requires the attention of the user, wherein the interactable avatar is a representative of an operating state of the at least one IoT device.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (14)