IP Library Granted Patent US 11,784,845
Granted Patent B2
US 11,784,845 · App. 16/147,319 · Granted Oct 10, 2023

System and method for disambiguation of Internet-of-Things devices

Inventors: M Anthony Lewis (La Jolla, CA); Amalendu Iyer (San Diego, CA); Manu Rastogi (San Diego, CA)
Assignee: QUALCOMM Incorporated
H04L12/282G06T7/74H04W8/22H04W60/00H04W64/003
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,784,845
App. No.
16/147,319
Granted
Oct 10, 2023
Kind
B2
Abstract

An apparatus may identify each object of a set of objects included in a first location, wherein the set of objects includes at least one IoT device and at least one other object. The apparatus may determine a first set of attributes for the at least one IoT device. The apparatus may store registration information associated with the at least one IoT device, the registration information including a first identifier associated with the at least one IoT device and including the first set of attributes for the at least one IoT device. The apparatus may obtain an input. The apparatus may determine whether the input corresponds to the at least one IoT device based on the registration information associated with the at least one IoT device. The apparatus may control the at least one IoT device when the input corresponds to the at least one IoT device.

Claims (85)

1. A method of operation of a system, the method comprising:

obtaining first image data representing a location;

identifying each object of a set of objects included in the location;

obtaining second image data representing the location after a changing of a state of at least one Internet-of-Things (IoT) device;

identifying the at least one IoT device based on a difference between the first image data and the second image data;

storing registration information associated with the at least one IoT device, the registration information including a first identifier associated with the at least one IoT device and including a first set of attributes for the at least one IoT device;

matching a description associated with an input to the first set of attributes based on a representation indicating at least one of a spatial attribute or a visual attribute of the at least one IoT device in a location that includes the at least one IoT device, wherein the description indicates a spatial relationship between the at least one IoT device and at least one other object in the location; and

controlling operation of the at least one IoT device based on an instruction included in the input when the description is matched to the first set of attributes of the at least one IoT device.

2. The method of claim 1 , wherein the first set of attributes further comprises at least one of the visual attribute associated with the at least one IoT device or the spatial attribute associated with the at least one IoT device, and at least one of a classification associated with the at least one IoT device or a capability attribute associated with the at least one IoT device.

3. The method of claim 1 , further comprising:

processing the input to determine the description and the instruction; and

identifying the first identifier associated with the at least one IoT device based on matching the description to the first set of attributes,

wherein the first identifier is used for the controlling the operation of the at least one IoT.

4. The method of claim 1 , wherein the input comprises a natural language input.

5. The method of claim 1 , further comprising:

determining the first set of attributes for the at least one IoT device, the first set of attributes indicating the at least one of the spatial attribute or the visual attribute of the at least one IoT device in the location, wherein the set of objects includes the at least one IoT device.

6. The method of claim 1 , wherein the identifying each object of the set of objects included in the location comprises:

changing a state of the at least one IoT device.

7. The method of claim 1 , wherein the description is matched to the first set of attributes based on correspondence between the spatial relationship and the at least one of the spatial attribute or the visual attribute of the at least one IoT device in the location.

8. The method of claim 1 , further comprising:

determining to identify a set of IoT devices,

wherein the identifying each object of the set of objects included in the location is based on the determining to identify the set of IoT devices.

9. The method of claim 1 , further comprising:

receiving, over a network, information associated with the at least one IoT device, the information including at least the first identifier associated with the at least one IoT device; and

associating the first identifier with the first set of attributes for the at least one IoT device, wherein the operation of the at least one IoT device is controlled using the first identifier.

10. An apparatus for operating a system, the apparatus comprising:

means for obtaining first image data representing a location;

means for identifying each object of a set of objects included in the location;

means for obtaining second image data representing the location after a changing of a state of at least one Internet-of-Things (IoT) device;

means for identifying the at least one IoT device based on a difference between the first image data and the second image data;

means for storing registration information associated with the at least one IoT device, the registration information including a first identifier associated with the at least one IoT device and including a first set of attributes for the at least one IoT device;

means for matching a description associated with an input to the first set of attributes based on a representation indicating at least one of a spatial attribute or a visual attribute of the at least one IoT device in a location that includes the at least one IoT device, wherein the description indicates a spatial relationship between the at least one IoT device and at least one other object in the location; and

means for controlling operation of the at least one IoT device based on an instruction included in the input when the description is matched to the first set of attributes of the at least one IoT device.

11. The apparatus of claim 10 , wherein the first set of attributes further comprises at least one of the visual attribute associated with the at least one IoT device or the spatial attribute associated with the at least one IoT device, and at least one of a classification associated with the at least one IoT device or a capability attribute associated with the at least one IoT device.

12. The apparatus of claim 10 , further comprising:

means for processing the input to determine the description and the instruction; and

means for identifying the first identifier associated with the at least one IoT device based on matching the description to the first set of attributes,

wherein the first identifier is used for the controlling the operation of the at least one IoT device.

13. The apparatus of claim 10 , wherein the input comprises a natural language input.

14. The apparatus of claim 10 , further comprising:

means for determining the first set of attributes for the at least one IoT device, the first set of attributes indicating the at least one of the spatial attribute or the visual attribute of the at least one IoT device in the location, wherein the set of objects includes the at least one IoT device.

15. The apparatus of claim 10 , wherein the means for identifying each object of the set of objects included in the first location is configured to:

change a state of the at least one IoT device.

16. The apparatus of claim 10 , wherein the description is matched to the first set of attributes based on correspondence between the spatial relationship and the at least one of the spatial attribute or the visual attribute of the at least one IoT device in the location.

17. The apparatus of claim 10 , further comprising:

means for determining to identify a set of IoT devices,

wherein the identifying each object of the set of objects included in the location is based on the determining to identify the set of IoT devices.

18. The apparatus of claim 10 , further comprising:

means for receiving, over a network, information associated with the at least one IoT device, the information including at least the first identifier associated with the at least one IoT device; and

means for associating the first identifier with the first set of attributes for the at least one IoT device, wherein the operation of the at least one IoT device is controlled using the first identifier.

19. An apparatus for operating a system, the apparatus comprising:

a memory; and

at least one processor coupled to the memory and configured to:

obtain first image data representing a location;

identify each object of a set of objects included in the location;

obtain second image data representing the location after a changing of a state of at least one Internet-of-Things (IoT) device;

identify the at least one IoT device based on a difference between the first image data and the second image data;

store registration information associated with the at least one IoT device, the registration information including a first identifier associated with the at least one IoT device and including a first set of attributes for the at least one IoT device;

match a description associated with an input to the first set of attributes based on a representation indicating at least one of a spatial attribute or a visual attribute of the at least one IoT device in a location that includes the at least one IoT device, wherein the description indicates a spatial relationship between the at least one IoT device and at least one other object in the location; and

control operation of the at least one IoT device based on an instruction included in the input when the description is matched to the first set of attributes of the at least one IoT device.

20. The apparatus of claim 19 , wherein the first set of attributes further comprises at least one of the visual attribute associated with the at least one IoT device or the spatial attribute associated with the at least one IoT device, and at least one of a classification associated with the at least one IoT device or a capability attribute associated with the at least one IoT device.

21. The apparatus of claim 19 , wherein the at least one processor is further configured to:

process the input to determine the description and the instruction; and

identify the first identifier associated with the at least one IoT device based on matching the description to the first set of attributes,

wherein the first identifier is used for the controlling the operation of the at least one IoT device.

22. The apparatus of claim 19 , wherein the input comprises a natural language input.

23. The apparatus of claim 19 , wherein the at least one processor is further configured to:

determine the first set of attributes for the at least one IoT device, the first set of attributes indicating the at least one of the spatial attribute or the visual attribute of the at least one IoT device in the location, wherein the set of objects includes the at least one IoT device.

24. The apparatus of claim 19 , wherein the identification of each object of the set of objects included in the first location comprises to:

change a state of the at least one IoT device.

25. The apparatus of claim 19 , wherein the description is matched to the first set of attributes based on correspondence between the spatial relationship and the at least one of the spatial attribute or the visual attribute of the at least one IoT device in the location.

26. The apparatus of claim 19 , wherein the at least one processor is further configured to:

determine to identify a set of IoT devices,

wherein the identification of each object of the set of objects included in the location is based on the determination to identify the set of IoT devices.

27. The apparatus of claim 19 , wherein the at least one processor is further configured to:

receive, over a network, information associated with the at least one IoT device, the information including at least the first identifier associated with the at least one IoT device; and

associate the first identifier with the first set of attributes for the at least one IoT device, wherein the operation of the at least one IoT device is controlled using the first identifier.

28. A non-transitory, computer-readable medium storing computer-executable code for operation of a system, comprising code to:

obtain first image data representing a location;

identify each object of a set of objects included in the location;

obtain second image data representing the location after a changing of a state of at least one Internet-of-Things (IoT) device;

identify the at least one IoT device based on a difference between the first image data and the second image data;

store registration information associated with the at least one IoT device, the registration information including a first identifier associated with the at least one IoT device and including a first set of attributes for the at least one IoT device;

match a description associated with an input to the first set of attributes based on a representation indicating at least one of a spatial attribute or a visual attribute of the at least one IoT device in a location that includes the at least one IoT device, wherein the description indicates a spatial relationship between the at least one IoT device and at least one other object in the location; and

control operation of the at least one IoT device based on an instruction included in the input when the description is matched to the first set of attributes of the at least one IoT device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 28, 2019
From: LEWIS, M ANTHONY; IYER, AMALENDU; RASTOGI, MANU
To: QUALCOMM INCORPORATED
Reel/Frame 048473/0077 →
Continuity (1)
Related Publication 20200106632A1 · Apr 2, 2020