IP Library › Granted Patent US 12,505,626
Granted Patent B2
US 12,505,626 · App. 18/271,776 · Granted Dec 23, 2025

Augmented Reality method and system enabling commands to control real-world devices

Inventors: Anthony Laurent (Vignoc, FR); Vincent Alleaume (Pace, FR); Caroline Baillard (Saint Sulpice la Foret, FR); Matthieu Fradet (Chanteloup, FR); Pierrick Jouet (Rennes, FR)
Assignee: INTERDIGITAL CE PATENT HOLDINGS, SAS
G06T19/006G06F3/167G06V10/255
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,505,626
App. No.
18/271,776
Granted
Dec 23, 2025
Kind
B2
Abstract

A camera captures part of a surrounding scene to obtain a user view, disambiguating information uniquely identifying at least one controllable device or group of controllable devices in a set of controllable devices of a given type or at least one location or direction for a mobile controllable device is obtained, the user view and the disambiguating information relating to at least one controllable device overlaid on the user view are displayed on a display, a command intended to control at least one controllable device is received, wherein a command including at least part of the disambiguating information and a message based on the command is sent towards a corresponding controllable device.

Claims (54)

1 . A system comprising:

a camera configured to capture a user view of a scene surrounding the camera;

a display;

memory configured to store instructions, executable by a processor, and to store parameters;

an input interface configured to receive user commands intended to control at least one controllable object; and

at least one hardware processor configured to execute the instructions to:

detect controllable objects in the user view; and

on condition that the controllable objects comprise multiple controllable objects of a same object type and that a received first command related to the same object type is ambiguous:

obtain disambiguating information for the multiple controllable objects of the same object type, the disambiguating information suitable for uniquely identifying at least two subsets of controllable objects of the same object type; and

cause the disambiguating information to be displayed, overlaid on the user view, on the display.

2 . The system of claim 1 , wherein at least one subset comprises a plurality of controllable objects.

3 . The system of claim 1 , wherein the at least two subsets each comprise a single controllable object of the same object type.

4 . The system of claim 1 , wherein a received second command comprises at least part of the disambiguating information; and

wherein the system further comprises a communication interface configured to send a message based on the received second command towards a corresponding controllable object.

5 . The system of claim 1 , wherein the input interface is a microphone and the first command is a voice command.

6 . The system of claim 1 , wherein the at least one hardware processor is further configured to execute the instructions to create a group of controllable objects upon reception of a message that is based on a third command and that comprises identifiers of controllable objects to be included in the group, and to associate the group with disambiguating information uniquely identifying the group.

7 . The system of claim 1 , wherein the at least one hardware processor is further configured to execute the instructions to, upon reception of a fourth command including a type and an indication that the fourth command relates to all controllable objects of the type in the user view, control every controllable object in the user view.

8 . The system of claim 1 , wherein the system is implemented in an Augmented Reality, AR, device.

9 . A method comprising:

receiving, at an input interface, a first command intended to control at least one controllable object;

detecting controllable objects in a user view captured using a camera; and

on condition that the controllable objects comprise multiple controllable objects of a same object type and that the first command related to the same object type is ambiguous:

obtaining disambiguating information for the multiple controllable objects of the same object type, the disambiguating information suitable for uniquely identifying at least two subsets of controllable objects of the same object type; and

displaying, overlaid on the user view, the disambiguating information on a display.

10 . The method of claim 9 , wherein at least one subset comprises a plurality of controllable objects.

11 . The method of claim 9 , wherein the at least two subsets each comprise a single controllable object of the same object type.

12 . The method of claim 9 , wherein a second received command comprises at least part of the disambiguating information; and

wherein the method further comprises sending, through a communication interface, a message based on the second received command towards a corresponding controllable object.

13 . The method of claim 9 , wherein the input interface is a microphone and the first command is a voice command.

14 . The method of claim 9 , further comprising:

creating a group of controllable objects upon reception of a message that is based on a third command and that comprises identifiers of controllable objects to be included in the group; and

associating the group with disambiguating information uniquely identifying the group.

15 . The method of claim 9 , further comprising, upon reception of a fourth command including a type and an indication that the fourth command relates to all controllable objects of the type in the user view, controlling every controllable object of the type in the user view.

16 . The method of claim 9 , wherein the method is implemented in an Augmented Reality, AR, device.

17 . A non-transitory computer-readable storage medium storing instructions that, when executed, cause at least one hardware processor to perform a method of claim 9 .

18 . A system comprising:

a camera configured to capture a user view of a scene surrounding the camera;

a display;

memory configured to store instructions, executable by a processor, and to store parameters;

at least one hardware processor configured to execute the instructions to:

detect a plurality of controllable objects in the user view;

receive a user command specifying a type of object to be controlled;

on condition that the plurality of controllable objects include a single controllable object of the type of object, send a control message corresponding to the user command intended for the single controllable object of the type of object; and

on condition that the plurality of controllable objects comprise a plurality of controllable objects of the type of object:

obtain disambiguating information for the plurality of controllable objects of the type of object, the disambiguating information suitable for uniquely identifying at least two subsets of the plurality of controllable objects of the type of object; and

cause the disambiguating information to be displayed, overlaid on the user view, on the display.

19 . A method comprising:

detecting a plurality of controllable objects in a user view captured by a camera;

receiving a user command specifying a type of object to be controlled;

on condition that the plurality of controllable objects includes a single controllable object of the type of object, sending a control message corresponding to the user command intended for the single controllable object of the type of object; and

on condition that the plurality of controllable objects comprise a plurality of controllable objects of the type of object:

obtaining disambiguating information for the plurality of controllable objects of the type of object, the disambiguating information suitable for uniquely identifying at least two subsets of the plurality of controllable objects of the type of object; and

causing the disambiguating information to be displayed, overlaid on the user view, on the display.

20 . A non-transitory computer-readable storage medium storing instructions that, when executed, cause at least one hardware processor to perform a method of claim 19 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2023
From: LAURENT, ANTHONY; ALLEAUME, VINCENT; BAILLARD, CAROLINE; FRADET, MATTHIEU; JOUET, PIERRICK
To: INTERDIGITAL CE PATENT HOLDINGS, SAS
Reel/Frame 064214/0812 →
Priority Claims (1)
EP 21305026 · Jan 12, 2021 · regional
Continuity (1)
Related Publication 20240127552A1 · Apr 18, 2024
References Cited (16)
US 5689717A · Pritt · 1997 [cited by examiner]
US 7031961B2 · Pitkow · 2006 [cited by examiner]
US 7692655B2 · Ni · 2010 [cited by examiner]
US 7697014B2 · Dolph · 2010 [cited by examiner]
US 10031722B1 · Mutagi et al. · 2018 [cited by applicant]
US 10466794B2 · Maeda et al. · 2019 [cited by applicant]
US 10726463B2 · Cho et al. · 2020 [cited by applicant]
US 10769438B2 · Bendale et al. · 2020 [cited by applicant]
US 10782848B2 · Issayeva et al. · 2020 [cited by applicant]
US 10990505B2 · Papp · 2021 [cited by examiner]
US 20170228936A1 · Goslin et al. · 2017 [cited by applicant]
US 20200236176A1 · Park · 2020 [cited by examiner]
EP 3332546A1 · 2018 [cited by applicant]
EP 3639119A1 · 2020 [cited by applicant]
Chopra, Shreya, “Evaluating User Preferences for Augmented Reality Interactions for the Internet of Things”, PRISM: University of Calgary's Digital Repository, The Vault: Electronic Theses and Dissertations, Master's th… [cited by applicant]
Huynh et al., “Semantic Labeling and Object Registration for Augmented Reality Language Learning”, Institute of Electrical and Electronics Engineering (IEEE), 2019 IEEE Conference on Virtual Reality and 3D User Interfac… [cited by applicant]