IP Library Granted Patent US 11,700,412
Granted Patent B2
US 11,700,412 · App. 17/137,960 · Granted Jul 11, 2023

Universal voice assistant

Inventors: Rex Xu (Foothill Ranch, CA); Wesley Millora (Santa Ana, CA); Steven McAllister (Kowloon, HK); Arsham Hatambeiki (San Francisco, CA); Nicu Ahmadi (Santa Ana, CA); Jelmer Jonkman (Santa Ana, CA); Steve Gutman (Santa Ana, CA); Norman G. Sheridan (Fremont, CA); Haiming Huang (Santa Ana, CA)
Assignee: Universal Electronics Inc.
H04N21/42203G10L15/22H04N21/42227G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,700,412
App. No.
17/137,960
Granted
Jul 11, 2023
Kind
B2
Abstract

Described are systems and methods for enabling voice interaction with appliances, services (e.g., media streaming services, gaming services, news feed services, social platform services, etc.), and the like by way of appropriate supplied apps (also referred to as “skills,” “actions,” or the like) which may be presented or downloaded to a smart device having associated therewith one or more cloud-based voice service platforms.

Claims (32)

1. A controlling device, comprising:

a processor;

a display device coupled to the processor;

at least one input element coupled to the processor;

a transmitter coupled to the processor;

a proximity sensing system coupled to the processor; and

a memory device couple to the processor, the memory storing instructions which, when executed by the processor, cause the controlling device to:

operate in a one of a plurality of controlling device operating modes, wherein each of the plurality of controlling device operating modes has associated therewith at least two user interfaces presentable in the display device and each of the at least two user interfaces associated within each of the plurality of controlling device operating modes is determinative of how input received via the at least one input element received while operating in each of the plurality of controlling device operating modes is to be processed by the processor;

repeatedly use the proximity sensing system to select a one of the at least two user interfaces for the one of the plurality of controlling device operating modes;

cause the selected one of the at least two user interfaces for the one of the plurality of controlling device operating modes to be presented in the display device; and

use the selected one of the at least two user interfaces for the one of the plurality of controlling device operating modes to determine if a first predetermined input received via the at least one input element is to cause the controlling device to transmit a command to control a functional operation of a predetermined one of a plurality of target appliances via use of the transmitter.

2. The controlling device as recited in claim 1 , further comprising a microphone coupled to the processor and wherein the instructions, when executed by the processor, cause the controlling device to operate in the one of a plurality of controlling device operating modes as a function of a user voice command received via the microphone.

3. The controlling device as recited in claim 2 , wherein the instructions, when executed by the processor, cause the controlling to device to respond to the user voice command received via the microphone only after a second predetermined input is received via the at least one input element while the controlling device is displaying in the display device a predetermined one of the at least two user interfaces for the one of the plurality of controlling device operating modes.

4. The controlling device as recited in claim 3 , wherein the at least one user input element comprises a pushable and rotatable input element and the second predetermined input comprises a pushing of the at least one user input element.

5. The controlling device as recited in claim 1 , wherein the proximity sensing system determines a physical distance of a user relative to the controlling device to select the one of the at least two user interfaces for the one of the plurality of controlling device operating modes.

6. The controlling device as recited in claim 1 , wherein the proximity sensing system determines a presence and absence of a communication device associated with a user on a predetermined communications network to select the one of the at least two user interfaces for the one of the plurality of controlling device operating modes.

7. The controlling device as recited in claim 1 , wherein a first one of each of the at least two user interfaces associated with each of the plurality of controlling device operating modes is selected for display in the display device in response to the proximity sensing system determining that a user is near the controlling device.

8. The controlling device as recited in claim 1 , wherein a first one of each of the at least two user interfaces associated with each of the plurality of controlling device operating modes is selected for display in the display device in response to the proximity sensing system determining that a user is far from the controlling device.

9. The controlling device as recited in claim 1 , wherein the display device comprises a touch screen display device and wherein at least one of the at least two user interfaces associated with each of the plurality of controlling device operating modes includes one or more softkeys for receiving user input.

10. A method, performed by a controlling device, comprising:

operating in a one of a plurality of controlling device operating modes, wherein each of the plurality of controlling device operating modes has associated therewith at least two user interfaces presentable in a display device of the controlling device and each of the at least two user interfaces associated within each of the plurality of controlling device operating modes is determinative of how input received via at least one input element of the controlling device received while operating in each of the plurality of controlling device operating modes is to be processed by the controlling device;

repeatedly using a proximity sensing system associated with the controlling device to select a one of the at least two user interfaces for the one of the plurality of controlling device operating modes;

causing the selected one of the at least two user interfaces for the one of the plurality of controlling device operating modes to be presented in the display device; and

using the selected one of the at least two user interfaces for the one of the plurality of controlling device operating modes to determine if a first predetermined input received via the at least one input element is to cause the controlling device to transmit a command to control a functional operation of a predetermined one of a plurality of target appliances via use of a transmitter of the controlling device.

11. The method as recited in claim 10 , further comprising selecting the one of a plurality of controlling device operating modes as a function of a user voice command received via a microphone associated with the controlling device.

12. The method as recited in claim 11 , further comprising responding to the user voice command received via the microphone only after a second predetermined input is received via the at least one input element while the controlling device is presenting in the display device a predetermined one of the at least two user interfaces for the one of the plurality of controlling device operating modes.

13. The method as recited in claim 12 , wherein the at least one user input element comprises a pushable and rotatable input element and the second predetermined input comprises a pushing of the at least one user input element.

14. The method as recited in claim 10 , wherein the proximity sensing system determines a physical distance of a user relative to the controlling device to select the one of the at least two user interfaces for the one of the plurality of controlling device operating modes.

15. The method as recited in claim 10 , wherein the proximity sensing system determines a presence and absence of a communication device associated with a user on a predetermined communications network to select the one of the at least two user interfaces for the one of the plurality of controlling device operating modes.

16. The method as recited in claim 10 , wherein a first one of each of the at least two user interfaces associated with each of the plurality of controlling device operating modes is selected for display in the display device in response to the proximity sensing system determining that a user is near the controlling device.

17. The method as recited in claim 10 , wherein a first one of each of the at least two user interfaces associated with each of the plurality of controlling device operating modes is selected for display in the display device in response to the proximity sensing system determining that a user is far from the controlling device.

18. The method as recited in claim 10 , wherein the display device comprises a touch screen display device and wherein at least one of the at least two user interfaces associated with each of the plurality of controlling device operating modes includes one or more softkeys for receiving user input.

Assignments (3)
SECURITY INTEREST Recorded May 15, 2024
From: UNIVERSAL ELECTRONICS INC.
To: U.S. BANK NATIONAL ASSOCIATION
Reel/Frame 067417/0402 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME FROM UNIVESAL TO UNIVERSAL PREVIOUSLY RECORDED ON REEL 054983 FRAME 0469. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 27, 2021
From: XU, REX; MILLORA, WESLEY; MCALLISTER, STEVEN; HATAMBEIKI, ARSHAM; AHMADI, NICU; JONKMAN, JELMER; GUTMAN, STEVE; SHERIDAN, NORMAN G; HUANG, HAIMING
To: UNIVERSAL ELECTRONICS INC.
Reel/Frame 055127/0757 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 21, 2021
From: XU, REX; MILLORA, WESLEY; MCALLISTER, STEVEN; HATAMBEIKI, ARSHAM; AHMADI, NICU; JONKMAN, JELMER; GUTMAN, STEVE; SHERIDAN, NORMAN G.; HUANG, HAIMING
To: UNIVESAL ELECTRONICS INC.
Reel/Frame 054983/0469 →
Continuity (4)
Continuation In Part 16717546 · Dec 17, 2019
Provisional Application 62956478 · Jan 2, 2020
Provisional Application 62789857 · Jan 8, 2019
Related Publication 20210120301A1 · Apr 22, 2021