IP Library › Granted Patent US 12,340,025
Granted Patent B2
US 12,340,025 · App. 17/712,835 · Granted Jun 24, 2025

Systems, methods, and apparatuses for execution of gesture commands

Inventors: Scott A. Armstrong (Wayne, PA); Arun Ravisankar (Philadelphia, PA); Resmi Vijayan (Philadelphia, PA); Arpit Mathur (Pittsburgh, PA); Julianne Heinzmann (Philadelphia, PA); Natalie Mazer (Philadelphia, PA)
Assignee: Comcast Cable Communications, LLC
G06F3/017F24F11/50G06F3/165G06V20/40G06V40/10G06V40/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,340,025
App. No.
17/712,835
Filed
Apr 4, 2022
Granted
Jun 24, 2025
Kind
B2
Art Unit
2673
USPC
382/103
Abstract

Upon detection of a gesture, a current context of an environment in which the gesture is performed may be determined. The current context may be used to interpret the gesture to determine which of potentially a plurality of devices are to be controlled by the gesture and whether the gesture is configured to control the determined device(s) in the current context. The current context may also be used to determine whether to adjust a threshold for determining whether the gesture is intended as a control command. An aspect of the detected gesture may be compared to the threshold to determine whether the gesture is intended as a control command. If the gesture is intended as a control command, the determined device(s) may be controlled accordingly.

Claims (55)

1. A method comprising:

determining, by a computing device, information associating a gesture with one or more commands associated with one or more devices;

receiving an indication that the gesture was detected;

adjusting, based on context information indicating content being output in an environment in which the gesture was detected, a gesture recognition threshold associated with the detected gesture;

selecting, based on determining that the detected gesture satisfies the adjusted gesture recognition threshold, the one or more commands; and

causing execution of the selected one or more commands.

2. The method of claim 1 , wherein the selecting is further based on a temperature of a room in which the gesture was detected.

3. The method of claim 1 , wherein the adjusting is further based on an emotional state of a user performing the detected gesture.

4. The method of claim 1 , wherein causing execution of the selected one or more commands comprises:

sending, to a first device in a first room in which the gesture was detected, a command to perform a first action; and

sending, to a second device in a second room different from the first room, a command to perform a second action.

5. The method of claim 1 , further comprising determining, based on the context information, an identity of one or more individuals in proximity to a user performing the detected gesture.

6. An apparatus comprising:

one or more processors; and

memory storing instructions that, when executed by the one or more processors, cause the apparatus to:

determine information associating a gesture with one or more commands associated with one or more devices;

receive an indication that the gesture was detected;

adjust, based on context information indicating content being output in an environment in which the gesture was detected, a gesture recognition threshold associated with the detected gesture;

select, based on determining that the detected gesture satisfies the adjusted gesture recognition threshold, the one or more commands; and

cause execution of the selected one or more commands.

7. The apparatus of claim 6 , wherein the instructions, when executed by the one or more processors, cause the selecting further based on a temperature of a room in which the gesture was detected.

8. The apparatus of claim 6 , wherein the instructions, when executed by the one or more processors, cause the adjusting further based on an emotional state of a user performing the detected gesture.

9. The apparatus of claim 6 , wherein the instructions, when executed by the one or more processors, further cause the apparatus to:

send, to a first device in a first room in which the gesture was detected, a command to perform a first action; and

send, to a second device in a second room different from the first room, a command to perform a second action.

10. The apparatus of claim 6 , wherein the instructions, when executed by the one or more processors, further cause the apparatus to:

determine, based on the context information, an identity of one or more individuals in proximity to a user performing the detected gesture.

11. A non-transitory computer-readable medium storing instructions that, when executed, cause:

determining, by a computing device, information associating a gesture with one or more commands associated with one or more devices;

receiving an indication that the gesture was detected;

adjusting, based on context information indicating content being output in an environment in which the gesture was detected, a gesture recognition threshold associated with the detected gesture;

selecting, based on determining that the detected gesture satisfies the adjusted gesture recognition threshold, the one or more commands; and

causing execution of the selected one or more commands.

12. The non-transitory computer-readable medium of claim 11 , wherein the selecting is further based on a temperature of a room in which the gesture was detected.

13. The non-transitory computer-readable medium of claim 11 , wherein the adjusting is further based on an emotional state of a user performing the detected gesture.

14. The non-transitory computer-readable medium of claim 11 , wherein the instructions, when executed, further cause:

sending, to a first device in a first room in which the gesture was detected, a command to perform a first action; and

sending, to a second device in a second room different from the first room, a command to perform a second action.

15. The non-transitory computer-readable medium of claim 11 , wherein the instructions, when executed, further cause:

determining, based on the context information, an identity of one or more individuals in proximity to a user performing the detected gesture.

16. A system comprising:

a first computing device configured to:

determine information associating a gesture with one or more commands associated with one or more devices;

receive an indication that the gesture was detected;

adjust, based on context information indicating content being output in an environment in which the gesture was detected, a gesture recognition threshold associated with the detected gesture; and

select, based on determining that the detected gesture satisfies the adjusted gesture recognition threshold, the one or more commands; and

a second computing device configured to:

cause execution of the selected one or more commands.

17. The system of claim 16 , wherein the selecting is further based on a temperature of a room in which the gesture was detected.

18. The system of claim 16 , wherein the adjusting is further based on an emotional state of a user performing the detected gesture.

19. The system of claim 16 , wherein the first computing device is further configured to:

send, to a first device in a first room in which the gesture was detected, a command to perform a first action; and

send, to a second device in a second room different from the first room, a command to perform a second action.

20. The system of claim 16 , wherein the first computing device is further configured to

determine, based on the context information, an identity of one or more individuals in proximity to a user performing the detected gesture.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 1, 2022
From: ARMSTRONG, SCOTT A.; RAVISANKAR, ARUN; VIJAYAN, RESMI; MATHUR, ARPIT; HEINZMANN, JULIANNE; MAZER, NATALIE
To: COMCAST CABLE COMMUNICATIONS, LLC
Reel/Frame 060421/0467 →
Continuity (1)
Related Publication 20230315211A1 · Oct 5, 2023
References Cited (35)
US 9093069B2 · Lee et al. · 2015 [cited by applicant]
US 9324322B1 · Torok et al. · 2016 [cited by applicant]
US 9697822B1 · Naik et al. · 2017 [cited by applicant]
US 9811664B1 · Hsu et al. · 2017 [cited by applicant]
US 9934785B1 · Hulaud · 2018 [cited by applicant]
US 10089072B2 · Piersol et al. · 2018 [cited by applicant]
US 10514766B2 · Gates et al. · 2019 [cited by applicant]
US 10558272B2 · Parshionikar · 2020 [cited by applicant]
US 10685669B1 · Lan et al. · 2020 [cited by applicant]
US 10930282B2 · Newendorp et al. · 2021 [cited by applicant]
US 11023520B1 · Sanders et al. · 2021 [cited by applicant]
US 11869039B1 · Riding · 2024 [cited by examiner]
US 20020083060A1 · Wang et al. · 2002 [cited by applicant]
US 20100146445A1 · Kraut · 2010 [cited by applicant]
US 20110157009A1 · Kim · 2011 [cited by examiner]
US 20110197263A1 · Stinson, III · 2011 [cited by applicant]
US 20120035924A1 · Jitkoff et al. · 2012 [cited by applicant]
US 20140074466A1 · Sharifi et al. · 2014 [cited by applicant]
US 20140191939A1 · Penn et al. · 2014 [cited by applicant]
US 20140270194A1 · Des Jardins · 2014 [cited by applicant]
US 20150086033A1 · Tebbs et al. · 2015 [cited by applicant]
US 20150347114A1 · Yoon · 2015 [cited by examiner]
US 20150355716A1 · Balasubramanian · 2015 [cited by examiner]
US 20170008308A1 · Willems et al. · 2017 [cited by applicant]
US 20180062691A1 · Barnett, Jr. · 2018 [cited by examiner]
US 20190066670A1 · White et al. · 2019 [cited by applicant]
US 20200021894A1 · Sanchez et al. · 2020 [cited by applicant]
US 20200042093A1 · Kline · 2020 [cited by examiner]
US 20200184962A1 · Chen · 2020 [cited by applicant]
US 20200186740A1 · Binder · 2020 [cited by applicant]
US 20210090575A1 · Mahmood et al. · 2021 [cited by applicant]
US 20210352380A1 · Duncan et al. · 2021 [cited by applicant]
An Easily Customized Gesture Recognizer for Assisted Living Using Commodity Mobile Devices:https://www.hindawi.com/journals/jhe/2018/3180652/. [cited by applicant]
Mezari, Antigoni, Maglogiannis, Ilias, An Easily Customized Gesture Recognizer for Assisted Living Using Commodity Mobile Devices, Journal of Healthcare Engineering, 2018, 3180652, 12 pages, 2018. https://doi.org/10.115… [cited by applicant]
Oct. 17, 2022—EP Search Report—EP App. No. 22177792.3. [cited by applicant]
Cited By (1)
US 12,705,839