IP Library Granted Patent US 12,536,991
Granted Patent B2
US 12,536,991 · App. 18/337,206 · Granted Jan 27, 2026

Systems and methods for crowdsourced actions and commands

Inventors: Rajat Mukherjee (San Jose, CA); Kiran Bindhu Hemaraj (Trivandrum, IN)
Assignee: Peloton Interactive, Inc.
G10L15/063G06F3/167G10L15/22G10L2015/0635G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,536,991
App. No.
18/337,206
Granted
Jan 27, 2026
Kind
B2
Abstract

Embodiments facilitate the intuitive creation, maintenance, and distribution of action datasets that include computing events or tasks that can be reproduced when a command is received by a digital assistant. The digital assistant can generate new action datasets, on-board new action datasets, and receive new action datasets or updates to existing action datasets locally or via a digital assistant server, among other things. The digital assistant server can also receive action datasets, maintain action datasets, and distribute action datasets to one or more digital assistants, among other things.

Claims (37)

1 . A computer-implemented method, comprising:

obtaining an action dataset having a command template that corresponds to a received command,

wherein the action dataset has a set of instructions interpretable by a remote computing device to cause the remote computing device to reproduce a series of operations utilizing an application of the remote computing device;

transmitting the action dataset to the remote computing device; and

causing the remote computing device to reproduce the series of operations based at least in part on the set of instructions included in the action dataset.

2 . The method of claim 1 , further comprising:

receiving the command from the remote computing device; and

obtaining the action dataset based on a set of keywords associated with the command template that correspond to the command received from the remote computing device.

3 . The method of claim 1 , further comprising:

receiving an action dataset profile from the remote computing device; and

obtaining the action dataset based on the action dataset profile.

4 . The method of claim 3 , wherein the action dataset profile includes a list of instruction sets interpretable by the remote computing device.

5 . A non-transitory computer storage medium storing computer-useable instructions that, when executed by one or more computing devices, cause the one or more computing devices to perform a method, the method comprising:

receiving a command from a computing device;

determining that at least two action datasets are relevant to the received command,

wherein an action dataset includes a command template and a set of instructions and is interpretable by the computing device to cause the computing device to reproduce a series of operations based on the set of instructions within the action dataset;

causing the computing device to display a listing of the at least two relevant action datasets;

receiving a selection of one action dataset of the at least two relevant action datasets; and

causing the computing device to reproduce the series of operations that corresponds to the selected one action dataset.

6 . The non-transitory computer storage medium of claim 5 , wherein the command template has a set of keywords, and the at least two action datasets are relevant to the received command based on a determination that each command template associated with the at least two action datasets corresponds to the received command.

7 . The non-transitory computer storage medium of claim 5 , further comprising:

communicating the selected one action dataset to the computing device in response to receiving the selection.

8 . The non-transitory computer storage medium of claim 7 , wherein each action dataset is associated with one application of the computing device.

9 . The non-transitory computer storage medium of claim 7 , wherein each action dataset is associated with one or more applications of the computing device, and the series of operations corresponding to the selected one action dataset is reproduced via the one or more applications.

10 . A method performed by a server device, the method comprising:

receiving a command from a digital assistant device, the command corresponding to a requested set of operations to be performed by the digital assistant device;

determining that the received command corresponds to a command template of an action dataset stored by the server device,

wherein the action dataset includes the command template and a set of instructions and is interpretable by the digital assistant device to reproduce the series of operations utilizing an application of the digital assistant device; and

communicating to the digital assistant device the action dataset determined to correspond to the received command.

11 . The method of claim 10 , further comprising:

causing a reproduction of the set of operations on the digital assistant device based at least in part on the communication of the action dataset to the digital assistant device.

12 . The method of claim 10 , wherein the action dataset is generated by a second digital assistant device and indexed by the server device for use by digital assistant devices.

13 . The method of claim 10 , wherein the command includes an alphanumeric text representation of a spoken command.

14 . The method of claim 13 , wherein alphanumeric text representation is generated by the digital assistant device based on a received audible command.

15 . The method of claim 10 , wherein the command is determined to correspond to the action dataset based at least in part on a determination that one or more keywords of the command template of the action dataset correspond to the received command.

16 . The method of claim 15 , wherein the command template of the action dataset includes at least one keyword and at least one defined parameter field.

17 . The method of claim 10 , wherein the action dataset corresponds to at least one application installed on the digital assistant device.

Continuity (6)
Continuation 17353383 · Jun 21, 2021
Continuation 16038993 · Jul 18, 2018
Continuation In Part 15984122 · May 18, 2018
Provisional Application 62576766 · Oct 25, 2017
Provisional Application 62508181 · May 18, 2017
Related Publication 20230335115A1 · Oct 19, 2023
References Cited (158)
US 5600711A · Yuen · 1997 [cited by applicant]
US 6173266B1 · Marx et al. · 2001 [cited by applicant]
US 6188976B1 · Ramaswamy et al. · 2001 [cited by applicant]
US 6442519B1 · Kanevsky et al. · 2002 [cited by applicant]
US 6535912B1 · Anupam et al. · 2003 [cited by applicant]
US 6636831B1 · Profit, Jr. et al. · 2003 [cited by applicant]
US 6678864B1 · Tsai · 2004 [cited by applicant]
US 7024348B1 · Scholz et al. · 2006 [cited by applicant]
US 7440895B1 · Miller et al. · 2008 [cited by applicant]
US 7546576B2 · Egli · 2009 [cited by applicant]
US 7627638B1 · Cohen · 2009 [cited by applicant]
US 7729919B2 · Wang · 2010 [cited by applicant]
US 7747573B2 · Butt et al. · 2010 [cited by applicant]
US 7756708B2 · Cohen et al. · 2010 [cited by applicant]
US 8160883B2 · Lecoeuche · 2012 [cited by applicant]
US 8453058B1 · Coccaro et al. · 2013 [cited by applicant]
US 8473949B2 · Horvitz et al. · 2013 [cited by applicant]
US 8620842B1 · Cormack · 2013 [cited by applicant]
US 8775177B1 · Heigold et al. · 2014 [cited by applicant]
US 8805766B2 · Ray · 2014 [cited by applicant]
US 9053708B2 · Koch et al. · 2015 [cited by applicant]
US 9123336B1 · Uszkoreit et al. · 2015 [cited by applicant]
US 9330659B2 · Ju et al. · 2016 [cited by applicant]
US 9361887B1 · Braga · 2016 [cited by examiner]
US 9384732B2 · Bishop et al. · 2016 [cited by applicant]
US 9412392B2 · Lindahl · 2016 [cited by applicant]
US 9472192B2 · Ding · 2016 [cited by applicant]
US 9479831B2 · Oostveen et al. · 2016 [cited by applicant]
US 9479931B2 · Ortiz, Jr. et al. · 2016 [cited by applicant]
US 9508339B2 · Kannan et al. · 2016 [cited by applicant]
US 9619468B2 · Adams et al. · 2017 [cited by applicant]
US 9620122B2 · Vanblon · 2017 [cited by applicant]
US 9754585B2 · Brockett · 2017 [cited by examiner]
US 10007500B1 · Suraci · 2018 [cited by examiner]
US 10176171B1 · Patterson et al. · 2019 [cited by applicant]
US 10209956B2 · Fletcher et al. · 2019 [cited by applicant]
US 10217462B2 · Sarikaya et al. · 2019 [cited by applicant]
US 10332513B1 · D'Souza et al. · 2019 [cited by applicant]
US 10402470B2 · Esterly · 2019 [cited by examiner]
US 10466963B2 · Levi et al. · 2019 [cited by applicant]
US 10489405B2 · Zheng · 2019 [cited by examiner]
US 10528605B2 · Braga et al. · 2020 [cited by applicant]
US 10606672B2 · Riva · 2020 [cited by examiner]
US 10698654B2 · Loughrey et al. · 2020 [cited by applicant]
US 12073147B2 · Carson · 2024 [cited by examiner]
US 20020032564A1 · Ehsani et al. · 2002 [cited by applicant]
US 20030212561A1 · Williams et al. · 2003 [cited by applicant]
US 20040236580A1 · Bennett · 2004 [cited by applicant]
US 20050010418A1 · McNair et al. · 2005 [cited by applicant]
US 20050010892A1 · McNair et al. · 2005 [cited by applicant]
US 20050097618A1 · Arling et al. · 2005 [cited by applicant]
US 20050135338A1 · Chiu et al. · 2005 [cited by applicant]
US 20050240917A1 · Wu · 2005 [cited by applicant]
US 20050261903A1 · Kawazoe et al. · 2005 [cited by applicant]
US 20060294509A1 · Mital et al. · 2006 [cited by applicant]
US 20070055492A1 · Wang et al. · 2007 [cited by applicant]
US 20070271292A1 · Acharya et al. · 2007 [cited by applicant]
US 20080021708A1 · Bennett et al. · 2008 [cited by applicant]
US 20080120616A1 · James et al. · 2008 [cited by applicant]
US 20080201140A1 · Wells et al. · 2008 [cited by applicant]
US 20080221715A1 · Krzyzanowski et al. · 2008 [cited by applicant]
US 20090070312A1 · Patterson · 2009 [cited by applicant]
US 20090249206A1 · Stahlberg · 2009 [cited by applicant]
US 20090307162A1 · Bui et al. · 2009 [cited by applicant]
US 20100036676A1 · Safdi et al. · 2010 [cited by applicant]
US 20100082398A1 · Davis et al. · 2010 [cited by applicant]
US 20100088100A1 · Lindahl · 2010 [cited by applicant]
US 20110066634A1 · Phillips et al. · 2011 [cited by applicant]
US 20110301943A1 · Patch · 2011 [cited by applicant]
US 20110320767A1 · Eren et al. · 2011 [cited by applicant]
US 20120035932A1 · Jitkoff et al. · 2012 [cited by applicant]
US 20120066600A1 · Nickel · 2012 [cited by applicant]
US 20120209613A1 · Agapi et al. · 2012 [cited by applicant]
US 20130013644A1 · Sathish et al. · 2013 [cited by applicant]
US 20130080177A1 · Chen · 2013 [cited by applicant]
US 20130152092A1 · Yadgar · 2013 [cited by applicant]
US 20130179423A1 · Gur et al. · 2013 [cited by applicant]
US 20130329086A1 · Malone · 2013 [cited by applicant]
US 20140074481A1 · Newman · 2014 [cited by applicant]
US 20140074483A1 · van Os · 2014 [cited by applicant]
US 20140108013A1 · Di Cristo et al. · 2014 [cited by applicant]
US 20140108308A1 · Stout · 2014 [cited by examiner]
US 20140115456A1 · White et al. · 2014 [cited by applicant]
US 20140136187A1 · Wolverton et al. · 2014 [cited by applicant]
US 20140222436A1 · Binder · 2014 [cited by applicant]
US 20140278413A1 · El et al. · 2014 [cited by applicant]
US 20140280238A1 · Gormack et al. · 2014 [cited by applicant]
US 20140282003A1 · Gruber et al. · 2014 [cited by applicant]
US 20140297282A1 · Peters et al. · 2014 [cited by applicant]
US 20150006178A1 · Peng et al. · 2015 [cited by applicant]
US 20150032451A1 · Gunn et al. · 2015 [cited by applicant]
US 20150045003A1 · Vora et al. · 2015 [cited by applicant]
US 20150089373A1 · Dwivedi et al. · 2015 [cited by applicant]
US 20150095031A1 · Conkie et al. · 2015 [cited by applicant]
US 20150120723A1 · Deshmukh et al. · 2015 [cited by applicant]
US 20150180967A1 · Takagishi · 2015 [cited by applicant]
US 20150242385A1 · Bao et al. · 2015 [cited by applicant]
US 20150248730A1 · Pilot et al. · 2015 [cited by applicant]
US 20150302850A1 · Lebrun · 2015 [cited by applicant]
US 20150317310A1 · Glass et al. · 2015 [cited by applicant]
US 20150348551A1 · Gruber et al. · 2015 [cited by applicant]
US 20150355609A1 · Warren · 2015 [cited by examiner]
US 20150371628A1 · Kreifeldt · 2015 [cited by applicant]
US 20150373183A1 · Woolsey et al. · 2015 [cited by applicant]
US 20160004974A1 · Pope · 2016 [cited by applicant]
US 20160019266A1 · Katsunuma et al. · 2016 [cited by applicant]
US 20160072940A1 · Cronin · 2016 [cited by examiner]
US 20160077853A1 · Feng et al. · 2016 [cited by applicant]
US 20160132568A1 · Vogel et al. · 2016 [cited by applicant]
US 20160155442A1 · Kannan · 2016 [cited by examiner]
US 20160162456A1 · Munro et al. · 2016 [cited by applicant]
US 20160162478A1 · Blassin · 2016 [cited by examiner]
US 20160179897A1 · Zheng · 2016 [cited by examiner]
US 20160225371A1 · Igrawal et al. · 2016 [cited by applicant]
US 20160259623A1 · Sumner et al. · 2016 [cited by applicant]
US 20160260430A1 · Panemangalore et al. · 2016 [cited by applicant]
US 20160275949A1 · Bishop et al. · 2016 [cited by applicant]
US 20160358603A1 · Azam et al. · 2016 [cited by applicant]
US 20160378279A1 · Sirpal et al. · 2016 [cited by applicant]
US 20160378325A1 · Hurley et al. · 2016 [cited by applicant]
US 20160378439A1 · Straub et al. · 2016 [cited by applicant]
US 20170011739A1 · Huang · 2017 [cited by applicant]
US 20170069177A1 · Takahata et al. · 2017 [cited by applicant]
US 20170093781A1 · Sharma et al. · 2017 [cited by applicant]
US 20170116982A1 · Gelfenbeyn et al. · 2017 [cited by applicant]
US 20170132199A1 · Vescovi et al. · 2017 [cited by applicant]
US 20170193123A1 · Jones et al. · 2017 [cited by applicant]
US 20170220240A1 · Kataria et al. · 2017 [cited by applicant]
US 20170289172A1 · Turakhia · 2017 [cited by applicant]
US 20180174577A1 · Jothilingam et al. · 2018 [cited by applicant]
US 20180308476A1 · Hirzel et al. · 2018 [cited by applicant]
US 20180336049A1 · Mukherjee · 2018 [cited by examiner]
US 20180336050A1 · Mukherjee · 2018 [cited by examiner]
US 20180336269A1 · Dobrynin et al. · 2018 [cited by applicant]
US 20180350353A1 · Gruber et al. · 2018 [cited by applicant]
US 20180366108A1 · Mukherjee et al. · 2018 [cited by applicant]
US 20180366113A1 · Hemaraj et al. · 2018 [cited by applicant]
US 20190130244A1 · Mars · 2019 [cited by examiner]
US 20190132436A1 · Jang et al. · 2019 [cited by applicant]
US 20190208130A1 · Hara et al. · 2019 [cited by applicant]
US 20190287512A1 · Zoller et al. · 2019 [cited by applicant]
US 20190347118A1 · Mukherjee et al. · 2019 [cited by applicant]
US 20230335115A1 · Mukherjee · 2023 [cited by examiner]
EP 2386975A2 · 2011 [cited by applicant]
EP 2760015A1 · 2014 [cited by applicant]
WO 2016109366A1 · 2016 [cited by applicant]
Lee, R. and Nathuji, R., “Power and performance Analysis of PDA Architectures,” pp. 11 (Dec. 12, 2000). [cited by applicant]
Notice of Allowance dated Oct. 5, 2021, in U.S. Appl. No. 15/936,001, 17 pages. [cited by applicant]
Final Office Action dated Nov. 3, 2021, in U.S. Appl. No. 16/110,108, 19 pages. [cited by applicant]
“The Q System”, Aiqudo, p. 1. [cited by applicant]
“The Q App & Action Kil”, Aiqudo, pp. 5. [cited by applicant]
“Q Commands”, Aiqudo, pp. 4. [cited by applicant]
“Hash table”, Wikipedia, Retrieved from Internet URL : https://en.wikipedia.org/w/index.php?ille=Hash_lable&oldid=753684620, accessed on Sep. 28, 2021, pp. 18 (Dec. 8, 2016). [cited by applicant]
Mechling, L. C., et al., “Using a Personal Digital Assistant to Increase Independent Task Completion by Students , with Autism Spectrum Disorder”, J Autism Dev Disord, pp. 1420-1434 {May 23, 2009). [cited by applicant]
Non Final Office Action dated Jul. 12, 2021 in U.S. Appl. No. 16/110,103, 20 pages. [cited by applicant]
Extended European Search Report and Opinion received for EP Patent Application No. 18801977.2, mailed on Jul. 22, 2021, 17 pages. [cited by applicant]
Non Final Office Action dated Sep. 2, 2021 in U.S. Appl. No. 15/984,122, 20 pages. [cited by applicant]
Extended European Search Report and Opinion received for EP Patent Application No. 19748228.4, mailed on Sep. 24, 2021, 11 pages. [cited by applicant]