IP Library Granted Patent US 12,531,065
Granted Patent B2
US 12,531,065 · App. 18/650,967 · Granted Jan 20, 2026

Systems and methods for managing voice environments and voice routines

Inventors: Nirmalya K. De (Sunnyvale, CA); Alan R. Bugos (Westford, MA); Dale M. Smith (Marblehead, MA); Stuart R. Patterson (Hull, MA); Jonathan E. Gordon (Bearsville, NY)
Assignee: Voice Care Tech Holdings LLC
G10L15/22G10L15/30G06F3/0482G06F3/167G10L2015/223G16H40/63
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,531,065
App. No.
18/650,967
Filed
Apr 30, 2024
Granted
Jan 20, 2026
Kind
B2
Examiner
AZAD, ABUL K
Art Unit
2656
USPC
704/251
Abstract

Provided is a voice assistance system with proactive routines that couples a remote server and respective user voice interactive devices to deliver a complete experience to the end user of the device. The user devices can be managed by groups and/or associated entities who manage voice services for their users. For example, the entities can provide pre-configured voice routines that perform actions on behalf of their users. The voice assistance system can also allow users to customize these routines to improve day to day operation. In addition, external services and/or providers can be linked to the system and allowed to define routines that have external system dependencies. Avoiding and managing conflicts in this environment becomes quite challenging. Some approaches use execution queues and priority, others invoke time slices and limitations on assignment of routines to time slices to resolve these issues, among other examples.

Claims (40)

1 . A voice assistance system for managing voice routine execution in a user environment, the system comprising:

at least one processor operatively connected to a memory;

at least one server system;

a plurality of voice devices, the plurality of voice devices comprising at least a speaker for communicating voice commands and a microphone for receiving voice input, wherein the plurality of voice devices are configured to enable assistance actions for respective users of the voice devices based on execution of voice routines;

wherein the at least one processor is configured to:

manage execution of a plurality of voice routines, the plurality of voice routines having associated execution times or triggers;

store primary versions of each voice routine of the plurality of routines;

store a user profile for the respective user of the voice device specifying one or more voice routines associated with a respective voice device, wherein the user profile defines the associated execution time or trigger of the one more voice routines in the user profile;

identify overlapping execution of a plurality of routines for one or more users;

generate an ordering of execution for the plurality of routines for the respective user; and

manage execution of the plurality of routines at the respective user's voice device according to the generated ordering.

2 . The system of claim 1 , wherein the at least one processor is configured to execute operations at respective voice devices, the server, and/or additional distributed computer resources.

3 . The system of claim 1 , wherein the at least one processor is configured to:

generate an execution queue for the plurality of routines having overlapping execution times or triggers.

4 . The system of claim 3 , wherein the at least one processor is configured to generate the ordering of the execution based on a first in first out queue.

5 . The system of claim 3 , wherein the at least one processor is configured to generate the ordering of the execution based on priority assignment or determination associated with the plurality of routines.

6 . The system of claim 5 , wherein the at least one processor is configured to generate the ordering of the execution to include a secondary and subsequent ordering within respective priority assignment or determination.

7 . The system of claim 6 , wherein the at least one processor is configured to generate the secondary and subsequent ordering based on a first in first out queue.

8 . The system of claim 1 , wherein the at least one processor is configured to communicate routines for a set time period or trigger to an in-memory database, and the in-memory database is configured to manage ordering operations on the routines and distribution of the routines to respective user devices.

9 . The system of claim 1 , further comprising routine application programming interfaces (APIs) configured to accept external generation of routines for execution at the plurality of user devices.

10 . The system of claim 9 , wherein the at least one processor is configured to assign an execution priority to the routines generated via external systems.

11 . The system of claim 1 , wherein the at least one processor is configured to automatically customize an execution time or trigger of at least one routine in a group of routines having an overlapping execution time or trigger.

12 . The system of claim 1 , further comprising a routine generation interface, wherein the routine generation interface is configured to prevent selection of overlapping timing of execution.

13 . The system of claim 1 , wherein the at least one processor is further configured to:

identify a currently executing routine conflicts with an upcoming routine; and

resolve the conflict based on ordering execution, delaying the upcoming routine, or rescheduling the upcoming routine.

14 . A computer implemented method for managing voice routine execution in a user environment, the method comprising:

registering, by at least one processor, a plurality of voice devices, the plurality of voice devices comprising at least a speaker for communicating voice commands and a microphone for receiving voice input, wherein the plurality of voice devices are configured to enable assistance actions for respective users of the voice devices based on execution of voice routines;

managing, by the at least one processor, execution of a plurality of voice routines, the plurality of voice routines having associated execution times or triggers;

storing, by the at least one processor, primary versions of each voice routine of the plurality of routines;

storing, by the at least one processor, a user profile for the respective user of the voice device specifying one or more voice routines associated with a respective voice device, wherein the user profile defines the associated execution time or trigger of the one more voice routines in the user profile;

identifying, by the at least one processor, overlapping execution of a plurality of routines for one or more users;

generating, by the at least one processor, an ordering of execution for the plurality of routines for the respective user; and

managing, by the at least one processor, execution of the plurality of routines at the respective user's voice device according to the generated ordering.

15 . The method of claim 14 , wherein the method further comprises executing operations at respective voice devices, the server, or additional distributed computer resources.

16 . The method of claim 14 , wherein the method further comprises generating an execution queue for the plurality of routines having overlapping execution times or triggers.

17 . The method of claim 16 , wherein the method further comprises generating the ordering of the execution based on a first in first out queue.

18 . The method of claim 16 , wherein the method further comprises generating the ordering of the execution based on priority assignment or determination associated with the plurality of routines.

19 . The method of claim 18 , wherein the method further comprises generating the ordering of the execution to include a secondary and subsequent ordering within respective priority assignment or determination.

20 . The method of claim 18 , wherein the method further comprises generating the secondary and subsequent ordering based on a first in first out queue.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 9, 2024
From: DE, NIRMALYA K.; BUGOS, ALAN R.; SMITH, DALE M.; PATTERSON, STUART R.; GORDON, JONATHAN E.
To: LIFEPOD SOLUTIONS, INC.
Reel/Frame 067937/0175 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 9, 2024
From: LIFEPOD SOLUTIONS, INC.
To: VOICE CARE TECH HOLDINGS LLC
Reel/Frame 067937/0291 →
Continuity (3)
Continuation 17875897 · Jul 28, 2022
Continuation 17385471 · Jul 26, 2021
Related Publication 20250104706A1 · Mar 27, 2025
References Cited (202)
US 5086391A · Chambers · 1992 [cited by applicant]
US 5612869A · Letzt · 1997 [cited by applicant]
US 5625864A · Budow · 1997 [cited by applicant]
US 6091362A · Stilp et al. · 2000 [cited by applicant]
US 6335927B1 · Elliot et al. · 2002 [cited by applicant]
US 7412260B2 · Gailey et al. · 2008 [cited by applicant]
US 7827040B2 · Brown · 2010 [cited by applicant]
US 8311863B1 · Kemp · 2012 [cited by applicant]
US 9363656B1 · George et al. · 2016 [cited by applicant]
US 9503873B1 · Yadav · 2016 [cited by applicant]
US 9715814B2 · Sattari · 2017 [cited by applicant]
US 9786148B2 · Sundaram · 2017 [cited by applicant]
US 9852599B1 · Slavin et al. · 2017 [cited by applicant]
US 9918212B1 · Immendorf et al. · 2018 [cited by applicant]
US 10157042B1 · Jayakumar · 2018 [cited by applicant]
US 10182732B2 · Evans et al. · 2019 [cited by applicant]
US 10258295B2 · Fountaine · 2019 [cited by applicant]
US 10282961B1 · Jordan et al. · 2019 [cited by applicant]
US 10311707B2 · Halverson · 2019 [cited by applicant]
US 10412206B1 · Liang et al. · 2019 [cited by applicant]
US 10516622B2 · Liu · 2019 [cited by applicant]
US 10572107B1 · Beebe et al. · 2020 [cited by applicant]
US 10658074B1 · Sorkey et al. · 2020 [cited by applicant]
US 10722185B2 · Fountaine · 2020 [cited by applicant]
US 11020064B2 · Fountaine · 2021 [cited by applicant]
US 11404062B1 · De · 2022 [cited by examiner]
US 11607182B2 · Fountaine · 2023 [cited by applicant]
US 12002465B2 · De · 2024 [cited by examiner]
US 12008994B2 · De · 2024 [cited by examiner]
US 20010054085A1 · Kurganov · 2001 [cited by applicant]
US 20020026266A1 · Montague · 2002 [cited by applicant]
US 20020150227A1 · Abraham · 2002 [cited by applicant]
US 20030052787A1 · Zerhusen et al. · 2003 [cited by applicant]
US 20040143602A1 · Ruiz et al. · 2004 [cited by applicant]
US 20050075542A1 · Goldreich · 2005 [cited by applicant]
US 20050179540A1 · Rubenstein · 2005 [cited by applicant]
US 20050240571A1 · Haigh et al. · 2005 [cited by applicant]
US 20050288721A1 · Girouard et al. · 2005 [cited by applicant]
US 20060049936A1 · Collins et al. · 2006 [cited by applicant]
US 20060053009A1 · Jeong et al. · 2006 [cited by applicant]
US 20060143050A1 · Dean · 2006 [cited by applicant]
US 20060184369A1 · Levonas · 2006 [cited by applicant]
US 20060288225A1 · Jung et al. · 2006 [cited by applicant]
US 20070066276A1 · Kuz et al. · 2007 [cited by applicant]
US 20070106510A1 · Hsing et al. · 2007 [cited by applicant]
US 20070189128A1 · Chung · 2007 [cited by applicant]
US 20070253021A1 · Mehta et al. · 2007 [cited by applicant]
US 20070255599A1 · Henry · 2007 [cited by applicant]
US 20080089491A1 · Kortum et al. · 2008 [cited by applicant]
US 20080165286A1 · Oh et al. · 2008 [cited by applicant]
US 20080247519A1 · Abella et al. · 2008 [cited by applicant]
US 20080294462A1 · Nuhaan et al. · 2008 [cited by applicant]
US 20090177641A1 · Raghavan · 2009 [cited by applicant]
US 20090243833A1 · Huang et al. · 2009 [cited by applicant]
US 20090259728A1 · Berisford et al. · 2009 [cited by applicant]
US 20100015585A1 · Baker · 2010 [cited by applicant]
US 20100131280A1 · Bogineni · 2010 [cited by applicant]
US 20100257458A1 · Herlein et al. · 2010 [cited by applicant]
US 20100269049A1 · Fearin · 2010 [cited by applicant]
US 20100286940A1 · Koverzin · 2010 [cited by applicant]
US 20100295684A1 · Hsieh · 2010 [cited by applicant]
US 20110059748A1 · Taylor et al. · 2011 [cited by applicant]
US 20110123971A1 · Berkowitz · 2011 [cited by applicant]
US 20110282671A1 · Dicks et al. · 2011 [cited by applicant]
US 20110301440A1 · Riley et al. · 2011 [cited by applicant]
US 20120087482A1 · Alexander, Sr. · 2012 [cited by applicant]
US 20120166322A1 · Simon · 2012 [cited by applicant]
US 20120196571A1 · Grkov et al. · 2012 [cited by applicant]
US 20130077536A1 · Piett et al. · 2013 [cited by applicant]
US 20130097682A1 · Zeljkovic et al. · 2013 [cited by applicant]
US 20130100268A1 · Mihailidis et al. · 2013 [cited by applicant]
US 20130147899A1 · Labhard · 2013 [cited by applicant]
US 20130149987A1 · Cheng et al. · 2013 [cited by applicant]
US 20130150686A1 · Fronterhouse et al. · 2013 [cited by applicant]
US 20130162426A1 · Wiesner et al. · 2013 [cited by applicant]
US 20130173305A1 · Hyde et al. · 2013 [cited by applicant]
US 20130214925A1 · Weiss · 2013 [cited by applicant]
US 20130253950A1 · Vanderpohl, III et al. · 2013 [cited by applicant]
US 20130267795A1 · Cosentino et al. · 2013 [cited by applicant]
US 20140004490A1 · Welling et al. · 2014 [cited by applicant]
US 20140005506A1 · Elghazzawi · 2014 [cited by applicant]
US 20140019157A1 · Nudd et al. · 2014 [cited by applicant]
US 20140073880A1 · Boucher et al. · 2014 [cited by applicant]
US 20140168453A1 · Shoemake et al. · 2014 [cited by applicant]
US 20140188398A1 · Cohen et al. · 2014 [cited by applicant]
US 20140214426A1 · Kanevsky et al. · 2014 [cited by applicant]
US 20140259017A1 · Murray et al. · 2014 [cited by applicant]
US 20140351411A1 · Woods et al. · 2014 [cited by applicant]
US 20140379344A1 · Smith et al. · 2014 [cited by applicant]
US 20150002292A1 · Cavalcanti et al. · 2015 [cited by applicant]
US 20150019255A1 · Coetzer · 2015 [cited by applicant]
US 20150094830A1 · Lipoma et al. · 2015 [cited by applicant]
US 20150145662A1 · Barfield, Jr. et al. · 2015 [cited by applicant]
US 20150162006A1 · Kummer · 2015 [cited by applicant]
US 20150185752A1 · Bard et al. · 2015 [cited by applicant]
US 20150193450A1 · Chung · 2015 [cited by applicant]
US 20150206531A1 · Fujisawa et al. · 2015 [cited by applicant]
US 20150269827A1 · Hopkins et al. · 2015 [cited by applicant]
US 20150269835A1 · Benoit et al. · 2015 [cited by applicant]
US 20150295784A1 · Kim et al. · 2015 [cited by applicant]
US 20150302766A1 · Oberlander · 2015 [cited by applicant]
US 20150373183A1 · Woolsey et al. · 2015 [cited by applicant]
US 20160004831A1 · Carlson · 2016 [cited by applicant]
US 20160027280A1 · Khan et al. · 2016 [cited by applicant]
US 20160041811A1 · Parundekar et al. · 2016 [cited by applicant]
US 20160052391A1 · Walsh et al. · 2016 [cited by applicant]
US 20160057595A1 · Ahmed et al. · 2016 [cited by applicant]
US 20160066189A1 · Mahaffey et al. · 2016 [cited by applicant]
US 20160088455A1 · Bozik et al. · 2016 [cited by applicant]
US 20160106627A1 · Geman et al. · 2016 [cited by applicant]
US 20160179787A1 · Deleeuw · 2016 [cited by applicant]
US 20160232302A1 · Geronimo-Button et al. · 2016 [cited by applicant]
US 20160232773A1 · Abeyta et al. · 2016 [cited by applicant]
US 20160324460A1 · Kusens · 2016 [cited by applicant]
US 20160328949A1 · Zhong · 2016 [cited by applicant]
US 20160329872A1 · Dizon · 2016 [cited by applicant]
US 20170069189A1 · Courm · 2017 [cited by applicant]
US 20170083622A1 · Blanco · 2017 [cited by applicant]
US 20170094490A1 · Ryan et al. · 2017 [cited by applicant]
US 20170103754A1 · Higbie et al. · 2017 [cited by applicant]
US 20170109474A1 · Jung et al. · 2017 [cited by applicant]
US 20170123391A1 · Sinha et al. · 2017 [cited by applicant]
US 20170124279A1 · Rothman · 2017 [cited by applicant]
US 20170140629A1 · Briggs et al. · 2017 [cited by applicant]
US 20170140754A1 · Ichimura · 2017 [cited by applicant]
US 20170160813A1 · Divakaran et al. · 2017 [cited by applicant]
US 20170186301A1 · Vaddepally et al. · 2017 [cited by applicant]
US 20170206899A1 · Bryant et al. · 2017 [cited by applicant]
US 20170213191A1 · Pitcher · 2017 [cited by applicant]
US 20170221283A1 · Pal et al. · 2017 [cited by applicant]
US 20170239432A1 · Delangre et al. · 2017 [cited by applicant]
US 20170251347A1 · Mehta et al. · 2017 [cited by applicant]
US 20170296107A1 · Reid et al. · 2017 [cited by applicant]
US 20180004909A1 · Cronin et al. · 2018 [cited by applicant]
US 20180007201A1 · Kurganov · 2018 [cited by applicant]
US 20180032692A1 · Hickle et al. · 2018 [cited by applicant]
US 20180047391A1 · Baik et al. · 2018 [cited by applicant]
US 20180054506A1 · Hart et al. · 2018 [cited by applicant]
US 20180060492A1 · Feng et al. · 2018 [cited by applicant]
US 20180060495A1 · Mahapatra et al. · 2018 [cited by applicant]
US 20180075219A1 · Klein et al. · 2018 [cited by applicant]
US 20180075712A1 · Field · 2018 [cited by applicant]
US 20180096690A1 · Mixter et al. · 2018 [cited by applicant]
US 20180116537A1 · Sullivan et al. · 2018 [cited by applicant]
US 20180122378A1 · Mixter et al. · 2018 [cited by applicant]
US 20180144590A1 · Mixter et al. · 2018 [cited by applicant]
US 20180190264A1 · Mixter et al. · 2018 [cited by applicant]
US 20180210701A1 · Segal et al. · 2018 [cited by applicant]
US 20180217264A1 · Syrjarinne · 2018 [cited by applicant]
US 20180226158A1 · Fish et al. · 2018 [cited by applicant]
US 20180247713A1 · Rothman · 2018 [cited by applicant]
US 20180268337A1 · Miller · 2018 [cited by examiner]
US 20180268346A1 · Cronin et al. · 2018 [cited by applicant]
US 20180310159A1 · Katz et al. · 2018 [cited by applicant]
US 20180315488A1 · Miranda et al. · 2018 [cited by applicant]
US 20180325469A1 · Fountaine · 2018 [cited by applicant]
US 20180325470A1 · Fountaine · 2018 [cited by applicant]
US 20190132932A1 · Klecha et al. · 2019 [cited by applicant]
US 20190163437A1 · Nagasaka · 2019 [cited by applicant]
US 20190179607A1 · Thangarathnam · 2019 [cited by applicant]
US 20190221225A1 · Bricklin et al. · 2019 [cited by applicant]
US 20190228631A1 · Stinson et al. · 2019 [cited by applicant]
US 20190233870A1 · Buck et al. · 2019 [cited by applicant]
US 20190290129A1 · Hanina · 2019 [cited by applicant]
US 20190343456A1 · Kahlert et al. · 2019 [cited by applicant]
US 20190364505A1 · Wang et al. · 2019 [cited by applicant]
US 20190378518A1 · Jeong et al. · 2019 [cited by applicant]
US 20200043502A1 · Ding · 2020 [cited by applicant]
US 20200047341A1 · Song et al. · 2020 [cited by applicant]
US 20200066254A1 · Hiroe et al. · 2020 [cited by applicant]
US 20200114159A1 · Kaib et al. · 2020 [cited by applicant]
US 20200251195A1 · Palo · 2020 [cited by examiner]
US 20200265699A1 · Bango et al. · 2020 [cited by applicant]
US 20200286620A1 · Fallon et al. · 2020 [cited by applicant]
US 20200327989A1 · Kuenen et al. · 2020 [cited by applicant]
US 20200380980A1 · Shum et al. · 2020 [cited by applicant]
US 20210038170A1 · Fountaine · 2021 [cited by applicant]
US 20210077036A1 · Fountaine · 2021 [cited by applicant]
US 20210104304A1 · Davidovics et al. · 2021 [cited by applicant]
US 20210142798A1 · Pulicharla et al. · 2021 [cited by applicant]
US 20210153818A1 · Fountaine · 2021 [cited by applicant]
US 20210158722A1 · Vyas et al. · 2021 [cited by applicant]
US 20210196209A1 · Fountaine · 2021 [cited by applicant]
US 20210375272A1 · Madwed · 2021 [cited by applicant]
US 20230066964A1 · De et al. · 2023 [cited by applicant]
US 20230070082A1 · De et al. · 2023 [cited by applicant]
US 20240074712A1 · Fountaine · 2024 [cited by applicant]
GB 2183123A · 1987 [cited by applicant]
WO WO2013056335A1 · 2013 [cited by applicant]
WO WO2015125939A1 · 2015 [cited by applicant]
WO WO2016097368A1 · 2016 [cited by applicant]
WO WO2016167429A1 · 2016 [cited by applicant]
WO WO2017146643A1 · 2017 [cited by applicant]
U.S. Appl. No. 16/936,019, filed Jul. 22, 2020, Fountaine. [cited by applicant]
U.S. Appl. No. 18/123,541, filed Mar. 20, 2023, Fountaine. [cited by applicant]
U.S. Appl. No. 17/875,963, filed Jul. 28, 2022, De et al. [cited by applicant]
U.S. Appl. No. 17/875,897, filed Jul. 28, 2022, De et al. [cited by applicant]
U.S. Appl. No. 18/650,900, filed Apr. 30, 2024, De [cited by applicant]
PCT/US2018/031783, Aug. 9, 2018, International Search Report and Written Opinion. [cited by applicant]
PCT/US2018/031783, Nov. 21, 2019, International Preliminary Report on Patentability. [cited by applicant]
International Search Report and Written Opinion dated Aug. 9, 2018, in connection with International Application No. PCT/US2018/031783. [cited by applicant]
International Preliminary Report on Patentability dated Nov. 21, 2019, in connection with International Application No. PCT/US2018/031783. [cited by applicant]