IP Library › Granted Patent US 12,387,721
Granted Patent B2
US 12,387,721 · App. 17/481,586 · Granted Aug 12, 2025

Multiuser voice command visualization

Inventors: Venkata Vara Prasad Karri (Visakhapatnam, IN); Sarbajit K. Rakshit (Kolkata, IN); Shailendra Moyal (Pune, IN)
Assignee: International Business Machines Corporation
G10L15/22G06F3/167G10L2015/223G10L2015/228
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,387,721
App. No.
17/481,586
Granted
Aug 12, 2025
Kind
B2
Abstract

A processor may receive a first command and a second command from one or more users. A processor may analyze the first command and the second command. A processor may determine command information associated with the first command and the second command. A processor may display the command information to at least one of the one or more users on a display screen. A processor may receive a response from the at least one of the one or more users associated with the command information on the display screen. A processor may execute the first command and the second command based, at least in part, on the command information and the response.

Claims (64)

1. A method for managing a smart device, the method comprising:

receiving, by a processor, a first command and second command from one or more users;

analyzing the first command and the second command using an artificial intelligence (AI) algorithm which analyzes historical command information and compares the analyzed historical command information with the first command and the second command;

determining command information associated with the first command and the second command based on the AI algorithm, wherein the command information comprises first information generated by natural language processing (NLP) on the first command and the second command, second information regarding a meaning of the first command and the second command, and third information regarding a contradictory relationship between the first command and the second command;

identifying at least one user from the one or more users by comparing a power bandwidth of a voice of a user associated with at least one of the first command and the second command to voice identifying data from a user profile;

displaying the command information and the identified at least one user to at least one of the one or more users on a display screen;

predicting additional command data including at least one predicted meaning of the first command and the second command based on the first information, the second information, and the third information associated with executing the first command and the second command;

receiving a response including a selected predicted meaning of the at least one predicted meaning from the at least one of the one or more users associated with the command information on the display screen; and

executing the first command and the second command based, at least in part, on the command information and the response.

2. The method of claim 1 , further comprising:

generating knowledge graph based, at least in part, on the first command and the second command,

wherein the first command is overlapped with the second command within a predetermined timeline, and the predetermined timeline is determined by a user of the smart device.

3. The method of claim 1 , wherein analyzing the first command and the second command, including:

determining additional information is needed to execute the first command and the second command; and

requesting the additional information from the one or more users.

4. The method of claim 1 , wherein analyzing the first command and the second command includes determining one or more command modifications associated with the first command.

5. The method of claim 1 , wherein analyzing the first command and the second command is further based on a command relationship.

6. The method of claim 1 , further comprising:

identifying a command relationship associated with the command information of the first command and the second command; and

displaying the command relationship on the display.

7. The method of claim 6 , wherein the command information includes at least one command question.

8. A system for managing a smart device, the system comprising:

a memory; and

a processor in communication with the memory, the processor being configured to perform operations comprising:

receiving a first command and a second command from one or more users;

analyzing the first command and the second command using an artificial intelligence (AI) algorithm which analyzes historical command information and compares the analyzed historical command information with the first command and the second command;

determining command information associated with the first command and the second command based on the AI algorithm, wherein the command information comprises first information generated by natural language processing (NLP) on the first command and the second command, second information regarding a meaning of the first command and the second command, and third information regarding a contradictory relationship between the first command and the second command;

identifying at least one user from the one or more users by comparing a power bandwidth of a voice of a user associated with at least one of the first command and the second command to voice identifying data from a user profile; and

displaying the command information and the identified at least one user to at least one of the one or more users on a display screen;

predicting additional command data including at least one predicted meaning of the first command and the second command based on the first information, the second information, and the third information associated with executing the first command and the second command;

receiving a response including a selected predicted meaning of the at least one predicted meaning from the at least one of the one or more users associated with the command information on the display screen; and

executing the first command and the second command based, at least in part, on the command information and the response.

9. The system of claim 8 , further comprising:

generating knowledge graph based, at least in part, on the first command and the second command,

wherein the first command is overlapped with the second command within a predetermined timeline, and the predetermined timeline is determined by a user of the smart device.

10. The system of claim 8 , wherein analyzing the first command and the second command, including:

determining additional information is needed to execute the first command and the second command; and

requesting the additional information from the one or more users.

11. The system of claim 8 , wherein analyzing the first command and the second command includes determining one or more command modifications associated with the first command.

12. The system of claim 8 , wherein analyzing the first command and the second command is further based on a command relationship.

13. The system of claim 8 , further comprising:

identifying a command relationship associated with the command information of the first command and the second command; and

displaying the command relationship on the display.

14. The system of claim 13 , wherein the command information includes at least one command question.

15. A computer program product for managing a smart devices, the computer program product comprising a non-transitory computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processors to perform a function, the function comprising

receiving a first command and a second command from one or more users;

analyzing the first command and the second command using an artificial intelligence (AI) algorithm which analyzes historical command information and compares the analyzed historical command information with the first command and the second command;

determining command information associated with the first command and the second command based on the AI algorithm, wherein the command information comprises first information generated by natural language processing (NLP) on the first command and the second command, second information regarding a meaning of the first command and the second command, and third information regarding a contradictory relationship between the first command and the second command;

identifying at least one user from the one or more users by comparing a power bandwidth of a voice of a user associated with at least one of the first command and the second command to voice identifying data from a user profile; and

displaying the command information and the identified at least one user to at least one of the one or more users on a display screen;

predicting additional command data including at least one predicted meaning of the first command and the second command based on the first information, the second information, and the third information associated with executing the first command and the second command;

receiving a response including a selected predicted meaning of the at least one predicted meaning from the at least one of the one or more users associated with the command information on the display screen; and

executing the first command and the second command based, at least in part, on the command information and the response.

16. The computer program product of claim 15 , further comprising:

generating knowledge graph based, at least in part, on the first command and the second command,

wherein the first command is overlapped with the second command within a predetermined timeline, and the predetermined timeline is determined by a user of the smart device.

17. The computer program product of claim 15 , wherein analyzing the first command and the second command, including:

determining additional information is needed to execute the first command and the second command; and

requesting the additional information from the one or more users.

18. The computer program product of claim 15 , wherein analyzing the first command and the second command includes determining one or more command modifications associated with the first command.

19. The computer program product of claim 15 , further comprising:

identifying a command relationship associated with the command information of the first command and the second command; and

displaying the command relationship on the display.

20. The computer program product of claim 19 , wherein the command information includes at least one command question.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 1, 2021
From: KARRI, VENKATA VARA PRASAD
To: IBM INDIA PRIVATE LIMITED
Reel/Frame 058259/0051 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 1, 2021
From: IBM INDIA PRIVATE LIMITED
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 058259/0131 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2021
From: RAKSHIT, SARBAJIT K.; MOYAL, SHAILENDRA
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 057560/0511 →
Continuity (1)
Related Publication 20230088513A1 · Mar 23, 2023
References Cited (31)
US 9817634B2 · Gupta · 2017 [cited by applicant]
US 20010056349A1 · St. John · 2001 [cited by examiner]
US 20030185358A1 · Sakamoto · 2003 [cited by examiner]
US 20060286969A1 · Talmor · 2006 [cited by examiner]
US 20150206529A1 · Kwon · 2015 [cited by examiner]
US 20160358603A1 · Azam · 2016 [cited by examiner]
US 20170220361A1 · Sharma · 2017 [cited by applicant]
US 20180268818A1 · Schoenmackers · 2018 [cited by examiner]
US 20190028803A1 · Benattar · 2019 [cited by examiner]
US 20190103111A1 · Tiwari · 2019 [cited by applicant]
US 20190138272A1 · Ahn · 2019 [cited by examiner]
US 20190311718A1 · Huber · 2019 [cited by applicant]
US 20190378516A1 · Kline · 2019 [cited by applicant]
US 20210174795A1 · Robert Jose · 2021 [cited by examiner]
US 20210366476A1 · Smith · 2021 [cited by examiner]
US 20220157314A1 · Varshney · 2022 [cited by examiner]
US 20220180867A1 · Bobbili · 2022 [cited by examiner]
US 20220406301A1 · Barros · 2022 [cited by examiner]
US 20230020504A1 · Moon · 2023 [cited by examiner]
CN 104715752A · 2015 [cited by applicant]
CN 106503156B · 2019 [cited by applicant]
CN 110663021A · 2020 [cited by applicant]
CN 110710170A · 2020 [cited by applicant]
CN 111785266A · 2020 [cited by applicant]
CN 111868824A · 2020 [cited by applicant]
JP 2018525751A · 2018 [cited by applicant]
KR 20190064613A · 2019 [cited by applicant]
Anonymous. “AI based Collective Voice Control Collaboration among Audio Conference Participants.” Published Feb. 8, 2018. 4 pages. Published by IP.com. https://priorart.ip.com/IPCOM/000252776. [cited by applicant]
Anonymous. “Method and system for recalling complete or partial voice command submitted to AI voice assistance system.” Published Mar. 12, 2020. 5 pages. Published by IP.com. https://priorart.ip.com/IPCOM/000261525. [cited by applicant]
Grabham, Dan. “Amazon Echo Show 5 review: Honey, I shrunk the screen.” Published Apr. 28, 2020. 17 pages. Published by Pocket-lint. https://www.pocket-lint.com/smart-home/reviews/amazon/148502-echo-show-5-review. [cited by applicant]
Mell, et al., “The NIST Definition of Cloud Computing,” Recommendations of the National Institute of Standards and Technology, U.S. Department of Commerce, Special Publication 800-145, Sep. 2011, 7 pgs. [cited by applicant]