IP Library Granted Patent US 12,495,010
Granted Patent B2
US 12,495,010 · App. 18/192,262 · Granted Dec 9, 2025

Moderating artificial intelligence (AI) agent interlocution in group dialog environments

Inventors: Michael Desmond (White Plains, NY); Zahra Ashktorab (Brooklyn, NY); Michelle Brachman (Quincy, MA); James Johnson (Somerville, MA); Casey Dugan (Cambridge, MA); Qian Pan (Canton, MA)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
H04L51/02G06F40/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,495,010
App. No.
18/192,262
Filed
Mar 29, 2023
Granted
Dec 9, 2025
Kind
B2
Art Unit
2657
USPC
704/9
Abstract

Provided are techniques for moderating Artificial Intelligence (AI) agent interlocution in group dialog environments. Under control of an interlocution module that has been trained with dialog content and dialog turns, an indication that interlocution is to be determined for a group dialog is received. Under control of the interlocution module, it is determined whether an AI agent is to participate in the group dialog based on a current dialog context and a dialog response. Under control of the interlocution module, in response to determining that the AI agent is to participate in the group dialog, the AI agent is triggered to post the dialog response to the group dialog.

Claims (50)

1. A computer-implemented method, comprising operations for:

during a group dialog with an Artificial Intelligence (AI) agent and at least two users,

under control of an interlocution module that has been trained with dialog content and dialog turns,

receiving an indication that an interlocution point is to be determined for the group dialog;

determining the interlocution point at which the AI agent is to participate in the group dialog based on a current dialog context and a dialog response; and

triggering the AI agent to post the dialog response to the group dialog at the interlocution point;

receiving feedback comprising a positive emote or a negative emote for the dialog response; and

further training the interlocution module based on the received feedback.

2. The computer-implemented method of claim 1 , further comprising operations for:

receiving another indication that interlocution is to be determined for the group dialog;

determining that the AI agent is to participate in the group dialog based on a new current dialog context; and

generating a new dialog response.

3. The computer-implemented method of claim 1 , wherein the dialog content and the dialog turns are annotated with persona data and temporal data, and wherein the temporal data comprises a duration, a time since a last response, and an average response time.

4. The computer-implemented method of claim 1 , wherein the dialog content is annotated with one or more positive interlocution points and one or more negative interlocution points.

5. The computer-implemented method of claim 1 , wherein the indication that the interlocution point is to be determined is generated at each dialog turn in the group dialog.

6. The computer-implemented method of claim 1 , wherein the indication that that the interlocution point is to be determined is generated periodically.

7. A computer program product, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform operations for:

during a group dialog with an Artificial Intelligence (AI) agent and at least two users,

under control of an interlocution module that has been trained with dialog content and dialog turns,

receiving an indication that an interlocution point is to be determined for the group dialog;

determining the interlocution point at which the AI agent is to participate in the group dialog based on a current dialog context and a dialog response; and

triggering the AI agent to post the dialog response to the group dialog at the interlocution point;

receiving feedback comprising a positive emote or a negative emote for the dialog response; and

further training the interlocution module based on the received feedback.

8. The computer program product of claim 7 , wherein the program instructions are executable by the processor to cause the processor to perform further operations for:

receiving another indication that interlocution is to be determined for the group dialog;

determining that the AI agent is to participate in the group dialog based on a new current dialog context; and

generating a new dialog response.

9. The computer program product of claim 8 , wherein the dialog content and the dialog turns are annotated with persona data and temporal data, and wherein the temporal data comprises a duration, a time since a last response, and an average response time.

10. The computer program product of claim 7 , wherein the dialog content is annotated with one or more positive interlocution points and one or more negative interlocution points.

11. The computer program product of claim 7 , wherein the indication that the interlocution point is to be determined is generated at each dialog turn in the group dialog.

12. The computer program product of claim 7 , wherein the indication that that the interlocution point is to be determined is generated periodically.

13. A computer system, comprising:

one or more processors, one or more computer-readable memories and one or more computer-readable, tangible storage devices; and

program instructions, stored on at least one of the one or more computer-readable, tangible storage devices for execution by at least one of the one or more processors via at least one of the one or more computer-readable memories, to perform operations comprising:

during a group dialog with an Artificial Intelligence (AI) agent and at least two users,

under control of an interlocution module that has been trained with dialog content and dialog turns,

receiving an indication that an interlocution point is to be determined for the group dialog;

determining the interlocution point at which the AI agent is to participate in the group dialog based on a current dialog context and a dialog response; and

triggering the AI agent to post the dialog response to the group dialog at the interlocution point;

receiving feedback comprising a positive emote or a negative emote for the dialog response; and

further training the interlocution module based on the received feedback.

14. The computer system of claim 13 , wherein the operations further comprise:

receiving another indication that interlocution is to be determined for the group dialog;

determining that the AI agent is to participate in the group dialog based on a new current dialog context; and

generating a new dialog response.

15. The computer system of claim 14 , wherein the dialog content and the dialog turns are annotated with persona data and temporal data, and wherein the temporal data comprises a duration, a time since a last response, and an average response time.

16. The computer system of claim 13 , wherein the dialog content is annotated with one or more positive interlocution points and one or more negative interlocution points.

17. The computer system of claim 13 , wherein the indication that the interlocution point is to be determined is generated at each dialog turn in the group dialog.

18. The computer system of claim 13 , wherein the indication that that the interlocution point is to be determined is generated periodically.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 29, 2023
From: DESMOND, MICHAEL; ASHKTORAB, ZAHRA; BRACHMAN, MICHELLE; JOHNSON, JAMES; DUGAN, CASEY; PAN, QIAN
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 063152/0437 →
Continuity (1)
Related Publication 20240333666A1 · Oct 3, 2024
References Cited (28)
US 8037147B1 · Herold et al. · 2011 [cited by applicant]
US 10366168B2 · Wu · 2019 [cited by applicant]
US 10750019B1 · Petrovykh · 2020 [cited by examiner]
US 10834026B2 · Nagaraja et al. · 2020 [cited by applicant]
US 11176927B2 · Langen · 2021 [cited by applicant]
US 11271830B2 · Murugan · 2022 [cited by applicant]
US 11431660B1 · Leeds et al. · 2022 [cited by applicant]
US 11507756B2 · Lima et al. · 2022 [cited by applicant]
US 20090030992A1 · Callanan · 2009 [cited by examiner]
US 20180218305A1 · Shah · 2018 [cited by examiner]
US 20200357403A1 · Chen · 2020 [cited by examiner]
US 20230008822A1 · Serban · 2023 [cited by examiner]
US 20230401380A1 · Gupta · 2023 [cited by examiner]
CN 109873752A · 2019 [cited by applicant]
US 11,438,185 B2, 09/2022, Vuskovic et al. (withdrawn) [cited by applicant]
Shuster, Kurt, et al. “Blenderbot 3: a deployed conversational agent that continually learns to responsibly engage.” arXiv preprint arXiv:2208.03188 (2022) (Year: 2022). [cited by examiner]
J.M. Makokha, “Enhancing Human-AI (H-AI) Collaboration On Design Tasks Using An Interactive Text/Voice Artificial Intelligence (AI) Agent”, In Proceedings of the 2022 International Conference on Advanced Visual Interfac… [cited by applicant]
Kim, et al., “Bot in the Bunch: Facilitating Group Chat Discussion by Improving Efficiency and Participation with a Chatbot,” In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 14 pp. (Apr.… [cited by applicant]
Li, e al., “ALOHA: Artificial Learning of Human Attributes for Dialogue Agents”, In Proceedings of the AAAI Conference on Artificial Intelligence (vol. 34, No. 05, pp. 8155-8163), Apr. 2020, 10 pp. [cited by applicant]
Vassilakopoulou, et al., “Developing human/AI interactions for chat-based customer services: lessons learned from the Norwegian government”, European Journal of Information Systems, Jul. 2022, 15 pp. (10.1080/0960085X.2… [cited by applicant]
Amershi, et al., “Guidelines for Human-AI Interaction”, In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, Paper 3, May 4-9, 2019, 13… [cited by applicant]
Shuster, et al., “BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage”, arXiv:2208.03188v3, Aug. 10, 2022, 38 pp. (https://arxiv.org/abs/2208.03188). [cited by applicant]
Zheng, et al., “UX Research on Conversational Human-AI Interaction: A Literature Review of the ACM Digital Library”, In CHI Conference on Human Factors in Computing Systems, Apr. 2022, 34 pp. [cited by applicant]
Mell, P. et al., “The NIST Definition of Cloud Computing (Draft)”, Sep. 2011, Computer Security Division Information Technology Laboratory National Institute of Standards and Technology, Total 7 pp. [cited by applicant]
Mell, P. et al., “Effectively and Securely Using the Cloud Computing Paradigm”, [online], Oct. 7, 2009, retrieved from the Internet at <URL: http://csrc.nist.gov/groups/SNS/cloud-computing/cloud-computing-v26.ppt>, Tota… [cited by applicant]
“GitHub”, Wikipedia, 030623, 23 pp., [online][retreived Mar. 6, 2023] https://en.wikipedia.org/wiki/GitHub). [cited by applicant]
“Slack (software)”, Wikipedia, 030623, 12 pp., [online][retreived Mar. 6, 2023] https://en.wikipedia.org/wiki/Slack_(software). [cited by applicant]
Vaswani et al., “Attention Is All You Need”, arXiv:1706.03762v7 [cs.CL], Aug. 2, 2023, 15 pages. [cited by applicant]