IP Library › Granted Patent US 12,530,615
Granted Patent B2
US 12,530,615 · App. 17/352,899 · Granted Jan 20, 2026

Intelligent oversight of multi-party engagements

Inventor: Daniel Thomas Harrison (Ontario, CA)
Assignee: Salesforce, Inc.
G06N20/00G06N5/04G06Q10/0633G06Q10/0639
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,530,615
App. No.
17/352,899
Granted
Jan 20, 2026
Kind
B2
Abstract

Artificial intelligence (AI) oversight may be added to a multiparty engagement, such as a conference between devices having user interfaces. The AI may apply visual indicators, e.g., informational elements, recommendations, or other data, on one or more user interface. Visual indicators assist with presenting or participating in a conference. Visual indicators may highlight, e.g., AI-determined attributes of participants in the conference. Attributes may be derived physiological characteristics of participants, such as mood, apparent interest, paying attention, as well as AI-derived data from analyzing data sources, such as data about the participant, past engagements, time zone, name/title and other information to facilitate interaction with the participant. The AI may also review data for past deals, resume, project plans, social media, customer relationship manager data, and the like and develop models to allow it to monitor a conference and provide recommendations to facilitate conference goals.

Claims (98)

1 . A computer system in a conference with other computer systems used by participants to a conference, the computer system configured to communicate with a host system to provide an artificial intelligence analysis of at least a key participant to the conference, the computer system comprising a set of one or more processors, and a memory coupled to the one or more processors for storing instructions that when executed by the one or more processors cause the computer system to perform operations comprising:

receive, from the host system, the artificial intelligence analysis of at least the key participant;

cause display of an interface for the conference, the interface including portions associated with at least one other computer system in the conference;

cause overlay of the portions of the interface with one or more visual representations of meta-data associated with the at least one other computer system, the meta-data including at least a portion of the received artificial intelligence analysis;

determine a recommendation based at least in part on the received artificial intelligence analysis;

validate the recommendation against corporate policy rules;

cause display in the interface the recommendation based at least in part on the received artificial intelligence analysis according to a result of validating the recommendation;

determining a history of activity for the conference;

identifying a current goal for a current conference segment based at least in part on the history of activity, wherein identifying the current goal is performed using a relationship manager source, the relationship manager source including information identifying one or more of: a customer, lead, or deal;

comparing a current activity in the current conference segment to the current goal;

evaluating the current activity to determine if it achieves the current goal; and

determining the recommendation based at least in part on the evaluation of the current activity.

2 . The computer system of claim 1 , in which the conference has one or more stages, and the memory including further instructions to cause the computer system to perform operations comprising:

identify an attendance for a current stage in the conference;

update the key participant based at least in part on the attendance; and

determine a next stage for the multi-stage conference based at least in part on the artificial intelligence analysis of an activity of at least the key participant in the current stage.

3 . The computer system of claim 2 , the memory including further instructions to cause the computer system to perform operations comprising:

identifying a required participant for the current stage; and

determining the next stage based at least in part on whether the required participant is in attendance.

4 . The computer system of claim 1 , wherein the computer systems include a server to perform the invoking the machine learning model to monitor the conference and to determine the artificial intelligence analysis.

5 . The computer system of claim 1 , wherein:

the artificial intelligence analysis includes an engagement factor determined for at least the key participant; and

the memory including further instructions to causing the computer system to perform operations comprising cause display of an alert in the interface based at least in part on the engagement factor.

6 . The computer system of claim 1 , the memory including further instructions to cause the computer system to perform operations comprising:

monitoring a selected one or more of speech, physiology, physical motion, or history associated with one or more participants in the conference to determine an activity of the one or more participant; and

determining the recommendation based at least in part on the monitoring.

7 . The computer system of claim 1 , the memory including further instructions to cause the computer system to perform operations comprising:

inspecting an organizational hierarchy to determine a first metric;

evaluating a calendar invitation to determine a second metric;

lookup a social media content to determine a third metric;

rank selected ones of the participants based at least in part on the first, second and third metric; and

determine the key participant based at least in part on the rank.

8 . The computer system of claim 1 , in which a relationship management system tracks the one or more segment, the memory including further instructions to cause the computer system to perform operations comprising:

lookup data corresponding to a tracking of the one or more segment in the relationship management system; and

determine the history of activity based at least in part on the data.

9 . A method to establish a conference with remote computer systems executing a conference application for respective participants of the conference, and engage in the conference based at least in part on receiving, from a host to be configured to invoke a machine learning model to monitor the conference, an artificial intelligence analysis of at least a key participant to the conference, the conference having one or more stages, the method comprising:

receive the artificial intelligence analysis of at least the key participant;

cause display of an interface for the conference, the interface including portions associated with at least one other computer system in the conference;

cause overlay of the portions of the interface with one or more visual representations of meta-data associated with the at least one other computer system, the meta-data including the received artificial intelligence analysis;

determine a recommendation based at least in part on the received artificial intelligence analysis;

validate the recommendation against corporate policy rules;

cause display in the interface the recommendation according to a result of validating the recommendation;

identify an attendance for a current stage in the conference;

update the key participant based at least in part on the attendance; and

determine a next stage for the conference based at least in part on the artificial intelligence analysis of an activity of at least the key participant in the current stage.

10 . The method of claim 9 , further comprising:

identify a required participant for the current stage; and

determine the next stage based at least in part on whether the required participant is in attendance.

11 . The method of claim 9 , wherein the computer system to receive the artificial intelligence analysis is to provide an artificial intelligence service.

12 . The method of claim 9 , in which the artificial intelligence analysis includes an engagement factor determined for at least the key participant, the method further comprising:

cause display of an alert in the interface based at least in part on the engagement factor.

13 . The method of claim 9 , further comprising:

determine an activity of the one or more participant based at least in part on monitor a selected one or more of speech, physiology, physical motion, or history associated of one or more participants in the conference; and

determine the recommendation based at least in part on the determined activity.

14 . The method of claim 9 , further comprising:

inspect an organizational hierarchy to determine a first metric;

evaluate a calendar invitation to determine a second metric;

lookup a social media content to determine a third metric;

rank selected ones of the participants based at least in part on the first, second and third metric; and

determine the key participant based at least in part on the rank.

15 . The method of claim 9 , in which a relationship management system tracks a multi-stage deal, the method further comprising:

determining, based on the relationship management system, a history of activity for the multi-stage deal;

identifying a current goal for the conference based at least in part the history of activity, wherein identifying the current goal is performed using a relationship manager source, the relationship manager source including information identifying one or more of: a customer, lead, or deal;

comparing a current activity in the conference;

evaluating the current activity for whether it achieves the current goal; and

determining the recommendation based at least in part on the evaluation of the current activity.

16 . A non-transitory machine-readable storage medium that provides instructions for a computer system to engage in a conference with other computer systems used by participants to a conference, and to communicate over one or more network to access an artificial intelligence analysis of at least a key participant to the conference, the conference having one or more stages, the instructions, if executed by a processor, are configurable to cause said processor to perform operations comprising:

access the artificial intelligence analysis of at least the key participant;

cause display of an interface for the conference, the interface including portions associated with at least one other computer system in the conference;

cause overlay of the portions of the interface with one or more visual representations of meta-data associated with the at least one other computer system, the meta-data including at least portion of the received artificial intelligence analysis;

determine a recommendation based at least in part on the artificial intelligence analysis of at least the key participant;

validate the recommendation against corporate policy rules;

cause display in the interface the recommendation according to a result of validating the recommendation;

identify an attendance for a current stage in the conference;

update the key participant based at least in part on the attendance; and

determine a next stage for the conference based at least in part on the artificial intelligence analysis of an activity of at least the key participant in the current stage.

17 . The medium of claim 16 , the instructions further include instructions that, if executed by the processor are configurable to cause said processor to perform operations comprising:

identify a required participant for the current stage; and

determine the next stage based at least in part on whether the required participant is in attendance.

18 . The medium of claim 16 , the instructions further include instructions that, if executed by the processor of the computer system to receive the artificial intelligence analysis, are configurable to cause said processor to perform operations comprising:

provide an artificial intelligence service.

19 . The medium of claim 16 , in which the artificial intelligence analysis includes an engagement factor determined for at least the key participant, and the instructions further include instructions that, if executed by the processor are configurable to cause said processor to perform operations comprising:

cause display of an alert in the interface based at least in part on the engagement factor.

20 . The medium of claim 16 , the instructions further include instructions that, if executed by the processor are configurable to cause said processor to perform operations comprising:

monitor selected ones of speech, physiology, physical motion, or history associated of one or more participants in the conference to determine an activity of the one or more participant; and

determine the recommendation based at least in part on the monitoring.

21 . The medium of claim 16 , the instructions further include instructions that, if executed by the processor are configurable to cause said processor to perform operations comprising:

inspecting an organizational hierarchy to determine a first metric;

evaluating a calendar invitation to determine a second metric;

lookup a social media content to determine a third metric;

ranking selected ones of the participants based at least in part on the first, second and third metric; and

determining the key participant based at least in part on the rank.

22 . The medium of claim 16 , in which a relationship management system tracks a multi-stage deal, the instructions further include instructions that, if executed by the processor are configurable to cause said processor to perform operations comprising:

determining, based on the relationship management system, a history of activity for the multi-stage deal;

identifying a current goal for the conference based at least in part the history of activity, wherein identifying the current goal is performed using a relationship manager source, the relationship manager source including information identifying one or more of: a customer, lead, or deal;

evaluating a current activity in the conference for if it achieves the current goal; and

determining the recommendation based at least in part on the evaluation.

23 . The method of claim 9 , wherein causing display in the interface the recommendation is performed if the recommendation is successfully validated.

Assignments (2)
CHANGE OF NAME Recorded Aug 4, 2026
From: SALESFORCE.COM, INC.
To: SALESFORCE, INC.
Reel/Frame 076118/0548 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 8, 2025
From: HARRISON, DANIEL THOMAS
To: SALESFORCE.COM, INC.
Reel/Frame 072504/0649 →
Continuity (1)
Related Publication 20220405630A1 · Dec 22, 2022
References Cited (197)
US 5577188A · Zhu · 1996 [cited by applicant]
US 5608872A · Schwartz et al. · 1997 [cited by applicant]
US 5649104A · Carleton et al. · 1997 [cited by applicant]
US 5715450A · Ambrose et al. · 1998 [cited by applicant]
US 5761419A · Schwartz et al. · 1998 [cited by applicant]
US 5819038A · Carleton et al. · 1998 [cited by applicant]
US 5821937A · Tonelli et al. · 1998 [cited by applicant]
US 5831610A · Tonelli et al. · 1998 [cited by applicant]
US 5873096A · Lim et al. · 1999 [cited by applicant]
US 5918159A · Fomukong et al. · 1999 [cited by applicant]
US 5963953A · Cram et al. · 1999 [cited by applicant]
US 5983227A · Nazem et al. · 1999 [cited by applicant]
US 6092083A · Brodersen et al. · 2000 [cited by applicant]
US 6161149A · Achacoso et al. · 2000 [cited by applicant]
US 6169534B1 · Raffel et al. · 2001 [cited by applicant]
US 6178425B1 · Brodersen et al. · 2001 [cited by applicant]
US 6189011B1 · Lim et al. · 2001 [cited by applicant]
US 6216133B1 · Masthoff · 2001 [cited by applicant]
US 6216135B1 · Brodersen et al. · 2001 [cited by applicant]
US 6233617B1 · Rothwein et al. · 2001 [cited by applicant]
US 6236978B1 · Tuzhilin · 2001 [cited by applicant]
US 6266669B1 · Brodersen et al. · 2001 [cited by applicant]
US 6288717B1 · Dunkle · 2001 [cited by applicant]
US 6295530B1 · Ritchie et al. · 2001 [cited by applicant]
US 6324568B1 · Diec et al. · 2001 [cited by applicant]
US 6324693B1 · Brodersen et al. · 2001 [cited by applicant]
US 6336137B1 · Lee et al. · 2002 [cited by applicant]
US D454139S · Feldcamp et al. · 2002 [cited by applicant]
US 6367077B1 · Brodersen et al. · 2002 [cited by applicant]
US 6393605B1 · Loomans · 2002 [cited by applicant]
US 6405220B1 · Brodersen et al. · 2002 [cited by applicant]
US 6411949B1 · Schaffer · 2002 [cited by applicant]
US 6434550B1 · Warner et al. · 2002 [cited by applicant]
US 6446089B1 · Brodersen et al. · 2002 [cited by applicant]
US 6535909B1 · Rust · 2003 [cited by applicant]
US 6549908B1 · Loomans · 2003 [cited by applicant]
US 6553563B2 · Ambrose et al. · 2003 [cited by applicant]
US 6560461B1 · Fomukong et al. · 2003 [cited by applicant]
US 6574635B2 · Stauber et al. · 2003 [cited by applicant]
US 6577726B1 · Huang et al. · 2003 [cited by applicant]
US 6601087B1 · Zhu et al. · 2003 [cited by applicant]
US 6604117B2 · Lim et al. · 2003 [cited by applicant]
US 6604128B2 · Diec et al. · 2003 [cited by applicant]
US 6609150B2 · Lee et al. · 2003 [cited by applicant]
US 6621834B1 · Scherpbier et al. · 2003 [cited by applicant]
US 6654032B1 · Zhu et al. · 2003 [cited by applicant]
US 6665648B2 · Brodersen et al. · 2003 [cited by applicant]
US 6665655B1 · Warner et al. · 2003 [cited by applicant]
US 6684438B2 · Brodersen et al. · 2004 [cited by applicant]
US 6711565B1 · Subramaniam et al. · 2004 [cited by applicant]
US 6724399B1 · Katchour et al. · 2004 [cited by applicant]
US 6728702B1 · Subramaniam et al. · 2004 [cited by applicant]
US 6728960B1 · Loomans et al. · 2004 [cited by applicant]
US 6732095B1 · Warshavsky et al. · 2004 [cited by applicant]
US 6732100B1 · Brodersen et al. · 2004 [cited by applicant]
US 6732111B2 · Brodersen et al. · 2004 [cited by applicant]
US 6754681B2 · Brodersen et al. · 2004 [cited by applicant]
US 6763351B1 · Subramaniam et al. · 2004 [cited by applicant]
US 6763501B1 · Zhu et al. · 2004 [cited by applicant]
US 6768904B2 · Kim · 2004 [cited by applicant]
US 6772229B1 · Achacoso et al. · 2004 [cited by applicant]
US 6782383B2 · Subramaniam et al. · 2004 [cited by applicant]
US 6804330B1 · Jones et al. · 2004 [cited by applicant]
US 6826565B2 · Ritchie et al. · 2004 [cited by applicant]
US 6826582B1 · Chatterjee et al. · 2004 [cited by applicant]
US 6826745B2 · Coker · 2004 [cited by applicant]
US 6829655B1 · Huang et al. · 2004 [cited by applicant]
US 6842748B1 · Warner et al. · 2005 [cited by applicant]
US 6850895B2 · Brodersen et al. · 2005 [cited by applicant]
US 6850949B2 · Warner et al. · 2005 [cited by applicant]
US 6907566B1 · McElfresh et al. · 2005 [cited by applicant]
US 7062502B1 · Kesler · 2006 [cited by applicant]
US 7069231B1 · Cinarkaya · 2006 [cited by applicant]
US 7069497B1 · Desai · 2006 [cited by applicant]
US 7100111B2 · McElfresh et al. · 2006 [cited by applicant]
US 7181758B1 · Chan · 2007 [cited by applicant]
US 7269590B2 · Hull et al. · 2007 [cited by applicant]
US 7289976B2 · Kihneman et al. · 2007 [cited by applicant]
US 7340411B2 · Cook · 2008 [cited by applicant]
US 7356482B2 · Frankland et al. · 2008 [cited by applicant]
US 7373599B2 · McElfresh et al. · 2008 [cited by applicant]
US 7401094B1 · Kesler · 2008 [cited by applicant]
US 7406501B2 · Szeto et al. · 2008 [cited by applicant]
US 7412455B2 · Dillon · 2008 [cited by applicant]
US 7454509B2 · Boulter et al. · 2008 [cited by applicant]
US 7508789B2 · Chan · 2009 [cited by applicant]
US 7599935B2 · La Rotonda et al. · 2009 [cited by applicant]
US 7603331B2 · Tuzhilin et al. · 2009 [cited by applicant]
US 7603483B2 · Psounis et al. · 2009 [cited by applicant]
US 7620655B2 · Larsson et al. · 2009 [cited by applicant]
US 7644122B2 · Weyer et al. · 2010 [cited by applicant]
US 7668861B2 · Steven · 2010 [cited by applicant]
US 7698160B2 · Beaven et al. · 2010 [cited by applicant]
US 7730478B2 · Weissman · 2010 [cited by applicant]
US 7747648B1 · Kraft et al. · 2010 [cited by applicant]
US 7779039B2 · Weissman et al. · 2010 [cited by applicant]
US 7779475B2 · Jakobson et al. · 2010 [cited by applicant]
US 7827208B2 · Bosworth et al. · 2010 [cited by applicant]
US 7853881B1 · Aly Assal et al. · 2010 [cited by applicant]
US 7945653B2 · Zukerberg et al. · 2011 [cited by applicant]
US 8005896B2 · Cheah · 2011 [cited by applicant]
US 8014943B2 · Jakobson · 2011 [cited by applicant]
US 8015495B2 · Achacoso et al. · 2011 [cited by applicant]
US 8032297B2 · Jakobson · 2011 [cited by applicant]
US 8073850B1 · Hubbard et al. · 2011 [cited by applicant]
US 8082301B2 · Ahlgren et al. · 2011 [cited by applicant]
US 8095413B1 · Beaven · 2012 [cited by applicant]
US 8095531B2 · Weissman et al. · 2012 [cited by applicant]
US 8095594B2 · Beaven et al. · 2012 [cited by applicant]
US 8103611B2 · Tuzhilin et al. · 2012 [cited by applicant]
US 8150913B2 · Cheah · 2012 [cited by applicant]
US 8209308B2 · Rueben et al. · 2012 [cited by applicant]
US 8209333B2 · Hubbard et al. · 2012 [cited by applicant]
US 8275836B2 · Beaven et al. · 2012 [cited by applicant]
US 8457545B2 · Chan · 2013 [cited by applicant]
US 8484111B2 · Frankland et al. · 2013 [cited by applicant]
US 8490025B2 · Jakobson et al. · 2013 [cited by applicant]
US 8504945B2 · Jakobson et al. · 2013 [cited by applicant]
US 8510045B2 · Rueben et al. · 2013 [cited by applicant]
US 8510664B2 · Rueben et al. · 2013 [cited by applicant]
US 8566301B2 · Rueben et al. · 2013 [cited by applicant]
US 8646103B2 · Jakobson et al. · 2014 [cited by applicant]
US 10805309B2 · Harrison · 2020 [cited by applicant]
US 11188838B2 · Harrison · 2021 [cited by applicant]
US 11606220B2 · Jorasch · 2023 [cited by examiner]
US 12094018B1 · O'Malley · 2024 [cited by examiner]
US 20010044791A1 · Richter et al. · 2001 [cited by applicant]
US 20020072951A1 · Lee et al. · 2002 [cited by applicant]
US 20020082892A1 · Raffel et al. · 2002 [cited by applicant]
US 20020129352A1 · Brodersen et al. · 2002 [cited by applicant]
US 20020140731A1 · Subramaniam et al. · 2002 [cited by applicant]
US 20020143997A1 · Huang et al. · 2002 [cited by applicant]
US 20020162090A1 · Parnell et al. · 2002 [cited by applicant]
US 20020165742A1 · Robbins · 2002 [cited by applicant]
US 20030004971A1 · Gong · 2003 [cited by applicant]
US 20030018705A1 · Chen et al. · 2003 [cited by applicant]
US 20030018830A1 · Chen et al. · 2003 [cited by applicant]
US 20030066031A1 · Laane et al. · 2003 [cited by applicant]
US 20030066032A1 · Ramachandran et al. · 2003 [cited by applicant]
US 20030069936A1 · Warner et al. · 2003 [cited by applicant]
US 20030070000A1 · Coker et al. · 2003 [cited by applicant]
US 20030070004A1 · Mukundan et al. · 2003 [cited by applicant]
US 20030070005A1 · Mukundan et al. · 2003 [cited by applicant]
US 20030074418A1 · Coker et al. · 2003 [cited by applicant]
US 20030120675A1 · Stauber et al. · 2003 [cited by applicant]
US 20030151633A1 · George et al. · 2003 [cited by applicant]
US 20030159136A1 · Huang et al. · 2003 [cited by applicant]
US 20030187921A1 · Diec et al. · 2003 [cited by applicant]
US 20030189600A1 · Gune et al. · 2003 [cited by applicant]
US 20030204427A1 · Gune et al. · 2003 [cited by applicant]
US 20030206192A1 · Chen et al. · 2003 [cited by applicant]
US 20030225730A1 · Warner et al. · 2003 [cited by applicant]
US 20040001092A1 · Rothwein et al. · 2004 [cited by applicant]
US 20040010489A1 · Rio et al. · 2004 [cited by applicant]
US 20040015981A1 · Coker et al. · 2004 [cited by applicant]
US 20040027388A1 · Berg et al. · 2004 [cited by applicant]
US 20040128001A1 · Levin et al. · 2004 [cited by applicant]
US 20040186860A1 · Lee et al. · 2004 [cited by applicant]
US 20040193510A1 · Catahan et al. · 2004 [cited by applicant]
US 20040199489A1 · Barnes-Leon et al. · 2004 [cited by applicant]
US 20040199536A1 · Barnes-Leon et al. · 2004 [cited by applicant]
US 20040199543A1 · Braud et al. · 2004 [cited by applicant]
US 20040249854A1 · Barnes-Leon et al. · 2004 [cited by applicant]
US 20040260534A1 · Pak et al. · 2004 [cited by applicant]
US 20040260659A1 · Chan et al. · 2004 [cited by applicant]
US 20040268299A1 · Lei et al. · 2004 [cited by applicant]
US 20050050555A1 · Exley et al. · 2005 [cited by applicant]
US 20050091098A1 · Brodersen et al. · 2005 [cited by applicant]
US 20080249972A1 · Dillon · 2008 [cited by applicant]
US 20090063415A1 · Chatfield et al. · 2009 [cited by applicant]
US 20090100342A1 · Jakobson · 2009 [cited by applicant]
US 20090177744A1 · Marlow et al. · 2009 [cited by applicant]
US 20110218958A1 · Warshavsky · 2011 [cited by applicant]
US 20110247051A1 · Bulumulla · 2011 [cited by applicant]
US 20120042218A1 · Cinarkaya · 2012 [cited by applicant]
US 20120233137A1 · Jakobson et al. · 2012 [cited by applicant]
US 20120290407A1 · Hubbard et al. · 2012 [cited by applicant]
US 20130212497A1 · Zelenko et al. · 2013 [cited by applicant]
US 20130218948A1 · Jakobson · 2013 [cited by applicant]
US 20130218949A1 · Jakobson · 2013 [cited by applicant]
US 20130218966A1 · Jakobson · 2013 [cited by applicant]
US 20130247216A1 · Cinarkaya · 2013 [cited by applicant]
US 20140075004A1 · Van Dusen · 2014 [cited by examiner]
US 20140359537A1 · Jackobson et al. · 2014 [cited by applicant]
US 20190236297A1 · Harrison · 2019 [cited by applicant]
US 20200019898A1 · Harrison · 2020 [cited by applicant]
US 20200027005A1 · Harrison · 2020 [cited by applicant]
US 20200090055A1 · Harrison · 2020 [cited by applicant]
US 20200242595A1 · Harrison · 2020 [cited by applicant]
US 20200311273A1 · Harrison · 2020 [cited by applicant]
US 20210019982A1 · Todd · 2021 [cited by examiner]
US 20210051037A1 · Atkins · 2021 [cited by examiner]
US 20210217001A1 · Harrison · 2021 [cited by applicant]
US 20210241307A1 · Harrison · 2021 [cited by applicant]
US 20210304259A1 · Harrison · 2021 [cited by applicant]
US 20210326528A1 · Harrison · 2021 [cited by applicant]
US 20210326589A1 · Harrison · 2021 [cited by applicant]