IP Library Granted Patent US 12,255,749
Granted Patent B2
US 12,255,749 · App. 18/129,758 · Granted Mar 18, 2025

Meeting insights with large language models

Inventors: Shawn Cantin Callegari (Bellevue, WA); Umesh Madan (Bellevue, WA); Samuel Edward Schillace (Portola Valley, CA); Abby Harrison (Woodinville, WA); Gina Elizabeth Triolo (Redmond, WA); Mark Karle (Seattle, WA); LeRoy F. Miller (Tacoma, WA); Devis Lucato (Kirkland, WA); Tara Eve Walker (Atlanta, GA); Brian Krabach (Snohomish, WA); Adrian Wyatt Bonar (Seattle, WA); Alexander Chao (Irvine, CA); Nicholas Becker (Boulder, CO)
Assignee: Microsoft Technology Licensing, LLC
H04L12/1822H04L12/1831
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,255,749
App. No.
18/129,758
Granted
Mar 18, 2025
Kind
B2
Abstract

In accordance with examples of the present disclosure, a collaborative platform provides a digital collaboration assistant that continuously monitors and analyzes shared meeting contents (e.g., voice, text chat messages, shared links and documents, presentation materials, and the like) by participants during a collaborative meeting in near real-time, periodically updates a structure summary log of the meeting contents that are deemed important during the collaborative meeting, and interacts with the participants throughout the collaborative meeting in near real-time, for example, to answer questions or provide additional information.

Claims (48)

1. A method for facilitating a collaborative meeting, the method comprising:

monitoring activities of participants of the collaborative meeting;

extracting insights from meeting contents shared by the participants, wherein the insights are extracted using a generative machine learning model;

selecting data from the insights that is deemed important based on engagement and interests of the participants;

generating a structured summary log based on the selected data from the insights associated with the collaborative meeting, wherein the structured summary log is generated using the generative machine learning model;

presenting the structured summary log in a collaborative canvas accessible by the participants during the collaborative meeting; and

generating one or more customized meeting summaries for one or more participants after the collaborative meeting, wherein the one or more customized meeting summaries are generated using the generative machine learning model.

2. The method of claim 1 , wherein the meeting contents include voice of the participants, text transcript of speech of participants, text chat messages, links and documents, and presentation materials shared by the participants during the collaborative meeting.

3. The method of claim 1 , wherein the insights include key points, action items, question-and-answer (QnA) pairs, contents from links and documents, and screenshots of presentation materials.

4. The method of claim 1 , wherein generating the structured summary log based on the insights associated with the collaborative meeting comprises generating the structured summary log every determined time period or predetermined number of contents during the collaborative meeting.

5. The method of claim 1 , wherein the structured summary log captures the insights that represent the meeting contents that are deemed important to the participants.

6. The method of claim 5 , wherein generating the structured summary log includes determining information from the meeting contents as important based on engagement and interests of the participants by listening for sentiment analysis to determine if the participants have a strong reaction.

7. The method of claim 5 , wherein generating the structured summary log includes determining information from the meeting contents as important based on engagement and interests of the participants by monitoring a density of dialog, a number of participants speaking or texting, and/or a number of hand-raised or emojis in a chat box when a particular meeting content is shared in the collaborative meeting.

8. The method of claim 1 , further comprising receiving, from a participant to the collaborative meeting, a change to content in the collaborative canvas.

9. The method of claim 8 , further comprising:

accepting the change to the content in the collaborative canvas; and

resharing the collaborative canvas with the participants.

10. A computing device for facilitating a collaborative meeting, the computing device comprising:

a processor; and

a memory having a plurality of instructions stored thereon that, when executed by the processor, causes the computing device to:

monitor activities of participants of the collaborative meeting;

extract insights from meeting contents shared by the participants, wherein the insights are extracted using a generative machine learning model;

select data from the insights that is deemed important based on engagement and interests of the participants;

generate a structured summary log based on the selected data from the insights associated with the collaborative meeting, wherein the structured summary log is generated using the generative machine learning model;

present the structured summary log in a collaborative canvas accessible by the participants during the collaborative meeting; and

generate one or more customized meeting summaries one or more of the participants after the collaborative meeting, wherein the one or more customized meeting summaries are generated using the generative machine learning model.

11. The computing device of claim 10 , wherein the meeting contents include voice of the participants, text transcript of speech of participants, text chat messages, links and documents, and presentation materials shared by the participants during the collaborative meeting, and the insights include key points, action items, question-and-answer (QnA) pairs, contents from links and documents, and screenshots of presentation materials.

12. The computing device of claim 10 , further comprising instructions stored thereon that, when executed by the processor, causes the computing device to receive, from a participant to the collaborative meeting, a change to content in the collaborative canvas.

13. The computing device of claim 12 , further comprising instructions stored thereon that, when executed by the processor, causes the computing device to:

accept the change to the content in the collaborative canvas; and

reshare the collaborative canvas with the participants.

14. The computing device of claim 10 , wherein to interact with the participants during the collaborative meeting includes to interact with an individual participant in a private chat box associated with the collaborative meeting based on the meeting contents that have hitherto been discussed or shared during the collaborative meeting in response to receiving a text message from the individual participant in the private chat box.

15. A non-transitory computer-readable medium storing instructions for facilitating a collaborative meeting, the instructions when executed by one or more processors of a computing device, cause the computing device to perform a method comprising:

monitoring activities of participants of the collaborative meeting;

extracting insights from meeting contents shared by the participants;

selecting data from the insights that is deemed important based on engagement and interests of the participants;

generating a structured summary log based on the selected data from the insights associated with the collaborative meeting;

presenting the structured summary log in a collaborative canvas accessible by the participants during the collaborative meeting;

interacting with participants during the collaborative meeting; and

generating a customized meeting summary for each of the participants after the collaborative meeting.

16. The non-transitory computer-readable medium of claim 15 , wherein the meeting contents include voice of the participants, text transcript of speech of participants, text chat messages, links and documents, and presentation materials shared by the participants during the collaborative meeting, and the insights include key points, action items, question-and-answer (QnA) pairs, contents from links and documents, and screenshots of presentation materials.

17. The non-transitory computer-readable medium of claim 15 , wherein the structured summary log captures the insights that represent the meeting contents that are deemed important to the participants.

18. The non-transitory computer-readable medium of claim 17 , wherein generating the structured summary log includes to determine information from the meeting contents as important based on engagement and interests of the participants by listening for sentiment analysis to determine if the participants have a strong reaction.

19. The non-transitory computer-readable medium of claim 17 , wherein to select data from the insights that is deemed important based on engagement and interests of the participants includes to monitor a density of dialog, a number of participants speaking or texting, and/or a number of hand-raised or emojis in a chat box when a particular meeting content is shared in the collaborative meeting.

20. The non-transitory computer-readable medium of claim 15 , wherein the method further comprises:

receiving, from a participant to the collaborative meeting, a change to content in the collaborative canvas;

accepting the change to the content in the collaborative canvas; and

resharing the collaborative canvas with the participants.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2023
From: CALLEGARI, SHAWN CANTIN; MADAN, UMESH; SCHILLACE, SAMUEL EDWARD; HARRISON, ABBY; TRIOLO, GINA ELIZABETH; KARLE, MARK; MILLER, LEROY F.; LUCATO, DEVIS; WALKER, TARA EVE; KRABACH, BRIAN; BONAR, ADRIAN WYATT; CHAO, ALEXANDER; BECKER, NICHOLAS
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 065086/0078 →
Continuity (4)
Provisional Application 63440590 · Jan 23, 2023
Provisional Application 63433619 · Dec 19, 2022
Provisional Application 63433627 · Dec 19, 2022
Related Publication 20240205037A1 · Jun 20, 2024
References Cited (63)
US 11017780B2 · Steelberg · 2021 [cited by applicant]
US 11095468B1 · Pandey · 2021 [cited by examiner]
US 11106736B1 · Newman · 2021 [cited by applicant]
US 11443164B2 · Dalli · 2022 [cited by applicant]
US 11573993B2 · Nelson · 2023 [cited by examiner]
US 11823477B1 · Ramezani · 2023 [cited by applicant]
US 20030115548A1 · Melgar · 2003 [cited by applicant]
US 20170212886A1 · Sarikaya et al. · 2017 [cited by applicant]
US 20180151081A1 · Chen · 2018 [cited by applicant]
US 20190028520A1 · Nawrocki · 2019 [cited by examiner]
US 20190384813A1 · Mahmoud · 2019 [cited by examiner]
US 20200133071A1 · Dai · 2020 [cited by applicant]
US 20200311122A1 · Ramamurthy · 2020 [cited by examiner]
US 20200311162A1 · Xu et al. · 2020 [cited by applicant]
US 20200403817A1 · Daredia · 2020 [cited by examiner]
US 20210109769A1 · Chenguang · 2021 [cited by applicant]
US 20210117479A1 · Liu · 2021 [cited by applicant]
US 20210182341A1 · Mullins · 2021 [cited by applicant]
US 20210224336A1 · Bright · 2021 [cited by applicant]
US 20210271707A1 · Lin · 2021 [cited by applicant]
US 20210303638A1 · Zhong et al. · 2021 [cited by applicant]
US 20220100831A1 · Moreno · 2022 [cited by applicant]
US 20220200934A1 · Dutta · 2022 [cited by applicant]
US 20220342900A1 · Basu · 2022 [cited by applicant]
US 20220358713A1 · Krishnamurthy · 2022 [cited by applicant]
US 20220385758A1 · Tadesse · 2022 [cited by examiner]
US 20230035076A1 · Wang · 2023 [cited by applicant]
US 20230111517A1 · Anderson · 2023 [cited by applicant]
US 20230142718A1 · Asgekar · 2023 [cited by applicant]
US 20230153641A1 · Manda · 2023 [cited by examiner]
US 20230153700A1 · Lindgren · 2023 [cited by applicant]
US 20230155903A1 · Song · 2023 [cited by applicant]
US 20240078376A1 · Li · 2024 [cited by applicant]
US 20240201959A1 · Callegari · 2024 [cited by applicant]
US 20240202173A1 · Schillace · 2024 [cited by applicant]
US 20240202451A1 · Schillace · 2024 [cited by applicant]
US 20240202452A1 · Schillace · 2024 [cited by applicant]
US 20240202460A1 · Schillace · 2024 [cited by applicant]
US 20240202582A1 · Schillace · 2024 [cited by applicant]
US 20240202584A1 · Schillace · 2024 [cited by applicant]
International Search Report and Written Opinion received for PCT Application No. PCT/US2023/081254, Apr. 10, 2024, 10 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Application No. PCT/US2023/081290, Mar. 11, 2024, 17 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Application No. PCT/US2023/082379, Apr. 22, 2024, 12 pages. [cited by applicant]
“Long-term Memory for AI,” Vector Database for Vector Search, Pinecone Systems, Inc., retrieved from: https://www.pinecone.io/, Mar. 27, 2023, 10 pages. [cited by applicant]
Anonymous: “Is there way to submit a table as an JSON file?”, Aug. 19, 2022, Retrieved from the Internet: URL: https://web.archive.org/web/20220819203852/https://community.openai.com/t/is-there-way-to-submit-a-table-as-… [cited by applicant]
Anonymous: “OpenAI—Spreadsheet creator”, Aug. 19, 2022, XP093140385, Retrieved from the Internet: URL: https://platform.openai.com/examples/default-spreadsheet-gen, 1 page. [cited by applicant]
Anonymous: “Skill Chaining—Wikipedia, the free encyclopedia”, Nov. 27, 2015, Retrieved from the Internet: URL: https://web.archive.org/web/20151127070537/https://en.wikipedia.org/wiki/Skill_chaining, 1 page. [cited by applicant]
Beaumont, Romain., “Semantic search with embeddings: index anything”, Dec. 1, 2020, Retrieved from the Internet: URL: https://web.archive.org/web/20221212165434/https://rom1504.medium.com/semantic-search-with-embeddings… [cited by applicant]
Chan Irene, “How to Create Meetings Summaries with OpenAI GPT -3”, Dec. 16, 2022, 04 pages. [cited by applicant]
Fukamizu, et al., “Generation High resolution 3D model from natural language by Generative Adversarial Network”, arxiv.org, Cornell University Library, 201 Olin Library Cornell University Ithaca, NY 14853, Jan. 22, 2019… [cited by applicant]
Holovaty, Adrian: “Adventures in generating music via ChatGPT text prompts”, Dec. 1, 2022, Retrieved from the Internet: URL: https://web.archive.org/web/20221217201750/https://www.holovaty.com/writing/chatgpt-music-gene… [cited by applicant]
International Search Report and Written Opinion received for PCT Application No. PCT/US2023/081261, mailed on Feb. 12, 2024, 15 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Application No. PCT/US2023/081271, mailed on Mar. 13, 2024, 12 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Application No. PCT/US2023/081303, mailed on Mar. 26, 2024, 15 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Application No. PCT/US2023/081323, mailed on Mar. 13, 2024, 17 pages. [cited by applicant]
International Search Report and Written Opinion received for PCT Application No. PCT/US2023/081342, mailed on Mar. 26, 2024, 14 pages. [cited by applicant]
Kan, “Not All Vector Databases Are Made Equal,” Towards Data Science, Oct. 2, 2021, retrieved from: https://towardsdatascience.com/milvus-pinecone-vespa-weaviate-vald-gsi-what-unites-these-buzz-words-and-what-makes-each… [cited by applicant]
Konidaris, et al., “Skill Discovery in Continuous Reinforcement Learning Domains using Skill Chaining”, Dec. 10, 2009, Retrieved from the Internet: URL: https://proceedings.neurips.cc/paper_files/paper/2009/file/e0cf1f4… [cited by applicant]
Magnani, et al., “Semantic Retrieval at Walmart”, Proceedings of the 59th ACM/IEEE Design Automation Conference, ACMPUB27, New York, NY, USA, Aug. 14, 2022, pp. 3495-3503. [cited by applicant]
Non-Final Office Action mailed on Sep. 10, 2024, in U.S. Appl. No. 18/122,563, 27 pages. [cited by applicant]
T, Vincent., “GPT-3 And Code Generation—AI-enabled Instant Software Development”, Jan. 12, 2021, retrieved from the Internet: URL: https://becominghuman.ai/gpt-3-and-cod e-generation-ai-enabled-instant-software-d evelop… [cited by applicant]
Final Office Action mailed on Jan. 3, 2025, in U.S. Appl. No. 18/122,563, 31 pages. [cited by applicant]
Non-Final Office Action mailed on Jan. 16, 2025, in U.S. Appl. No. 18/129,668, 22 pages. [cited by applicant]
Cited By (1)
US 12,445,404