IP Library › Granted Patent US 10,353,996
Granted Patent B2
US 10,353,996 · App. 15/424,997 · Granted Jul 16, 2019

Automated summarization based on physiological data

Inventors: Rachel Bellamy (Bedford, NY); Victor C. Dibia (Yorktown Heights, NY)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G06F17/241A61B5/165G06F16/345G10L15/26A61B5/01A61B5/021A61B5/024A61B5/0531A61B5/0816A61B5/14542A61B5/681A61B2503/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,353,996
App. No.
15/424,997
Granted
Jul 16, 2019
Kind
B2
Abstract

A computer-implemented method for generating an automated summary of a document based on physiological data annotation includes receiving a textual transcript, by a computer. Physiological data is received from one or more devices. Passages of the textual transcript are scored based on received physiological data. A summary of the textual transcript is automatically created, in response to said scoring passages of the textual transcript. Other embodiments include a system and a computer program product.

Claims (37)

1. A computer-implemented method for generating an automated summary of a document based on physiological data annotation, comprising:

digitizing an oral presentation before at least one audience member and performing speech recognition on the digitized oral presentation, using a presenter device, to produce a textual transcript;

receiving the textual transcript, by a computer in communication with the presenter device over a computer network;

receiving physiological data from one or more devices used by the at least one audience member that are in communication with the computer over the computer network;

scoring passages of the textual transcript, by the computer, based on received physiological data;

automatically creating a summary of the textual transcript, by the computer, in response to said scoring passages of the textual transcript; and

displaying the created summary on an external device.

2. The computer-implemented method of claim 1 , wherein the one or more devices are worn by an audience to the oral presentation.

3. The computer-implemented method of claim 1 , wherein the one or more devices are one or more wearable devices.

4. The computer-implemented method of claim 1 , wherein the one or more devices include a plurality of biometric sensors.

5. The computer-implemented method of claim 1 , wherein the one or more devices includes a smartwatch.

6. The computer-implemented method of claim 1 , wherein the physiological data includes physiological data selected from a group consisting of: body temperature, skin conductivity, heart rate, blood pressure, neural oscillations, blood oxygen levels, respiration rate, or pheromone levels.

7. The computer-implemented method of claim 1 , further comprising interpreting the received physiological data as a level of emotional excitement/engagement; wherein said scoring of the passages of the textual transcript is performed in response to said interpreting the received physiological data as a level of emotional excitement/engagement.

8. The computer-implemented method of claim 1 , wherein passages of the textual transcript having a highest score are represented in the summary.

9. A system for generating an automated summary of a document based on physiological data annotation, comprising:

a processor;

a memory, operably coupled to the processor, the memory comprising program instructions that when executed by the processor, cause the system to:

digitizing an oral presentation before at least one audience member and performing speech recognition on the digitized oral presentation, using a presenter device, to produce a textual transcript;

receiving the textual transcript, by a computer in communication with the presenter device over a computer network;

receiving physiological data from one or more devices used by the at least one audience member that are in communication with the computer over the computer network;

scoring passages of the textual transcript, by the computer, based on received physiological data;

automatically creating a summary of the textual transcript, by the computer, in response to said scoring passages of the textual transcript; and

displaying the created summary on an external device.

10. The system of claim 9 , wherein the one or more devices are worn by an audience to the oral presentation.

11. The system of claim 9 , wherein the one or more devices are one or more wearable devices.

12. The system of claim 9 , wherein the one or more devices includes a biometric sensor that is adapted to measure data selected from a group consisting of: body temperature, skin conductivity, heart rate, blood pressure, neural oscillations, blood oxygen levels, respiration rate, or pheromone levels.

13. A computer program product for generating an automated summary of a document based on physiological data annotation, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, the program instructions executable by a computer to cause the computer to:

digitizing an oral presentation before at least one audience member and performing speech recognition on the digitized oral presentation, using a presenter device, to produce a textual transcript;

receiving the textual transcript, by a computer in communication with the presenter device over a computer network;

receiving physiological data from one or more devices used by the at least one audience member that are in communication with the computer over the computer network;

scoring passages of the textual transcript, by the computer, based on received physiological data;

automatically creating a summary of the textual transcript, by the computer, in response to said scoring passages of the textual transcript; and

displaying the created summary on an external device.

14. The computer program product of claim 13 , wherein the one or more devices are worn by an audience to the oral presentation.

15. The computer program product of claim 13 , wherein the one or more devices include a plurality of biometric sensors.

16. The computer program product of claim 13 , wherein the physiological data includes physiological data selected from a group consisting of: body temperature, skin conductivity, heart rate, blood pressure, neural oscillations, blood oxygen levels, respiration rate, or pheromone levels.

17. The computer program product of claim 13 , further comprising interpreting the received physiological data as a level of emotional excitement/engagement; wherein said scoring of the passages of the textual transcript is performed in response to said interpreting the received physiological data as a level of emotional excitement/engagement.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2017
From: BELLAMY, RACHEL; DIBIA, VICTOR C.
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 041179/0271 →
Continuity (1)
Related Publication 20180225271A1 · Aug 9, 2018
Cited By (1)
US 12,450,433