IP Library Granted Patent US 11,412,325
Granted Patent B2
US 11,412,325 · App. 16/904,434 · Granted Aug 9, 2022

Recording meeting audio via multiple individual smartphones

Inventors: Andrew Sinkov (San Francisco, CA); Alexander Pashintsev (Cupertino, CA)
Assignee: EVERNOTE CORPORATION
H04R3/005G06F40/169G10L15/26G10L17/00G10L21/028G10L25/51G10L2021/02087H04R3/04H04R2430/01H04R2499/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,412,325
App. No.
16/904,434
Granted
Aug 9, 2022
Kind
B2
Abstract

A method of providing audio information from a meeting includes receiving a first audio stream from a first input audio device and a second audio stream from a second input audio device during the meeting, identifying a first audio fragment from the first audio stream, and identifying a second audio fragment from the second audio stream. The method also includes compiling the audio fragments from the first and second audio streams into an audio file that includes at least the first audio fragment and the second audio fragment. The method further includes providing the audio file to one or more recipients. The audio file identifies the first audio fragment as corresponding to a first participant of the meeting and the second audio fragment as corresponding to a second participant of the meeting.

Claims (67)

1. A method of recording audio information from a meeting, the method comprising:

establishing a first connection with a first audio input device of a plurality of audio input devices, the first connection configured to enable a system to receive a first audio stream recorded by the first audio input device;

establishing a second connection with a second audio input device of the plurality of audio input devices, the second connection configured to enable the system to receive a second audio stream recorded by the second audio input device;

receiving the first and second audio streams during the meeting;

receiving one or more additional user voice inputs annotating at least a first audio fragment and a second audio fragment;

in response to the one or more additional user voice inputs, automatically:

identifying from the first audio stream the first audio fragment;

identifying from the second audio stream the second audio fragment; and

compiling audio fragments from the first audio stream and the second audio stream into an audio file that includes at least the first audio fragment and the second audio fragment; and

providing the audio file to one or more recipients, wherein the audio file identifies the first audio fragment as corresponding to a first participant and the second audio fragment as corresponding to a second participant.

2. The method of claim 1 , further comprising:

determining that the first and second audio input devices correspond respectively to a first participant identifier and a second participant identifier, the second participant identifier being distinct from the first participant identifier;

associating the first audio fragment to the first participant identifier; and

associating the second audio fragment to the second participant identifier.

3. The method of claim 1 , wherein providing the audio file to one or more recipients includes replaying the audio file to the one or more recipients.

4. The method of claim 1 , further comprising:

generating a storyboard that includes at least the first audio fragment;

receiving one or more user inputs to edit the storyboard; and

in response to the one or more user inputs to edit the storyboard, performing an action including one or more of:

emphasizing audio fragments belonging to the first participant;

deemphasizing audio fragments belonging to the first participant;

grouping a plurality of audio fragments in the audio file by topic;

grouping audio fragments corresponding to the first participant and the second participant in the audio file; and

adding new audio fragments to the storyboard.

5. The method of claim 4 , wherein the storyboard is an audio file.

6. The method of claim 1 , further comprising:

generating a storyboard that includes a subset, less than all, of audio fragments in the audio file.

7. The method of claim 1 , further comprising:

maintaining the first audio fragment in a first audio channel associated with the first participant; and

maintaining the second audio fragment in a second audio channel associated with the second participant, the first and second audio channels being separate from each other.

8. The method of claim 1 , further comprising:

adding a pre-recorded introduction to the audio file.

9. The method of claim 1 , wherein a visual signal is provided on the first or second audio input device.

10. The method of claim 9 , wherein the first or second participant responds to the visual signal provided on the first or second audio input device, respectively, to confirm whether the first or second participant is currently speaking.

11. The method of claim 1 , wherein the audio file has a single audio channel.

12. The method of claim 1 , further comprising:

incorporating the one or more additional user voice inputs in the audio file based on locations of the first and second audio fragments in the audio file.

13. A non-transitory computer-readable medium storing one or more programs configured for execution by a system, the one or more programs including instructions for:

establishing a first connection with a first audio input device of a plurality of audio input devices, the first connection configured to enable the system to receive a first audio stream recorded by the first audio input device;

establishing a second connection with a second audio input device of the plurality of audio input devices, the second connection configured to enable the system to receive a second audio stream recorded by the second audio input device;

receiving the first and second audio streams;

identifying from the first audio stream a first audio fragment;

identifying from the second audio stream a second audio fragment;

compiling audio fragments from the first audio stream and the second audio stream into an audio file that includes at least the first audio fragment and the second audio fragment;

generating a storyboard that includes at least the first audio fragment;

receiving one or more user inputs to edit the storyboard;

in response to the one or more user inputs to edit the storyboard, performing an action including one or more of:

emphasizing audio fragments belonging to the first participant;

deemphasizing audio fragments belonging to the first participant;

grouping a plurality of audio fragments in the audio file by topic;

grouping audio fragments corresponding to the first participant and the second participant in the audio file; and

adding new audio fragments to the storyboard; and

providing the audio file to one or more recipients, wherein the audio file identifies the first audio fragment as corresponding to a first participant and the second audio fragment as corresponding to a second participant.

14. The non-transitory computer-readable medium of claim 13 , the one or more programs further including instructions for:

determining that the first and second audio input devices correspond respectively to a first participant identifier and a second participant identifier, the second participant identifier being distinct from the first participant identifier;

associating the first audio fragment to the first participant identifier; and

associating the second audio fragment to the second participant identifier.

15. The non-transitory computer-readable medium of claim 13 , wherein providing the audio file to one or more recipients includes replaying the audio file to the one or more recipients.

16. The non-transitory computer-readable medium of claim 13 , wherein the storyboard is an audio file.

17. The non-transitory computer-readable medium of claim 13 , the one or more programs further including instructions for:

generating a storyboard that includes a subset, less than all, of audio fragments in the audio file.

18. The non-transitory computer-readable medium of claim 13 , the one or more programs further including instructions for:

maintaining the first audio fragment in a first audio channel associated with the first participant; and

maintaining the second audio fragment in a second audio channel associated with the second participant, the first and second audio channels being separate from each other.

19. The non-transitory computer-readable medium of claim 13 , the one or more programs further including instructions for:

adding a pre-recorded introduction to the audio file.

20. The non-transitory computer-readable medium of claim 13 , wherein the audio file has a single audio channel.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 12, 2024
From: EVERNOTE CORPORATION
To: BENDING SPOONS S.P.A.
Reel/Frame 066288/0195 →
RELEASE OF SECURITY INTEREST Recorded Mar 17, 2023
From: MUFG BANK, LTD.
To: EVERNOTE CORPORATION
Reel/Frame 063116/0260 →
RELEASE OF SECURITY INTEREST Recorded Oct 8, 2021
From: EAST WEST BANK
To: EVERNOTE CORPORATION
Reel/Frame 057852/0078 →
SECURITY INTEREST Recorded Oct 6, 2021
From: EVERNOTE CORPORATION
To: MUFG UNION BANK, N.A.
Reel/Frame 057722/0876 →
SECURITY INTEREST Recorded Oct 19, 2020
From: EVERNOTE CORPORATION
To: EAST WEST BANK
Reel/Frame 054113/0876 →
Continuity (4)
Division 16231056 · Dec 21, 2018
Continuation 15214559 · Jul 20, 2016
Provisional Application 62197249 · Jul 27, 2015
Related Publication 20200322723A1 · Oct 8, 2020