IP Library Granted Patent US 11,496,711
Granted Patent B1
US 11,496,711 · App. 17/323,256 · Granted Nov 8, 2022

Systems and methods for collaborative conferencing and annotating presented assets with relevant conference contributions

Inventor: Stephen Cronan (Los Angeles, CA)
Assignee: 5th Kind, Inc.
H04N7/155G06F3/04842H04N5/278
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,496,711
App. No.
17/323,256
Granted
Nov 8, 2022
Kind
B1
Abstract

Disclosed is a collaboration system that synchronizes what is seen and heard by all participants to a conference such that participant input provided during the conference are seen and heard with respect to the same state of a presented asset. Additionally, the collaboration system may monitor the conference, may extract a first participant contribution prior to presentation of a first asset in the conference and a second participant contribution that is made during a particular interval of the conference when the first asset is presented. The collaboration system may link the second participant contribution to the first asset, may receive a request for the first asset after the conference has concluded, and may provide the first asset with the second participant contribution in response to the request.

Claims (82)

1. A method comprising:

monitoring a conference involving two or more participants and at least a first asset that is presented during a particular interval of the conference by one of the two or more participants;

extracting a first participant contribution that is made prior to presenting the first asset in the conference, and a second participant contribution that is made during the particular interval of the conference the first asset is presented;

linking the second participant contribution, that is extracted from the conference, directly to the first asset and separate from a recorded copy of the conference;

receiving a request for the first asset after the conference has concluded; and

providing the first asset with the second participant contribution in response to the request, wherein providing the first asset with the second participation comprises retrieving the first asset with the second participant contribution without accessing the recorded copy of the conference in response to the request for the first asset.

2. The method of claim 1 further comprising:

determining a particular state of the first asset when the second participant contribution is made, wherein the first asset has a plurality of different states during the particular interval of the conference; and

wherein linking the second participant contribution comprises linking the second participant contribution to the particular state of the first asset.

3. The method of claim 2 , wherein providing the first asset with the second participant contribution further comprises:

presenting the first asset in a user interface (“UI”) with a UI element for accessing the second participant contribution; and

transitioning the first asset to the particular state in response to a selection of the UI element while presenting the first asset in the UI.

4. The method of claim 3 , wherein transitioning the first asset comprises one or more of:

(i) playing a particular set of frames from a video,

(ii) selecting one or more elements from a plurality of elements of the first asset, or

(iii) presenting a particular slide from a plurality of slides of the first asset

simultaneously with a presentation of the second participant contribution, wherein the particular set of frames, the one or more elements, or the particular slide corresponds to the particular state of the first asset.

5. The method of claim 2 , wherein providing the first asset with the second participant contribution further comprises:

opening a first file associated with the first asset without opening a second file storing the recorded copy of the conference;

presenting the first asset at a first state of the plurality of different states with a UI element for the second participant contribution;

receiving a selection of the UI element; and

presenting the second participant contribution with the particular state of the first asset.

6. The method of claim 1 , wherein the second participant contribution comprises one or more of:

an audio snippet of at least one of the two or more participants speaking during the particular interval of the conference the first asset is presented,

text messages exchanged between the two or more participants during the particular interval, or

visual markups generated by at least one of the two or more participants during the particular interval.

7. The method of claim 1 , wherein linking the second participant contribution to the first asset comprises:

adding the second participant contribution as metadata of a file storing the first asset.

8. The method of claim 1 , wherein linking the second participant contribution to the first asset comprises:

storing, in a database, an identifier of the first asset, the second participant contribution, and a particular state that the first asset had when the second participant contribution was introduced into the conference.

9. The method of claim 8 , wherein providing the first asset with the second participant contribution comprises:

extracting the identifier of the first asset from the request;

querying the database based on the identifier from the request; and

obtaining, based on the querying, the second participant contribution and the particular state of the first asset to provide with the first asset in response to the request.

10. The method of claim 1 further comprising:

extracting a third participant contribution that is made during the particular interval when the first asset has a first state, wherein the second participant contribution is made during the particular interval when the first asset has a different second state; and

generating a UI that presents the first asset and selectable UI elements for the second participant contribution and the third participant contribution.

11. The method of claim 10 further comprising:

modifying the UI to present the first asset with the first state and the third participant contribution in response to selection of the selectable UI element for the third participant contribution; and

modifying the UI to present the first asset with the second state and the second participant contribution in response to selection of the selectable UI element for the second participant contribution.

12. The method of claim 1 , wherein providing the first asset with the second participant contribution further comprises:

obtaining audio of at least one of the two or more participants speaking during the particular interval;

generating text based on a transcription of the audio; and

presenting the text with contents of the first asset.

13. The method of claim 1 , wherein the conference is a first conference, the method further comprising:

monitoring a second conference involving two or more different participants than the first conference and at least the first asset that is presented during the second conference;

extracting a third participant contribution that is made when the first asset is presented as part of the second conference;

linking the third participant contribution to the first asset in addition to the second participant contribution from the first conference being linked to the first asset; and

wherein receiving the request for the first asset comprises:

determining an identifier of a user or user device issuing the request;

determining that the identifier matches identifiers for one of the two or more participants from the first conference, and that the identifier does not match identifiers for any of the two or more different participants from the second conference; and

filtering participant contributions that are linked to the first asset in response to determining that the identifier matches identifiers for one of the two or more participants from the first conference, wherein filtering the participant contributions comprises retaining the second participant contribution and discarding the third participant contribution that is linked to the first asset.

14. The method of claim 1 further comprising:

detecting presentation of a second asset after the first asset in the conference;

extracting a third participant contribution that is made after detecting the presentation of the second asset and during the presentation of the second asset;

linking the third participant contribution to the second asset;

receiving a request for the second asset after the conference has concluded; and

providing the second asset with the third participant contribution in response to the request for the second asset.

15. A system comprising:

one or more processors configured to:

monitor a conference involving two or more participants and at least a first asset that is presented during a particular interval of the conference by one of the two or more participants;

extract a first participant contribution that is made prior to presenting the first asset in the conference, and a second participant contribution that is made during the particular interval of the conference the first asset is presented;

link the second participant contribution, that is extracted from the conference, directly to the first asset and separate from a recorded copy of the conference;

receive a request for the first asset after the conference has concluded; and

provide the first asset with the second participant contribution in response to the request, wherein providing the first asset with the second participation comprises retrieving the first asset with the second participant contribution without accessing the recorded copy of the conference in response to the request for the first asset.

16. The system of claim 15 , wherein the one or more processors are further configured to:

determine a particular state of the first asset when the second participant contribution is made, wherein the first asset has a plurality of different states during the particular interval of the conference; and

wherein linking the second participant contribution comprises linking the second participant contribution to the particular state of the first asset.

17. The system of claim 16 , wherein providing the first asset with the second participant contribution further comprises:

presenting the first asset in a user interface (“UI”) with a UI element for accessing the second participant contribution; and

transitioning the first asset to the particular state in response to a selection of the UI element while presenting the first asset in the UI.

18. The system of claim 16 , wherein providing the first asset with the second participant contribution further comprises:

opening a first file associated with the first asset without opening a second file storing the recorded copy of the conference;

presenting the first asset at a first state of the plurality of different states with a UI element for the second participant contribution;

receiving a selection of the UI element; and

presenting the second participant contribution with the particular state of the first asset.

19. A non-transitory computer-readable medium, storing a plurality of processor-executable instructions to:

monitor a conference involving two or more participants and at least a first asset that is presented during a particular interval of the conference by one of the two or more participants;

extract a first participant contribution prior to presenting the first asset in the conference, and a second participant contribution that is made during the particular interval of the conference the first asset is presented;

link the second participant contribution, that is extracted from the conference, directly to the first asset and separate from a recorded copy of the conference;

receive a request for the first asset after the conference has concluded; and

provide the first asset with the second participant contribution in response to the request, wherein providing the first asset with the second participation comprises retrieving the first asset with the second participant contribution without accessing the recorded copy of the conference in response to the request for the first asset.

Assignments (2)
SECURITY INTEREST Recorded Apr 26, 2023
From: SOHONET DE LLC
To: GLAS TRUST CORPORATION LIMITED
Reel/Frame 063454/0820 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 18, 2021
From: CRONAN, STEPHEN
To: 5TH KIND, INC.
Reel/Frame 056273/0762 →
Cited By (2)
US 12,190,292 US 12,229,726