Granted Patent B1

US 10,764,060 · App. 15/946,749 · Granted Sep 1, 2020

Inventors: Ilya Sokolov (Boston, MA); Keith Newstadt (Newton, MA)

Assignee: NortonLifeLock Inc.

H04L9/3247H04L9/321H04L9/32H04L63/08H04L63/12

Abstract

Claims (60)

1. A computer-implemented method for authenticating a multimedia stream, at least a portion of the method being performed by a computing device comprising at least one processor, the method comprising:

generating a metadata transcript based on at least a portion of a multimedia stream;

digitally signing the metadata transcript;

transmitting both the digitally signed metadata transcript and the multimedia stream to a recipient device to enable the recipient device to authenticate the multimedia stream based on a comparison of the digitally signed metadata transcript with an observed metadata transcript, wherein the observed metadata transcript is locally generated by the recipient device based on the multimedia stream;

generating an original sense graph from the digitally signed metadata transcript;

generating an observed sense graph from the observed metadata transcript; and

authenticating the multimedia stream when the observed sense graph represents the original sense graph.

2. The computer-implemented method of claim 1 , wherein the comparison of the digitally signed metadata transcript with the observed metadata transcript includes a direct comparison, and the multimedia stream is authenticated based on the digitally signed metadata transcript matching the observed metadata transcript.

3. The computer-implemented method of claim 1 , wherein:

generating the original sense graph from the digitally signed metadata transcript is based on natural language processing;

generating the observed sense graph from the observed metadata transcript is based on natural language processing; and

authenticating the multimedia stream includes comparing the original sense graph with the observed sense graph to determine whether the observed sense graph represents the original sense graph.

4. The computer-implemented method of claim 1 , further comprising embedding the digitally signed metadata transcript into the multimedia stream.

5. The computer-implemented method of claim 1 , further comprising storing the digitally signed metadata transcript on a cloud server accessible to the recipient device.

6. The computer-implemented method of claim 1 , wherein the metadata transcript includes a textual transcript of dialogue in the multimedia stream.

7. The computer-implemented method of claim 1 , wherein the metadata transcript includes identifications of persons in the multimedia stream.

8. The computer-implemented method of claim 1 , wherein the metadata transcript includes descriptions of at least one of microexpressions, vocal expressions, tone of voice, body language, and hand gestures of persons in the multimedia stream.

9. A computer-implemented method for authenticating a multimedia stream, at least a portion of the method being performed by a computing device comprising at least one processor, the method comprising:

receiving, from a signing device, both a multimedia stream and a digitally signed metadata transcript corresponding to the multimedia stream;

authenticating the digitally signed metadata transcript;

generating an observed metadata transcript based on the received portion of the multimedia stream;

comparing the authenticated metadata transcript to the observed metadata transcript by:

generating an original sense graph from the authenticated metadata transcript;

generating an observed sense graph from the observed metadata transcript; and

authenticating, based on the observed sense graph representing the original sense graph, the received portion of the multimedia stream.

10. The computer-implemented method of claim 9 , wherein the comparison of the authenticated metadata transcript with the observed metadata transcript includes a direct comparison, and the multimedia stream is authenticated based on the authenticated metadata transcript matching the observed metadata transcript.

11. The computer-implemented method of claim 9 , wherein:

generating the original sense graph from the authenticated metadata transcript is based on natural language processing;

generating the observed sense graph from the observed metadata transcript is based on natural language processing; and

authenticating the received portion of the multimedia stream includes comparing the original sense graph with the observed sense graph to determine whether the observed sense graph represents the original sense graph.

12. The computer-implemented method of claim 9 , further comprising extracting the digitally signed metadata transcript from the multimedia stream.

13. The computer-implemented method of claim 9 , further comprising retrieving the digitally signed metadata transcript from a cloud server accessible to the recipient device.

14. The computer-implemented method of claim 9 , wherein the metadata transcript includes one or more of:

a textual transcript of dialogue in the multimedia stream;

identifications of persons in the multimedia stream; and

descriptions of at least one of microexpressions, vocal expressions, tone of voice, body language, and hand gestures of persons in the multimedia stream.

15. A system for authenticating a multimedia stream, the system comprising:

a signing device comprising at least one physical processor and at least one module configured to:

generate a metadata transcript based on at least a portion of a multimedia stream;

digitally sign the metadata transcript; and

transmit both the digitally signed metadata transcript and the multimedia stream; and

a recipient device comprising at least one physical processor and at least one module configured to:

receive both the digitally signed metadata transcript and the multimedia stream from the signing device;

authenticate the digitally signed metadata transcript;

generate an observed metadata transcript based on the multimedia stream;

compare the authenticated metadata transcript to the observed metadata transcript by:

generating an original sense graph from the authenticated metadata transcript;

generating an observed sense graph from the observed metadata transcript; and

authenticate, based on the observed sense graph representing the original sense graph, the multimedia stream.

16. The system of claim 15 , wherein the comparison of the authenticated metadata transcript with the observed metadata transcript includes a direct comparison, and the multimedia stream is authenticated based on the authenticated metadata transcript matching the observed metadata transcript.

17. The system of claim 15 , wherein:

generating the original sense graph from the authenticated metadata transcript is based on natural language processing;

generating the observed sense graph from the observed metadata transcript is based on natural language processing; and

authenticating the multimedia stream includes comparing the original sense graph with the observed sense graph to determine whether the observed sense graph represents the original sense graph.

18. The system of claim 15 , wherein transmitting both the digitally signed metadata transcript and the multimedia stream comprises embedding the digitally signed metadata transcript into the multimedia stream.

19. The system of claim 15 , wherein transmitting both the digitally signed metadata transcript and the multimedia stream comprises storing the digitally signed metadata transcript on a cloud server accessible to the recipient device.

20. The system of claim 15 , wherein the metadata transcript includes one or more of:

a textual transcript of dialogue in the multimedia stream;

identifications of persons in the multimedia stream; and

descriptions of at least one of microexpressions, vocal expressions, tone of voice, body language, and hand gestures of persons in the multimedia stream.

Assignments (6)