IP Library Granted Patent US 12,476,931
Granted Patent B2
US 12,476,931 · App. 17/950,984 · Granted Nov 18, 2025

Automatic detection, extraction, and memorialization of media content

Inventor: Harsh V. Mendiratta (East Brunswick, NJ)
Assignee: Avaya Management L.P.
H04L51/216G06N3/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,476,931
App. No.
17/950,984
Granted
Nov 18, 2025
Kind
B2
Abstract

Communications over a network, such as electronic conferences, often have a small portion of content that is notable within the entirety of the communications. By automatically identifying and preserving such notable portions, the relevant “nugget” from the communications may be maintained without requiring preserving the entirety of the communications. Preservation may comprise converting the notable portion to a non-fungible token and adding the token to a blockchain wherein it may be exchanged by the owner to an interested party.

Claims (52)

1 . A system for memorializing a notable portion of a communication, comprising:

a network interface to a network;

a processor; and

a computer-readable medium coupled to the processor, the computer-readable medium comprising one or more computer-readable instructions, the processor executing the one or more computer-readable instructions to:

receive, via the network interface, a communication comprising communication content being exchanged between a plurality of communication devices over the network;

automatically preserve the notable portion in response to identifying the notable portion; and

terminate receiving the communication upon determining the communication is not designated as eligible for identifying notable portions therein.

2 . The system of claim 1 , wherein identifying the notable portion comprises the processor providing the communication content to a neural network trained to determine notable portions therefrom and receiving indicia of the notable portion from the neural network.

3 . The system of claim 2 , wherein the neural network is trained via a computer-implemented method, comprising:

collecting a set of prior communication content from a database;

applying one or more transformations to each set of prior communication content including altering a sentiment, altering a volume of an audio portion of the communication content, altering a level of animation of images of participants in a video portion of the communication content, inserting a change in topic, removing a change in topic, adding a negating word, adding an achievement word, removing the achievement word, adding an achievement image, removing the achievement image, adding an achievement pattern of speech, removing the achievement pattern of speech, removing the negating word, adding a stop word, or removing a stop word to create a modified set of prior communication content;

creating a first training set comprising the set of prior communication content, the modified set of communication content, and a set of non-notable communication content;

training the neural network in a first stage using the first training set;

creating a second training set for a second stage of training comprising the first training set and the set of non-notable communication content that are incorrectly detected as notable portions after the first stage of training; and

training the neural network in the second stage using the second training set.

4 . The system of claim 2 , wherein the notable portion is delineated from an entirety of the communication content as a start of a topic discussed in the communication content that comprises the notable portion.

5 . The system of claim 2 , wherein the notable portion is delineated from an entirety of the communication content as an end of a topic discussed in the communication content that comprises the notable portion.

6 . The system of claim 1 , wherein the processor, upon determining the communication is designated as eligible for identifying the notable portion, enables at least one ancillary communication service to the communication.

7 . The system of claim 1 , wherein the processor preserves the notable portion, further comprising the processor executing the one or more computer-readable instructions to create a non-fungible token of the notable portion.

8 . The system of claim 7 , wherein the processor preserves the notable portion, further comprising the processor executing the one or more computer-readable instructions to add the non-fungible token to a blockchain.

9 . A method memorializing a notable portion of a communication, comprising:

receiving, via a network interface, a communication comprising communication content being exchanged between a plurality of communication devices over a network; and

automatically preserving the notable portion in response to identifying the notable portion; and

wherein upon determining the communication is designated as eligible for identifying the notable portion, enabling at least one ancillary communication service to the communication, wherein the ancillary communication service comprises at least one of recording, whiteboarding, and co-browsing.

10 . The method of claim 9 , wherein identifying the notable portion comprises providing the communication content to a neural network trained to determine notable portions therefrom and receiving indicia of the notable portion from the neural network.

11 . The method of claim 10 , wherein the neural network is trained via a computer-implemented method, comprising:

collecting a set of prior communication content from a database;

applying one or more transformations to each set of prior communication content including altering a sentiment, altering a volume of an audio portion of the communication content, altering a level of animation of images of participants in a video portion of the communication content, inserting a change in topic, removing a change in topic, adding a negating word, adding an achievement word, removing the achievement word, adding an achievement image, removing the achievement image, adding an achievement pattern of speech, removing the achievement pattern of speech, removing the negating word, adding a stop word, or removing a stop word to create a modified set of prior communication content;

creating a first training set comprising the set of prior communication content, the modified set of communication content, and a set of non-notable communication content;

training the neural network in a first stage using the first training set;

creating a second training set for a second stage of training comprising the first training set and the set of non-notable communication content that are incorrectly detected as notable portions after the first stage of training; and

training the neural network in the second stage using the second training set.

12 . The method of claim 10 , wherein the notable portion is delineated from an entirety of the communication content as a start of a topic discussed in the communication content that comprises the notable portion.

13 . The method of claim 10 , wherein the notable portion is delineated from an entirety of the communication content as an end of a topic discussed in the communication content that comprises the notable portion.

14 . The method of claim 9 , wherein receiving the communication content further comprising terminating receiving of the communication upon determining the communication is not designated as eligible for identifying the notable portion therein.

15 . The method of claim 9 , wherein preserving the notable portion further comprises creating a non-fungible token of the notable portion.

16 . The method of claim 15 , wherein preserving the notable portion further comprises adding the non-fungible token to a blockchain.

17 . A system, comprising:

means to receive, via a network interface, a communication comprising communication content being exchanged between a plurality of communication devices over a network;

means to automatically preserve a notable portion in response to identifying the notable portion;

wherein the means to identify the notable portion comprise means to provide the communication content to a neural network trained to determine notable portions therefrom and receive indicia of the notable portion from the neural network; and

means to terminate receiving the communication upon determining the communication is not designated as eligible for identifying notable portions therein.

18 . The system of claim 17 , wherein the neural network is trained via a computer-implemented method, comprising:

collecting a set of prior communication content from a database;

applying one or more transformations to each set of prior communication content including altering a sentiment, altering a volume of an audio portion of the communication content, altering a level of animation of images of participants in a video portion of the communication content, inserting a change in topic, removing a change in topic, adding a negating word, adding an achievement word, removing the achievement word, adding an achievement image, removing the achievement image, adding an achievement pattern of speech, removing the achievement pattern of speech, removing the negating word, adding a stop word, or removing a stop word to create a modified set of prior communication content;

creating a first training set comprising the set of prior communication content, the modified set of communication content, and a set of non-notable communication content;

training the neural network in a first stage using the first training set;

creating a second training set for a second stage of training comprising the first training set and the set of non-notable communication content that are incorrectly detected as notable portions after the first stage of training;

training the neural network in the second stage using the second training set; and

preserving the notable portion, further comprising creating a non-fungible token of the notable portion.

19 . The system of claim 18 , further comprising means to add the non-fungible token to a blockchain.

20 . The system of claim 17 , further comprising means to, upon determining the communication is designated as eligible for identifying the notable portion, enable at least one ancillary communication service to the communication.

Assignments (3)
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 4, 2023
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 063542/0662 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 3, 2023
From: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; KNOAHSOFT INC.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB [COLLATERAL AGENT]
Reel/Frame 063742/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2022
From: MENDIRATTA, HARSH V.
To: AVAYA MANAGEMENT L.P.
Reel/Frame 061188/0110 →
Continuity (1)
Related Publication 20240106783A1 · Mar 28, 2024
References Cited (36)
US 8380875B1 · Gilmour · 2013 [cited by examiner]
US 8612211B1 · Shires · 2013 [cited by examiner]
US 8782403B1 · Satish · 2014 [cited by examiner]
US 9202469B1 · Moorjani · 2015 [cited by examiner]
US 9544704B1 · John · 2017 [cited by examiner]
US 9563689B1 · Pueyo · 2017 [cited by examiner]
US 11604622B1 · Guo · 2023 [cited by examiner]
US 20030093412A1 · Urkumyan · 2003 [cited by examiner]
US 20050159136A1 · Rouse · 2005 [cited by examiner]
US 20060285545A1 · Schmidt · 2006 [cited by examiner]
US 20110033048A1 · Stanwood · 2011 [cited by examiner]
US 20110116771A1 · Ota · 2011 [cited by examiner]
US 20120324350A1 · Rosenblum · 2012 [cited by examiner]
US 20130191452A1 · Beerse · 2013 [cited by examiner]
US 20130329868A1 · Midtun · 2013 [cited by examiner]
US 20140204423A1 · Koutrika · 2014 [cited by examiner]
US 20150281250A1 · Miller · 2015 [cited by examiner]
US 20160344663A1 · Hwang · 2016 [cited by examiner]
US 20180083792A1 · Wanderski · 2018 [cited by examiner]
US 20180181626A1 · Lyons · 2018 [cited by examiner]
US 20190121851A1 · Shires · 2019 [cited by examiner]
US 20190320139A1 · Toyoda · 2019 [cited by examiner]
US 20200159755A1 · Iida · 2020 [cited by examiner]
US 20210065695A1 · Motosugi · 2021 [cited by examiner]
US 20210350385A1 · Ellison · 2021 [cited by examiner]
CN 113239675A · 2021 [cited by examiner]
CN 115668371A · 2023 [cited by examiner]
CN 115967651A · 2023 [cited by examiner]
JP 4096132B2 · 2008 [cited by examiner]
JP 2008148328A · 2008 [cited by examiner]
JP 2011101229A · 2011 [cited by examiner]
JP 2013054670A · 2013 [cited by examiner]
KR 101522616B1 · 2014 [cited by examiner]
WO WO2015182436A1 · 2015 [cited by examiner]
U.S. Appl. No. 17/950,974, filed Sep. 22, 2022, Singh et al. [cited by applicant]
Official Action for India Patent Application No. 202314061647, dated Jul. 3, 2025 6 pages. [cited by applicant]