IP Library Granted Patent US 12688853
Granted Patent B2
US 12688853 · App. 18/408,622 · Granted Jul 21, 2026

System for enabling processing rich media data

Inventor: Kishore Daggubati (Danville, CA)
G10L15/26H04N21/2187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12688853
App. No.
18/408,622
Granted
Jul 21, 2026
Kind
B2
Abstract

A system for processing rich media data comprising audio data is disclosed. The system comprising a server with one or more processors is configured to receive the rich media data comprising the audio data, process the audio data to generate transcript of the audio data, and process the transcript to automatically segregate the transcript into a plurality of segments. Further the server is configured to associate each of the segments with at least one label, among a plurality of labels that are predefined and reflect the segments and the label associated with each of the segments on the rich media data.

Claims (48)

1 . A system for processing rich media data comprising audio data, wherein a server comprising one or more processors is configured to:

receive the rich media data comprising the audio data;

process the audio data to generate a transcript of the audio data;

process the transcript to automatically segregate the transcript into a plurality of segments;

screen data in a first segment among the plurality of segments in a sequence to identify presence of at least one of a plurality of key strings including a first key string and a second key string, wherein the first key string is associated with a first label and the second key string is associated with a second label, wherein the at least one of the key strings from a plurality of labels are stored in a database;

associate each of the segments with at least one label, from the plurality of labels that are predefined, based on detection of one or more key strings within the segment;

reflect the plurality of segments and the label associated with each of the segments on the rich media data;

generate a clipped rich media data from the received rich media data, wherein the clipped rich media data comprises at least one of the segments associated with one of the labels from the plurality of labels and a duration of the clipped rich media data is shorter than the duration of the rich media data; and

transmit the clipped rich media data to a user based on a parameter corresponding to the user.

2 . The system of claim 1 , wherein the server is configured to source the rich media data from a live stream and the segregation occurs in real-time during the live stream.

3 . The system of claim 1 , wherein the server is configured to segregate the rich media data into the plurality of segments upon detecting at least one discontinuation in the received rich media data.

4 . The system of claim 3 , wherein the discontinuation corresponds to instances when at least one speaker ceases speaking or takes a pause in the rich media data.

5 . The system according to claim 1 , where two of the segments linked to the first label among the plurality of labels have varying durations.

6 . The system according to claim 1 , wherein two of the segments linked to the first label among the plurality of labels are separated, and at least one intermediate segment linked to the second label among the plurality of labels is positioned between the two segments associated with the first label.

7 . The system according to claim 1 , comprising the database comprising the plurality of labels, with each of the labels associated with a list of key strings, wherein the list of key strings is predefined.

8 . The system according to claim 7 , wherein the server is configured to:

screen data in the transcript in a sequence to identify presence of at least one of the key strings from the list of key strings; and

associate each of the key strings with the at least one label from the plurality of labels.

9 . The system according to claim 1 , wherein the server is configured to

associate the first segment, among the plurality of segments, with the first label and the second label upon identifying the first key string and the second key string in the first segment.

10 . The system according to claim 1 , comprising the database comprising the plurality of labels, with each of the labels associated with a list of key strings, wherein the server is configured to screen data in the first segment, among the plurality of segments, in a sequence to identify presence of the at least one of the key strings, wherein upon identifying the at least one of the key strings associated with the first label and identifying at least two of the key strings associated with the second label, the first segment is associated with the second label.

11 . The system according to claim 1 , comprising the database comprising the plurality of labels, with each of the labels associated with a list of key strings, wherein the server is configured to screen data in the first segment, among the plurality of segments, in the sequence to identify presence of at least one of the key strings, wherein upon identifying at least one of the key strings associated with the first label and identifying same number of key strings associated with the second label, the first segment is associated with the first label, wherein the first label has a higher priority than the second label.

12 . The system of claim 1 , wherein the server is configured to automatically retrieve at least one of the segments, associated with at least one of the labels, from the plurality of labels, wherein the at least one of the labels is received by the server.

13 . The system of claim 1 , wherein the server is configured to automatically retrieve at least two of the segments, each one associated with at least one of two labels from the plurality of labels, wherein the two labels are received by the server.

14 . The system of claim 1 , wherein the server is configured to automatically retrieve at least one of the segments, associated with one of the labels from the plurality of labels, to the user based on the label associated with said user.

15 . The system of claim 1 , wherein the server is configured to automatically reflect at least two of the segments on the rich media data, wherein each of the at least two of the segments are reflected separately.

16 . The system of claim 1 , wherein the server is configured to automatically reflect at least two of the segments on the rich media data, wherein each of the at least two of the segments are reflected together.

17 . The system of claim 1 , wherein the server is configured to automatically reflect at least one of the segments based on a key string received, wherein the segment comprises at least one of the key strings from the plurality of key strings.

18 . The system of claim 1 , wherein the server is configured to automatically reflect at least one of the segments comprising at least one of the key strings from a list of key strings, wherein the at least one of the key strings is received from the user.

19 . The system of claim 1 , wherein the server is configured to reflect at least one of the segments on the rich media data to the user, associated with the one of the labels from the plurality of labels, based on an input received from said user, wherein the server is configured to enable the user to select from the plurality of labels.

20 . The system of claim 1 , wherein the server is configured to reflect the plurality of segments on the rich media data to the user, associated with at least two of the labels from the plurality of labels, based on an input received from said user, wherein the server is configured to enable the user to select the at least two of the labels from the plurality of labels.

21 . The system of claim 1 , wherein the server is configured to automatically transmit the clipped rich media data.

22 . The system of claim 1 , wherein the server is configured to automatically transmit the clipped rich media data to at least two users.

23 . The system of claim 1 , wherein the server is configured to transmit the clipped rich media data associated with the at least one of the segments, wherein each of the at least one of the segment is associated with two of the labels from the plurality of labels, to the user based on the parameter corresponding to said user.

24 . The system according to claim 1 , wherein the server is configured to:

receive a request from the user to receive the clipped rich media data;

retrieve the parameter corresponding to said user from the database; and

transmit, to the user, the clipped rich media data associated with at least the one of the segments, wherein the segment is associated with the one of the labels associated with the parameter corresponding to the said user.

25 . The system of claim 1 , wherein the server is configured to receive a request from the user to transmit the clipped rich media data to a group of users based on the parameter corresponding to the group of users, wherein the clipped rich media data comprises of segments comprising at least one key string or the at least one label associated with the group of users.

26 . The system of claim 1 , wherein the server is configured to generate the clipped rich media data from the received rich media data, wherein the clipped rich media data comprises of the at least one of the segments associated with at least two of the labels from the predefined plurality of labels, wherein duration of the clipped rich media data is shorter than the rich media data.

27 . The system of claim 1 , wherein the server is configured to generate the clipped rich media data from the received rich media data, wherein the clipped rich media data comprises of at least two of the segments associated with at least two of the labels from the predefined plurality of labels wherein:

each of the at least two segments is associated with the plurality of labels; and

the duration of the clipped rich media data is shorter than the rich media data.

28 . The system of claim 1 , wherein the server is configured to generate the clipped rich media data from the received rich media data, wherein the clipped rich media data is linked to at least the one of the segments comprising at least one key string.

29 . The system of claim 1 , wherein the server is configured to:

provide a plurality of markers to the user;

allow the user to position the plurality of markers on the rich media data; and

create the clipped rich media data from the received rich media data based on the placement of the markers on the rich media data.