IP Library › Granted Patent US 10,970,357
Granted Patent B2
US 10,970,357 · App. 12/847,984 · Granted Apr 6, 2021

System and method for visualization of tag metadata associated with a media event

Inventors: Ajita John (Holmdel, NJ); Shreeharsh Kelkar (Summit, NJ); Doree Duncan Seligmann (New York, NY)
Assignee: Avaya Inc.
G06F16/958
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,970,357
App. No.
12/847,984
Filed
Jul 30, 2010
Granted
Apr 6, 2021
Kind
B2
Art Unit
2168
USPC
707/797
Abstract

A system and method are provided for summarizing multiple aspects of tags associated with media events. In the system and method, tag metadata for tags generated at one or more user interfaces associated with at least one media event is obtained. Thereafter, tags are organized into a hierarchy of tags based on the metadata and a metadata sorting criteria. Additionally, tag significance data for tags is computed based on the metadata and the hierarchy. A visual representation of the tags can then be generated, where indicia for the tags is spatially arranged to visually depict the hierarchy of the tags are selected to visually depict at least a relative significance among sibling tags in the hierarchy.

Claims (35)

1. A method comprising:

receiving, by a processor via a communication interface, a tag request;

obtaining, from the tag request, tag metadata for a plurality of tags generated during a live media event, the plurality of tags being associated with the live media event and wherein the tag metadata is responsive to the tag request;

organizing, by the processor, the plurality of tags into a hierarchy of tags based on a sorting criteria of the tag metadata, the hierarchy of tags comprising a first level of tags, a second level of tags below the first level of tags, and a third level of tags below the second level of tags, wherein the first level of tags represents temporal segments of the live media event, wherein the second level of tags represents speakers associated with the live media event, wherein the third level of tags represents discussion topics associated with the live media event, and wherein at least one tag occurs in two or more locations in the hierarchy of tags;

computing, by the processor, tag significance data for the hierarchy of tags based, at least in part, on the tag metadata and wherein the tag significance data for a tag comprises at least one of a frequency of use of the tag, a duration of a media segment associated with the tag, and a similarity measure of the tag; and

generating, by the processor, a visual representation, for presentation by a user terminal coupled to the processor, of the hierarchy of tags, wherein a plurality of indicia for the hierarchy of tags are spatially arranged to form one of a treemap and a set diagram of the plurality of indicia, wherein sibling tags of the hierarchy of tags are represented by sibling nodes in the one of the treemap and set diagram and to visually depict a relative significance of each tag of the plurality of tags based on the tag significance data; and

wherein a first characteristic of indicia for sibling tag subsets in the hierarchy of tags is different from a second characteristic of indicia for a corresponding parent subset.

2. The method of claim 1 , wherein generating the visual representation further comprises depicting the relative significance of each tag of the plurality of tags by adjusting one of a size, a shape, a style, or a color of each of the plurality of indicia.

3. The method of claim 1 , wherein a group of sibling subsets in the set diagram is further spatially arranged to form a facet diagram.

4. The method of claim 1 , wherein one of the first characteristic or the second characteristic comprises a boundary line.

5. A system comprising:

a processor of a computing device and the processor being coupled to other components of the computing device and wherein the computing device comprises a communication interface; and

a non-transitory computer-readable storage medium storing instructions which, when executed by the processor, cause the processor to perform operations comprising:

receiving, by a processor via a communication interface, a tag request;

obtaining, from the tag request, tag metadata for a plurality of tags generated during a live media event, the plurality of tags being associated with the live media event and wherein the tag metadata is responsive to the tag request;

organizing the plurality of tags into a hierarchy of tags based on a sorting criteria of the tag metadata, the hierarchy of tags comprising a first level of tags, a second level of tags below the first level of tags, and a third level of tags below the second level of tags, wherein the first level of tags represents temporal segments of the live media event, wherein the second level of tags represents speakers associated with the live media event, wherein the third level of tags represents discussion topics associated with the live media event, and wherein at least one tag occurs in two or more locations in the hierarchy of tags;

computing tag significance data for the hierarchy of tags based, at least in part, on the tag metadata and wherein the tag significance data for a tag comprises at least one of a frequency of use of the tag, a duration of a media segment associated with the tag, and a similarity measure of the tag; and

generating, for presentation by a user terminal coupled to the processor, a visual representation of the hierarchy of tags, wherein a plurality of indicia for the hierarchy of tags are spatially arranged to visually depict a relative significance of each tag of the plurality of tags based on the tag significance data.

6. The system of claim 5 , wherein the instructions to cause the processor to perform generating the visual representation further comprises instructions to cause the processor to perform depicting the relative significance of each tag of the plurality of tags by adjusting one of a size, a shape, a style, or a color of each of the plurality of indicia.

7. The system of claim 5 , wherein the instructions further comprise instructions to cause the processor to perform spatially arranging the plurality of indicia to form a treemap of the plurality of indicia, wherein sibling tags of the hierarchy of tags are represented by sibling nodes in the treemap.

8. The system of claim 5 , wherein the instructions further comprise instructions to cause the processor to perform spatially arranging the plurality of indicia to form a set diagram of the plurality of indicia, wherein each group of sibling tags in the hierarchy of tags defines a group of sibling subsets for the set diagram.

9. The system of claim 8 , wherein the group of sibling subsets in the set diagram is further spatially arranged to form a nested facet diagram.

10. The system of claim 8 , wherein a first characteristic of indicia for the group of sibling subsets is different from a second characteristic of indicia for a corresponding parent subset.

11. The system of claim 8 , wherein one of the first or second characteristic comprises a set outline.

12. A non-transitory computer-readable storage device storing instructions which, when executed by a processor, the processor comprising a portion of a computing device and coupled with components of the computing device, cause the processor to perform operations comprising:

receiving, by the processor via a communication interface, a tag request;

receiving, from the tag request, tag metadata for a plurality of tags generated during a live media event, the plurality of tags being associated with the live media event and wherein the tag metadata is responsive to the tag request;

organizing the plurality of tags into a hierarchy of tags based on a sorting criteria of the tag metadata, the hierarchy of tags comprising a first level of tags and a second level of tags, the second level of tags being below the first level of tags, and a third level of tags below the second level of tags, wherein the first level of tags represents temporal segments of the live media event, wherein the second level of tags represents speakers associated with the live media event, wherein the third level of tags represents discussion topics associated with the live media event, and wherein at least one tag occurs in two or more locations in the hierarchy of tags;

computing tag significance data for the hierarchy of tags based, at least in part, on the tag metadata and wherein the tag significance data for a tag comprises at least one of a frequency of use of the tag, a duration of a media segment associated with the tag, and a similarity measure of the tag; and

generating a visual representation, for presentation by a user terminal coupled to the processor, of the hierarchy of tags, wherein a plurality of indicia for the hierarchy of tags are spatially arranged to visually depict a relative significance of each tag of the plurality of tags based on the tag significance data.

13. The non-transitory computer-readable storage device of claim 12 , storing additional instructions which, when executed by the processor, cause the processor to perform further operations comprising depicting the relative significance of each tag of the plurality of tags by adjusting one of a size, a shape, a style, or a color of each of the plurality of indicia.

14. The non-transitory computer-readable storage device of claim 12 , storing additional instructions which, when executed by the processor, cause the processor to perform further operations comprising spatially arranging the plurality of indicia to form a treemap of the plurality of indicia, wherein sibling tags of the hierarchy tags are represented by sibling nodes in the treemap.

15. The non-transitory computer-readable storage device of claim 12 , storing additional instructions which, when executed by the processor, cause the processor to perform further operations comprising spatially arranging the plurality of indicia to form a set diagram of the plurality of indicia, wherein each group of sibling tags in the hierarchy of tags defines a group of sibling subsets for the set diagram.

16. The method of claim 1 , wherein that tag significance for the tag comprises the frequency of use of the tag, the duration of the media segment associated with the tag, and the similarity measure of the tag.

17. The non-transitory computer-readable storage device of claim 15 , storing additional instructions which, when executed by the processor, cause the processor to perform further operations comprising specifying a first boundary line for subsets of sibling tags in the hierarchy of tags that is different from a second boundary line for a parent subset of the sibling subsets.

Assignments (20)
(SECURITY INTEREST) GRANTOR'S NAME CHANGE Recorded Sep 21, 2023
From: AVAYA INC.
To: AVAYA LLC
Reel/Frame 065019/0231 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 53955/0436) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063705/0023 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 61087/0386) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063690/0359 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001) Recorded May 18, 2023
From: GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT
To: AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC. (FORMER NAME OF AVAYA CLOUD INC.); HYPERQUALITY, INC.; HYPERQUALITY II, LLC; CAAS TECHNOLOGIES, LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 063779/0622 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 4, 2023
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 063542/0662 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 3, 2023
From: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; KNOAHSOFT INC.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB [COLLATERAL AGENT]
Reel/Frame 063742/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS AT REEL 45124/FRAME 0026 Recorded Apr 26, 2023
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: AVAYA HOLDINGS CORP.; AVAYA INC.; AVAYA MANAGEMENT L.P.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063457/0001 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 5, 2022
From: AVAYA INC.; INTELLISIST, INC.; AVAYA MANAGEMENT L.P.; AVAYA CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 061087/0386 →
SECURITY INTEREST Recorded Sep 25, 2020
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 053955/0436 →
SECURITY INTEREST Recorded Jan 23, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 045124/0026 →
SECURITY INTEREST Recorded Jan 10, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT
Reel/Frame 045034/0001 →
BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 041576/0001 Recorded Dec 15, 2017
From: CITIBANK, N.A.
To: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS INC.; OCTEL COMMUNICATIONS LLC (FORMERLY KNOWN AS OCTEL COMMUNICATIONS CORPORATION); VPNET TECHNOLOGIES, INC.
Reel/Frame 044893/0531 →
BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 029608/0256 Recorded Dec 15, 2017
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
To: AVAYA INC.
Reel/Frame 044891/0801 →
BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 025863/0535 Recorded Dec 15, 2017
From: THE BANK OF NEW YORK MELLON TRUST, NA
To: AVAYA INC.
Reel/Frame 044892/0001 →
BANKRUPTCY COURT ORDER RELEASING ALL LIENS INCLUDING THE SECURITY INTEREST RECORDED AT REEL/FRAME 030083/0639 Recorded Dec 15, 2017
From: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
To: AVAYA INC.
Reel/Frame 045012/0666 →
SECURITY INTEREST Recorded Jan 27, 2017
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS INC.; OCTEL COMMUNICATIONS CORPORATION; VPNET TECHNOLOGIES, INC.
To: CITIBANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 041576/0001 →
SECURITY AGREEMENT Recorded Mar 13, 2013
From: AVAYA, INC.
To: BANK OF NEW YORK MELLON TRUST COMPANY, N.A., THE
Reel/Frame 030083/0639 →
SECURITY AGREEMENT Recorded Jan 10, 2013
From: AVAYA, INC.
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 029608/0256 →
SECURITY AGREEMENT Recorded Feb 22, 2011
From: AVAYA INC., A DELAWARE CORPORATION
To: BANK OF NEW YORK MELLON TRUST, NA, AS NOTES COLLATERAL AGENT, THE
Reel/Frame 025863/0535 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2010
From: JOHN, AJITA; KELKAR, SHREEHARSH; SELIGMANN, DOREE DUNCAN
To: AVAYA INC.
Reel/Frame 024793/0924 →
Continuity (1)
Related Publication 20120030244A1 · Feb 2, 2012
Cited By (1)
US 12,524,457