IP Library › Granted Patent US 9,507,778
Granted Patent B2
US 9,507,778 · App. 11/437,344 · Granted Nov 29, 2016

Summarization of media object collections

Inventors: Alexander B. Jaffe (Beverly Hills, CA); Mor Naaman (San Francisco, CA); Marc E. Davis (San Francisco, CA)
Assignee: Yahoo! Inc.
G06F17/30041G06F17/3005G06F17/30064G06F17/30241G06K9/00664G06K9/6219G11B27/105
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,507,778
App. No.
11/437,344
Granted
Nov 29, 2016
Kind
B2
Abstract

In one example, an apparatus and method are provided for summarizing (or selecting a representative subset from) a collection of media objects. A method includes selecting a subset of media objects from a collection of geographically-referenced (e.g., via GPS coordinates) media objects based on a pattern of the media objects within a spatial region. The media objects may further be selected based on (or be biased by) various social aspects, temporal aspects, spatial aspects, or combinations thereof relating to the media objects and/or a user. Another method includes clustering a collection of media objects in a cluster structure having a plurality of subclusters, ranking the media objects of the plurality of subclusters, and selection logic for selecting a subset of the media objects based on the ranking of the media objects.

Claims (38)

1. An apparatus comprising:

a processor; and

a storage medium for tangibly storing thereon program logic for execution by the processor, the program logic comprising:

receiving logic executed by the processor for receiving, from a client device operated by a user, a query for a summary of media objects;

determining logic, executed by the processor, for determining metadata associated with each of the media objects;

summarization logic executed by the processor for summarizing a subset of the media objects into a collection based on both a pattern of the media objects within a spatial region and based on a social network of the user, the summarizing logic comprising heuristics associated with the patterns and the metadata for use with the summarizing, the summarization logic further comprising selection logic for selecting the subset based upon an identity of the user and a characteristic associated with the user; and

generating logic executed by the processor for generating a visualization for the collection based on textual tags that are associated with the metadata, where a textual tag deemed relevant is displayed in the visualization in a size that corresponds to an importance of the relevant textual tag, the importance of the relevant textual tag based on attributes of the collection.

2. The apparatus of claim 1 , wherein the pattern relates to a density of the media objects within the spatial region.

3. The apparatus of claim 1 , further comprising selection logic for selecting the subset based upon a temporal aspect of the media objects.

4. The apparatus of claim 3 , wherein the temporal aspect relates to recency of the media objects.

5. The apparatus of claim 1 , further comprising selection logic for selecting the subset based on a visual feature of the media objects.

6. The apparatus of claim 1 , further comprising selection logic for selecting the subset based on text associated with the media objects.

7. The apparatus of claim 1 , further comprising selection logic for selecting the subset based on data associated with the media objects.

8. The apparatus of claim 7 , wherein the data comprises a user generated tag.

9. The apparatus of claim 1 , wherein the query comprises a search query, the search query on an object having a spatial aspect.

10. A method comprising:

receiving, by a computing device from a client device operated by a user, a query for a summary of media objects;

determining, by the computing device, metadata associated with each of the media objects;

summarizing, by the computing device, a subset of the media objects into a collection based on both a pattern of the media objects within a spatial region and based on a social network of the user, the summarizing logic comprising heuristics associated with the patterns and the metadata for use with the summarizing, the summarization logic further comprising selection logic for selecting the subset based upon an identity of the user and a characteristic associated with the user; and

generating, by the computing device, a visualization for the collection based on textual tags that are associated with the metadata, where a textual tag deemed relevant is displayed in the visualization in a size that corresponds to an importance of the relevant textual tag, the importance of the relevant textual tag based on attributes of the collection.

11. The method of claim 10 , wherein the pattern relates to a density of the media objects within the spatial region.

12. The method of claim 10 , wherein the summarizing further comprises selecting the subset based upon a temporal aspect of the media objects.

13. The method of claim 10 , wherein the summarizing further comprises selecting the subset based on a visual feature of the media objects.

14. The method of claim 10 , wherein the summarizing further comprises selecting the subset based on text associated with the media objects.

15. The method of claim 10 , wherein the summarizing further comprises selecting the subset based on data associated with the media objects.

16. The method of claim 15 , wherein the data comprises a user generated tag.

17. The method of claim 10 , wherein the query comprises a search query, the search query on an object having a spatial aspect.

18. A non-transitory computer readable storage medium comprising computer-executable instructions executed by a processor for summarizing a collection of media objects, the instructions for:

receiving, by the processor from a client device operated by a user, a query for a summary of media objects;

determining, by the processor, metadata associated with each of the media objects;

summarizing, by the processor, a subset of the media objects into a collection based on both a pattern of the media objects within a spatial region and based on a social network of the user, the summarizing logic comprising heuristics associated with the patterns and the metadata for use with the summarizing, the summarizing further comprising selecting, by the processor, the subset based upon an identity of the user and a characteristic associated with the user; and

generating, by the processor, a visualization for the collection based on textual tags that are associated with the metadata, where a textual tag deemed relevant is displayed in the visualization in a size that corresponds to an importance of the relevant textual tag, the importance of the relevant textual tag based on attributes of the collection.

19. The non-transitory computer readable storage medium of claim 18 , wherein the pattern relates to a density of the media objects within the spatial region.

20. The non-transitory computer readable storage medium of claim 18 , wherein the summarizing further comprises selecting the subset based upon a temporal aspect of the media objects.

21. The non-transitory computer readable storage medium of claim 18 , wherein the summarizing further comprises selecting the subset based on a visual feature of the media objects.

22. The non-transitory computer readable storage medium of claim 18 , wherein the summarizing further comprises selecting the subset based on data associated with the media objects.

23. The non-transitory computer readable storage medium of claim 22 , wherein the data comprises a user generated tag.

24. The non-transitory computer readable storage medium of claim 18 , wherein the query comprises a search query, the search query on an object having a spatial aspect.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2021
From: VERIZON MEDIA INC.
To: VERIZON PATENT AND LICENSING INC.
Reel/Frame 057453/0431 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2020
From: OATH INC.
To: VERIZON MEDIA INC.
Reel/Frame 054258/0635 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 2, 2018
From: YAHOO HOLDINGS, INC.
To: OATH INC.
Reel/Frame 045240/0310 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2017
From: YAHOO! INC.
To: YAHOO HOLDINGS, INC.
Reel/Frame 042963/0211 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2007
From: JAFFE, ALEXANDER B.; NAAMAN, MOR; DAVIS, MARC E.
To: YAHOO! INC.
Reel/Frame 019153/0755 →
Continuity (1)
Related Publication 20070271297A1 · Nov 22, 2007