IP Library Granted Patent US 8,855,798
Granted Patent B2
US 8,855,798 · App. 13/345,615 · Granted Oct 7, 2014

User interface to media files

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,855,798
App. No.
13/345,615
Granted
Oct 7, 2014
Kind
B2
Abstract

A user interface generator is configured to access a media file that stores acoustic data representative of sounds. The user interface generator determines a mood category of the media file, based on a mood vector calculated from the acoustic data. The mood category characterizes the media file as being evocative of a mood described by the mood category. The user interface generator generates a user interface that depicts a grid or map (e.g., a “mood grid” or a “mood map”) of multiple zones. One of the zones may occupy a position in the grid or map that corresponds to the mood category. The user interface may then be presented by the user interface generator (e.g., to a user). In the presented user interface, the zone that corresponds to the mood category may be operable (e.g., by the user) to perform one or more actions pertinent to the mood category.

Claims (136)

1. A method comprising:

accessing a media file from a plurality of media files,

the media file storing acoustic data representative of sounds;

determining a mood category of the media file based on a predominant component of a mood vector calculated from the acoustic data representative of the sounds of the media file,

the predominant component of the mood vector being one of multiple components of the mood vector,

the determined mood category characterizing the media file as evocative of a mood described by the mood category;

generating a two-dimensional user interface to the plurality of media files,

the two-dimensional user interface depicting a grid that includes a zone whose position in the grid corresponds to the mood category determined based on the predominant component of the mood vector calculated from the media file,

the generating of the two-dimensional user interface including coloring the zone based on a count of media files characterized by the determined mood category within a user-configured period of time,

the generating of the two-dimensional user interface being performed by a processor of a machine; and

presenting the two-dimensional user interface that depicts the grid with the zone whose position corresponds to the mood category.

2. The method of claim 1 , wherein:

the determining of the mood category of the media file includes:

summing weights of the multiple components of the mood vector; and

accessing a database that correlates the mood category with a largest weight among the summed weights.

3. The method of claim 1 , wherein:

the determining of the mood category of the media file includes accessing a database that correlates the mood category with the predominant component of the mood vector.

4. The method of claim 3 , wherein:

the database that correlates the mood category with the predominant component of the mood vector is a first localized database among multiple localized databases that reference the predominant component of the mood vector.

5. The method of claim 1 , wherein:

the determining of the mood category of the media file includes accessing a predetermined human-generated lookup table that maps the multiple components of the mood vector to a plurality of mood categories that includes the mood category.

6. The method of claim 1 , wherein:

the determining of the mood category of the media file includes accessing a lookup table that correlates the mood category with the position of the zone in the grid.

7. The method of claim 1 , wherein:

the presenting of the two-dimensional user interface includes displaying the two-dimensional user interface on a display,

the zone whose position in the grid corresponds to the mood category overlaps an interactive portion of a controller that is operable to initiate an action with respect to the mood category.

8. The method of claim 7 , wherein:

the interactive portion of the controller is operable to initiate the action selected from a group consisting of:

generation of a playlist for the mood category,

modification of the playlist for the mood category,

modification of a parameter that defines the playlist for the mood category,

generation of a recommendation from the mood category,

modification of a preference that influences recommendations from the mood category, and

identification of a user related to the mood category.

9. The method of claim 7 , wherein:

the interactive portion of the controller is operable to initiate the action with respect to a further mood category that corresponds to a further zone adjacent to the zone in the grid.

10. The method of claim 7 , wherein:

the controller is configured to receive at least one of a touch input, a gesture input, or a voice input.

11. The method of claim 7 , wherein:

the controller is configured to receive a sequence of inputs that specifies multiple zones in the grid as a selection of multiple mood categories in sequential order.

12. The method of claim 1 further comprising:

generating a playlist based on the mood category,

the playlist identifying a subset of the plurality of media files that includes the media file and characterizing the subset as evocative of the mood described by the mood category,

the playlist corresponding to the zone whose position in the grid corresponds to the mood category; and

presenting the playlist in response to a user-generated selection of the position of the zone within the two-dimensional user interface.

13. The method of claim 1 further comprising:

receiving a user-generated selection of the zone whose position corresponds to the mood category; and

initiating playback of a playlist that references the media file and that corresponds to the mood category,

the initiating of the playback of the playlist being in response to the user-generated selection of the zone.

14. The method of claim 1 further comprising:

receiving a user-generated selection of the zone whose position corresponds to the mood category; and

initiating playback of a representative audio file that is evocative of the mood described by the mood category,

the initiating of the playback of the representative audio file being in response to the user-generated selection of the zone.

15. The method of claim 1 , wherein:

the generating of the two-dimensional user interface includes indicating that the zone corresponds to a preferred mood category of a user.

16. The method of claim 1 , wherein:

the mood category is identified by a mood descriptor that describes the mood of which the media file is characterized as being evocative; and

the generating of the two-dimensional user interface is based on a set of mood descriptors inclusive of the mood descriptor and localized to a geographic region.

17. The method of claim 1 , wherein:

the mood category corresponds to an energy level within a range of energy levels descriptive of musical calmness; and

the grid includes an axis that represents the range of energy levels.

18. The method of claim 17 , wherein:

the range of energy levels includes a low energy level that indicates high musical calmness and includes a high energy level that indicates low musical calmness.

19. The method of claim 17 further comprising:

receiving a user-generated selection of the axis for display of the range of energy levels; and wherein

the generating of the two-dimensional user interface generates the two-dimensional user interface with the axis in response to the user-generated selection of the axis for display.

20. The method of claim 1 , wherein:

the mood category corresponds to a valence level within a range of valence levels, the valence level being descriptive of musical darkness; and

the grid includes an axis that represents the range of valence levels.

21. The method of claim 20 , wherein:

the range of valence levels includes a low positivity level that indicates a high musical darkness and that includes a high positivity level that indicates a low musical darkness.

22. The method of claim 20 further comprising:

receiving a user-generated selection of the axis for display of the range of valence levels; and wherein

the generating of the two-dimensional user interface generates the two-dimensional user interface with the axis in response to the user-generated selection of the axis for display.

23. The method of claim 1 , wherein:

the generating of the two-dimensional user interface that depicts the grid includes generating the grid as an arrangement of multiple zones that include the zone whose position in the grid corresponds to the mood category; and

the multiple zones of the grid correspond to multiple playlists that identify multiple subsets of the plurality of media files.

24. The method of claim 23 , wherein:

the generating of the grid with the multiple zones includes determining a uniform size of the multiple playlists that correspond to the multiple zones; and

generating the multiple playlists based on the uniform size.

25. The method of claim 23 , wherein:

the generating of the grid with the multiple zones is based on weather data indicative of weather at a location.

26. The method of claim 23 , wherein:

the generating of the grid with the multiple zones is based on speed data indicative of a speed of a vehicle.

27. The method of claim 23 , wherein:

the generating of the grid with the multiple zones is based on location data indicative of a location.

28. The method of claim 23 , wherein:

the generating of the grid with the multiple zones is based on time data indicative of a time of day at a location.

29. The method of claim 23 , wherein:

the generating of the grid with the multiple zones is based on a preference of a user.

30. The method of claim 23 , wherein:

the generating of the grid with multiple zones is based on drowsiness data indicative of a level of drowsiness of a driver of a vehicle.

31. The method of claim 30 further comprising:

initiating playback of a playlist among the multiple playlists,

the playlist referencing the media file and corresponding to the mood category that characterizes the media file as evocative of the mood described by the mood category,

the initiating of the playback of the playlist being based on the drowsiness data that indicates the level of drowsiness of the driver of the vehicle.

32. The method of claim 30 further comprising:

generating the drowsiness data from an image that depicts an eye of the driver of the vehicle.

33. The method of claim 32 further comprising:

capturing the image that depicts the eye of the driver from a camera in the vehicle that is pointed at the eye of the driver of the vehicle.

34. The method of claim 1 further comprising:

calculating the mood vector of the media file by performing an analysis of the acoustic data representative of the sounds of the media file; and

determining the predominant component of the mood vector based on the analysis of the acoustic data.

35. The method of claim 34 , wherein:

the analysis of the acoustic data that represents the sounds of the media file includes a determination of at least one of a tempo histogram, a chroma histogram, an audio spectrum envelope, an audio spectral flatness, a mel-frequency cepstral coefficient, a modulation of mel-frequency cepstral coefficients, a spectral correlation, a proportion of percussive sounds, a modulation of percussive sounds, a strength of percussive sounds, a strength of non-percussive sounds, a periodicity of percussive sounds, a periodicity of non-percussive sounds, a standard deviation of percussive sounds, a chroma flatness, a chroma eccentricity, a harmonic transition strength, a major key, a minor key, a harmonic feature, a standard deviation of harmonic features, a local tempo, or a standard deviation of local tempos,

the determination being based on the acoustic data that represents the sounds of the media file.

36. A non-transitory machine-readable storage medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

accessing a media file from a plurality of media files,

the media file storing acoustic data representative of sounds;

determining a mood category of the media file based on a predominant component of a mood vector calculated from the acoustic data representative of the sounds of the media file,

the predominant component of the mood vector being one of multiple components of the mood vector,

the determined mood category characterizing the media file as evocative of a mood described by the mood category;

generating a two-dimensional user interface to the plurality of media files,

the two-dimensional user interface depicting a grid that includes a zone whose position in the grid corresponds to the mood category determined based on the predominant component of the mood vector calculated from the media file,

the generating of the two-dimensional user interface including coloring the zone based on a count of media files characterized by the determined mood category within a user-configured period of time,

the generating of the two-dimensional user interface being performed by the one or more processors of the machine; and

presenting the two-dimensional user interface that depicts the grid with the zone whose position corresponds to the mood category.

37. The non-transitory machine-readable storage medium of claim 36 , wherein the operations further comprise:

generating a playlist based on the mood category,

the playlist identifying a subset of the plurality of media files that includes the media file and characterizing the subset as evocative of the mood described by the mood category,

the playlist corresponding to the zone whose position in the grid corresponds to the mood category; and

presenting the playlist in response to a user-generated selection of the position of the zone within the two-dimensional user interface.

38. A system comprising:

an access module configured to access a media file from a plurality of media files, the media file storing acoustic data representative of sounds;

the category module configured to determine a mood category of the media file based on a predominant component of a mood vector calculated from the acoustic data representative of the sounds of the media file,

the predominant component of the mood vector being one of multiple components of the mood vector,

the determined mood category characterizing the media file as evocative of a mood described by the mood category;

a processor configured by a generation module to generate a two-dimensional user interface to the plurality of media files,

the two-dimensional user interface depicting a grid that includes a zone whose position in the grid corresponds to the mood category determined based on the predominant component of the mood vector calculated from the media file,

the generating of the two-dimensional user interface including coloring the zone based on a count of media files characterized by the determined mood category within a user-configured period of time; and

a presentation module configured to present the two-dimensional user interface that depicts the grid with the zone whose position corresponds to the mood category.

39. The system of claim 38 further comprising:

a player module configured to generate a playlist based on the mood category,

the playlist identifying a subset of the plurality of media files that includes the media file and characterizing the subset as evocative of the mood described by the mood category, and

the playlist corresponding to the zone whose position in the grid corresponds to the mood category; and wherein

the presentation module is configured to present the playlist in response to a user-generated selection of the position of the zone within the two-dimensional user interface.

Assignments (13)
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
RELEASE (REEL 042262 / FRAME 0601) Recorded Oct 13, 2022
From: CITIBANK, N.A.
To: GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC
Reel/Frame 061748/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Apr 13, 2017
From: GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE DIGITAL VENTURES, LLC
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 042262/0601 →
RELEASE OF SECURITY INTEREST IN PATENT RIGHTS Recorded Feb 8, 2017
From: JPMORGAN CHASE BANK, N.A.
To: GRACENOTE, INC.; CASTTV INC.; TRIBUNE MEDIA SERVICES, LLC; TRIBUNE DIGITAL VENTURES, LLC
Reel/Frame 041656/0804 →
SECURITY AGREEMENT Recorded Nov 13, 2014
From: GRACENOTE, INC.; TRIBUNE BROADCASTING COMPANY, LLC; TRIBUNE DIGITAL VENTURES, LLC; TRIBUNE MEDIA COMPANY
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 034231/0333 →
SECURITY INTEREST Recorded Mar 19, 2014
From: GRACENOTE, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 032480/0272 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2012
From: DIMARIA, PETER C.; CHEN, CHING-WEI; BRENNER, VADIM
To: GRACENOTE, INC.
Reel/Frame 027689/0392 →