IP Library Granted Patent US 10,365,886
Granted Patent B2
US 10,365,886 · App. 16/011,165 · Granted Jul 30, 2019

Identification of audio content

Inventors: Eric Clayton (Concord, MA); Aurelio Rafael Ramos (Jamaica Plain, MA)
Assignee: Sonos, Inc.
G06F3/165G11B27/34H04H60/37H04R27/00G06F16/27H04L67/42H04R3/12H04R2227/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,365,886
App. No.
16/011,165
Granted
Jul 30, 2019
Kind
B2
Abstract

An example implementation involves a playback device receiving digital data representing audio content, the digital data encoded in a first format. The playback device causes one or more speaker drivers to playback the audio content. The playback device decodes a portion of the received digital data to convert the portion of the received digital data from the first format to a second format and transmits, via a network interface to a computing device of an identification system, the decoded portion of the received digital data. The playback device receives, from via the network interface from the identification system, metadata corresponding to the audio content, and in response, causes a control device to display a graphical representation of the received metadata, wherein causing the control device to display the graphical representation comprises sending, via the network interface to the control device, the received metadata to the control device.

Claims (81)

1. A playback device, comprising:

an enclosure;

a network interface mounted in the enclosure;

one or more speaker drivers mounted in the enclosure;

one or more processors mounted in the enclosure; and

tangible, non-transitory, computer-readable media mounted in the enclosure and storing instructions that, when executed by the one or more processors, cause the playback device to perform functions comprising:

receiving, via the network interface from a control device, a command to play back audio content, wherein the audio content is identified by first metadata;

based on the received command, causing, via the one or more speaker drivers, playback of the audio content;

while playing back musical content within the audio content via the one or more speaker drivers, determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content;

based on determining that the first metadata excludes the one or more items of metadata corresponding to musical content within the audio content, transmitting, via the network interface, a request for second metadata corresponding to the musical content and excluded from the first metadata, from an identification system, the request including a portion of the audio content representing the musical content;

receiving, via the network interface from the identification system in response to transmitting the request, additional metadata corresponding to the musical content; and

in response to receiving, from the identification system, the additional metadata corresponding to the musical content, causing the control device to display a graphical representation of the received additional metadata, wherein causing the control device to display the graphical representation comprises sending, via the network interface to the control device, the received additional metadata to the control device.

2. The playback device of claim 1 , wherein the functions further comprise:

receiving digital data representing the audio content, wherein the digital data is encoded in a first format;

decoding the portion of the audio content representing the musical content to convert the portion of the received digital data from the first format to a second format; and

wherein transmitting the request for metadata corresponding to the musical content from an identification system comprises transmitting the decoded portion of the audio content representing the musical content.

3. The playback device of claim 1 , wherein the additional metadata comprises one or more of: (i) album name; (ii) track title; (iii) artist name; (iv) album year; (v) release date; (vi) composing entity; and (vii) performing entity.

4. The playback device of claim 1 , wherein the functions further comprise:

based on determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content, causing the control device to display a graphical representation of a retrieval request;

receiving, via the network interface from the control device, a command for the playback device to retrieve further metadata corresponding to the musical content from the identification system;

transmitting, via the network interface, a request for further metadata corresponding to the musical content from the identification system;

receiving, via the network interface from the identification system in response to transmitting the request, further metadata corresponding to the musical content; and

in response to receiving, from the identification system, the further metadata corresponding to the musical content, causing the control device to display a graphical representation of the further metadata corresponding to the musical content, wherein causing the control device to display the graphical representation comprises sending, via the network interface to the control device, the received further metadata to the control device.

5. The playback device of claim 1 , wherein the functions further comprise:

based on determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content, causing the control device to display a graphical representation of a search request;

receiving, via the network interface from the control device, a search command for the playback device to search for further metadata corresponding to the musical content;

based on the search command, performing a search for the further metadata corresponding to the musical content; and

causing the control device to display a graphical representation of results of the search for the further metadata corresponding to the musical content, wherein causing the control device to display the graphical representation comprises sending, via the network interface to the control device, the results of the search to the control device.

6. The playback device of claim 1 , the functions further comprising sending requests for third metadata corresponding to the musical content from the identification system at periodic instances of time.

7. The playback device of claim 1 , wherein determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content comprises detecting a discontinuity in the musical content.

8. The playback device of claim 1 , wherein sending the additional metadata to the control device comprises sending one or more of (i) metadata related to a particular audio track within the musical content, (ii) data identifying a network location of a particular device from which metadata related to the musical content can be retrieved, (iii) a uniform resource locator identifying a network location of the particular device from which metadata related to the musical content can be retrieved, and (iv) an identifier recognizable to a metadata curating device as corresponding to metadata related to the musical content.

9. The playback device of claim 1 , wherein the identification system is a first identification system and wherein the functions further comprise:

receiving, via the network interface from the first identification system, a message indicating that the first identification system was unable to (i) identify the audio content and (ii) retrieve information related to the audio content;

based on receiving the message, transmitting, via the network interface, a further request for third metadata corresponding to the audio content representing the musical content, from a second identification system; and

receiving, via the network interface from the second identification system in response to transmitting the further request, supplementary metadata identifying the audio content and containing information related to the audio content.

10. The playback device of claim 9 , wherein the functions further comprise:

based on receiving, from the second identification system, the supplementary metadata, storing instructions to send future requests corresponding to the audio content to the second identification system.

11. The playback device of claim 9 , wherein the second identification system is configured to receive digital data corresponding to sample rates, frequency ranges, or formats that are different than those for which the first identification system is configured to receive.

12. A tangible, non-transitory computer-readable medium having stored thereon instructions executable by a one or more processors to cause a playback device to perform functions comprising:

receiving, via a network interface from a control device, a command to play back audio content, wherein the audio content is identified by first metadata;

based on the received command, causing, via one or more speaker drivers, playback of the audio content;

while playing back musical content within the audio content via the one or more speaker drivers, determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content;

based on determining that the first metadata excludes the one or more items of metadata corresponding to musical content within the audio content, transmitting, via the network interface, a request for second metadata corresponding to the musical content and excluded from the first metadata, from an identification system, the request including a portion of the audio content representing the musical content;

receiving, via the network interface from the identification system in response to transmitting the request, additional metadata corresponding to the musical content; and

in response to receiving, from the identification system, the additional metadata corresponding to the musical content, causing the control device to display a graphical representation of the received additional metadata, wherein causing the control device to display the graphical representation comprises sending, via the network interface to the control device, the received additional metadata to the control device.

13. The tangible, non-transitory computer-readable medium of claim 12 , wherein the functions further comprise:

receiving digital data representing the audio content, wherein the digital data is encoded in a first format;

decoding the portion of the audio content representing the musical content to convert the portion of the received digital data from the first format to a second format; and

wherein transmitting the request for metadata corresponding to the musical content from an identification system comprises transmitting the decoded portion of the audio content representing the musical content.

14. The tangible, non-transitory computer-readable medium of claim 12 , wherein the additional metadata comprises one or more of: (i) album name; (ii) track title; (iii) artist name; (iv) album year; (v) release date; (vi) composing entity; and (vii) performing entity.

15. The tangible, non-transitory computer-readable medium of claim 12 , wherein the functions further comprise:

based on determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content, causing the control device to display a graphical representation of a retrieval request;

receiving, via the network interface from the control device, a command for the playback device to retrieve further metadata corresponding to the musical content from the identification system;

transmitting, via the network interface, a request for further metadata corresponding to the musical content from the identification system;

receiving, via the network interface from the identification system in response to transmitting the request, further metadata corresponding to the musical content; and

in response to receiving, from the identification system, the further metadata corresponding to the musical content, causing the control device to display a graphical representation of the further metadata corresponding to the musical content, wherein causing the control device to display the graphical representation comprises sending, via the network interface to the control device, the received further metadata to the control device.

16. The tangible, non-transitory computer-readable medium of claim 12 , wherein the functions further comprise:

based on determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content, causing the control device to display a graphical representation of a search request;

receiving, via the network interface from the control device, a search command for the playback device to search for further metadata corresponding to the musical content;

based on the search command, performing a search for the further metadata corresponding to the musical content; and

causing the control device to display a graphical representation of results of the search for the further metadata corresponding to the musical content, wherein causing the control device to display the graphical representation comprises sending, via the network interface to the control device, the results of the search to the control device.

17. The tangible, non-transitory computer-readable medium of claim 12 , wherein determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content comprises detecting a discontinuity in the musical content.

18. A method to be performed by a playback device, the method comprising:

receiving, via a network interface from a control device, a command to play back audio content, wherein the audio content is identified by first metadata;

based on the received command, causing, via one or more speaker drivers, playback of the audio content;

while playing back musical content within the audio content via the one or more speaker drivers, determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content;

based on determining that the first metadata excludes the one or more items of metadata corresponding to musical content within the audio content, transmitting, via the network interface, a request for second metadata corresponding to the musical content from an identification system and excluded from the first metadata, the request including a portion of the audio content representing the musical content;

receiving, via the network interface from the identification system in response to transmitting the request, additional metadata corresponding to the musical content; and

in response to receiving, from the identification system, the additional metadata corresponding to the musical content, causing the control device to display a graphical representation of the received additional metadata, wherein causing the control device to display the graphical representation comprises sending, via the network interface to the control device, the received additional metadata to the control device.

19. The method of claim 18 , further comprising:

receiving digital data representing the audio content, wherein the digital data is encoded in a first format;

decoding the portion of the audio content representing the musical content to convert the portion of the received digital data from the first format to a second format; and

wherein transmitting the request for metadata corresponding to the musical content from an identification system comprises transmitting the decoded portion of the audio content representing the musical content.

20. The method of claim 18 , wherein the additional metadata comprises one or more of: (i) album name; (ii) track title; (iii) artist name; (iv) album year; (v) release date; (vi) composing entity; and (vii) performing entity.

21. The method of claim 18 , further comprising:

based on determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content, causing the control device to display a graphical representation of a search request;

receiving, via the network interface from the control device, a search command for the playback device to search for further metadata corresponding to the musical content;

based on the search command, performing a search for the further metadata corresponding to the musical content; and

causing the control device to display a graphical representation of results of the search for the further metadata corresponding to the musical content, wherein causing the control device to display the graphical representation comprises sending, via the network interface to the control device, the results of the search to the control device.

22. The method of claim 18 , wherein determining that the first metadata excludes one or more items of metadata corresponding to musical content within the audio content comprises detecting a discontinuity in the musical content.

23. The method of claim 18 , wherein sending the additional metadata to the control device comprises sending one or more of (i) metadata related to a particular audio track within the musical content, (ii) data identifying a network location of a particular device from which metadata related to the musical content can be retrieved, (iii) a uniform resource locator identifying a network location of the particular device from which metadata related to the musical content can be retrieved, and (iv) an identifier recognizable to a metadata curating device as corresponding to metadata related to the musical content.

Assignments (4)
RELEASE OF SECURITY INTEREST Recorded Oct 18, 2021
From: JPMORGAN CHASE BANK, N.A.
To: SONOS, INC.
Reel/Frame 058213/0597 →
SECURITY AGREEMENT Recorded Oct 15, 2021
From: SONOS, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 058123/0206 →
SECURITY INTEREST Recorded Aug 30, 2018
From: SONOS, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 046991/0433 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 18, 2018
From: CLAYTON, ERIC; RAMOS, AURELIO RAFAEL
To: SONOS, INC.
Reel/Frame 046121/0468 →
Continuity (3)
Continuation 15587699 · May 5, 2017
Continuation 14684208 · Apr 10, 2015
Related Publication 20180364970A1 · Dec 20, 2018