IP Library Granted Patent US 11,024,301
Granted Patent B2
US 11,024,301 · App. 16/530,236 · Granted Jun 1, 2021

Modification of electronic system operation based on acoustic ambience classification

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,024,301
App. No.
16/530,236
Granted
Jun 1, 2021
Kind
B2
Abstract

Methods and systems for modification of electronic system operation based on acoustic ambience classification are presented. In an example method, at least one audio signal present in a physical environment of a user is detected. The at least one audio signal is analyzed to extract at least one audio feature from the audio signal. The audio signal is classified based on the audio feature to produce at least one classification of the audio signal. Operation of an electronic system interacting with the user in the physical environment is modified based on the classification of the audio signal.

Claims (42)

1. An apparatus comprising:

a noise cancellation module to filter a first audio signal to generate a first filtered audio signal, the first audio signal generated via a first sensor in an environment during presentation of media content in the environment via a media player;

a classifier to:

assign a first classification to the first filtered audio signal based on a first feature of the first filtered audio signal;

assign a second classification to a second audio signal based on a second feature of the second audio signal, the second audio signal generated via the first sensor or a second sensor in the environment during the presentation of the media content; and

instruct the noise cancellation module to filter the second audio signal to cause the noise cancellation module to generate a second filtered audio signal based on the assignment of the second classification to the second audio signal; and

a rules engine to instruct the media player to adjust the media content based on the one of the first filtered audio signal or the second filtered audio signal to generate adjusted media content for presentation in the environment.

2. The apparatus of claim 1 , wherein the first classification is indicative of ambient noise in the environment.

3. The apparatus of claim 1 , wherein the first classification is indicative of the first audio signal including voice data.

4. The apparatus of claim 1 , wherein the classifier is to receive a third audio signal from the noise cancellation module, the third audio signal filtered by the noise cancellation module.

5. The apparatus of claim 4 , wherein the third audio signal is generated by the media player.

6. The apparatus of claim 1 , wherein the first feature includes one or more of volume, pitch, energy, or bandwidth associated with the first filtered audio signal.

7. The apparatus of claim 1 , wherein the rules engine is to adjust the media content by adjusting a volume of the media content.

8. The apparatus of claim 1 , wherein the second feature includes one or more of volume, pitch, energy, or bandwidth associated with the second audio signal.

9. A non-transitory machine readable storage medium comprising instructions that, when executed, cause at least one machine to at least:

filter a first audio signal to generate a first filtered audio signal, the first audio signal generated via a first sensor in an environment during presentation of media content in the environment via a media player;

assign a first classification to the first filtered audio signal based on a first feature of the first filtered audio signal;

assign a second classification to a second audio signal based on a second feature of the second audio signal, the second audio signal generated via the first sensor or a second sensor in the environment during of the presentation of the media content;

filter the second audio signal to generate a second filtered audio signal based on the assignment of the second classification to the second audio signal; and

instruct the media player to adjust the media content based on the one of the first filtered audio signal or the second filtered audio signal to generate adjusted media content for presentation in the environment.

10. The non-transitory machine readable storage medium of claim 9 , wherein the first classification is indicative of ambient noise in the environment.

11. The non-transitory machine readable storage medium of claim 9 , wherein the first classification is indicative of the first audio signal including voice data.

12. The non-transitory machine readable storage medium of claim 9 , wherein the instructions, when executed, cause the machine to access a third audio signal, the third audio signal being a filtered audio signal.

13. The non-transitory machine readable storage medium of claim 9 , wherein the first feature includes one or more of volume, pitch, energy, or bandwidth associated with the first filtered audio signal.

14. The non-transitory machine readable storage medium of claim 9 , wherein the instructions, when executed, cause the machine to adjust the media content by adjusting a volume of the media content.

15. The non-transitory machine readable storage medium of claim 9 , wherein the second feature includes one or more of volume, pitch, energy, or bandwidth associated with the second audio signal.

16. A system comprising:

at least one sensor to generate (a) a first audio signal generated in an environment during presentation of media content in the environment via a media player and (b) a second audio signal in the environment during the presentation of the media content;

memory; and

at least one processor to execute the instructions to:

filter the first audio signal to generate a first filtered audio signal;

assign a first classification to the first filtered audio signal based on a first feature of the first filtered audio signal;

assign a second classification to the second audio signal based on a second feature of the second audio signal;

filter the second audio signal to generate a second filtered audio signal based on the assignment of the second classification to the second audio signal; and

instruct the media player to adjust the media content based on the one of the first filtered audio signal or the second filtered audio signal to generate adjusted media content for presentation in the environment.

17. The system of claim 16 , wherein the first classification is indicative of ambient noise in the environment.

18. The system of claim 16 , wherein the first classification is indicative of the first audio signal including voice data.

19. The system of claim 16 , wherein the instructions, when executed, cause the at least one processor to access a third audio signal, the third audio signal being a filtered audio signal.

20. The system of claim 19 , wherein the third audio signal is generated by the media player.

21. The system of claim 16 , wherein the first feature includes one or more of volume, pitch, energy, or bandwidth associated with the first filtered audio signal.

22. The system of claim 16 , wherein the instructions, when executed, cause the at least one processor to adjust the media content by adjusting a volume of the media content.

23. The system of claim 16 , wherein the second feature includes one or more of volume, pitch, energy, or bandwidth associated with the second audio signal.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2019
From: JEVACHANDRAN, SURESH; BRENNER, VADIM; CREMER, MARKUS K
To: GRACENOTE, INC.
Reel/Frame 050367/0956 →