IP Library › Granted Patent US 12,245,020
Granted Patent B2
US 12,245,020 · App. 17/907,988 · Granted Mar 4, 2025

Electronic device, method and computer program

Inventors: Stefan Uhlich (Stuttgart, DE); Michael Enenkl (Stuttgart, DE)
Assignee: SONY GROUP CORPORATION
H04S7/307H04S2400/11H04S2400/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,245,020
App. No.
17/907,988
Granted
Mar 4, 2025
Kind
B2
Abstract

An electronic device having circuitry, which is configured to estimate a distraction level of an audio object stream, and to modify the audio object stream based on the estimated distraction Audio object level to obtain a modified audio object stream.

Claims (30)

1. An electronic device comprising:

circuitry configured to

estimate a distraction level of an audio object stream,

perform a field-of-listening evaluation on the audio object stream to estimate a position distraction level corresponding to the distraction level, and

modify the audio object stream based on the estimated distraction level to obtain a modified audio object stream.

2. The electronic device of claim 1 , wherein the circuitry is further configured to modify the audio object stream based on the estimated distraction level by an audio object stream modification including a decision tree.

3. The electronic device of claim 2 , wherein the circuitry is further configured to evaluate the decision tree to determine a list of actions.

4. The electronic device of claim 3 , wherein the circuitry is further configured to perform an action block to obtain the modified audio object stream.

5. The electronic device of claim 3 , wherein the list of actions includes an amplitude reduction of an audio object, a low-pass/median filtering, and/or a modification of position.

6. The electronic device of claim 1 , wherein the circuitry is configured to perform a sound signature estimation on the audio object stream to estimate an aural distraction level.

7. The electronic device of claim 6 , wherein the circuitry is configured to perform the sound signature estimation on the audio object stream using a deep neural network.

8. The electronic device of claim 1 , wherein the circuitry is configured to perform a distance calculation on the audio object stream to obtain a distance estimation.

9. The electronic device of claim 8 , wherein the distance estimation comprises a perceived distance, a perceived velocity vector, a cross-correlation, and/or an auto-correlation.

10. The electronic device of claim 9 , wherein the circuitry is further configured to extract coordinates and a bitstream to obtain the perceived distance, the perceived velocity vector, the cross-correlation, and/or the auto-correlation.

11. The electronic device of claim 1 , wherein the circuitry is further configured to perform a driving situation analysis based on acquired vehicle data to estimate a driving situation.

12. The electronic device of claim 11 , wherein a level of criticalness of a current driving situation is estimated based on the driving situation.

13. The electronic device of claim 1 , wherein the circuitry is further configured to perform a song history analysis on a history of songs to estimate a novelty factor related to the audio object stream.

14. The electronic device of claim 1 , wherein the circuitry is further configured to extract coordinates of an audio object in the audio object stream.

15. The electronic device of claim 14 , wherein the coordinates of an audio object represent a position of the audio object in a field of listening.

16. The electronic device of claim 1 , wherein the circuitry is further configured to extract spectral and temporal characteristics of the audio object stream from a bitstream.

17. The electronic device of claim 16 , wherein an aural distraction level is estimated based on the obtained audio bitstream.

18. The electronic device of claim 1 , wherein the circuitry is further configured to perform distraction minimization in the audio object stream to obtain the modified audio object stream.

19. A method comprising:

estimating a distraction level of an audio object stream;

performing a field-of-listening evaluation on the audio object stream to estimate a position distraction level corresponding to the distraction level; and

modifying the audio object stream based on the estimated distraction level to obtain a modified audio object stream.

20. A non-transitory computer-readable medium including computer-readable instructions that, when executed by a processor cause the processor to perform a method comprising:

estimating a distraction level of an audio object stream;

performing a field-of-listening evaluation on the audio object stream to estimate a position distraction level corresponding to the distraction level; and

modifying the audio object stream based on the estimated distraction level to obtain a modified audio object stream.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2022
From: ENENKL, MICHAEL
To: SONY GROUP CORPORATION
Reel/Frame 061711/0728 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 30, 2022
From: UHLICH, STEFAN
To: SONY GROUP CORPORATION
Reel/Frame 061356/0837 →
Priority Claims (1)
EP 20161654 · Mar 6, 2020 · regional
Continuity (1)
Related Publication 20230164510A1 · May 25, 2023
References Cited (13)
US 8190438B1 · Nelissen · 2012 [cited by applicant]
US 20090076637A1 · Kameyama · 2009 [cited by applicant]
US 20090287479A1 · Szczerba · 2009 [cited by examiner]
US 20110040707A1 · Theisen et al. · 2011 [cited by applicant]
US 20120114130A1 · Lovitt · 2012 [cited by applicant]
US 20150053066A1 · Hampiholi · 2015 [cited by examiner]
US 20190213429A1 · Sicconi et al. · 2019 [cited by applicant]
US 20200364663A1 · Colella · 2020 [cited by examiner]
US 20230273290A1 · Eronen · 2023 [cited by examiner]
CN 106911763A · 2017 [cited by applicant]
EP 3401905A1 · 2018 [cited by applicant]
International Search Report and Written Opinion mailed on May 31, 2021, received for PCT Application PCT/EP2021/054930, filed on Feb. 26, 2021, 10 pages. [cited by applicant]
“Audio Definition Model”, ITU-R, BS Series, Broadcasting Service (sound), BS.2076-1, Jun. 2017, pp. 1-104. [cited by applicant]