IP Library › Granted Patent US 11,487,496
Granted Patent B2
US 11,487,496 · App. 16/882,049 · Granted Nov 1, 2022

Controlling audio processing

Inventors: Antti Johannes Eronen (Tampere, FI); Jussi Artturi Leppänen (Tampere, FI); Arto Lehtiniemi (Lempaala, FI); Sujeet Shyamsundar Mate (Tampere, FI)
Assignee: Nokia Technologies Oy
G06F3/165H04R3/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,487,496
App. No.
16/882,049
Granted
Nov 1, 2022
Kind
B2
Abstract

An apparatus comprising means for: receiving an indication of a form factor of a device; selecting an audio component, in dependence on the receiving an indication of a form factor of the device and in dependence on an assigned location of a graphical user interface object associated with the audio component, wherein the graphical user interface object is assigned to at least a first display area when the device is in a first form factor and is assigned to the at least a first display area when the device is in a second form factor; controlling audio processing of audio associated with the selected audio component; and providing at least the processed audio for audio output by one or more loudspeakers.

Claims (48)

1. An apparatus comprising

at least one processor; and

at least one non-transitory memory including computer program code;

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to perform:

receiving an indication of a form factor of a device;

selecting an audio component for audio processing, in dependence on the received indication of the form factor of the device and in dependence on an assigned location of a graphical user interface object associated with the audio component, wherein the graphical user interface object is assigned to at least a first display area when the device is in a first form factor and is assigned to at least the first display area when the device is in a second form factor, wherein the audio component is one of: a spatial audio source for audio processing, a software application for audio processing, or an audio content item for audio processing;

controlling audio processing of audio associated with the selected audio component to at least one of:

modify a location of the audio associated with the selected audio component to be different from the assigned location of the graphical user interface object associated with the selected audio component, or

process the audio associated with the selected audio component to increase a perceived ambience of the audio; and

providing at least the processed audio for audio output with one or more loudspeakers.

2. The apparatus of claim 1 , wherein the form factor is dependent on flexing of a body of the device.

3. The apparatus of claim 1 , wherein the form factor is dependent on folding of a body of the device.

4. The apparatus of claim 1 , wherein the graphical user interface object corresponds to at least one of: the spatial audio source; the software application; or the audio content item.

5. The apparatus of claim 1 , wherein the first display area is configured to move relative to a second display area of the device when the form factor of the device is changed, and wherein selecting the audio component is dependent on which one of the first display area or the second display area the graphical user interface object is assigned to.

6. The apparatus of claim 1 , wherein selecting the audio component is dependent on which side of a fold line the assigned location is.

7. The apparatus of claim 1 , wherein selecting the audio component is dependent on an orientation of the device, wherein the audio component is selected based, at least partially, on one of:

a determination that the assigned location is not oriented towards a user of the device, or

a determination that the first display area is at least partially facing away from the user based, at least partially, on the form factor,

wherein the audio component is the spatial audio source.

8. The apparatus of claim 1 , wherein an extent of controlling the audio processing is dependent on an extent of a change of the form factor of the device or is dependent on an extent of a change of orientation of the device with respect to a user of the device.

9. The apparatus of claim 1 , wherein controlling audio processing comprises controlling an audio signal processing effect.

10. The apparatus of claim 9 , wherein the audio signal processing effect comprises at least one of: filtering; reverberation; echo; decorrelation; divergence; or spreading.

11. The apparatus of claim 1 , wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to perform:

controlling a position of a spatial audio sound object in a sound scene in dependence on a change in the form factor of the device, wherein the audio component comprises the spatial audio sound object.

12. The apparatus of claim 1 , wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to perform:

concurrently providing the audio associated with the selected audio component and audio associated with a non-selected audio component for output with the one or more loudspeakers, wherein the audio associated with the selected audio component is processed differently from the audio associated with the non-selected audio component.

13. The apparatus of claim 1 , embodied as the device or as a controller of the device.

14. A method comprising:

receiving an indication of a form factor of a device;

selecting an audio component for audio processing, in dependence on the received indication of the form factor of the device and in dependence on an assigned location of a graphical user interface object associated with the audio component, wherein the graphical user interface object is assigned to at least a first display area when the device is in a first form factor and is assigned to at least the first display area when the device is in a second form factor, wherein the audio component is one of: a spatial audio source for audio processing, a software application for audio processing, or an audio content item for audio processing;

controlling audio processing of audio associated with the selected audio component to at least one of:

modify a location of the audio associated with the selected audio component to be different from the assigned location of the graphical user interface object associated with the selected audio component, or

process the audio associated with the selected audio component to increase a perceived ambience of the audio; and

providing at least the processed audio for audio output with one or more loudspeakers.

15. A method as claimed in claim 14 , wherein the form factor is dependent on flexing of a body of the device.

16. A method as claimed in claim 14 , wherein the form factor is dependent on folding of a body of the device.

17. A method as claimed in claim 14 , wherein the graphical user interface object corresponds to at least one of: the spatial audio source; the software application; or the audio content item.

18. A method as claimed in claim 14 , wherein the first display area is configured to move relative to a second display area of the device when the form factor of the device is changed, and wherein the selecting of the audio component is dependent on which one of the first display area or the second display area the graphical user interface object is assigned to.

19. A method as claimed in claim 14 , wherein the selecting of the audio component is dependent on at least one of:

on which side of a fold line the assigned location is; or

an orientation of the device.

20. A non-transitory computer readable medium comprising program instructions for causing an apparatus to perform at least the following:

causing receiving an indication of a form factor of a device;

causing selecting an audio component for audio processing, in dependence on the received indication of the form factor of the device and in dependence on an assigned location of a graphical user interface object associated with the audio component, wherein the graphical user interface object is assigned to at least a first display area when the device is in a first form factor and is assigned to at least the first display area when the device is in a second form factor, wherein the audio component is one of: a spatial audio source for audio processing, a software application for audio processing, or an audio content item for audio processing;

causing controlling audio processing of audio associated with the selected audio component to at least one of:

modify a location of the audio associated with the selected audio component to be different from the assigned location of the graphical user interface object associated with the selected audio component, or

process the audio associated with the selected audio component to increase a perceived ambience of the audio; and

causing providing at least the processed audio for audio output with one or more loudspeakers.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 7, 2020
From: ERONEN, ANTTI JOHANNES; LEPPANEN, JUSSI ARTTURI; LEHTINIEMI, ARTO; MATE, SUJEET SHYAMSUNDAR
To: NOKIA TECHNOLOGIES OY
Reel/Frame 053140/0769 →
Priority Claims (1)
EP 19177934 · Jun 3, 2019 · regional
Continuity (1)
Related Publication 20200379719A1 · Dec 3, 2020
Cited By (1)
US 12,518,065