IP Library › Granted Patent US 11,782,673
Granted Patent B2
US 11,782,673 · App. 17/522,073 · Granted Oct 10, 2023

Controlling audio output

Inventors: Lasse Juhani Laaksonen (Tampere, FI); Jussi Leppänen (Tampere, FI); Miikka Vilermo (Siuro, FI); Arto Lehtiniemi (Lempäälä, FI)
Assignee: Nokia Technologies Oy
G06F3/165G01P13/00G06F3/011H04R1/1041H04R2430/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,782,673
App. No.
17/522,073
Granted
Oct 10, 2023
Kind
B2
Abstract

An apparatus, method and computer program for controlling audio output is disclosed. The apparatus may comprise means for receiving data from one or more sensors representing one or more motion characteristics of a user and determining, based on the received data, one or more time instances associated with a sound event. The apparatus may also comprise means for controlling an active hear-through system of a wearable audio output device so as to temporarily modify, at a time of the one or more time instances, sound received by one or more input transducers associated with the active hear-through system that are output to an output transducer associated with the active hear-through system.

Claims (41)

1. An apparatus comprising:

at least one processor; and

at least one non-transitory memory storing instructions, that when executed by the at least one processor, cause the apparatus to:

receive data from one or more sensors representing one or more motion characteristics of a user;

determine, based on the received data, one or more time instances associated with a sound event; and

control an active hear-through system of a wearable audio output device to temporarily modify independently, at a time of the one or more time instances, sound received by input transducers associated with the active hear-through system that are output to an output transducer associated with the active hear-through system.

2. The apparatus of claim 1 , wherein the determining of the one or more time instances further comprises:

determine, based on the one or more motion characteristics, one or more time instances associated with the sound event due to an impact caused by the user or an object.

3. The apparatus of claim 2 , wherein the sound event is a repeating sound event due to an impact caused by the user or the object.

4. The apparatus of claim 1 , wherein the one or more sensors comprise one or more inertial sensors of, or in communication with, the apparatus.

5. The apparatus of claim 4 , wherein the one or more sensors comprise one or more of an accelerometer or gyroscope.

6. The apparatus of claim 1 , wherein the determining of the one or more time instances further comprises:

predict, based on a set of reference data, the one or more time instances at which the sound event will occur.

7. The apparatus of claim 1 , wherein the at least one non-transitory memory storing instructions is executed by the at least one processor to cause the apparatus to:

generate a first pattern comprising a sequence of time instances, including at least one prior time instance, when the one or more motion characteristics was associated with the sound event;

compare the first pattern with a plurality of predetermined reference patterns, wherein each reference pattern comprises a different pattern of the time instances;

identify the reference pattern to which the generated first pattern most closely corresponds; and

determine the one or more time instances based on remaining time instances of the identified reference pattern.

8. The apparatus of claim 7 , wherein the at least one non-transitory memory storing instructions is executed by the at least one processor to cause the apparatus to:

generate a second pattern, subsequent in time to the generating of the first pattern; measure a variance between the second pattern and the identified reference pattern; and

compare the second pattern, responsive to an identification of the variance measure exceeding a predetermined value, to the plurality of the predetermined reference patterns to identify a different reference pattern for determining the one or more time instances.

9. The apparatus of claim 1 , wherein the control of the active hear-through system further comprises: temporarily mute or reduce an amplitude of sounds received by the input transducer at the one or more time instances.

10. The apparatus of claim 1 , wherein the at least one non-transitory memory storing instructions is executed by the at least one processor to cause the apparatus to: output to the output transducer, at a time including or covering the time of the one or more time instances, a recorded sound segment to overlay the modified sound.

11. The apparatus of claim 1 , wherein the at least one non-transitory memory storing instructions is executed by the at least one processor to cause the apparatus to perform:

control of the active hear-through system further comprising:

control an active hear-through system of a wearable audio output device which comprises first and second earphones comprising respective first and second output transducers, the controlling being configured to modify, at the one or more time instances, sound received by a first input transducer located on the first earphone independently from sound received by a second input transducer located on the second earphone.

12. The apparatus of claim 11 , wherein the first earphone comprises one or more first sensors for generating a first set of data representing one or more first motion characteristics, and the second earphone comprises one or more second sensors for generating a second set of data representing one or more second motion characteristics, the controlling means being configured to detect, based on a difference between the first and second motion characteristics, that a sound event is associated more with the first earphone than the second earphone, and to modify sound received by the first input transducer differently from sound received by the second transducer.

13. The apparatus of claim 1 , comprising a part of the wearable audio output device.

14. The apparatus of claim 1 , wherein the wearable audio output device is a virtual reality headset, that comprises one or more earbuds, earphones, headphones or speakers.

15. A method, comprising:

receiving data from one or more sensors representing one or more motion characteristics of a user;

determining, based on the received data, one or more time instances associated with a sound event; and

controlling an active hear-through system of a wearable audio output device to temporarily modify independently, at a time of the one or more time instances, sound received by input transducers associated with the active hear-through system that are output to an output transducer associated with the active hear-through system.

16. The method of claim 15 , wherein the determining of the one or more time instances comprises determining, based on the one or more motion characteristics, one or more time instances associated with the sound event due to an impact caused by the user or an object.

17. The method of claim 16 , wherein the sound event is a repeating sound event due to an impact caused by the user or the object.

18. The method of claim 15 , wherein the one or more sensors comprise one or more inertial sensors of, or in communication with, the apparatus.

19. The method of claim 18 , wherein the one or more sensors comprise one or more of an accelerometer or gyroscope.

20. A non-transitory computer readable medium comprising program instructions stored thereon for performing at least:

receiving data from one or more sensors representing one or more motion characteristics of a user;

determining, based on the received data, one or more time instances associated with a sound event; and

controlling an active hear-through system of a wearable audio output device to temporarily modify independently, at a time of the one or more time instances, sound received by input transducers associated with the active hear-through system that are output to an output transducer associated with the active hear-through system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 9, 2021
From: LAAKSONEN, LASSE JUHANI; VILERMO, MIIKKA TAPANI; LEHTINIEMI, ARTO JUHANI; LEPPANEN, JUSSI ARTTURI
To: NOKIA TECHNOLOGIES OY
Reel/Frame 058058/0339 →
Priority Claims (1)
EP 20209803 · Nov 25, 2020 · regional
Continuity (1)
Related Publication 20220164160A1 · May 26, 2022