IP Library Granted Patent US 10,834,498
Granted Patent B2
US 10,834,498 · App. 16/367,138 · Granted Nov 10, 2020

Using image data to adjust a microphone setting

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,834,498
App. No.
16/367,138
Granted
Nov 10, 2020
Kind
B2
Abstract

For using image data to adjust a microphone setting, methods, apparatus, and systems are disclosed. One apparatus includes a camera that captures image data, a directional microphone that captures audio signals, a processor and a memory that stores code executable by the processor. The processor determines a location of a user relative to the apparatus using the image data and adjusts microphone settings for direction-of-amplification based on the location of the user.

Claims (41)

1. An apparatus comprising:

a camera that captures image data;

a directional microphone that captures audio signals;

an orientation sensor that detects an orientation of the apparatus;

a processor; and

a memory that stores code executable by the processor to:

detect that the apparatus is placed on a flat surface based on input from the orientation sensor; and

in response to detecting that the apparatus is placed on the flat surface:

activate the camera and capture image data;

determine a location of a user relative to a top dead center of the apparatus using the image data; and

adjust microphone settings for direction-of-amplification based on the location of the user.

2. The apparatus of claim 1 , wherein the directional microphone comprises an electronically-adjustable directional microphone, wherein adjusting microphone settings for direction-of-amplification based on the location of the user comprises adjusting a directionality of the directional microphone to acquire audio signals in a direction vector to the user.

3. The apparatus of claim 1 , wherein adjusting microphone settings for direction-of-amplification based on the location of the user comprises adjusting one or more of: beam direction aim, beamforming algorithm, amplification levels, and interference patterns.

4. The apparatus of claim 1 , wherein adjusting microphone settings for direction-of-amplification based on the location of the user comprises amplifying audio pickup in a direction vector pointing to the location of the user and suppressing audio pickup in other direction vectors.

5. The apparatus of claim 1 , wherein determining the location of the user relative to the apparatus comprises identifying an angular location of the user relative to the directional microphone, wherein adjusting microphone settings for direction-of-amplification based on the location of the user comprises estimating an angle-of-arrival (“AoA”) of incoming audio signals and increasing microphone sensitivity in the direction of the AoA.

6. The apparatus of claim 1 , wherein the camera captures the image data in response to one of: a change in orientation of the apparatus and a change in operation mode of the apparatus.

7. The apparatus of claim 1 , wherein the processor further detects a change in user location and re-adjusts the microphone settings for direction-of-amplification in response to the change in user location.

8. The apparatus of claim 6 , wherein the operation mode comprises a tablet mode where a display of the apparatus is arranged parallel to a body of the apparatus.

9. A method comprising:

detecting that an electronic device is placed on a flat surface based on input from an orientation sensor, the electronic device comprising a camera and a directional microphone;

in response to detecting that the apparatus is placed on the flat surface:

activating the camera and capturing image data by the electronic device;

determining, by use of a processor, a location of a user relative to a top dead center of the electronic device based on the image data; and

adjusting a direction-of-amplification of the directional microphone based on the location of the user.

10. The method of claim 9 , wherein the directional microphone comprises an electronically-adjustable directional microphone, wherein adjusting the direction-of-amplification of the directional microphone based on the location of the user comprises adjusting a directionality of the directional microphone to acquire audio signals in a direction vector to the user.

11. The method of claim 9 , wherein adjusting the direction-of-amplification of the directional microphone based on the location of the user comprises adjusting one or more of: beam direction aim, beamforming algorithm, amplification levels, and interference patterns.

12. The method of claim 9 , wherein adjusting the direction-of-amplification of the directional microphone based on the location of the user comprises amplifying audio pickup in a direction vector pointing to the location of the user and suppressing audio pickup in other direction vectors.

13. The method of claim 9 , wherein determining the location of the user relative to the electronic device comprises identifying an angular location of the user relative to the directional microphone, wherein adjusting the direction-of-amplification of the directional microphone based on the location of the user comprises estimating an angle-of-arrival (“AoA”) of incoming audio signals and increasing microphone sensitivity in the direction of the AoA.

14. The method of claim 9 , wherein capturing the image data occurs in response to one of: a change in orientation of the electronic device and a change in operation mode of the electronic device.

15. The method of claim 9 , further comprising detecting a change in user location and re-adjusting the direction-of-amplification of the directional microphone in response to the change in user location.

16. The method of claim 14 , wherein the operation mode comprises a tablet mode where a display of the electronic device is arranged parallel to a body of the electronic device.

17. A program product comprising a computer readable storage medium that stores code executable by a processor, the executable code comprising code to:

detect that an electronic device is placed on a flat surface based on input from an orientation sensor, the electronic device comprising a camera and a directional microphone;

in response to detecting that the electronic device is placed on the flat surface:

activate the camera and capture image data via the camera;

determine, using the image data, a location of a user relative to a top dead center of the electronic device;

and

adjust a microphone setting for direction-of-amplification based on the location of the user.

18. The program product of claim 17 , wherein the directional microphone comprises an electronically-adjustable directional microphone, wherein adjusting the microphone setting for direction-of-amplification comprises adjusting a directionality of the directional microphone to acquire audio signals in a direction vector to the user.

19. The program product of claim 17 , wherein adjusting the microphone setting for direction-of-amplification comprises adjusting one or more of: beam direction aim, beamforming algorithm, amplification levels, and interference patterns.

20. The program product of claim 17 , wherein adjusting the microphone setting for direction-of-amplification comprises amplifying audio pickup in a direction vector pointing to the location of the user and suppressing audio pickup in other direction vectors.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2025
From: LENOVO PC INTERNATIONAL LIMITED
To: LENOVO SWITZERLAND INTERNATIONAL GMBH
Reel/Frame 069870/0670 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2022
From: LENOVO (SINGAPORE) PTE LTD
To: LENOVO PC INTERNATIONAL LIMITED
Reel/Frame 060638/0220 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 28, 2019
From: KAPINOS, ROBERT JAMES; VANBLON, RUSSELL SPEIGHT; LI, SCOTT WENTAO; NORTON, ROBERT JAMES, JR
To: LENOVO (SINGAPORE) PTE. LTD.
Reel/Frame 048730/0419 →