IP Library › Granted Patent US 11,494,158

Granted Patent B2

US 11,494,158 · App. 16/408,061 · Granted Nov 8, 2022

Augmented reality microphone pick-up pattern visualization

Inventors: Christopher George Reiger (Chicago, IL); Mathew T. Abraham (Colorado Springs, CO)

Assignee: Shure Acquisition Holdings, Inc.

G06F3/165 H04R1/406 H04R3/005

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 11,494,158
App. No.: 16/408,061
Granted: Nov 8, 2022
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

Augmented reality visual display of microphone pick-up patterns are disclosed. An example method includes capturing, via a camera of a computing device, an image of a microphone, and displaying the image on a display of the computing device. The method also includes determining, by the computing device, a location and orientation of the microphone relative to the camera, determining one or more parameters of a pick-up pattern of the microphone, determining a visual representation of the pick-up pattern based on the one or more parameters, and displaying the visual representation of the pick-up pattern overlaid on the image of the microphone.

Claims (92)

1. A method comprising:

capturing, via a camera of a computing device in a first position, a first image of a microphone, wherein the microphone is a steerable pattern microphone or array microphone;

displaying the first image on a display of the computing device;

determining, by the computing device, a first location and orientation of the microphone relative to the camera;

(A) responsive to receiving a first lobe coordinate corresponding to a pick-up pattern of the microphone being steered in a first direction:

determining a first visual representation of the pick-up pattern based on (1) the first lobe coordinate, (2) the first location and orientation of the microphone relative to the camera, and (3) the microphone being in an unmuted state; and

displaying the first visual representation of the pick-up pattern overlaid on the first image of the microphone;

(B) responsive to the microphone being modified to a muted state:

determining a second visual representation of the pick-up pattern based on (1) the first lobe coordinate, (2) the first location and orientation of the microphone relative to the camera, and (3) the microphone being in the muted state; and

displaying the second visual representation of the pick-up pattern overlaid on the first image of the microphone;

(C) responsive to receiving a second lobe coordinate corresponding to the pick-up pattern of the microphone being steered in a second direction:

determining a third visual representation of the pick-up pattern based on (1) the second lobe coordinate, (2) the first location and orientation of the microphone relative to the camera, and (3) the microphone being in the unmuted state, and

displaying the third visual presentation of the pick-up pattern overlaid on the first image of the microphone; and

(D) responsive to the microphone being modified to the muted state:

determining a fourth visual representation of the pick-up pattern based on (1) the second lobe coordinate, (2) the first location orientation of the microphone relative to the camera, and (3) the microphone being in the muted state; and

displaying the fourth visual representation of the pick-up pattern overlaid on the first image of the microphone.

2. The method of claim 1 , further comprising responsive to receiving the first lobe coordinate corresponding to the pick-up pattern of the microphone being steered in the first direction, determining one or more of a shape or a size of the pick-up pattern of the microphone based on the first lobe coordinate and an object in an environment where the microphone is located.

3. The method of claim 2 , wherein determining the pick-up pattern of the microphone comprises:

determining a presence of the object in the environment;

determining the pick-up of the microphone based on the first lobe coordinate; and

modifying the one or more of the shape or the size of the pick-up pattern based on the presence of the object.

4. The method of claim 1 , further comprising:

receiving, by the computing device, the first lobe coordinate.

5. The method of claim 4 , further comprising determining one or more parameters of the pick-up pattern of the microphone based on the received first lobe coordinates.

6. The method of claim 1 , wherein the first location and orientation of the microphone relative to the camera are determined based on the first image.

7. The method of claim 1 , further comprising:

receiving location and orientation data from the microphone, wherein the first location and orientation of the microphone relative to the camera are determined based on the received location and orientation data.

8. The method of claim 1 , further comprising:

determining one or more parameters of the pick-up pattern by receiving the one or more parameters from the microphone, wherein the one or more parameters of the pick-up pattern comprise one or more of a length, width, size, and shape corresponding to the pick-up pattern.

9. The method of claim 1 , further comprising:

receiving user input via a user interface of the computing device, wherein the user interface comprises a touch screen, and wherein the user input comprises a touch and drag motion; and

responsive to receiving the user input, transmitting an instruction to the microphone to modify one or more parameters of the pick-up pattern.

10. The method of claim 1 , wherein determining the first location and orientation of the microphone relative to the camera comprises determining the first location and orientation of the microphone relative to the camera based on a shape of the microphone.

11. The method of claim 1 , further comprising:

capturing, via the camera of the computing device in a second position different from the first position, a second image of the microphone;

displaying the second image on the display of the computing device;

determining, by the computing device, a second location and orientation of the microphone relative to the camera;

determining a fifth visual representation of the pick-up pattern based on (1), the first lobe coordinate, and (2) the second location and orientation of the microphone relative to the camera; and

displaying the fifth visual representation of the pick-up pattern overlaid on the second image of the microphone.

12. A computing device comprising:

a camera configured to capture a first image of a microphone when positioned in a first position, wherein the microphone is a steerable pattern microphone or array microphone;

a user interface; and

a processor configured to:

display the first image of the microphone on the user interface;

determine a first location and orientation of the microphone relative to the camera;

(A) responsive to receiving a first lobe coordinate corresponding to a pick-up pattern of the microphone being steered in a first direction,

determine a first visual representation of the pick-up pattern based on (1) the first lobe coordinate, (2) the first location and orientation of the microphone relative to the camera, and (3) the microphone being in an unmuted state; and

display the first visual representation of the pick-up pattern overlaid on the first image of the microphone;

(B) responsive to the microphone being modified to a muted state:

determine a second visual representation of the pick-up pattern based on (1) the first lobe coordinate, (2) the first location and orientation of the microphone relative to the camera, and (3) the microphone being in the muted state; and

display the second visual representation of the pick-up pattern overlaid on the first image of the microphone,

(C) responsive to receiving a second lobe coordinate corresponding to the pick-up pattern of the microphone being steered in a second direction:

displaying the third visual presentation of the pick-up pattern overlaid on the first image of the microphone; and

(D) responsive to the microphone being modified to the muted state:

display the fourth visual representation of the pick-up pattern overlaid on the first image of the microphone.

13. The computing device of claim 12 , wherein the process is further configured to: responsive to receiving the first lobe coordinate corresponding to the pick-up pattern of the microphone being steered in the first direction, determine one or more of a shape or a size of the pick-up pattern of the microphone based on the first lobe coordinate and an object in an environment where the microphone is located.

14. The computing device of claim 12 , wherein the processor is further configured to:

receive, from the steerable pattern microphone or array microphone, the first lobe coordinates.

15. The computing device of claim 12 , wherein the first location and orientation of the microphone relative to the camera are determined based on the first image.

16. The computing device of claim 12 :

wherein the user interface is configured to receive user input and comprises a touch screen, and wherein the user input comprises a touch and drag motion; and

wherein the processor is further configured to, responsive to receiving the user input, transmit an instruction to the microphone to modify one or more parameters of the pick-up pattern.

17. The computing device of claim 12 , wherein the camera is further configured to capture a second image of the microphone when positioned in a second position and wherein the processor is further configured to:

display the second image of the microphone on the user interface;

determine a second location and orientation of the microphone relative to the camera;

determine a fifth visual representation of the pick-up pattern based on (1) the first lobe coordinate, and (2) the second location and orientation of the microphone relative to the camera; and

display the fifth visual representation of the pick-up pattern overlaid on the second image.

18. A non-transitory, computer-readable medium having instructions stored thereon that, when executed by a processor, cause a performance of a set of acts comprising:

capturing, via a camera of a computing device in a first position, a first image of a microphone, wherein the microphone is a steerable pattern microphone or array microphone;

displaying the first image on a user interface of the computing device;

determining a first location and orientation of the microphone relative to the camera;