IP Library Granted Patent US 10,089,071
Granted Patent B2
US 10,089,071 · App. 15/172,080 · Granted Oct 2, 2018

Automatic audio attenuation on immersive display devices

Inventors: Jeffrey Kohler (Redmond, WA); Denise Ng (Kirkland, WA)
Assignee: Microsoft Technology Licensing, LLC
G06F3/167A63F13/211A63F13/212A63F13/215A63F13/25A63F13/424A63F13/5255G02B27/017G06F3/011G06F3/165G10L21/034H03G3/20A63F2300/8082G10L15/26G10L25/78
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,089,071
App. No.
15/172,080
Granted
Oct 2, 2018
Kind
B2
Abstract

Examples disclosed herein relate to controlling volume on an immersive display device. One example provides a near-eye display device comprising a sensor subsystem, a logic subsystem, and a storage subsystem storing instructions executable by the logic subsystem to receive image sensor data from the sensor subsystem, present content comprising a visual component and an auditory component, while presenting the content, detect via the image sensor data that speech is likely being directed at a wearer of the near-eye display device, and in response to detecting that speech is likely being directed at the wearer, attenuate an aspect of the auditory component.

Claims (50)

1. A near-eye display device, comprising:

a sensor subsystem comprising one or more image sensors;

a logic subsystem; and

a storage subsystem storing instructions executable by the logic subsystem to

receive image sensor data from the sensor subsystem,

present content comprising a visual component and an auditory component,

while presenting the content, detect speech from a first person,

determine via the image sensor data that speech from the first person is likely being directed at a wearer of the near-eye display device,

in response to determining that speech from the first person is likely being directed at the wearer, attenuate an aspect of the auditory component,

while presenting the content, detect speech from a second person,

determine via the image sensor data that speech from the second person is likely not being directed at the wearer of the near-eye display device, and

in response to determining that speech from the second person is likely not being directed at the wearer, not attenuate the aspect of the auditory component.

2. The near-eye display device of claim 1 wherein the instructions executable to detect that speech is likely being directed at the wearer comprise instructions executable to detect via the image sensor data that a person is likely speaking to the wearer based on detecting a face of the person.

3. The near-eye display device of claim 1 , wherein the sensor subsystem comprises a microphone array, and wherein the instructions executable to detect that speech is likely being directed at the wearer comprise instructions executable to detect that a person is likely speaking to the wearer via directional audio data as received from the microphone array.

4. The near-eye display device of claim 1 , wherein the instructions executable to detect that speech is likely being directed at the wearer comprise instructions executable to detect that a person is likely speaking to the wearer via sensor data received from another device being used by the person.

5. The near-eye display device of claim 1 , wherein the instructions executable to detect that speech is likely being directed at the wearer comprise instructions executable to detect that a person is likely speaking to the wearer by detecting one or more of the person being within a threshold distance from the wearer and the person being oriented toward the wearer.

6. The near-eye display device of claim 1 , wherein the instructions executable to attenuate an aspect of the auditory component comprise instructions executable to reduce a volume of the auditory component.

7. The near-eye display device of claim 1 , wherein the auditory component comprises multi-channel audio content, and wherein the instructions executable to attenuate an aspect of the auditory component comprise instructions executable to reduce a volume of a first subset of channels of the multi-channel audio content differently than a second subset of channels of the multi-channel audio content.

8. The near-eye display device of claim 1 , wherein the instructions executable to attenuate an aspect of the auditory component comprise instructions executable to pause the content being presented.

9. The near-eye display device of claim 1 , wherein the instructions are further executable to determine that the speech likely being directed at the wearer has likely stopped, and in response restore the aspect of the auditory component.

10. The near-eye display device of claim 1 , wherein the instructions executable to receive sensor data comprise instructions executable to receive a stream of depth image data from one or more depth image sensors, and wherein the instructions are further executable to detect a possible presence of a person via the stream of depth image data, and in response acquire two-dimensional image data with an outward-facing two-dimensional camera, and detect that the person is likely speaking to the wearer via the two-dimensional image data.

11. The near-eye display device of claim 1 , wherein the near-eye display device comprises a virtual reality display device, and wherein the instructions are further executable to, upon detecting that speech is likely being directed at the wearer, provide a video feed of a real-world view.

12. On a head-mounted near-eye display device comprising a sensor subsystem and one or more image sensors, a method comprising:

receiving image sensor data from the sensor subsystem;

presenting content on the near-eye display device, the content comprising a visual component and an auditory component;

while presenting the content on the near-eye display device, detecting speech from a first person;

determining via the image sensor data that speech from the first person is likely being directed at a wearer of the near-eye display device;

in response to determining that speech from the first person is likely being directed at the wearer of the near-eye display device, attenuating an aspect of the auditory component;

while presenting the content, detecting speech from a second person;

determining via the image sensor data that speech from the second person is likely not being directed at the wearer of the near-eye display device; and

in response to determining that the speech from the second person is likely not being directed at the wearer, not attenuating the aspect of the auditory component.

13. The method of claim 12 , wherein detecting that speech is likely being directed at the wearer comprises detecting that a person is likely speaking to the wearer via the image sensor data based on detecting a face of the person.

14. The method of claim 12 , wherein detecting that speech is likely being directed at the wearer comprises detecting that a person is likely speaking to the wearer via directional audio data received from a microphone array of the sensor subsystem.

15. The method of claim 12 , wherein detecting that speech is likely being directed at the wearer comprises detecting that a person is likely speaking to the wearer via sensor data received from another device being used by the person.

16. The method of claim 12 , wherein attenuating an aspect of the auditory component comprises reducing a volume of the auditory component.

17. A near-eye display device, comprising:

a sensor subsystem comprising one or more image sensors;

a logic subsystem; and

a storage subsystem storing instructions executable by the logic subsystem to

receive image sensor data from the sensor subsystem,

present content, the content comprising a visual component and an auditory component,

while presenting the content, detect speech from a first person,

determine via the image sensor data that speech from the first person is likely being directed at a wearer of the near-eye display device,

in response to determining that speech from the first person is likely being directed at the wearer, reduce a volume of the auditory component,

while presenting the content, detect speech from a second person,

determine via the image sensor data that speech from the second person is likely not being directed at the wearer of the near-eye display device, and

in response to determining that speech from the second person is likely not being directed at the wearer, not reduce the volume of the auditory component.

18. The near-eye display device of claim 17 , wherein the auditory component comprises multi-channel audio content, and wherein the instructions executable to reduce a volume of the auditory component comprise instructions executable to reduce a volume of a first subset of channels of the multi-channel audio content differently than a second subset of channels of the multi-channel audio content.

19. The near-eye display device of claim 17 , wherein the instructions executable to detect that speech is likely being directed at the wearer comprise instructions executable to detect via the image sensor data that a person is likely speaking to the wearer based on detecting a face of the person.

20. The near-eye display device of claim 17 , wherein the instructions executable to detect that speech is likely being directed at the wearer comprise instructions executable to detect that a person is likely speaking to the wearer by detecting one or more of the person being within a threshold distance from the wearer and the person being oriented toward the wearer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2018
From: KOHLER, JEFFREY; NG, DENISE
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 046588/0480 →
Continuity (1)
Related Publication 20170351485A1 · Dec 7, 2017