IP Library › Granted Patent US 10,349,122
Granted Patent B2
US 10,349,122 · App. 15/837,523 · Granted Jul 9, 2019

Accessibility for the hearing-impaired using keyword to establish audio settings

Inventors: Peter Shintani (San Diego, CA); Brant Candelore (Escondido, CA); Mahyar Nejat (San Diego, CA); Robert Noel Blanchard (Escondido, CA)
Assignee: Sony Corporation
H04N21/439G10L15/22H04N21/42203H04N21/4415H04N21/6587H04R25/55G10L2015/223H04R2225/41H04R2225/43H04R2430/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,349,122
App. No.
15/837,523
Granted
Jul 9, 2019
Kind
B2
Abstract

An audio video display device executes a voice assistant that recognizes a spoken name associated with a hearing-impaired person and in response reduces the audio volume for the content being decoded, on the assumption that someone is speaking to the hearing-impaired person, and/or pauses the content being decoded, and/or determines the location of the source of the command and steers a microphone array to that location, and/or allows for independent volume/mute controls via an assistive listening device such as a neck loop to control the volume or mute the audio played on hearing aids independently of the volume of the display device.

Claims (60)

1. A device comprising:

at least one computer memory that is not a transitory signal and that comprises instructions executable by at least one processor in an audio video device (AVD) to:

receive voice input;

responsive to the voice input matching a first command, alter audio presentation associated with an audio video program being presented on the AVD;

establish a first audio mode in which the AVD streams audio to at least one hearing aid paired with the AVD but does not stream ambient sound detected by at least one microphone of the AVD to the hearing aid; and

establish a second audio mode in which the AVD streams audio to at least one hearing aid paired with the AVD and also streams ambient sound detected by at least one microphone of the AVD to the hearing aid.

2. The device of claim 1 , comprising the at least one processor.

3. The device of claim 1 , comprising the at least one microphone.

4. The device of claim 1 , wherein the altering comprises:

reducing audio volume of the AVD.

5. The device of claim 1 , wherein the altering comprises:

pausing presentation of content on the AVD.

6. The device of claim 1 , wherein the altering comprises:

steering at least one microphone toward a source of the voice input.

7. The device of claim 1 , wherein the altering comprises:

allowing for audio control of the AVD independently of audio control of a hearing aid to which the AVD streams audio.

8. A method, comprising:

establishing a first audio mode in an audio video presentation system (AVPS), the first audio mode comprising a standalone mode in which an audio video display device (AVDD) outputs audio on at least one speaker of the AVDD;

establishing a second audio mode in the AVPS in which the AVDD streams audio to at least one hearing aid paired with the AVDD but does not stream ambient sound detected by at least one microphone of the AVPS to the hearing aid; and

establishing a third audio mode in the AVPS in which the AVDD streams audio to at least one hearing aid paired with the AVDD and also streams ambient sound detected by at least one microphone of the AVPS to the hearing aid.

9. The method of claim 8 , comprising:

responsive to detecting speech satisfying a criteria, reducing audio volume output by the AVDD; and

responsive to not detecting speech for a threshold period, increasing audio volume output by the AVDD.

10. The method of claim 8 , comprising:

responsive to detecting speech satisfying a criteria, pausing content output by the AVDD; and

responsive to not detecting speech for a threshold period, resuming play of content output by the AVDD.

11. The method of claim 8 , comprising:

responsive to voice input matching a first command, altering audio presentation associated with an audio video program being presented on the AVDD, the altering comprising one or more of:

reducing audio volume of the AVDD;

pausing presentation of content on the AVDD;

steering at least one microphone toward a source of the voice input;

allowing for audio control of the AVDD independently of audio control of a hearing aid to which the AVD streams audio.

12. The method of claim 11 , wherein the altering comprises:

reducing audio volume of the AVDD.

13. The method of claim 11 , wherein the altering comprises:

pausing presentation of content on the AVDD.

14. The method of claim 11 , wherein the altering comprises:

steering at least one microphone toward a source of the voice input.

15. The method of claim 11 , wherein the altering comprises:

allowing for audio control of the AVDD independently of audio control of a hearing aid to which the AVD streams audio.

16. An audio video assembly (AVA), comprising:

at least one display for presenting video under control of at least one processor;

at least one speaker for presenting audio under control of at least one processor; and

at least one storage comprising instructions executable by at least one processor to:

establish a first audio mode in the AVA in which an audio video display device (AVDD) of the AVA streams audio to at least one hearing aid paired with the AVDD but does not stream ambient sound detected by at least one microphone of the AVA to the hearing aid; and

establish a second audio mode in the AVA in which the AVDD streams audio to at least one hearing aid paired with the AVDD and also streams ambient sound detected by at least one microphone of the AVA to the hearing aid.

17. The AVA of claim 16 , wherein the instructions are executable to:

establish a third audio mode in the AVA in which the AVDD outputs audio on at least one speaker of the AVDD and does not stream audio to the hearing aid.

18. The AVA of claim 16 , wherein the instructions are executable to:

responsive to detecting speech satisfying a criteria, reduce audio volume output by the AVDD; and

responsive to not detecting speech for a threshold period, increase audio volume output by the AVDD.

19. The AVA of claim 16 , wherein the instructions are executable to:

responsive to detecting speech satisfying a criteria, pause content output by the AVDD; and

responsive to not detecting speech for a threshold period, resume play of content output by the AVDD.

20. The AVA of claim 16 , wherein the instructions are executable to:

responsive to voice input matching a first command, alter audio presentation associated with an audio video program being presented on the AVDD, the altering comprising one or more of:

reducing audio volume of the AVDD;

pausing presentation of content on the AVDD;

steering at least one microphone toward a source of the voice input;

allowing for audio control of the AVDD independently of audio control of a hearing aid to which the AVD streams audio.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2021
From: SONY GROUP CORPORATION
To: SATURN LICENSING LLC
Reel/Frame 057939/0387 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 21, 2021
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 057871/0646 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2017
From: SHINTANI, PETER; CANDELORE, BRANT; NEJAT, MAHYAR; BLANCHARD, ROBERT
To: SONY CORPORATION
Reel/Frame 044433/0661 →
Continuity (1)
Related Publication 20190182536A1 · Jun 13, 2019