Method for providing distant support to a personal hearing system user and system for implementing such a method
Distant support is provided to a personal hearing system user by a support provider over a network. Support provider and user communicate with each other by speech transmitted over the network. The user depends in regard to understanding speech on his or her hearing aids. During the support session the hearing aids may have to be removed, may have to be switched off or may be programmed in an unfavorable way. In this case, the user may not be able to understand the speech of the support provider any more. The system enables the support provider to select a message from a list of available messages which is then presented as a visual image to the user. The obstructed acoustical channel is bypassed by relying on visual communication.
1. A method for providing a distant support to a user of a personal hearing system by a support provider using a support provider system, said personal hearing system comprising at least one of a hearing aid and a cochlear implant, and said method comprising the steps of:
establishing a network connection between a user computer located at said personal hearing system and a supporter computer forming part of said support provider system by a network;
performing a speech transmission by transmitting speech of said support provider over said network or a further network and over said personal hearing system to said user;
interrupting said speech transmission at least partially;
determining a model and/or a configuration of said at least one of said hearing aid and said cochlear implant;
visually presenting a plurality of messages via said supporter computer and receiving a selection of a message by said supporter computer from said plurality of messages, wherein said plurality of messages are related to use of said at least one of said hearing aid and said cochlear implant;
transmitting said message and/or an identification of said message over said network connection; and
visually presenting said message in the form of an image or a moving image by said user computer for perception by said user and/or a third person located at said user, wherein said image or said moving image visually depicts substantially said determined model and/or said configuration of said at least one of said hearing aid and said cochlear implant.
2. The method of claim 1 , wherein said plurality of visually presented messages comprises at least three of the following messages:
insert hearing aid;
switch on/off hearing aid;
clean hearing aid;
change battery of hearing aid;
change parts of hearing aid;
check microphone protection of hearing aid;
check receiver protection of hearing aid;
operate volume control of hearing aid;
operate program toggle of hearing aid;
mount hearing aid for hearing aid self-test;
operate hearing aid for hearing aid self-test;
pair hearing aid with auxiliary device;
mount/dismount hook of hearing aid;
mount/dismount ear-mold of hearing aid;
dismount ear-mold of hearing aid;
connect programming cable to hearing aid;
disconnect programming cable from hearing aid;
attach left/right-mark to hearing aid;
show left/right-mark on hearing aid;
perform feedback test for hearing aid;
put hearing aid in dry and/or storage case;
question how a stimulus presented by a hearing aid was perceived;
any of the above messages, but explicitly regarding only a right hearing aid;
any of the above messages, but explicitly regarding only a left hearing aid;
any of the above messages, but explicitly regarding both the left hearing aid and the right hearing aid;
an alert message;
adjust volume of user computer loudspeaker;
adjust position of user computer microphone;
a question to be answered acoustically;
a question with multiple-choice answer;
a question with a set of check/uncheck answers;
a question with a free-text answer;
a message directed to a third person;
an instruction to provide a quiet environment, in particular by closing windows;
an instruction to make a particular sound;
an instruction to a third person to speak; and
a custom message defined by said support provider.
3. The method of claim 1 , wherein said image or said moving image is an interactive presentation.
4. The method of claim 1 , wherein:
said distant support comprises a hearing aid fitting; and
software for presenting said plurality of visually presented messages is integrated with a fitting software, and/or said plurality of visually presented messages is selected and/or sorted depending on a hearing aid fitting workflow stage.
5. The method of claim 1 , wherein said personal hearing system is designed to compensate a hearing loss and comprises one of the following:
one hearing aid;
two hearing aids;
one cochlear implant;
two cochlear implants; and
one hearing aid and one cochlear implant.
6. The method of claim 1 , wherein
said identification of said message is sent by said supporter computer to a server, said server being connected to said network, said server storing a plurality of images and/or moving images associated with message identifications, said server sending an image and/or a moving image associated with said identification of said message to said user computer, and/or
said identification of said message is sent by said supporter computer to said user computer, said user computer storing a plurality of images and/or moving images associated with message identifications.
7. The method of claim 1 , further comprising the step of defining a custom message and a corresponding image or moving image by said support provider.
8. The method of claim 7 , further comprising the step of uploading said custom message and said corresponding image or moving image to a server, thereby making it available for use by further support provider systems.
9. The method of claim 1 , further comprising the steps of:
responding to said message by said user and/or said third person located at said user, said responding comprising one or more of the following:
a user interface action on said user computer;
selecting a button;
selecting an acknowledge button;
selecting an answer button;
selecting an answer out of a choice of answers defined by said message;
selecting or unselecting items out of one or more items defined by said message;
typing a free-text answer;
speaking;
placing a telephone call to said support provider;
placing an internet voice and/or video call;
sending an internet chat message; and
receiving a response yielded by said responding by said support provider.
10. The method of claim 1 , wherein said network is the internet.
11. The method of claim 1 , wherein said visually presenting of said plurality of messages via said supporter computer is performed after said interruption of said speech transmission at least partially.
12. The method of claim 11 , wherein said interruption of said speech transmission at least partially comprises at least one of removing, switching off, and reconfiguring said personal hearing system.
13. The method of claim 1 , wherein said plurality of messages visually presented via said supporter computer are prestored on said computer or on a remote server communicatively connected to said computer by way of said network or another network.
14. A system for providing a distant support to a user of a personal hearing system by a support provider, said personal hearing system comprising at least one of a hearing aid and a cochlear implant, and said system comprising at least one computer that:
establishes a network connection between a user computer located at said personal hearing system and a supporter computer forming part of a support provider system by a network;
performs a speech transmission by transmitting speech of said support provider over said network or a further network and over said personal hearing system to said user;
interrupts said speech transmission at least partially;
determines a model and/or a configuration of said at least one of said hearing aid and said cochlear implant;
visually presents a plurality of messages via said supporter computer and receives a selection of a message by said supporter computer from said plurality of messages, wherein said plurality of messages are related to use of said at least one of said hearing aid and said cochlear implant;
transmits said message and/or an identification of said message over said network connection;
visually presents said message in the form of an image or a moving image by said user computer for perception by said user and/or a third person located at said user, wherein said image or said moving image visually depicts substantially said determined model and/or said configuration of said at least one of said hearing aid and said cochlear implant.
15. The system of claim 14 , wherein said plurality of visually presented messages comprises at least three of the following messages:
insert hearing aid;
switch on/off hearing aid;
clean hearing aid;
change battery of hearing aid;
change parts of hearing aid;
check microphone protection of hearing aid;
check receiver protection of hearing aid;
operate volume control of hearing aid;
operate program toggle of hearing aid;
mount hearing aid for hearing aid self-test;
operate hearing aid for hearing aid self-test;
pair hearing aid with auxiliary device;
mount/dismount hook of hearing aid;
mount/dismount ear-mold of hearing aid;
dismount ear-mold of hearing aid;
connect programming cable to hearing aid;
disconnect programming cable from hearing aid;
attach left/right-mark to hearing aid;
show left/right-mark on hearing aid;
perform feedback test for hearing aid;
put hearing aid in dry and/or storage case;
question how a stimulus presented by a hearing aid was perceived;
any of the above messages, but explicitly regarding only a right hearing aid;
any of the above messages, but explicitly regarding only a left hearing aid;
any of the above messages, but explicitly regarding both the left hearing aid and the right hearing aid;
an alert message;
adjust volume of user computer loudspeaker;
adjust position of user computer microphone;
a question to be answered acoustically;
a question with multiple-choice answer;
a question with a set of check/uncheck answers;
a question with a free-text answer;
a message directed to a third person;
an instruction to provide a quiet environment, in particular by closing windows;
an instruction to make a particular sound;
an instruction to a third person to speak; and
a custom message defined by said support provider.
16. The system of claim 14 , wherein:
said distant support comprises a hearing aid fitting; and
software for presenting said plurality of visually presented messages is integrated with a fitting software, and/or said plurality of visually presented messages is selected and/or sorted depending on a hearing aid fitting workflow stage.
17. The system of claim 14 , wherein said personal hearing system is designed to compensate a hearing loss and comprises one of the following:
one hearing aid;
two hearing aids;
one cochlear implant;
two cochlear implants; and
one hearing aid and one cochlear implant.
18. The system of claim 14 , wherein
said identification of said message is sent by said supporter computer to a server, said server being connected to said network, said server storing a plurality of images and/or moving images associated with message identifications, said server sending an image and/or a moving image associated with said identification of said message to said user computer, and/or
said identification of said message is sent by said supporter computer to said user computer, said user computer storing a plurality of images and/or moving images associated with message identifications.
19. The system of claim 14 , wherein said visually presenting of said plurality of messages via said supporter computer is performed after said interruption of said speech transmission at least partially.
20. The system of claim 19 , wherein said interruption of said speech transmission at least partially comprises at least one of removing, switching off, and reconfiguring said personal hearing system.