IP Library Granted Patent US 11,928,982
Granted Patent B2
US 11,928,982 · App. 16/324,270 · Granted Mar 12, 2024

Interaction system, method and device

Inventor: Lin Zhu (Beijing, CN)
Assignee: BOE TECHNOLOGY GROUP CO., LTD.
G09B21/009G06F3/015G06F3/16H04R1/403H04R1/406H04R3/005H04R3/12H04R2201/401
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,928,982
App. No.
16/324,270
Granted
Mar 12, 2024
Kind
B2
Abstract

Embodiments of the disclosure provide an interaction system, method and device. The interaction system includes an electroencephalogram electrode array that determines a position of a sound source and invoking the electroencephalogram electrode corresponding to the position of the sound source to output a touch signal to a user.

Claims (65)

1. An interaction system comprising,

an electroencephalogram electrode array comprising at least one electroencephalogram electrode;

a micro microphone array comprising a plurality of micro microphones;

a signal processing circuit electrically connected with the electroencephalogram electrode array and the micro microphone array respectively, the signal processing circuit comprising a processor and a plurality of converting circuits, and the plurality of micro microphones electrically connected one-to-one with the plurality of converting circuits respectively, and the processor electrically connected with electroencephalogram electrodes in the electroencephalogram electrode array;

a memory configured to store data and electrically connected with the signal processing circuit; and

at least one program stored in the memory and configured to carry out, when executed by the signal processing circuit,

determining a distance between a sound source and each of the micro microphones based on intensities of audio signals of the sound source output by the plurality of micro microphones,

determining a position of the sound source based on the distance between the sound source and each of the micro microphones,

determining an electroencephalogram electrode of the electroencephalogram electrode array corresponding to the position of the sound source, and

invoking the electroencephalogram electrode corresponding to the position of the sound source to output a touch signal.

2. The system according to claim 1 , wherein the signal processing circuit is located above the electroencephalogram electrode array, and the micro microphone array is located above the signal processing circuit.

3. The system according to claim 1 , wherein the system further comprises a display apparatus, and wherein the at least one program is further configured to invoke the display apparatus to perform a corresponding display after determining the position of the sound source.

4. The system according to claim 3 , wherein the system further comprises a speaker array, speakers in the speaker array are electrically connected with the processor, and the at least one program is further configured to obtain an interaction content electroencephalogram signal of the user and a direction specified by the user through the electroencephalogram electrode array, and invoke at least one speaker corresponding to the direction to output a sound based on the interaction content electroencephalogram signal.

5. The system according to claim 4 , wherein the at least one program is configured to,

invoke the display apparatus to highlight a plurality of direction ranges in a first direction selection interface in turn, when receiving a starting active interaction electroencephalogram signal of the user through the electroencephalogram electrode array;

determine a currently highlighted direction range as a direction range specified by the user, when receiving a determination electroencephalogram signal of the user through the electroencephalogram electrode array;

invoke the display apparatus to display an interaction information inputting interface; and

invoke at least one speaker corresponding to the direction range specified by the user to output a sound based on the interaction content electroencephalogram signal, when receiving the interaction content electroencephalogram signal fed back by the user with respect to guiding of the interaction information inputting interface, through the electroencephalogram electrode array.

6. The system according to claim 4 , wherein the at least one program is further configured to,

invoke the display apparatus to highlight a plurality of direction ranges in a first direction selection interface in turn, when receiving a starting active interaction electroencephalogram signal of the user through the electroencephalogram electrode array;

determine a currently highlighted direction range as a direction range specified by the user, when receiving a determination electroencephalogram signal of the user through the electroencephalogram electrode array;

invoke the display apparatus to highlight a plurality of angular directions in a second direction selection interface in turn, after determining the direction range specified by the user;

determine a currently highlighted angular direction as an angular direction specified by the user, when receiving a determination electroencephalogram signal of the user through the electroencephalogram electrode array;

invoke the display apparatus to display the interaction information inputting interface; and

invoke at least one speaker corresponding to the angular direction specified by the user to output a sound based on the interaction content electroencephalogram signal, when receiving the interaction content electroencephalogram signal fed back by the user with respect to guiding of the interaction information inputting interface, through the electroencephalogram electrode array.

7. An interaction method comprising,

determining a distance between a sound source and each of a plurality of micro microphones of a micro microphone array based on intensities of audio signals of the sound source output by the micro microphones;

determining a position of the sound source based on the distance between the sound source and each of the micro microphones;

determining an electroencephalogram electrode of an electroencephalogram electrode array corresponding to the position of the sound source; and

invoking the electroencephalogram electrode corresponding to the position of the sound source to output a touch signal.

8. The method according to claim 7 , further comprising, invoking a display apparatus to correspondingly display the determined position of the sound source.

9. The method according to claim 8 , further comprising,

obtaining an interaction content electroencephalogram signal of the user and a direction specified by the user through the electroencephalogram electrode array; and

invoking at least one speaker of a speaker array corresponding to the direction to output a sound based on the interaction content electroencephalogram signal.

10. The method according to claim 9 , further comprising,

invoking the display apparatus to highlight a plurality of direction ranges in a first direction selection interface in turn, when receiving a starting active interaction electroencephalogram signal of the user through the electroencephalogram electrode array;

determining a currently highlighted direction range as a direction range specified by the user, when receiving a determination electroencephalogram signal of the user through the electroencephalogram electrode array;

invoking the display apparatus to display an interaction information inputting interface; and

invoking at least one speaker corresponding to the direction range specified by the user to output a sound based on the interaction content electroencephalogram signal, when receiving the interaction content electroencephalogram signal fed back by the user with respect to guiding of the interaction information inputting interface, through the electroencephalogram electrode array.

11. The method according to claim 9 , further comprising,

invoking the display apparatus to highlight a plurality of direction ranges in a first direction selection interface in turn, when receiving a starting active interaction electroencephalogram signal of the user through the electroencephalogram electrode array;

determining a currently highlighted direction range as a direction range specified by the user, when receiving a determination electroencephalogram signal of the user through the electroencephalogram electrode array;

invoking the display apparatus to highlight a plurality of angular directions in a second direction selection interface in turn;

determining a currently highlighted angular direction as an angular direction specified by the user, when receiving a determination electroencephalogram signal of the user through the electroencephalogram electrode array;

invoking the display apparatus to display the interaction information inputting interface; and

invoking at least one speaker corresponding to the angular direction specified by the user to output a sound based on the interaction content electroencephalogram signal, when receiving the interaction content electroencephalogram signal fed back by the user with respect to guiding of the interaction information inputting interface, through the electroencephalogram electrode array.

12. An interaction device comprising,

a sound source position determining component for determining a distance between a sound source and each of a plurality of micro microphones of a micro microphone array based on intensities of audio signals of the sound source output by the micro microphones, and determining a position of the sound source based on the distance between the sound source and each of the micro microphones;

an electroencephalogram electrode determining component for determining an electroencephalogram electrode of an electroencephalogram electrode array corresponding to the position of the sound source; and

a signal outputting component for invoking the electroencephalogram electrode corresponding to the position of the sound source to output a touch signal.

13. The interaction device according to claim 12 , wherein the signal outputting component is further used for invoking a display apparatus to correspondingly display the position of the sound source determined by the sound source position determining component.

14. The interaction device according to claim 13 , further comprising,

a sound outputting component for obtaining an interaction content electroencephalogram signal of the user and a direction specified by the user through the electroencephalogram electrode array; and invoking at least one speaker of a speaker array corresponding to the direction to output a sound based on the interaction content electroencephalogram signal.

15. The interaction device according to claim 14 , wherein the sound outputting component is specifically used for,

invoking the display apparatus to highlight a plurality of direction ranges in a first direction selection interface in turn, when receiving a starting active interaction electroencephalogram signal of the user through the electroencephalogram electrode array;

determining a currently highlighted direction range as a direction range specified by the user, when receiving a determination electroencephalogram signal of the user through the electroencephalogram electrode array;

invoking the display apparatus to display an interaction information inputting interface; and

invoking at least one speaker corresponding to the direction range specified by the user to output a sound based on the interaction content electroencephalogram signal, when receiving the interaction content electroencephalogram signal fed back by the user with respect to guiding of the interaction information inputting interface, through the electroencephalogram electrode array.

16. The interaction device according to claim 14 , wherein the sound outputting component is specifically used for,

invoking the display apparatus to highlight a plurality of direction ranges in a first direction selection interface in turn, when receiving a starting active interaction electroencephalogram signal of the user through the electroencephalogram electrode array;

determining a currently highlighted direction range as a direction range specified by the user, when receiving a determination electroencephalogram signal of the user through the electroencephalogram electrode array;

invoking the display apparatus to highlight a plurality of angular directions in a second direction selection interface in turn;

determining a currently highlighted angular direction as a angular direction specified by the user, when receiving a determination electroencephalogram signal of the user through the electroencephalogram electrode array;

invoking the display apparatus to display the interaction information inputting interface; and

invoking at least one speaker corresponding to the angular direction specified by the user to output a sound based on the interaction content electroencephalogram signal, when receiving the interaction content electroencephalogram signal fed back by the user with respect guiding of the interaction information inputting interface, through the electroencephalogram electrode array.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2019
From: ZHU, LIN
To: BOE TECHNOLOGY GROUP CO., LTD.
Reel/Frame 048344/0869 →
Priority Claims (1)
CN 201710312121.3 · May 5, 2017 · national
Continuity (1)
Related Publication 20230186786A1 · Jun 15, 2023