IP Library Granted Patent US 9,143,880
Granted Patent B2
US 9,143,880 · App. 14/467,944 · Granted Sep 22, 2015

Systems and methods for providing audio to a user based on gaze input

Inventors: Anders Vennström (Stockholm, SE); Fredrik Lindh (Solna, SE)
Assignee: TOBII AB
H04S7/307G06F3/013G06F3/167H04S2400/01H04S2400/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,143,880
App. No.
14/467,944
Granted
Sep 22, 2015
Kind
B2
Abstract

According to the invention, a method for providing audio to a user is disclosed. The method may include determining, with an eye tracking device, a gaze point of a user on a display. The method may also include causing, with a computer system, an audio device to produce audio to the user, where content of the audio may be based at least in part on the gaze point of the user on the display.

Claims (86)

1. A method for providing audio to a user, wherein the method comprises:

determining a gaze point of a user on a display;

determining how many sound channels are produced by an audio device;

determining a particular area of the display which is associated with each sound channel determined to be produced by the audio device;

causing the audio device to produce audio to the user, wherein content of the audio is based at least in part on the gaze point of the user on the display;

determining head information associated with the user;

wherein content of the audio is further based at least in part on the head information associated with the user; and

wherein content of the audio being based at least in part on the gaze point comprises a sound channel associated with the particular area in which the gaze point of the user is located.

2. The method for providing audio to a user of claim 1 , wherein the content of the audio being based at least in part on the gaze point comprises:

audio content associated with a particular area of the display in which the gaze point of the user is located, wherein the particular area is a sub-portion of a total area of the display.

3. The method for providing audio to a user of claim 2 , wherein the content of the audio being based at least in part on the gaze point further comprises:

no audio content associated with a remainder of the display besides the particular area.

4. The method for providing audio to a user of claim 1 , wherein the content of the audio being based at least in part on the gaze point comprises:

audio content associated with a particular area of the display in which the gaze point of the user is located, at a first volume, wherein the particular area is a sub-portion of a total area of the display; and

audio content associated with a remainder of the display besides the particular area, at a second volume, wherein the first volume is greater than the second volume.

5. The method for providing audio to a user of claim 1 , wherein determining how many sound channels are produced by the audio device comprises:

determining how many simulated sound channels are produced by the audio device.

6. The method for providing audio to a user of claim 1 , wherein the content of the audio being based at least in part on the gaze point further comprises:

no audio content associated with at least one sound channel not associated with the particular area in which the gaze point of the user is located.

7. The method for providing audio to a user of claim 6 , wherein at least one sound channel not associated with the particular area in which the gaze point of the user is located comprises:

all sound channels not associated with the particular area in which the gaze point of the user is located.

8. The method for providing audio to a user of claim 1 , wherein the method further comprises:

the sound channel associated with the particular area in which the gaze point of the user is located, at a first volume; and

at least one sound channel not associated with the particular area in which the gaze point of the user is located, at a second volume, wherein the first volume is greater than the second volume.

9. The method for providing audio to a user of claim 8 , wherein at least one sound channel not associated with the particular area in which the gaze point of the user is located comprises:

all sound channels not associated with the particular area in which the gaze point of the user is located.

10. The method for providing audio to a user of claim 1 , wherein the method further comprises:

determining a virtual distance and direction from each of a plurality of virtual sound sources to the gaze point of the user on the display; and

wherein the content of the audio being based at least in part on the gaze point comprises:

each virtual sound source being produced in a manner based at least in part on the virtual distance and direction from the virtual sound source to the gaze point of the user.

11. The method for providing audio to a user of claim 10 , wherein each virtual sound source being produced in a manner based at least in part on the virtual distance and direction from the virtual sound source to the gaze point of the user comprises:

reproducing multiple audio sources at multiple dynamic volumes.

12. The method for performing audio to a user of claim 1 , wherein causing the audio device to produce audio to the user comprises:

modifying the audio produced based upon the gaze point remaining fixated for at least a predetermined threshold of time.

13. A system for providing audio to a user, wherein the system comprises:

an eye tracking device for at least determining a gaze point of a user on a display;

a computer system for at least:

causing an audio device to produce audio to the user, wherein content of the audio is based at least in part on the gaze point of the user on the display;

determining how many sound channels are produced by the audio device;

determining a particular area of the display which is associated with each sound channel determined to be produced by the audio device; and

wherein the content of the audio being based at least in part on the gaze point comprises:

at least a first frequency of sound on a first sound channel associated with the particular area in which the gaze point of the user is located; and

at least a second frequency of sound on a second channel not associated with the particular area in which the gaze point of the user is located.

14. The system for providing audio to a user of claim 13 , wherein the computer system is further for at least:

determining how many sound channels are produced by the audio device;

determining a particular area of the display which is associated with each sound channel determined to be produced by the audio device; and

wherein the content of the audio being based at least in part on the gaze point comprises a sound channel associated with the particular area in which the gaze point of the user is located.

15. The system for providing audio to a user of claim 13 , wherein the computer system is further for at least:

determining a virtual distance and direction from each of a plurality of virtual sound sources to the gaze point of the user on the display; and

wherein the content of the audio being based at least in part on the gaze point comprises:

each virtual sound source being produced in a manner based at least in part on the virtual distance and direction from the virtual sound source to the gaze point of the user.

16. A non-transitory machine readable medium with instructions stored thereon for providing audio to a user, the instructions executable by at least one processor for at least:

determining a gaze point of a user on a display;

determining how many sound channels are produced by an audio device;

determining a particular area of the display which is associated with each sound channel determined to be produced by the audio device;

causing an audio device to produce audio to the user, wherein content of the audio is based at least in part on the gaze point of the user on the display;

determining a virtual distance and direction from each of a plurality of virtual sound sources to the gaze point of the user on the display; and

wherein the content of the audio being based at least in part on the gaze point comprises:

each virtual sound source being produced in a manner based at least in part on the virtual distance and direction from the virtual sound source to the gaze point of the user; and

a sound channel associated with the particular area in which the gaze point of the user is located.

17. A non-transitory machine readable medium with instructions stored thereon for providing audio to a user, the instructions executable by at least one processor for at least:

determining a gaze point of a user on a display;

causing an audio device to produce audio to the user, wherein content of the audio is based at least in part on the gaze point of the user on the display;

determining how many sound channels are produced by the audio device;

determining a particular area of the display which is associated with each sound channel determined to be produced by the audio device; and

wherein the content of the audio being based at least in part on the gaze point comprises a sound channel associated with the particular area in which the gaze point of the user is located.

18. A method for providing audio to a user, wherein the method comprises:

determining a gaze point of a user on a display;

determining how many sound channels are produced by an audio device;

determining a particular area of the display which is associated with each sound channel determined to be produced by the audio device;

causing the audio device to produce audio to the user, wherein content of the audio is based at least in part on the gaze point of the user on the display;

determining head information associated with the user;

wherein content of the audio is further based at least in part on the head information associated with the user; and

wherein content of the audio being based at least in part on the gaze point comprises:

at least a first frequency of sound on a first sound channel associated with the particular area in which the gaze point of the user is located; and

at least a second frequency of sound on a second channel not associated with the particular area in which the gaze point of the user is located.

19. A non-transitory machine readable medium with instructions stored thereon for providing audio to a user, the instructions executable by at least one processor for at least:

determining a gaze point of a user on a display;

determining how many sound channels are produced by an audio device;

determining a particular area of the display which is associated with each sound channel determined to be produced by the audio device;

causing an audio device to produce audio to the user, wherein content of the audio is based at least in part on the gaze point of the user on the display;

determining a virtual distance and direction from each of a plurality of virtual sound sources to the gaze point of the user on the display; and

wherein the content of the audio being based at least in part on the gaze point comprises:

each virtual sound source being produced in a manner based at least in part on the virtual distance and direction from the virtual sound source to the gaze point of the user;

at least a first frequency of sound on a first sound channel associated with the particular area in which the gaze point of the user is located; and

at least a second frequency of sound on a second channel not associated with the particular area in which the gaze point of the user is located.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 1, 2015
From: VENNSTRÖM, ANDERS; LINDH, FREDRIK
To: TOBII AB
Reel/Frame 036001/0229 →
Continuity (2)
Provisional Application 61869501 · Aug 23, 2013
Related Publication 20150055808A1 · Feb 26, 2015