IP Library › Granted Patent US 11,755,277
Granted Patent B2
US 11,755,277 · App. 17/090,787 · Granted Sep 12, 2023

Daydream-aware information recovery system

Inventors: Joseph Verbeke (San Francisco, CA); Stefan Marti (Oakland, CA)
Assignee: Harman International Industries, Incorporated
G06F3/165A61B5/0059A61B5/01A61B5/0531A61B5/1126A61B5/163A61B5/165A61B5/369A61B5/6803G10L15/22G10L15/26G10L21/043G10L25/51G10L25/78A61B2562/0219H04R1/1008H04R1/1016H04R1/1041
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,755,277
App. No.
17/090,787
Granted
Sep 12, 2023
Kind
B2
Abstract

A system includes a sensing module configured to collect physiological information from a user; an audio input device configured to capture auditory content that is in an environment proximate the user; and one or more processors configured to: determine that a user has entered a state of inwardly focused attention based on first physiological information collected from the user; and in response, record the auditory content captured by the audio input device.

Claims (46)

1. A system, comprising:

a sensing module configured to collect physiological information from a user;

an audio input device configured to capture auditory content that is in an environment proximate the user; and

one or more processors configured to:

determine there is audible speech content in the auditory content,

determine that the user has entered a daydreaming state based on first physiological information collected from the user; and

in response to determining that the user has entered the daydreaming state and that there is audible speech content in the auditory content, record the auditory content captured by the audio input device.

2. The system of claim 1 , wherein:

the system further comprises an audio output device configured to deliver the recorded auditory content to the user; and

the one or more processors are further configured to:

determine that the user has exited the daydreaming state based on second physiological information collected from the user; and

cause the audio output device to playback the recorded auditory content to the user.

3. The system of claim 2 , further comprising a head-worn component, wherein the audio output device is disposed in the head-worn component.

4. The system of claim 1 , wherein the one or more processors are further configured to modify the recorded auditory content after recording.

5. The system of claim 1 , wherein the one or more processors are further configured to modify the captured auditory content by changing the captured auditory content to a different modality of content.

6. The system of claim 1 , wherein the one or more processors are further configured to change speed of playback of the recorded auditory content based on a duration of a time interval during which the auditory content is recorded.

7. The system of claim 1 , wherein the sensing module is configured to collect physiological information from a group consisting of an electroencephalographic measurement, an electrodermal activity measurement, a skin temperature measurement, a pupillometry measurement, a reflective photosensing measurement, and an inertial measurement unit.

8. The system of claim 1 , further comprising a head-worn component, wherein at least one sensor of the sensing module is disposed in the head-worn component.

9. A method, comprising:

collecting first physiological information with a sensor included in a head-worn device that is worn by a user;

capturing auditory content that is in an environment proximate the user via an audio input device included in the head-worn device;

determining there is audible speech content in the auditory content;

determining that the user has entered a daydreaming state based on the first physiological information; and

in response to determining that the user has entered the daydreaming state and that there is audible speech content in the auditory content, recording the auditory content captured by the audio input device.

10. The method of claim 9 , further comprising:

determining that the user has exited the daydreaming state based on second physiological information collected from the user with the sensor; and

causing an audio output device included in the head-worn device to playback the recorded auditory content to the user.

11. The method of claim 10 , wherein the audio output device is further configured to playback the recorded auditory content to the user privately.

12. The method of claim 10 , further comprising modifying the recorded auditory content.

13. The method of claim 12 , further comprising modifying the captured auditory content by changing the captured auditory content to a different modality of content.

14. The method of claim 13 , wherein the different modality of content comprises at least one of:

a text-based message for transmission to a computing device associated with the user,

an audio message for transmission to the computing device, or

an audio message for playback to the user that is based on a text-based message generated from the captured auditory content.

15. The method of claim 14 , further comprising transmitting at least one of the text-based message to the computing device or the audio message to the computing device.

16. The method of claim 9 , further comprising changing a speed of playback of the recorded auditory content based on a duration of a time interval during which the auditory content is recorded.

17. One or more non-transitory computer readable media storing instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:

collecting first physiological information with a sensor included in a head-worn device that is worn by a user;

capturing auditory content that is in an environment proximate the user via an audio input device included in the head-worn device;

determining there is audible speech content in the auditory content;

determining that the user has entered a daydreaming state based on the first physiological information; and

in response to determining that the user has entered the daydreaming state and that there is audible speech content in the auditory content, recording the auditory content captured by the audio input device.

18. The one or more non-transitory computer readable media of claim 17 , wherein:

determining that the user has exited the daydreaming state based on second physiological information collected from the user with the sensor; and

causing an audio output device included in the head-worn device to playback the recorded auditory content to the user.

19. The one or more non-transitory computer readable media of claim 17 , wherein the instructions, when executed by the one or more processors, cause the one or more processors to perform the step of modifying the recorded auditory content after recording.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 21, 2021
From: VERBEKE, JOSEPH; MARTI, STEFAN
To: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
Reel/Frame 054988/0718 →
Continuity (1)
Related Publication 20220137915A1 · May 5, 2022
Cited By (1)
US 12,471,846