IP Library Granted Patent US 12,721,545
Granted Patent B2
US 12,721,545 · App. 18/731,613 · Granted Sep 1, 2026

Alertness determination for non-alert detection using ear-worn electronic devices

Inventors: Justin R. Burwinkel (Eden Prairie, MN); Kyle Olson (St. Louis Park, MN); Jeffrey Paul Solum (Greenwood, MN); Yoshi Kasahara (Chaska, MN); Gregory J. Haubrich (Champlin, MN); Christine Tan (Eden Prairie, MN)
Assignee: Starkey Laboratories, Inc.
A61B5/11A61B5/01A61B5/0816A61B5/162A61B5/163A61B5/165A61B5/18A61B5/398A61B5/4845A61B5/6817A61B5/7405A61B5/742A61B5/7455B60W40/08B60W60/0051G16H20/30G16H40/67A61B2503/22A61B2503/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,721,545
App. No.
18/731,613
Granted
Sep 1, 2026
Kind
B2
Abstract

Techniques to detect a non-alert state of a user may include receiving sensor data from an ear-worn electronic device disposed at least partially in the ear of a user, determining an alertness state of the user based on the sensor data, and providing alert data in response to the alertness state comprising a non-alert state to a user stimulation interface of the ear-worn electronic device or to an external device.

Claims (41)

1 . A method, comprising:

receiving sensor data from an ear-worn electronic device disposed at least partially in the ear of a user, the sensor data comprising sound data from at least one microphone of the ear-worn electronic device;

determining a reaction speed of the user based at least in part on the sound data;

determining an alertness state of the user is a non-alert state based on at least determining the reaction speed does not satisfy a threshold reaction speed; and

in response to determining the alertness state of the user is the non-alert state, providing alert data to a user stimulation interface of the ear-worn electronic device or to an external device.

2 . The method according to claim 1 , wherein the sensor data comprises one or both of:

motion data indicating a head position of the user; and

motion data indicating head movements of the user.

3 . The method according to claim 1 , wherein the sensor data comprises physiological data including one or more of:

data indicating a respiration rate of the user;

data indicating surprise of the user;

data indicating a temperature of the user;

data indicating physiological electrical signals of the user indicative of eye gaze; and

data indicating head motion or position of the user.

4 . The method according to claim 1 , wherein the sensor data comprises one or both of:

data indicating a reaction speed of the user; and

emotional state data.

5 . The method according to claim 1 , further comprising determining the alertness state of the user further based on external sensor data.

6 . The method according to claim 5 , wherein the external sensor data comprises motion data from at least one motion sensor indicating arm movements of the user.

7 . The method according to claim 5 , wherein the external sensor data comprises visual data from at least one optical sensor comprising eye gaze data of the user.

8 . The method according to claim 7 , wherein the external sensor data comprises driving data, the method further comprising determining a user operation adherence level based on the driving data.

9 . The method according to claim 5 , wherein the external sensor data comprises chemical sensor data indicating an impairment level.

10 . The method according to claim 1 , further comprising receiving support animal data indicating a reaction of a support animal of the user.

11 . The method according to claim 1 , further comprising:

determining a driver error score based on a current driver score to a predetermined baseline driver score; and

determining an alertness state of the user further based on the driver error score.

12 . The method according to claim 1 , further comprising updating a model to determine the alertness state of the user based on historical user data to reduce false positive indications of non-alert states.

13 . The method according to claim 1 , further comprising providing the alert data to an external device to activate an autonomous or semi-autonomous operational mode of a machine being operated by the user.

14 . The method according to claim 1 , wherein a user-perceptible alert is provided in response to the alert data comprising one of more of the following: an audible alert, a haptic alert, an electrical stimulation alert, and a visual alert.

15 . The method according to claim 1 , wherein the sound data comprises sound produced by a vehicle operated by the user running over a rumble strip.

16 . The method according to claim 1 , wherein the sensor data comprises data indicative of the user's circadian rhythm, and the alertness state of the user is determined based on the circadian rhythm data.

17 . The method according to claim 1 , further comprising outputting an audible sound and detecting an audible response of the user, wherein the sound data includes the audible response of the user.

18 . The method according to claim 1 , further comprising detecting the start of a sound and determining an amount of time from the start of the sound until the sound stops, wherein determining the reaction speed is further based on the amount of time from the start of the sound until the sound stops.

19 . A method, comprising:

receiving sensor data from an ear-worn electronic device disposed at least partially in the ear of a user, the sensor data comprising sound data from at least one microphone of the ear-worn electronic device, the sensor data further comprising motion data from a motion sensor of the ear-worn electronic device;

determining a reaction speed of the user based at least in part on the sound data and the motion data;

determining an alertness state of the user is a non-alert state based on determining the reaction speed does not satisfy a threshold reaction speed; and

in response to determining the alertness state of the user is the non-alert state, providing alert data to a user stimulation interface of the ear-worn electronic device or to an external device.

20 . The method according to claim 19 , wherein the motion data is indicative of one or both of head position of the user and head movements of the user.

21 . The method according to claim 19 , wherein the sound data comprises sound produced by a vehicle operated by the user running over a rumble strip.

22 . The method according to claim 19 , wherein the sensor data comprises data indicative of the user's circadian rhythm, and the alertness state of the user is determined based on the circadian rhythm data.

Continuity (3)
Division 17206342 · Mar 19, 2021
Provisional Application 62992325 · Mar 20, 2020
Related Publication 20240315598A1 · Sep 26, 2024
References Cited (50)
US 6920229B2 · Boesen · 2005 [cited by applicant]
US 7532964B2 · Fujita et al. · 2009 [cited by applicant]
US 7650004B2 · Durant · 2010 [cited by applicant]
US 8022831B1 · Wood-Eyre · 2011 [cited by applicant]
US 8355794B2 · Lineaweaver et al. · 2013 [cited by applicant]
US 8487775B2 · Victor et al. · 2013 [cited by applicant]
US 8652040B2 · LeBoeuf · 2014 [cited by examiner]
US 9007220B2 · Johns · 2015 [cited by examiner]
US 9142130B1 · Dukish · 2015 [cited by examiner]
US 9260013B2 · Kume et al. · 2016 [cited by applicant]
US 9579060B1 · Lisy · 2017 [cited by examiner]
US 9763614B2 · Geller · 2017 [cited by examiner]
US 9838771B1 · Masaki · 2017 [cited by examiner]
US 10045130B2 · Masaki · 2018 [cited by examiner]
US 10081317B2 · Naboulsi · 2018 [cited by applicant]
US 10342482B1 · Lisy · 2019 [cited by examiner]
US 10799122B2 · Tzvieli · 2020 [cited by examiner]
US 10874346B1 · Lisy · 2020 [cited by examiner]
US 10898133B1 · Lisy · 2021 [cited by examiner]
US 11170240B2 · Ardelean · 2021 [cited by examiner]
US 11298064B1 · Lisy · 2022 [cited by examiner]
US 11338106B2 · Fabry · 2022 [cited by examiner]
US 20010028309A1 · Torch · 2001 [cited by examiner]
US 20060011144A1 · Kates · 2006 [cited by examiner]
US 20060214807A1 · Tengshe · 2006 [cited by examiner]
US 20100280338A1 · Chou · 2010 [cited by examiner]
US 20120197093A1 · LeBoeuf · 2012 [cited by examiner]
US 20120293773A1 · Publicover · 2012 [cited by examiner]
US 20140058220A1 · LeBoeuf · 2014 [cited by examiner]
US 20150363657A1 · Shigemura · 2015 [cited by examiner]
US 20160014497A1 · Chizi · 2016 [cited by examiner]
US 20160119726A1 · Pontoppidan · 2016 [cited by applicant]
US 20170265798A1 · Sales · 2017 [cited by examiner]
US 20170313190A1 · Shimada · 2017 [cited by examiner]
US 20170347177A1 · Masaki · 2017 [cited by examiner]
US 20170347178A1 · Masaki · 2017 [cited by examiner]
US 20170347179A1 · Masaki · 2017 [cited by examiner]
US 20180009442A1 · Spasojevic · 2018 [cited by examiner]
US 20180242859A1 · LeBoeuf · 2018 [cited by examiner]
US 20180268695A1 · Agnew · 2018 [cited by examiner]
US 20190121356A1 · Migneco · 2019 [cited by examiner]
US 20190366844A1 · Yoon · 2019 [cited by examiner]
US 20200085312A1 · Tzvieli · 2020 [cited by examiner]
US 20200112755A1 · Seshadri · 2020 [cited by examiner]
US 20200218914A1 · Ardelean · 2020 [cited by examiner]
US 20210290135A1 · Burwinkel · 2021 [cited by examiner]
US 20240315598A1 · Burwinkel · 2024 [cited by examiner]
EP 2071875 · 2009 [cited by applicant]
JP 4980988 · 2012 [cited by applicant]
KR 2020170004127 · 2017 [cited by applicant]