IP Library Granted Patent US 9,585,581
Granted Patent B1
US 9,585,581 · App. 14/870,900 · Granted Mar 7, 2017

Real-time biometric detection of oscillatory phenomena and voltage events

Inventors: Brian Mullins (Sierra Madre, CA); Teresa Ann Nick (Woodland Hills, CA); Laura Berman (Venice, CA); Arye Barnehama (Venice, CA); Eric Douglas Lundquist (Los Angeles, CA)
Assignee: DAQRI, LLC
A61B5/04012A61B5/0478A61B5/6803A61B5/7257
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,585,581
App. No.
14/870,900
Granted
Mar 7, 2017
Kind
B1
Abstract

A system and method for identifying changes in a state or activity is described. A real-time event monitoring application, implemented in a hardware processor, computes features over varying sampling periods, which are stored in cascading buffers. The various sampling periods enable determination of trends of a computed feature, comparison of the trends of the computed feature with trends of other features, normalization of the computed feature based on the same or different features at the same or different time scales, scaling of the normalized computed feature relative to other features at the same or different time scale, and identification of a change in state or activity based on a scaled normalized computed feature.

Claims (48)

1. A method comprising:

detecting biometric data representing different types of waves using at least two electrodes configured to be connected to a user;

computing, using a hardware processor, features of the biometric data over a plurality of sampling periods;

forming a cascading buffer based on the plurality of sampling periods from the computed features of the biometric data;

dynamically monitoring shifting baselines of the computed features over the plurality of sampling periods in the cascading buffer; and

identifying a change in the state of the user based on shifting baselines in the cascading buffer.

2. The method of claim 1 , wherein the biometric data include oscillatory brain wave data, the different types of waves including an alpha type of wave, a beta type of wave, a delta type of wave, a theta type of wave, a slow-wave type of wave, a gamma type of wave, and a high-gamma type of wave, the slow-type of wave having a frequency less than 1 Hz.

3. The method of claim 1 , wherein the sampling periods include varying sampling periods.

4. The method of claim 1 , further comprising:

identifying the change in the state of the user over successively longer sampling periods.

5. The method of claim 1 , further comprising:

filtering the biometric data to attenuate electrical interference;

applying a Fourier transform operation on the filtered biometric data over a sliding window of the plurality of sampling periods; and

computing a variability metric over the plurality of sampling periods based on an output of the Fourier transform operation.

6. The method of claim 1 , further comprising:

disposing the at least two electrodes in a head mounted device.

7. The method of claim 6 , further comprising:

capturing a reference identifier from a physical object with a camera in the head mounted device;

identifying a virtual object associated with the reference identifier;

displaying the virtual object in a display of the head mounted device; and

in response to a relative movement between the head mounted device and the physical object caused by a user, modifying the virtual object based on the change in the state of the user of the head mounted device.

8. A server comprising:

a processor; and

a memory storing instructions that, when executed by the processor, configure the server to:

detect biometric data representing different types of waves using at least two electrodes configured to be connected to a user;

compute, using a hardware processor, features of the biometric data over a plurality of sampling periods;

form a cascading buffer based on the plurality of sampling periods from the computed features of the biometric data;

dynamically monitor shifting baselines of the computed features over the plurality of sampling periods in the cascading buffer; and

identify a change in the state of the user based on shifting baselines in the cascading buffer.

9. The server of claim 8 , wherein the biometric data include oscillatory brain wave data, the different types of waves including an alpha type of wave, a beta type of wave, a delta type of wave, a theta type of wave, a slow-wave type of wave, a gamma type of wave, and a high-gamma type of wave, the slow-wave type of wave having a frequency less than 1 Hz.

10. The server of claim 8 , wherein the sampling periods include vary varying sampling periods.

11. The server of claim 8 , wherein the instructions further configure the server to:

identify the change in the state of the user over successively longer sampling periods.

12. The server of claim 8 , wherein the instructions further configure the server to:

filter the biometric data to attenuate electrical interference;

apply a Fourier transform operation on the filtered biometric data over a sliding window of the plurality of sampling periods; and

compute a variability metric over the plurality of sampling periods based on an output of the Fourier transform operation.

13. The server of claim 8 , wherein the instructions further configure the server to:

capture a reference identifier from a physical object with a camera in a head mounted device;

identify a virtual object associated with the reference identifier;

display the virtual object in a display of the head mounted device; and

in response to a relative movement between the head mounted device and the physical object caused by a user, modify the virtual object based on the change in the state of the user of the head mounted device.

14. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to:

detect biometric data representing different types of waves using at least two electrodes configured to be connected to a user;

compute, using a hardware processor, features of the biometric data over a plurality of sampling periods;

form a cascading buffer based on the plurality of sampling periods from the computed features of the biometric data;

dynamically monitor shifting baselines of the computed features over the plurality of sampling periods in the cascading buffer; and

identify a change in the state of the user based on shifting baselines in the cascading buffer.

Assignments (12)
CHANGE OF NAME Recorded Aug 3, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060936/0494 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 2, 2021
From: RPX CORPORATION
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 056777/0588 →
RELEASE OF SECURITY INTEREST Recorded Oct 26, 2020
From: JEFFERIES FINANCE LLC
To: RPX CORPORATION
Reel/Frame 054486/0422 →
PATENT SECURITY AGREEMENT Recorded Oct 23, 2020
From: RPX CLEARINGHOUSE LLC; RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 054198/0029 →
PATENT SECURITY AGREEMENT Recorded Oct 23, 2020
From: RPX CLEARINGHOUSE LLC; RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 054244/0566 →
RELEASE OF SECURITY INTEREST Recorded Aug 14, 2020
From: AR HOLDINGS I, LLC
To: DAQRI, LLC
Reel/Frame 053498/0580 →
PATENT SECURITY AGREEMENT Recorded Aug 14, 2020
From: RPX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 053498/0095 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2020
From: DAQRI, LLC
To: RPX CORPORATION
Reel/Frame 053413/0642 →
RELEASE OF SECURITY INTEREST Recorded Oct 23, 2019
From: SCHWEGMAN, LUNDBERG & WOESSNER, P.A.
To: DAQRI, LLC
Reel/Frame 050805/0606 →
LIEN Recorded Oct 8, 2019
From: DAQRI, LLC
To: SCHWEGMAN, LUNDBERG & WOESSNER, P.A.
Reel/Frame 050672/0601 →
SECURITY INTEREST Recorded Jun 26, 2019
From: DAQRI, LLC
To: AR HOLDINGS I LLC
Reel/Frame 049596/0965 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 18, 2016
From: MULLINS, BRIAN; NICK, TERESA ANN; BERMAN, LAURA; BARNEHAMA, ARYE; LUNDQUIST, ERIC DOUGLAS
To: DAQRI, LLC
Reel/Frame 039476/0489 →