IP Library Granted Patent US 11,452,477
Granted Patent B2
US 11,452,477 · App. 17/078,889 · Granted Sep 27, 2022

Electrogram annotation system

Inventors: Walter Blume (Edwardville, IL); Michael K. Southworth (St. Louis, MO); Jonathan R. Silva (St. Louis, MO); Jennifer N. Avari Silva (St. Louis, MO); Ignacio Soriano (Madrid, ES)
Assignee: SentiAR, Inc.
A61B5/339A61B5/066A61B5/163A61B5/349A61B5/7203A61B5/749G06F3/011G06F3/013G06F3/017G06T11/60G10L15/22G16H40/63G16H50/20A61B5/7267A61B2090/502G06T2210/41G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,452,477
App. No.
17/078,889
Granted
Sep 27, 2022
Kind
B2
Abstract

In an embodiment, an electrogram (EGM) processing system provides, for display by a head-mounted display (HMD) worn by a user, a holographic rendering of intracardiac geometry. The HMD also displays an electrogram waveform. The EGM processing system determines a gaze direction of the user by processing sensor data from the HMD. The HMD displays a marker overlaid on the electrogram waveform at a location based on an intersection point between the gaze direction and the electrogram waveform. The EGM processing system determines a measurement of the electrogram waveform using the location of the marker. The HMD displays the measurement of the electrogram waveform.

Claims (74)

1. A system comprising:

a head-mounted display (HMD) worn by a user; and

a non-transitory computer-readable storage medium storing instructions, the instructions when executed by one or more processors cause the one or more processors to:

provide, for display by the HMD, a holographic rendering of intracardiac geometry including position of a catheter;

provide, for display by the HMD, an electrogram waveform generated using data collected from the catheter, wherein the electrogram waveform is displayed adjacent to the holographic rendering;

determine a gaze direction of the user by processing sensor data from the HMD;

provide, for display by the HMD, a marker overlaid on the electrogram waveform at a location based on an intersection point between the gaze direction and the electrogram waveform;

determine a first position of a first measurement graphic by tracking the location of the marker;

determine a second position of a second measurement graphic by tracking the location of the marker;

determine a measurement of the electrogram waveform based on a distance between the first position and the second position; and

provide, for display by the HMD, the measurement of the electrogram waveform adjacent to the electrogram waveform.

2. The system of claim 1 , wherein the non-transitory computer-readable storage medium stores further instructions that when executed by the one or more processors cause the one or more processors to:

determine a feature of the electrogram waveform; and

responsive to determining that the first position of the first measurement graphic is within a threshold distance from a position of the feature of the electrogram waveform, determine the first position of the first measurement graphic as the position of the feature of the electrogram waveform.

3. The system of claim 2 , wherein the non-transitory computer-readable storage medium stores further instructions that when executed by the one or more processors cause the one or more processors to:

determine the feature of the electrogram waveform using a model trained using training data labeled by an electrophysiologist to generate candidate features of interest for heartbeat data.

4. The system of claim 1 , wherein the non-transitory computer-readable storage medium stores further instructions that when executed by the one or more processors cause the one or more processors to:

determine a command by processing an audio input from the user; and

update the first position of the first measurement graphic based on the command.

5. The system of claim 1 , wherein determine the gaze direction of the user by processing sensor data from the HMD comprises:

determine head tracking information using the sensor data;

determine eye tracking information using the sensor data; and

determine that the head tracking information is consistent with the eye tracking information.

6. A method comprising:

providing, for display by a head-mounted display (HMD) worn by a user, a holographic rendering of intracardiac geometry including position of a catheter;

providing, for display by the HMD, an electrogram waveform generated using data collected from the catheter, wherein the electrogram waveform is displayed adjacent to the holographic rendering;

determining a gaze direction of the user by processing sensor data from the HMD;

providing, for display by the HMD, a marker overlaid on the electrogram waveform at a location based on an intersection point between the gaze direction and the electrogram waveform;

determining a first position of a first measurement graphic by tracking the location of the marker;

determining a second position of a second measurement graphic by tracking the location of the marker,

determining a measurement of the electrogram waveform based on a distance between the first position and the second position; and

providing, for display by the HMD, the measurement of the electrogram waveform adjacent to the electrogram waveform.

7. The method of claim 6 , further comprising:

determining a feature of the electrogram waveform; and

responsive to determining that the first position of the first measurement graphic is within a threshold distance from a position of the feature of the electrogram waveform, determining the first position of the first measurement graphic as the position of the feature of the electrogram waveform.

8. The method of claim 7 , further comprising:

determining the feature of the electrogram waveform using a model trained using training data labeled by an electrophysiologist to generate candidate features of interest for heartbeat data.

9. The method of claim 7 , wherein determining the feature of the electrogram waveform comprises:

filtering noise of the electrogram waveform using independent component analysis.

10. The method of claim 7 , wherein the feature of the electrogram waveform is a peak or inflection of the electrogram waveform.

11. The method of claim 6 , further comprising:

determining a command by processing an audio input from the user; and

updating the first position of the first measurement graphic based on the command.

12. The method of claim 6 , further comprising:

determining proximity between the location of the marker and a target location of the electrogram waveform; and

providing audio feedback at a frequency according to the proximity.

13. The method of claim 12 , further comprising:

determining the target location of the electrogram waveform based on a point of activation of a heartbeat signal in the electrogram waveform.

14. The method of claim 6 , wherein determining the gaze direction of the user by processing sensor data from the HMD comprises:

determining head tracking information using the sensor data;

determining eye tracking information using the sensor data; and

determining that the head tracking information is consistent with the eye tracking information.

15. The method of claim 6 , further comprising:

determining a position of a first surface of an electronic display; and

wherein the holographic rendering of intracardiac geometry and the electrogram waveform are displayed by the HMD on a second surface offset from the first surface.

16. The method of claim 6 , further comprising:

determining a gesture indicating an interaction by the user with the electrogram waveform, wherein the measurement of the electrogram waveform is further determined using the gesture.

17. A non-transitory computer-readable storage medium storing instructions, the instructions when executed by one or more processors cause the one or more processors to:

provide, for display by a head-mounted display (HMD) worn by a user, a holographic rendering of intracardiac geometry including position of a catheter;

provide, for display by the HMD, an electrogram waveform generated using data collected from the catheter, wherein the electrogram waveform is displayed adjacent to the holographic rendering;

determine a gaze direction of the user by processing sensor data from the HMD;

provide, for display by the HMD, a marker overlaid on the electrogram waveform at a location based on an intersection point between the gaze direction and the electrogram waveform;

determine a first position of a first measurement graphic by tracking the location of the marker;

determine a second position of a second measurement graphic by tracking the location of the marker,

determine a measurement of the electrogram waveform based on a distance between the first position and the second position; and

provide, for display by the HMD, the measurement of the electrogram waveform adjacent to the electrogram waveform.

18. A method comprising:

providing, for display by a head-mounted display (HMD) worn by a user, a holographic rendering of intracardiac geometry including position of a catheter;

providing, for display by the HMD, an electrogram waveform generated using data collected from the catheter, wherein the electrogram waveform is displayed adjacent to the holographic rendering;

determining a gesture indicating an interaction by the user with the electrogram waveform to control a location of a marker;

determining a first position of a first measurement graphic by tracking the location of the marker;

determining a second position of a second measurement graphic by tracking the location of the marker;

determining a measurement of the electrogram waveform based on a distance between the first position and the second position; and

providing, for display by the HMD, the measurement of the electrogram waveform adjacent to the electrogram waveform.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 15, 2021
From: BLUME, WALTER; SOUTHWORTH, MICHAEL K.; SILVA, JONATHAN R.; SILVA, JENNIFER N. AVARI; SORIANO, IGNACIO
To: SENTIAR, INC.
Reel/Frame 056548/0638 →
Continuity (2)
Provisional Application 62926422 · Oct 25, 2019
Related Publication 20210121089A1 · Apr 29, 2021