IP Library Granted Patent US 10,631,791
Granted Patent B2
US 10,631,791 · App. 16/016,725 · Granted Apr 28, 2020

Video clip selector for medical imaging and diagnosis

Inventors: Charles Cadieu (San Francisco, CA); Ha Hong (Pleasant Hill, CA); Kilian Koepsell (San Francisco, CA); Johan Mathe (San Francisco, CA); Nicolas Poilvert (Seattle, WA); Michael Cannon (Haverford, PA); Nathanael Romano (San Francisco, CA); Natalia Bilenko (Oakland, CA); Charles Chen (San Bruno, CA); Nina Miolane (San Francisco, CA)
Assignee: Caption Health, Inc.
A61B5/7221A61B5/004A61B5/0082G06N3/08G06T7/0012G06T2207/10016G06T2207/20081G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,631,791
App. No.
16/016,725
Granted
Apr 28, 2020
Kind
B2
Abstract

A method for clip selection includes receiving through an interface to a medical imaging device, a selection of a diagnostic procedure and a target portion of a mammalian body. Thereafter, the device acquires video clip imagery of the target portion and stores the video clip imagery in an image store. Each video clip of the video clip imagery is then image processed to determine a view and a quality of each video clip and a rule is retrieved from a rules base corresponding to the selected diagnostic procedure and target portion. In this regard, the rule specifies a requisite view and quality of the video clip imagery. Finally, the retrieved rule is applied to the video clip imagery as a filter to produce a subset of video clip imagery satisfying the specified requisite view and quality and the subset of video clip imagery is stored in the image store.

Claims (46)

1. A method for clip selection for medical imaging comprising:

receiving through an interface to a medical imaging device, a selection of a diagnostic procedure and a target portion of a mammalian body;

acquiring a multiplicity of video clip imagery, each of the multiplicity of video clip imagery providing a different view of the target portion utilizing the medical imaging device;

storing the video clip imagery in an image store;

image processing each video clip of the video clip imagery to determine a view and a quality of each video clip;

retrieving a rule from a rules base corresponding to the selected diagnostic procedure and target portion, the rule specifying a requisite view and quality of the video clip imagery;

applying the retrieved rule to the video clip imagery as a filter to produce a subset of video clip imagery satisfying the specified requisite view and quality; and,

storing the subset of video clip imagery in the image store.

2. The method of claim 1 , further comprising:

on condition that a video clip satisfying the specified requisite view and quality in the video clip imagery is determined upon the application of the retrieved rule not to exist in the video clip imagery, generating an alert through the interface of the medical imaging device.

3. The method of claim 1 , wherein the image processing of each video clip comprises submitting each video clip to a neural network trained to generate output indicating a recognized view in a submitted video clip at a specified level of confidence.

4. The method of claim 1 , wherein the image processing of each video clip comprises submitting each video clip to a content-based image retrieval system adapted to compare a submitted video clip to a data store of known images of particular views so as to indicate a recognized view in the submitted video clip.

5. The method of claim 3 , wherein the image processing of each video clip further comprises computationally computing a generalized degree of quality of a submitted image based upon the specified level of confidence produced in the output of the neural network.

6. The method of claim 1 , wherein the rule additionally specifies a requisite presence of a landmark feature in the view, and wherein the image processing of each video clip comprises submitting each video clip to a neural network trained to generate output indicating a recognized landmark feature in a submitted video clip at a specified level of confidence, such that during application of the retrieved rule, an absence of the landmark feature correlates to poor quality of the video clip, but a presence of the landmark feature correlates to good quality of the video clip.

7. The method of claim 1 , wherein the storing occurs during real-time acquisition of the multiplicity of video clip imagery of the target portion utilizing the medical imaging device.

8. A medical imaging data processing system configured for clip selection, the system comprising:

a host computing system comprising one or more computers, each including memory and at least one processor;

a diagnostic imaging computer program executing in the memory of the host computing system, the program providing control instructions to a communicatively coupled medical imaging device, the program additionally providing an interface to the medical imaging device, the program yet further comprising computer program instructions enabled during execution to perform:

receiving through the interface a selection of a diagnostic procedure and a target portion of a mammalian body;

acquiring a multiplicity of video clip imagery, each of the multiplicity of video clip imagery providing a different view of the target portion utilizing the medical imaging device;

storing the video clip imagery in an image store;

image processing each video clip of the video clip imagery to determine a view and a quality of each video clip;

retrieving a rule from a rules base corresponding to the selected diagnostic procedure and target portion, the rule specifying a requisite view and quality of the video clip imagery;

applying the retrieved rule to the video clip imagery as a filter to produce a subset of video clip imagery satisfying the specified requisite view and quality; and,

storing the subset of video clip imagery in the image store of the host computing system.

9. The system of claim 8 , wherein the program instructions are further enabled to perform:

on condition that a video clip satisfying the specified requisite view and quality in the video clip imagery is determined upon the application of the retrieved rule not to exist in the video clip imagery, generating an alert through the interface of the medical imaging device.

10. The system of claim 8 , wherein the image processing of each video clip comprises submitting each video clip to a neural network trained to generate output indicating a recognized view in a submitted video clip at a specified level of confidence.

11. The system of claim 8 , wherein the image processing of each video clip comprises submitting each video clip to a content-based image retrieval system adapted to compare a submitted video clip to a data store of known images of particular views so as to indicate a recognized view in the submitted video clip.

12. The system of claim 10 , wherein the image processing of each video clip further comprises computationally computing a generalized degree of quality of a submitted image based upon the specified level of confidence produced in the output of the neural network.

13. The system of claim 8 , wherein the rule additionally specifies a requisite presence of a landmark feature in the view, and wherein the image processing of each video clip comprises submitting each video clip to a neural network trained to generate output indicating a recognized landmark feature in a submitted video clip at a specified level of confidence, such that during application of the retrieved rule, an absence of the landmark feature correlates to poor quality of the video clip, but a presence of the landmark feature correlates to good quality of the video clip.

14. A computer program product for clip selection for medical imaging, the computer program product including a non-transitory computer readable storage medium having program instructions embodied therewith, the program instructions executable by a device to cause the device to perform a method including:

receiving through an interface to a medical imaging device, a selection of a diagnostic procedure and a target portion of a mammalian body;

acquiring a multiplicity of video clip imagery, each of the multiplicity of video clip imagery providing a different view of the target portion utilizing the medical imaging device;

storing the video clip imagery in an image store;

image processing each video clip of the video clip imagery to determine a view and a quality of each video clip;

retrieving a rule from a rules base corresponding to the selected diagnostic procedure and target portion, the rule specifying a requisite view and quality of the video clip imagery;

applying the retrieved rule to the video clip imagery as a filter to produce a subset of video clip imagery satisfying the specified requisite view and quality; and,

storing the subset of video clip imagery in the image store.

15. The computer program product of claim 14 , wherein the method performed by the device further comprises:

on condition that a video clip satisfying the specified requisite view and quality in the video clip imagery is determined upon the application of the retrieved rule not to exist in the video clip imagery, generating an alert through the interface of the medical imaging device.

16. The computer program product of claim 14 , wherein the image processing of each video clip comprises submitting each video clip to a neural network trained to generate output indicating a recognized view in a submitted video clip at a specified level of confidence.

17. The computer program product of claim 14 , wherein the image processing of each video clip comprises submitting each video clip to a content based image retrieval system adapted to compare a submitted video clip to a data store of known images of particular views so as to indicate a recognized view in the submitted video clip.

18. The computer program product of claim 16 , wherein the image processing of each video clip further comprises computationally computing a generalized degree of quality of a submitted image based upon the specified level of confidence produced in the output of the neural network.

19. The computer program product of claim 14 , wherein the rule additionally specifies a requisite presence of a landmark feature in the view, and wherein the image processing of each video clip comprises submitting each video clip to a neural network trained to generate output indicating a recognized landmark feature in a submitted video clip at a specified level of confidence, such that during application of the retrieved rule, an absence of the landmark feature correlates to poor quality of the video clip, but a presence of the landmark feature correlates to good quality of the video clip.

20. The computer program product of claim 14 , wherein the storing occurs during real-time acquisition of the multiplicity of video clip imagery of the target portion utilizing the medical imaging device.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 19, 2022
From: CADIEU, CHARLES; HONG, HA; KOEPSELL, KILIAN; MATHE, JOHAN; POILVERT, NICOLAS; CANNON, MICHAEL; ROMANO, NATHANAEL
To: BAY LABS, INC.
Reel/Frame 062140/0044 →
CHANGE OF NAME Recorded Dec 20, 2021
From: BAY LABS, INC.
To: CAPTION HEALTH, INC.
Reel/Frame 058549/0074 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2019
From: BILENKO, NATALIA; CHEN, CHARLES; MIOLANE, NINA
To: BAY LABS, INC.
Reel/Frame 049633/0957 →
Continuity (1)
Related Publication 20190392581A1 · Dec 26, 2019
Cited By (4)
US 12,484,880 US 12,527,544 US 12,611,179 US 12,635,973