IP Library › Granted Patent US 11,030,780
Granted Patent B2
US 11,030,780 · App. 16/365,175 · Granted Jun 8, 2021

Ultrasound speckle reduction and image reconstruction using deep learning techniques

Inventors: Dongwoon Hyun (Sunnyvale, CA); Jeremy J. Dahl (Palo Alto, CA); Kevin T. Looby (Stanford, CA); Leandra L. Brickson (Menlo Park, CA)
Assignee: The Board of Trustees of the Leland Stanford Junior University
G06T11/008A61B8/5207A61B8/5215G06N3/08G06N20/00G06T2211/428
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,030,780
App. No.
16/365,175
Granted
Jun 8, 2021
Kind
B2
Abstract

Ultrasound B-mode images are reconstructed directly from transducer channel signals using a convolutional neural network (CNN). The CNN is trained with a dataset including, as inputs, simulated transducer array channel signals containing simulated speckle and, as outputs, corresponding simulated speckle-free B-mode ground truth images. After training, measured real-time RF signals taken directly from an ultrasound transducer array elements prior to summation are input to the CNN and processed by the CNN to generate as output an estimated real-time B-mode image with reduced speckle.

Claims (15)

1. A method for ultrasound image reconstruction using a convolutional neural network (CNN), the method comprising:

(a) training the CNN with a dataset comprising simulated transducer array channel signals containing simulated speckle as inputs, and corresponding simulated speckle-free echogenicity estimates (B-mode images) as outputs; wherein the training uses a loss function involving a norm between estimated B-mode images and simulated speckle-free B-mode images; wherein the estimated B-mode images are estimated by the CNN from the simulated transducer array channel signals;

(b) measuring real-time RF signals taken directly from ultrasound transducer array elements prior to summation;

(c) preprocessing the measured real-time RF signals to apply time delays to focus the array at field points, and inputting the pre-processed measured real-time RF signals to the CNN;

(d) processing by the CNN the pre-processed measured real-time RF signals to produce as output an estimated real-time B-mode image with reduced speckle.

2. The method of claim 1 wherein the loss function is a log-domain normalization-independent loss function.

3. The method of claim 1 wherein the loss function is a normalization-independent mixture of l 1 and multi-scale structural similarity losses.

4. The method of claim 1 wherein the CNN has 8 to 16 convolution blocks, wherein each of the convolution blocks has a 2D convolution, batch normalization, and a rectified linear unit.

5. The method of claim 1 wherein the CNN has 16 layers of convolution blocks and 32 filters per layer.

6. The method of claim 1 further comprising performing a conventional DAS envelope-detection reconstruction to generate a conventional B-mode image from the real-time RF signals, and concatenating the generated conventional B-mode image to an output of a block of the CNN.

7. The method of claim 1 wherein simulated transducer array channel signals are unfocused or focused channel signals.

8. The method of claim 1 wherein the input signals are modulated RF signals or demodulated baseband signals.

9. The method of claim 1 wherein the CNN concatenates the original input data to an intermediate hidden layer of the network.

10. The method of claim 1 wherein the CNN performs a multi-scale or multi-resolution processing of the data via striding or pooling.

11. The method of claim 1 wherein the CNN utilizes 3D convolutions.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2019
From: HYUN, DONGWOON; DAHL, JEREMY J.; LOOBY, KEVIN T.; BRICKSON, LEANDRA L.
To: THE BOARD OF TRUSTEES OF THE LELAND STANFORD JUNIOR UNIVERSITY
Reel/Frame 049959/0096 →
Continuity (2)
Provisional Application 62648009 · Mar 26, 2018
Related Publication 20190295295A1 · Sep 26, 2019