Granted Patent B2

US 12,376,832 · App. 18/032,953 · Granted Aug 5, 2025

Inventors: Liren Zhu (Sunnyvale, CA); Danhua Zhao (San Jose, CA)

Assignee: DeepSight Technology, Inc.

A61B8/5261A61B8/4488

Abstract

Claims (74)

1. A method of imaging comprising:

receiving a first signal from one or more array elements of a first type in a mixed transducer array;

receiving a second signal from one or more array elements of a second type in the mixed transducer array, wherein at least one of the first type and the second type is an optical sensor, wherein the second type is a broad bandwidth optical sensor;

receiving a third signal from one or more array elements of a third type in the mixed transducer array;

generating a first image from the first signal, a second image from the second signal, a third image from the third signal; and

combining the first image, the second image, and the third image to generate a compound image.

2. The method of claim 1 , wherein the first type and the second type are optical resonators with different characteristics.

3. A method of imaging, comprising:

receiving a first signal from one or more array elements of a first type in a mixed transducer array;

receiving a second signal from one or more array elements of a second type in the mixed transducer array, wherein at least one of the first type and the second type is an optical sensor;

generating a first image from the first signal and a second image from the second signal;

determining one or more compounding coefficients for the first image and the second image, comprising:

transforming the first and second images to first and second transform domain images using at least one transformation operator;

determining one or more transform domain compounding coefficients for the first and second transform domain images; and

inverse transforming the one or more transform domain compounding coefficients to determine the one or more compounding coefficients for the first and second images; and

combining the first image and the second image based on the one or more compounding coefficients to generate a compound image, combining the first image and the second image comprising determining a weighted average of the first image and the second image.

4. The method of claim 3 , wherein determining one or more transform domain compounding coefficients for the first and second transform domain images comprises applying one or more coefficient compounding rules to the first and second transform domain images.

5. A method of imaging, comprising:

receiving a first signal from one or more array elements of a first type in a mixed transducer array;

receiving a second signal from one or more array elements of a second type in the mixed transducer array, wherein at least one of the first type and the second type is an optical sensor;

generating a first image from the first signal and a second image from the second signal;

determining one or more compounding coefficients for the first image and the second image, comprising:

determining a first image quality factor map for the first image and a second image quality factor map for the second image; and

determining a first compounding coefficient for the first image based on the first image quality factor map, and a second compounding coefficient for the second image based on the second image quality factor map; and

combining the first image and the second image based on the one or more compounding coefficients to generate a compound image, combining the first image and the second image comprising determining a weighted average of the first image and the second image.

6. A method of imaging, comprising:

receiving a first signal from one or more array elements of a first type in a mixed transducer array;

receiving a second signal from one or more array elements of a second type in the mixed transducer array, wherein at least one of the first type and the second type is an optical sensor;

generating a first image from the first signal and a second image from the second signal;

determining one or more compounding coefficients for the first image and the second image, comprising:

determining a local entropy of each pixel in the first image and in the second image; and

determining the one or more compounding coefficients based on the determined local entropies; and

combining the first image and the second image based on the one or more compounding coefficients to generate a compound image, combining the first image and the second image comprising determining a weighted average of the first image and the second image.

7. The method of claim 6 , wherein determining the one or more compounding coefficients for the first image and the second image further comprises applying a linear filter to each of the first image and the second image.

8. The method of claim 6 , wherein determining the one or more compounding coefficients for the first image and the second image further comprises determining the one or more compounding coefficients as a function of imaging depth.

9. A method of imaging, comprising:

receiving a first signal from one or more array elements of a first type in a mixed transducer array;

receiving a second signal from one or more array elements of a second type in the mixed transducer array, wherein at least one of the first type and the second type is an optical sensor;

generating a first image from the first signal and a second image from the second signal; and

combining the first image and the second image to generated a compound image, combining the first image and the second image comprising determining a weighted average of the first image and the second image, determining the weighted average comprising applying a saturation mask that reduces weight of at least a portion of the first image and/or the second image that has exceeded a predetermined saturation threshold.

10. The method of claim 3 , wherein at least one of the first image and the second image is a harmonic image.

11. The method of claim 10 , wherein the harmonic image is a sub-harmonic image or a super-harmonic image.

12. An apparatus for imaging a target comprising:

a mixed transducer array comprising:

one or more array elements of a first type configured to receive a first signal, the one or more array elements of the first type comprising a non-optical transducer;

one or more array elements of a second type configured to receive a second signal, the one or more array elements of the second type comprising a broad bandwidth optical sensor; and

one or more array elements of a third type configured to receive a third signal, the one or more array elements of the third type comprising an ultra-sensitive optical sensor;

and

one or more processors configured to:

generate a first image from the first signal, a second image from the second signal, and a third image from the third image; and

combine the first image, the second image, and the third image to generate a compound image.

13. The apparatus of claim 12 , wherein the first type and the second type are optical resonators with different characteristics.

14. The apparatus of claim 12 , wherein the non-optical transducer is a piezoelectric transducer, a single crystal material transducer, a piezoelectric micromachined ultrasound transducer (PMUT), or a capacitive micromachined ultrasonic transducer (CMUT).

15. An apparatus for imaging a target, comprising:

a mixed transducer array comprising:

one or more array elements of a first type configured to receive a first signal, the one or more array elements of the first type comprising a non-optical transducer;

one or more array elements of a second type configured to receive a second signal, wherein the one or more array elements of the second type comprising an optical sensor; and

one or more array elements of a third type configured to receive a third signal, the one or more array elements of the third type comprising an ultra-sensitive optical sensor; and

one or more processors configured to:

filter the first signal, the second signal, and/or the third signal using one or more filters;

generate a first image from the first signal, a second image from the second signal, and a third image from the third signal; and

combine the first image, the second image, and the third image to generate a compound image.

16. The apparatus of claim 15 , wherein the one or more filters comprise a harmonic band-pass filter.

17. The method of claim 3 , wherein determining the one or more compounding coefficients for the first image and the second image further comprises applying a linear filter to each of the first image and the second image.

18. The method of claim 3 , wherein determining the one or more compounding coefficients for the first image and the second image further comprises determining the one or more compounding coefficients as a function of imaging depth.

19. The method of claim 5 , wherein determining the one or more compounding coefficients for the first image and the second image further comprises applying a linear filter to each of the first image and the second image.

20. The method of claim 5 , wherein determining the one or more compounding coefficients for the first image and the second image further comprises determining the one or more compounding coefficients as a function of imaging depth.

21. The method of claim 5 , wherein at least one of the first image and the second image is a harmonic image.

22. The method of claim 21 , wherein the harmonic image is a sub-harmonic image or a super-harmonic image.

23. The method of claim 6 , wherein at least one of the first image and the second image is a harmonic image.

24. The method of claim 23 , wherein the harmonic image is a sub-harmonic image or a super-harmonic image.

25. The method of claim 9 , wherein at least one of the first image and the second image is a harmonic image.

26. The method of claim 25 , wherein the harmonic image is a sub-harmonic image or a super-harmonic image.

27. The method of claim 1 , wherein combining the first image and the second image comprises determining an arithmetic or geometric average of the first image and the second image.

Assignments (1)

Continuity (2)

References Cited (44)