IP Library Granted Patent US 12,675,848
Granted Patent B2
US 12,675,848 · App. 19/020,675 · Granted Jul 7, 2026

Method and apparatus for a software enabled high resolution ultrasound imaging device

Inventor: Masoud Vaziri (Richardson, TX)
Assignee: Optics Innovation LLC
G06T5/50G06F18/251G06T7/0012G06T2207/10088G06T2207/10136
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,675,848
App. No.
19/020,675
Filed
Jan 14, 2025
Granted
Jul 7, 2026
Kind
B2
Art Unit
2485
USPC
382/128
Abstract

Various computational methods and techniques are presented to increase the lateral and axial resolution of an ultrasound imager in order to allow a medical practitioner to use an ultrasound imager in real time to obtain a 3D map of a portion of a body with a resolution that is comparable to an MRI machine.

Claims (28)

1 . An ultrasound imaging apparatus comprising:

at least one ultrasound imaging unit configured to:

direct a first beam of soundwaves having a first frequency and a first beam width toward a volume to generate first image data that is reproducible as a first image of a first slice of the volume, the first image having a first axial resolution in the direction of the beam and a first lateral resolution transverse to the direction of the beam; and

direct a second beam of soundwaves having a second frequency and a second beam width toward the volume to generate second image data that is reproducible as a second image of a second slice of the volume, the second image having a second axial resolution and a second lateral resolution, at least a portion of the second image corresponding to at least a portion of the first image; and

a processor in communication with the at least one ultrasound imaging unit, the processor configured to:

execute an image resolution enhancement procedure to generate an enhanced first image of the first slice of the volume, the enhanced first image having an increase in at least one of the first axial image resolution and the first lateral image resolution of at least a subset of the first image of the first slice of the volume based at least in part on the second image.

2 . The ultrasound imaging apparatus of claim 1 , wherein the second frequency is higher than the first frequency, the second beam angle is narrower than the first beam angle, and the image resolution enhancement procedure increases the first axial image resolution and the first lateral image resolution of the at least a subset of the first image of the first slice of the volume based at least in part on the second image.

3 . The ultrasound imaging apparatus of claim 1 , wherein the second frequency is higher than the first frequency, the second beam angle is the same as or wider than the first beam angle, and the image resolution enhancement procedure increases the axial image resolution of the at least a subset of the first image of the first slice of the volume based at least in part on the second image.

4 . The ultrasound imaging apparatus of claim 1 , wherein the second frequency is the same as the first frequency, the second beam angle is narrower than the first beam angle, and the image resolution enhancement procedure increases the first lateral image resolution of the at least a subset of the first image of the first slice of the volume based at least in part on the second image.

5 . The ultrasound imaging apparatus of claim 1 , wherein the image resolution enhancement procedure increases the at least one of the first axial image resolution and the first lateral image resolution of an entirety of the first image of the first slice of the volume.

6 . The ultrasound imaging apparatus of claim 1 , wherein the processor is configured to store data reproducible as the at least a subset of the first image of the first slice of the volume in a memory device of the ultrasound imaging apparatus.

7 . The ultrasound imaging apparatus of claim 1 , wherein the at least one ultrasound imaging unit is configured to alternatingly direct the first beam and direct the second beam.

8 . The ultrasound imaging apparatus of claim 1 , wherein the processor is further configured to capture the position and orientation of the at least one ultrasound imaging unit via a 9-axis accelerometer when each of the first beam and the second beam of soundwaves is directed toward the volume.

9 . The ultrasound imaging apparatus of claim 8 , wherein the processor is configured to combine a plurality of the enhanced first images of the first slice of the volume into a three dimensional image of the volume.

10 . The ultrasound imaging apparatus of claim 1 , wherein the image resolution enhancement procedure is iterative bandwidth extrapolation.

11 . An ultrasound imaging method comprising:

directing, via at least one first ultrasound imaging unit, a first beam of soundwaves having a first frequency and a first beam width toward a volume to generate first image data that is reproducible as a first image of a first slice of the volume, the first image having a first axial resolution in the direction of the beam and a first lateral resolution transverse to the direction of the beam; and

directing, via the at least one first ultrasound imaging unit, a second beam of soundwaves having a second frequency and a second beam width toward the volume to generate second image data that is reproducible as a second image of a second slice of the volume, the second image having a second axial resolution and a second lateral resolution, at least a portion of the second image corresponding to at least a portion of the first image; and

executing, via a processor in communication with the at least one ultrasound imaging unit, an image resolution enhancement procedure to generate an enhanced first image of the first slice of the volume, the enhanced first image having an increase in at least one of the first axial image resolution and the first lateral image resolution of at least a subset of the first image of the first slice of the volume based at least in part on the second image.

12 . The ultrasound imaging method of claim 11 , wherein the second frequency is higher than the first frequency, the second beam angle is narrower than the first beam angle, and the image resolution enhancement procedure increases the first axial image resolution and the first lateral image resolution of the at least a subset of the first image of the first slice of the volume based at least in part on the second image.

13 . The ultrasound imaging method of claim 11 , wherein the second frequency is higher than the first frequency, the second beam angle is the same as or wider than the first beam angle, and the image resolution enhancement procedure increases the axial image resolution of the at least a subset of the first image of the first slice of the volume based at least in part on the second image.

14 . The ultrasound imaging method of claim 11 , wherein the second frequency is the same as the first frequency, the second beam angle is narrower than the first beam angle, and the image resolution enhancement procedure increases the first lateral image resolution of the at least a subset of the first image of the first slice of the volume based at least in part on the second image.

15 . The ultrasound imaging method of claim 11 , wherein the image resolution enhancement procedure increases the at least one of the first axial image resolution and the first lateral image resolution of an entirety of the first image of the first slice of the volume.

16 . The ultrasound imaging method of claim 11 , further comprising storing, via the processor, data reproducible as the at least a subset of the first image of the first slice of the volume in a memory device of the ultrasound imaging apparatus.

17 . The ultrasound imaging method of claim 11 , wherein the at least one ultrasound imaging unit alternates between directing the first beam and directing the second beam.

18 . The ultrasound imaging method of claim 11 , further comprising capturing, via the processor and a 9-axis accelerometer, the position and orientation of the at least one ultrasound imaging unit when the at least one ultrasound imaging unit is directing each of the first beam of soundwaves and the second beam of soundwaves toward the volume.

19 . The ultrasound imaging method of claim 18 , further comprising, via the processor, combining a plurality of the enhanced first images for a plurality of the first slices of the volume into a three dimensional image of the volume.

20 . The ultrasound imaging method of claim 11 , wherein the image resolution enhancement procedure is iterative bandwidth extrapolation.

Continuity (4)
Continuation 17722347 · Apr 17, 2022
Continuation 16507910 · Jul 10, 2019
Provisional Application 62696346 · Jul 11, 2018
Related Publication 20250148570A1 · May 8, 2025
References Cited (167)
US 4028725A · Lewis · 1977 [cited by applicant]
US 4907296A · Blecha · 1990 [cited by applicant]
US 5262871A · Wilder · 1993 [cited by applicant]
US 5856811A · Shih · 1999 [cited by applicant]
US 5859921A · Suzuki · 1999 [cited by applicant]
US 6091546A · Spitzer · 2000 [cited by applicant]
US 6163336A · Richards · 2000 [cited by applicant]
US 6198485B1 · Mack · 2001 [cited by applicant]
US 6307526B1 · Mann · 2001 [cited by applicant]
US 6434280B1 · Peleg · 2002 [cited by applicant]
US 6486799B1 · Still · 2002 [cited by applicant]
US 6661495B1 · Popovich · 2003 [cited by applicant]
US 6766067B2 · Freeman · 2004 [cited by applicant]
US 6850629B2 · Jeon · 2005 [cited by applicant]
US 7023464B1 · Harada · 2006 [cited by applicant]
US 7331671B2 · Hammoud · 2008 [cited by applicant]
US 7391887B2 · Durnell · 2008 [cited by applicant]
US 7492926B2 · Kang · 2009 [cited by applicant]
US 7538326B2 · Johnson · 2009 [cited by applicant]
US 7697024B2 · Currivan · 2010 [cited by applicant]
US 7715658B2 · Cho · 2010 [cited by applicant]
US 7894666B2 · Mitarai · 2011 [cited by applicant]
US 8014632B2 · Matsumoto · 2011 [cited by applicant]
US 8139089B2 · Doyle · 2012 [cited by applicant]
US 8159519B2 · Kurtz · 2012 [cited by applicant]
US 8189100B2 · Li · 2012 [cited by applicant]
US 8305899B2 · Luo · 2012 [cited by applicant]
US 8432492B2 · Deigmoeller · 2013 [cited by applicant]
US 8872910B1 · Vaziri · 2014 [cited by applicant]
US 9230140B1 · Ackley · 2016 [cited by applicant]
US 9438491B1 · Kwok · 2016 [cited by applicant]
US 9438819B2 · Van Broeck · 2016 [cited by applicant]
US 9618746B2 · Browne · 2017 [cited by applicant]
US 9674490B2 · Koravadi · 2017 [cited by applicant]
US 9727790B1 · Vaziri · 2017 [cited by applicant]
US 9779311B2 · Lee · 2017 [cited by applicant]
US 9858676B2 · Bostick · 2018 [cited by applicant]
US 9864372B2 · Chen · 2018 [cited by applicant]
US 10039445B1 · Torch · 2018 [cited by applicant]
US 10064552B1 · Vaziri · 2018 [cited by applicant]
US 10708514B2 · Haltmaier · 2020 [cited by applicant]
US 11051782B1 · Douglas · 2021 [cited by examiner]
US 11189017B1 · Baqai · 2021 [cited by applicant]
US 11287262B2 · Dooley · 2022 [cited by applicant]
US 12198301B2 · Zhang · 2025 [cited by examiner]
US 12226547B2 · Toro Estrella · 2025 [cited by examiner]
US 12303162B2 · Wen · 2025 [cited by examiner]
US 12303228B2 · Vaziri · 2025 [cited by examiner]
US 12464093B2 · Vaziri · 2025 [cited by examiner]
US D1107916S · Lewis · 2025 [cited by examiner]
US 12490992B2 · Perler · 2025 [cited by examiner]
US 12507864B2 · Zhao · 2025 [cited by examiner]
US 12541180B2 · Rakshit · 2026 [cited by examiner]
US 20030122930A1 · Schofield · 2003 [cited by applicant]
US 20040212882A1 · Liang · 2004 [cited by applicant]
US 20040218834A1 · Bishop · 2004 [cited by applicant]
US 20050046698A1 · Knight · 2005 [cited by applicant]
US 20060033992A1 · Solomon · 2006 [cited by applicant]
US 20070041663A1 · Cho · 2007 [cited by applicant]
US 20070115349A1 · Currivan · 2007 [cited by applicant]
US 20080010060A1 · Asano · 2008 [cited by applicant]
US 20080030592A1 · Border · 2008 [cited by applicant]
US 20080036875A1 · Jones · 2008 [cited by applicant]
US 20080198324A1 · Fuziak · 2008 [cited by applicant]
US 20080291295A1 · Kato · 2008 [cited by applicant]
US 20080297589A1 · Kurtz · 2008 [cited by applicant]
US 20090136158A1 · Tamura · 2009 [cited by applicant]
US 20090189974A1 · Deering · 2009 [cited by applicant]
US 20090210786A1 · Suzuki · 2009 [cited by applicant]
US 20090219224A1 · Elg · 2009 [cited by applicant]
US 20100053555A1 · Enriquez · 2010 [cited by applicant]
US 20100103276A1 · Border · 2010 [cited by applicant]
US 20100128135A1 · Filipovich · 2010 [cited by applicant]
US 20100149073A1 · Chaum · 2010 [cited by applicant]
US 20100157078A1 · Atanassov · 2010 [cited by applicant]
US 20100157079A1 · Atanassov · 2010 [cited by applicant]
US 20100165287A1 · Pienimaa · 2010 [cited by applicant]
US 20100208207A1 · Connell II · 2010 [cited by applicant]
US 20100240988A1 · Varga · 2010 [cited by applicant]
US 20100254630A1 · Ali · 2010 [cited by applicant]
US 20100277619A1 · Scarff · 2010 [cited by applicant]
US 20100289941A1 · Ito · 2010 [cited by applicant]
US 20100290668A1 · Friedman · 2010 [cited by applicant]
US 20100290685A1 · Wein · 2010 [cited by examiner]
US 20110064327A1 · Dagher · 2011 [cited by applicant]
US 20110263946A1 · El Kaliouby · 2011 [cited by applicant]
US 20110279666A1 · Strömbom · 2011 [cited by applicant]
US 20120086780A1 · Sharma · 2012 [cited by applicant]
US 20120257005A1 · Browne · 2012 [cited by applicant]
US 20130106911A1 · Salsman · 2013 [cited by applicant]
US 20130121525A1 · Chen · 2013 [cited by applicant]
US 20130242057A1 · Hong · 2013 [cited by applicant]
US 20140146153A1 · Birnkrant · 2014 [cited by applicant]
US 20140267890A1 · Lelescu · 2014 [cited by applicant]
US 20140313335A1 · Koravadi · 2014 [cited by applicant]
US 20150009550A1 · Misago · 2015 [cited by applicant]
US 20150209002A1 · De Beni · 2015 [cited by examiner]
US 20160012280A1 · Ito · 2016 [cited by applicant]
US 20160179093A1 · Prokhorov · 2016 [cited by applicant]
US 20160225192A1 · Jones · 2016 [cited by applicant]
US 20170007351A1 · Yu · 2017 [cited by applicant]
US 20170019599A1 · Muramatsu · 2017 [cited by applicant]
US 20170099479A1 · Browd · 2017 [cited by applicant]
US 20170142312A1 · Dal Mutto · 2017 [cited by applicant]
US 20170181802A1 · Sachs · 2017 [cited by applicant]
US 20170225336A1 · Deyle · 2017 [cited by applicant]
US 20170322410A1 · Watson · 2017 [cited by applicant]
US 20170360578A1 · Shin · 2017 [cited by examiner]
US 20180012413A1 · Jones · 2018 [cited by applicant]
US 20180188892A1 · Levac · 2018 [cited by applicant]
US 20180330473A1 · Foi · 2018 [cited by examiner]
US 20190175214A1 · Wood · 2019 [cited by examiner]
US 20190254754A1 · Johnson · 2019 [cited by applicant]
US 20190272336A1 · Ciecko · 2019 [cited by applicant]
US 20200041261A1 · Bernstein · 2020 [cited by applicant]
US 20200077033A1 · Chan · 2020 [cited by applicant]
US 20200117025A1 · Sauer · 2020 [cited by applicant]
US 20200330179A1 · Ton · 2020 [cited by applicant]
US 20210067764A1 · Shau · 2021 [cited by applicant]
Brattain et al. (Machine learning for medical ultrasound: status, methods, and future opportunities. Abdom Radiol (NY). Apr. 2018;43 (4):786-799. doi: 10.1007/s00261-018-1517-0. PMID: 29492605; PMCID: PMC5886811. [cited by applicant]
F. Coly et al. “Ultrasound Orientation Sensor”, BS thesis, Worcester Polytechnic Institute. Apr. 25, 2019. [cited by applicant]
A Zandifar, R. Duraiswami, L. S. Davis, A video-based framework for the analysis of presentations/ posters, 2003 (Year: 2003) 10 pages. [cited by applicant]
Z. Zalevsky, D. Mendlovic, Optical Superresolution, 2004 (Year: 2004) 261 pages. [cited by applicant]
“A High Speed Eye Tracking System with Robust Pupil Center Estimation Algorithm”, Proceedings of the 29th Ammal International Conference of the IEEE EMBS, 25 Kyon, France, pp. 3331-3334, Aug. 2007. [cited by applicant]
“A Novel Method of Video-Based Pupil Tracking”, Proceedings of the 2009 IEEE International Conference on Systems, Man and Cybernetics, San Antonio, Tex., USA—pp. 1255-1262, Oct. 2009. [cited by applicant]
Athanasios Papoulis; A New Algorithm in Spectral Analysis and Band-Limited Extrapolation; IEEE Transactions on Circuits and Systems, Sep. 1975; vol. CAS-22, No. 9; pp. 735-742. [cited by applicant]
Barbara Zitova et al.; Image Registration Methods: a Survey; Department of Image Processing; Institute of Information Theory and Automation Academy of Sciences of the Szech Republic; Image and Vision Computing; pp. 977-… [cited by applicant]
B. K. Gunturk, “Super-resolution imaging”, in Compu-tational Photography Methods and Applications, by R. Lukac, CRC Press, 2010 [Abstract Provided]. [cited by applicant]
Cheng et al. Developing a Real-Time Identify-and-Locate System for the Blind. Workshop on Computer Vision Applications for the Visually Impaired, James Coughlan and Roberto Manduchi, Oct. 2008, Marseille, France. [cited by applicant]
Danny Keren et al.; Image Sequence Enhancement Using Sub-pixel Displacements; Department of computer science; The Hebrew University of Jerusalem; 1988 IEEE; pp. 742-746. [cited by applicant]
D. Li, D. Winfield and D. Parkhurst, “Starburst: A Hybrid algorithm for video based eye tracking combining feature-based and model-based approaches”, Iowa State Univer-sity, Ames, lowa. [cited by applicant]
Edward R. Dowski, Jr. et al.; Extended Depth of Field Through Wave-Front Coding; Apr. 10, 1995; Optical Society of America; vol. 34, No. 11; Applied Optics pp. 1859-1866. [cited by applicant]
Eran Gur and Zeev Zalevsky; Single-Image Digital Super-Resolution a Revised Gerchberg-Papoulis Algorithm; AENG International Journal of Computer Science; Nov. 17, 2007; pp. 1-5. [cited by applicant]
Extrema.m, http:/lwww.malhworks.com/matlabcentral/fileexchange/12275-extrema-m- extrema2-m, Sep. 14, 2006. [cited by applicant]
Eyelink User Manual, SR Research Lid., Copyright 2005-2008, 134 pages. [cited by applicant]
Eyelink Data Viewer User's Manual, SR Research Lid., Copyright 2002-2008, 149 pages. [cited by applicant]
Fritz Gleyo, Microsoft May Make Life-Sized Cortana in Person for HoloLens, (Dec. 14, 2015). [cited by applicant]
Guestrin et al. “General Theory of Remote Gaze Estimation Using the Pupil Center and Corneal Reflections”, IEEE Trans. Biomedical Eng., vol. 53, No. 6, pp. 1124-1133, Jun. 2006. [cited by applicant]
Jessi Hempel, Project HoloLens: Our Exclusive Hands-On With Microsoft's Holographic Goggles, (Jan. 21, 2015). [cited by applicant]
John Bardsley et al.; Blind Iterative Restoration of Images With Spatially-Varying Blur; 9 pages. [cited by applicant]
J. Goodman, Introduction to Fourier Optics, rd edition, 160-165, McGraw-Hill, 1988. [cited by applicant]
Jordan Novet, Microsoft could build a life-sized Cortana for HoloLens, https://www.technologyrecord.com/Article/introducing-microsoft-hololens-development- edition-48296. [cited by applicant]
Kennet Kubala et al.; Reducing Complexity in Computational Imaging Systems; CDM Optics, Inc.; Sep. 8, J003; vol. 11, No. 18; Optics Express; pp. 2102-2108. [cited by applicant]
Lees et al. (Ultrasound Imaging in Three and Four Dimensions, Seminars in Ultrasound, CT, and MR/, vol. 22, No. 1 Feb. 2001: pp. 85-105, (Year: 2001). [cited by applicant]
Lindsay James, Introducing Microsoft HoloLens Development Edition, https://blogs.windows.com/ :levices/2015/04/30/build-2015-a-closer-look-at-the-microsoft- hololens-hardware/. [cited by applicant]
Lisa Gottesfeld Brown; A Survey of Image Registration Techniques; Department of Computer Science; Columbia University; Jan. 12, 1992; pp. 1-60. [cited by applicant]
Malcolm et al. Combining topdown processes to guide eye movements during real-world scene search. Journal of Vision, 10(2):4, p. 1-11 (2010). [cited by applicant]
Maria E. Angelopoulou et al.; FPGA-based Real-lime Super-Resolution on an Adaptive Image Sensor; Department of Electrical and Electronic Engineering, Imperial College London; 9 pages. [cited by applicant]
Maria E. Angelopoulou et al.; Robust Real-Time Super-Resolution on FPGA and an Application to Video Enhancement; Imperial College London; ACM Journal Name; Sep. 2008; vol. V, No. N; pp. 1-27. [cited by applicant]
Moreno et al. Classification of visual and linguistic tasks using eye-movement features; Journal of Vision (2014) 14 (3):11, 1-18. [cited by applicant]
Oliver Bowen et al.; Real-Time Image Super Resolution Using an FPGA; Department of Electrical and Electronic Engineering; Imperial College London; 2008 IEEE; pp. 89-94. [cited by applicant]
Patrick Vandewalle et al.; A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution; Ecole Polytechnique Federal de Lausanne, School of Computer and Communication Sciences; Depa… [cited by applicant]
P. C. Hansen, J. G. Nagy, D. P. O'Leary, Deblurring Images: matrices, Spectra and Filtering, SIAM (2006) [Abstract Provided]. [cited by applicant]
P. Milanfar, Super-Resolution Imaging, CRC Press (2011) [Abstract Provided]. [cited by applicant]
Pravin Bhat et al.; Using Photographs to Enhance Videos of a Static Scene; University of Washington; Microsoft Research; Adobe Systems; University of California; The Eurographics Association 2007; pp. 1-12. [cited by applicant]
R. W. Gerchberg, “Super-resolution through error energy reduction”, Optica Acta, vol. 21, No. 9, pp. 709-720,(1974). [cited by applicant]
S. Chaudhuri, Super-Resolution Imaging, Kluwer Aca-demic Publishers (2001) [Abstract Provided]. [cited by applicant]
Sang-Hyuck Lee et al.; Breaking Diffraction Limit of a Small F-Number Compact Camera Using Wavefront Coding; Center for Information Storage Device; Department of Mechanical Engineering, Yonsei University, Shinchondong, … [cited by applicant]
Suk Hwan Lim and Amnon Silverstein; Estimation and Removal of Motion Blur by Capturing Two Images With Different Exposures; HP Laboratories and NVidia Corp.; HPL-2008-170; Oct. 21, 2008; 8 pages. [cited by applicant]
S.-W Jung and S.-J. Ko, “Image deblurring using multi-exposed images” in Computational Photography 65 Methods and Applications, by R. Lukac, CRC Press, 2010. [Abstract Provided]. [cited by applicant]
Todd Holmdahl, Build 2015: A closer look at the Microsoft HoloLens hardware, https://blogs.windows.com/ :levices/2015/04/30/build-2015-a-closer-look-at-the-microsoft- hololens-hardware/. [cited by applicant]
Tod R. Lauer; Deconvolution With a Spatially-Variant PSF; National Optical Astronomy Observatory; Tucson, AZ; arXiv:astro-ph/0208247v1; Aug. 12, 2002; 7 pages. [cited by applicant]
V. Barmore, Iterative-Interpolation Super-Resolution Image Reconstruction, Springer (2009) [Abstract Provided]. [cited by applicant]
W. Thomas Cathey et al.; New Paradigm for Imaging Systems; Optical Society of America; Applied Optics; Oct. 10, 2002; vol. 41, No. 29; pp. 6080-6092. [cited by applicant]
William T. Freeman et al.; Example-Based Super-Resolution; Mitsubishi Electric Research Labs; Mar./Apr. J002; IEEE Computer Graphics and Applications; pp. 56-65. [cited by applicant]
Sawhney, H. et al.; “Hybrid Stereo Camera: An IBR Approach for Synthesis of Very High Resolution Stereoscopic Image Sequences”; AC SIGGRAPH, pp. 451-460; 2001 (10 pages). [cited by applicant]
Zitnick, L. et al.; “Stereo for Image-Based Rendering Using Image Over-Segmentation”; International Journal of Computer Visions; 2006 (32 pages). [cited by applicant]