IP Library › Granted Patent US 12,239,481
Granted Patent B2
US 12,239,481 · App. 17/604,941 · Granted Mar 4, 2025

Anatomical structure identification apparatus and display method thereof

Inventors: Anjan Kumar Paul (Seongnam-si, KR); Hojun Lee (Seongnam-si, KR)
Assignee: SAMSUNG MEDISON CO., LTD.
A61B8/08A61B8/463A61B8/469
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,239,481
App. No.
17/604,941
Granted
Mar 4, 2025
Kind
B2
Abstract

An ultrasonic imaging apparatus and an ultrasonic image display method are disclosed. An ultrasonic imaging apparatus according to one disclosed embodiment can comprise: a display unit; a user interface; a memory for storing one or more instructions; and a processor for executing the one or more instructions so as to determine a reference point in an ultrasonic image, identify at least one anatomical structure of interest on the basis of a location relationship with the reference point with respect to the determined reference point, and control the display unit so that the identified anatomical structure of interest and information about the anatomical structure of interest are displayed.

Claims (42)

1. An ultrasonic 2-dimensional (2D) image display method comprising:

acquiring the ultrasonic 2D image including a proximal carpal tunnel, wherein the ultrasonic 2D image shows a cross section of the proximal carpal tunnel;

determining a reference point in the ultrasonic 2D image, wherein one of a plurality of landmark anatomical structures included in the proximal carpal tunnel is selected as the reference point;

identifying at least one anatomical structures of interest based on a positional relationship with the reference point on the basis of the determined reference point, wherein the at least one anatomical structures of interest is identified from among the plurality of landmark anatomical structures except the reference point, and the positional relationship includes a 2-dimensional distance value in the ultrasonic 2D image, a direction in the ultrasonic 2D image, and a natural language description indicating the 2-dimensional distance value and the direction between the anatomical structure of interest and the reference point; and

displaying the identified anatomical structure of interest of the proximal carpal tunnel and information about the anatomical structure of interest on the ultrasonic image or parallel with the ultrasonic 2D image,

wherein the information about the anatomical structure of interest is information indicating the positional relationship between the anatomical structure of interest and the reference point.

2. The ultrasonic image display method of claim 1 , wherein the identifying of at least one anatomical structures of interest based on the positional relationship with the reference point on the basis of the determined reference point further includes identifying the anatomical structure of interest on the ultrasonic image by applying data about the reference point and the anatomical structure of interest to a learning model, and

learning model is trained through position context information.

3. The ultrasonic image display method of claim 1 , wherein the anatomical structure of interest is determined based on an input of a user selecting a specific anatomical structure from among a plurality of anatomical structures.

4. The ultrasonic image display method of claim 1 , wherein the plurality of landmark anatomical structures of the proximal carpal tunnel includes at least one of an ulnar artery, an ulnar nerve, a median nerve, a scaphoid tubercle, a pisiform, a flexor retinaculum, and a flexor pollicis longus.

5. The ultrasonic image display method of claim 1 , wherein the reference point is determined based on an input of a user.

6. The ultrasonic image display method of claim 5 , wherein the reference point is determined based on a click event of the user at a specific position in the ultrasonic image or an input of the user related to position coordinates.

7. The ultrasonic image display method of claim 1 , wherein the reference point is determined based on a point at which at least one reference anatomical structure is located on the ultrasonic image.

8. The ultrasonic image display method of claim 7 , wherein the at least one reference anatomical structure is determined based on an input of a user selecting a specific anatomical structure from among a plurality of anatomical structures.

9. The ultrasonic image display method of claim 1 , wherein the identifying of at least one anatomical structures of interest based on the positional relationship with the reference point on the basis of the determined reference point further includes:

determining whether the at least one anatomical structures of interest are identifiable; and

when it is determined that the at least one anatomical structures of interest are unidentifiable, acquiring an estimated position of the at least one anatomical structures of interest on the ultrasonic image based on the positional relationship on the basis of the reference point.

10. The ultrasonic image display method of claim 9 , further comprising:

calculating a probability of the estimated position; and

displaying the calculated probability.

11. An ultrasonic imaging apparatus comprising:

a display unit;

a user interface;

a memory configured to store one or more instructions, and

a processor configured to:

acquire an ultrasonic 2-dimensional (2D) image including a proximal carpal tunnel, wherein the ultrasonic 2D image shows a cross section of the proximal carpal tunnel;

determine a reference point in the ultrasonic 2D image, wherein one of a plurality of landmark anatomical structures included in the proximal carpal tunnel is selected as the reference point,

identify at least one anatomical structure of interest based on a positional relationship with the reference point on the basis of the determined reference point, wherein the at least one anatomical structures of interest is identified from among the plurality of landmark anatomical structures except the reference point, and the positional relationship includes a 2-dimensional distance value in the ultrasonic 2D image, a direction in the ultrasonic 2D image, and a natural language description indicating the 2-dimensional distance value and the direction between the anatomical structure of interest and the reference point, and

control the display unit to display the identified anatomical structure of interest of the proximal carpal tunnel and information about the anatomical structure of interest on the ultrasonic image or parallel with the 2D ultrasonic image,

wherein the information about the anatomical structure of interest is information indicating the positional relationship between the anatomical structure of interest and the reference point.

12. The ultrasonic imaging apparatus of claim 11 , wherein the reference point is determined based on a point at which at least one reference anatomical structure is located on the ultrasonic image.

13. The ultrasonic imaging apparatus of claim 11 , wherein the processor identifies the anatomical structure of interest on the ultrasonic image by applying data about the reference point and the anatomical structure of interest to a learning model, and the learning model is trained through position context information.

14. The ultrasonic imaging apparatus of claim 11 , wherein it is determined whether the at least one anatomical structure of interest is identifiable, and

when it is determined that the at least one anatomical structure of interest is unidentifiable, an estimated position of the at least one anatomical structure of interest on the ultrasonic image is acquired based on the positional relationship on the basis of the reference point.

15. The ultrasonic imaging apparatus of claim 11 , wherein the plurality of landmark anatomical structures of the proximal carpal tunnel includes at least one of an ulnar artery, an ulnar nerve, a median nerve, a scaphoid tubercle, a pisiform, a flexor retinaculum, and a flexor pollicis longus.

16. A non-transitory computer-readable recording medium for storing a computer program code for, when being read and executed by a processor, performing an ultrasonic 2-dimensional (2D) image display method, wherein the ultrasonic 2D image display method includes:

acquiring the ultrasonic 2D image including a proximal carpal tunnel, wherein the ultrasonic 2D image shows a cross section of the proximal carpal tunnel;

determining a reference point in the ultrasonic 2D image, wherein one of a plurality of landmark anatomical structures included in the proximal carpal tunnel is selected as the reference point;

identifying at least one anatomical structure of interest based on a positional relationship with the reference point on the basis of the determined reference point, wherein the at least one anatomical structures of interest is identified from among the plurality of landmark anatomical structures except the reference point, and the positional relationship includes a 2-dimensional distance value in the ultrasonic 2D image, a direction in the ultrasonic 2D image, and a natural language description indicating the 2-dimensional distance value and the direction between the anatomical structure of interest and the reference point;

displaying the identified anatomical structure of interest of the proximal carpal tunnel and information about the anatomical structure of interest on the ultrasonic 2D image or parallel with the ultrasonic image,

wherein the information about the anatomical structure of interest is information indicating the positional relationship between the anatomical structure of interest and the reference point.

17. The non-transitory computer-readable recording medium of claim 16 , wherein the plurality of landmark anatomical structures of the proximal carpal tunnel includes at least one of an ulnar artery, an ulnar nerve, a median nerve, a scaphoid tubercle, a pisiform, a flexor retinaculum, and a flexor pollicis longus.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2021
From: PAUL, ANJAN KUMAR; LEE, HOJUN
To: SAMSUNG MEDISON CO., LTD.
Reel/Frame 057861/0334 →
Priority Claims (1)
KR 10-2019-0057132 · May 15, 2019 · national
Continuity (1)
Related Publication 20220211340A1 · Jul 7, 2022
References Cited (42)
US 7505805B2 · Kuroda · 2009 [cited by applicant]
US 9865059B2 · Gulaka et al. · 2018 [cited by applicant]
US 10231705B2 · Lee · 2019 [cited by applicant]
US 10426438B2 · Roh et al. · 2019 [cited by applicant]
US 10441249B2 · Kim · 2019 [cited by applicant]
US 10977509B2 · Feng et al. · 2021 [cited by applicant]
US 20050038423A1 · Makin · 2005 [cited by examiner]
US 20090093717A1 · Carneiro et al. · 2009 [cited by applicant]
US 20100249589A1 · Lysyansky · 2010 [cited by examiner]
US 20110237949A1 · Zhao · 2011 [cited by examiner]
US 20150011886A1 · Radulescu et al. · 2015 [cited by applicant]
US 20150265251A1 · Cho · 2015 [cited by examiner]
US 20160155222A1 · Jeong · 2016 [cited by examiner]
US 20160183925A1 · Kim · 2016 [cited by applicant]
US 20170007161A1 · Zou et al. · 2017 [cited by applicant]
US 20170007209A1 · Yoo · 2017 [cited by examiner]
US 20170181730A1 · Ardon et al. · 2017 [cited by applicant]
US 20180296193A1 · Cho et al. · 2018 [cited by applicant]
US 20190261949A1 · Labyed · 2019 [cited by examiner]
EP 1757244A1 · 2007 [cited by applicant]
JP 2007244746A · 2007 [cited by applicant]
JP 2015500083A · 2015 [cited by applicant]
JP 2018175688A · 2018 [cited by applicant]
JP 6739318B2 · 2020 [cited by applicant]
JP 6815586B2 · 2021 [cited by applicant]
KR 1020150089837A · 2015 [cited by applicant]
KR 1020150108693A · 2015 [cited by applicant]
KR 1020150108701A · 2015 [cited by applicant]
KR 1020160051474A · 2016 [cited by applicant]
KR 1020160081478A · 2016 [cited by applicant]
KR 1020180065093A · 2018 [cited by applicant]
KR 101876338B1 · 2018 [cited by applicant]
KR 1020190105301A · 2019 [cited by applicant]
KR 102475822B1 · 2022 [cited by applicant]
WO 2018009405A1 · 2018 [cited by applicant]
International Search Report and Written Opinion dated May 25, 2020 issued in International Patent Application No. PCT/KR2020/001941 (with English translation). [cited by applicant]
G. Lin, et al., “Exploring Context with Deep Structured Models for Semantic Segmentation,” IEEE Transaction On Patterns Analysis And Machine Intelligence, vol. 40, No. 6, Jun. 2018, pp. 1352-1366. [cited by applicant]
T-H Vu, et al., “Context-aware CNNs for person head detection,” 2015 IEEE International Conference on Computer, Nov. 24, 2015. [cited by applicant]
F. I. Alam, et al., “Conditional Random Field and Deep Feature Learning for Hyperspectral Image Classification,” IEEE Transactions on Geoscience and Remote Sensing, vol. 57, No. 3, Mar. 2019. [cited by applicant]
The Extended European Search Report dated May 9, 2023 issued in European Patent Application No. 20805076.5. [cited by applicant]
Korean Office Action dated Mar. 20, 2024 issued in Korean Patent Application No. 10-2019-0057132 (with English translation). [cited by applicant]
Notice of Allowance dated Nov. 20, 2024, issued in corresponding Korean Patent Application No. 10-2019-0057132 with an English translation. [cited by applicant]