Granted Patent B2

US 12,564,975 · App. 17/438,237 · Granted Mar 3, 2026

Inventor: Ingrid Christina Maria Flinsenberg (Eindhoven, NL)

Assignee: KONINKLIJKE PHILIPS N.V.

B26B19/388G06T7/248G06T7/74G06T2207/30196

Abstract

Claims (67)

1 . A method of providing guidance regarding orientation of a hand-held device on a subject during a treatment operation based on a location of the device on a surface of a body part of the subject during the treatment operation using the device, wherein the device comprises one or more orientation sensors for measuring orientation of the device in a reference frame of the device, the method comprising:

obtaining a three dimensional (3D) representation of the body part, the 3D representation comprising normal vectors for respective positions on the surface of the body part;

receiving a plurality of orientation measurements from the one or more orientation sensors representing orientations of the device during the treatment operation on the body part;

determining in real-time or near real-time a sequence of orientations of the device during the treatment operation based on the plurality of orientation measurements; and

determining in real-time or near real-time the location of the device on the surface of the body part during the treatment operation by comparing the sequence of orientations of the device to the normal vectors and the respective positions of the normal vectors; and

providing feedback to a user of the device based on the determined location of the device on the surface of the body part during the treatment operation, wherein the feedback comprises guidance or instructions to the user on moving or using the device on the surface of the body part of the subject.

2 . The method of claim 1 , wherein the comparing comprises identifying a sequence of normal vectors in the 3D representation having respective orientations that match the sequence of orientations of the device.

3 . The method of claim 1 , wherein the comparing comprises determining the location of the device on the surface of the body part as a position associated with a normal vector on the surface of the body part that has an orientation that matches a final orientation in the sequence of orientations of the device.

4 . The method of claim 1 , further comprising:

receiving a plurality of movement measurements from one or more movement sensors of the device representing movement of the device during the treatment operation on the body part; and

determining a sequence of positions of the device during the treatment operation based on the plurality of received movement measurements,

wherein the sequence of positions indicates a path in a reference frame of the device that the device has moved during the treatment operation, and

wherein the comparing comprises comparing the sequence of orientations and the sequence of positions of the device to the normal vectors and the respective positions of the normal vectors to determine the location of the device on the surface of the body part during the treatment operation.

5 . The method of claim 4 , wherein the comparing further comprises identifying a sequence of normal vectors in the 3D representation having respective positions and orientations that match the sequence of positions and the sequence of orientations of the device, respectively.

6 . The method of claim 4 , wherein the comparing further comprises determining the location of the device on the surface of the body part as a position associated with a normal vector on the surface of the body part that has a position and orientation that matches a final position in the sequence of positions of the device and a final orientation in the sequence of orientations of the device.

7 . The method of claim 4 , further comprising:

estimating an orientation of the body part relative to the device from the sequence of positions and the sequence of orientations of the device; and

rotating the 3D representation of the body part according to the estimated orientation,

wherein the comparing further comprises comparing the sequence of orientations and the sequence of positions of the device to the normal vectors and respective positions of the normal vectors in the rotated 3D representation to determine the location of the device on the surface of the body part during the treatment operation.

8 . The method of claim 1 , further comprising:

obtaining an initial image that includes the device and the body part;

determining an orientation of the device relative to the body part using the initial image; and

rotating the 3D representation of the body part according to the orientation of the device relative to the body part,

wherein the comparing comprises comparing the sequence of orientations of the device to the normal vectors and respective positions of the normal vectors in the rotated 3D representation to determine the location of the device on the surface of the body part during the treatment operation.

9 . The method of claim 8 , further comprising:

obtaining one or more further images during the treatment operation, the one or more further images including the body part;

comparing the one or more further images and the initial image to determine an amount of movement and/or change in orientation of the body part during the treatment operation; and

when the amount of movement and/or change in orientation of the body part is determined to occur at a time point during the treatment operation, adjusting the 3D representation of the body part according to the amount or movement and/or change in orientation,

wherein the comparing further comprises, for the orientation measurements obtained after the time point, comparing the sequence of orientations of the device after the time point to the normal vectors and respective positions of the normal vectors in the adjusted 3D representation to determine the location of the device on the surface of the body part during the treatment operation.

10 . The method of claim 1 , wherein the device comprises a treatment portion for contacting the body part and for performing the treatment operation;

wherein the determining comprises:

rotating the orientation measurements such that the rotated orientation measurements represent an orientation of the treatment portion; and

determining a sequence of orientations of the treatment portion during the treatment operation using the rotated orientation measurements; and

wherein the comparing comprises comparing the sequence of orientations of the treatment portion to the normal vectors and respective positions of the normal vectors to determine the location of the device on the surface of the body part during the treatment operation.

11 . The method of claim 1 , further comprising:

automatically adjusting one or more operational parameters of the device based on the determined location of the device on the surface of the body part during the treatment operation.

12 . A non-transitory computer readable medium storing computer readable code for providing guidance regarding orientation of a hand-held device on a subject during a treatment operation based on a location of the device on a surface of a body part of the subject during the treatment operation, wherein the device is comprises one or more orientation sensors for measuring orientation of the device in a reference frame of the device, the computer readable code being configured such that, on execution by a computer or processor, cause the computer or processor to:

obtain a three dimensional (3D) representation of the body part, the 3D representation comprising normal vectors for respective positions on the surface of the body part;

receive a plurality of orientation measurements from the one or more orientation sensors representing orientations of the device during the treatment operation on the body part;

determine in real-time or near real-time a sequence of orientations of the device during the treatment operation based on the plurality of orientation measurements;

determine in real-time or near real-time the location of the device on the surface of the body part during the treatment operation by comparing the sequence of orientations of the device to the normal vectors and respective positions of the normal vectors; and

provide feedback to a user of the device based on the determined location of the device on the surface of the body part during the treatment operation, wherein the feedback comprises guidance or instructions to the user on moving or using the device on the surface of the body part of the subject.

13 . A system comprising:

a device configured to perform a treatment operation on a body part of a subject, wherein the device comprises one or more orientation sensors for measuring orientation of the device in a reference frame of the device during the treatment operation; and

an apparatus configured to provide guidance regarding orientation of a hand-held device on the subject during the treatment operation by determining a location of the device on a surface of the body part of the subject during the treatment operation, wherein the apparatus comprises a processing unit configured to:

obtain a three dimensional (3D) representation of the body part, the 3D representation comprising normal vectors for respective positions on the surface of the body part;

receive a plurality of orientation measurements from the one or more orientation sensors representing orientations of the device during the treatment operation on the body part;

determine in real-time or near real-time a sequence of orientations of the device during the treatment operation based on the plurality of orientation measurements;

determine in real-time or near real-time the location of the device on the surface of the body part during the treatment operation by comparing the sequence of orientations of the device to the normal vectors and respective positions of the normal vectors to determine the location of the device on the surface of the body part during the treatment operation; and

provide feedback to a user of the device based on the determined location of the device on the surface of the body part during the treatment operation, wherein the feedback comprises guidance or instructions to the user on moving or using the device on the surface of the body part of the subject.

14 . The system of claim 13 , wherein the apparatus is comprised in the device.

15 . The system of claim 13 , wherein the apparatus is separate from the device.

16 . The system of claim 13 , wherein the processing unit is configured to compare the sequence of orientations of the device to the normal vectors and the respective positions of the normal vectors by identifying a sequence of normal vectors in the 3D representation having respective orientations that match the sequence of orientations of the device.

17 . The system of claim 13 , wherein the processing unit is configured to compare the sequence of orientations of the device to the normal vectors and the respective positions of the normal vectors by determining the location of the device on the surface of the body part as a position associated with a normal vector on the surface of the body part that has an orientation that matches a final orientation in the sequence of orientations of the device.

18 . The system of claim 13 , wherein the processing unit is further configured to:

receive a plurality of movement measurements from one or more movement sensors of the device representing movement of the device during the treatment operation on the body part; and

determine a sequence of positions of the device during the treatment operation based on the plurality of received movement measurements, wherein the sequence of positions indicates a path in a reference frame of the device that the device has moved during the treatment operation.

19 . The system of claim 13 , wherein the processing unit is further configured to:

obtain an initial image that includes the device and the body part;

determine an orientation of the device relative to the body part using the initial image; and

rotate the 3D representation of the body part according to the orientation of the device relative to the body part,

wherein the processing unit is configured to compare the sequence of orientations of the device to the normal vectors and the respective positions of the normal vectors by comparing the sequence of orientations of the device to the normal vectors and respective positions of the normal vectors in the rotated 3D representation to determine the location of the device on the surface of the body part during the treatment operation.

20 . The system of claim 13 , wherein the device further comprises a treatment portion configured to contact the body part for performing the treatment operation,

wherein the processing unit is configured to determine the sequence of orientations of the device during the treatment operation by:

rotating the orientation measurements such that the rotated orientation measurements represent an orientation of the treatment portion; and

determining a sequence of orientations of the treatment portion during the treatment operation using the rotated orientation measurements, and

wherein the processing unit is configured to compare the sequence of orientations of the device to the normal vectors and the respective positions of the normal vectors by comparing the sequence of orientations of the treatment portion to the normal vectors and respective positions of the normal vectors to determine the location of the device on the surface of the body part during the treatment operation.

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (20)