IP Library › Granted Patent US 12,496,146
Granted Patent B2
US 12,496,146 · App. 17/438,197 · Granted Dec 16, 2025

Method for guiding a robot arm, guiding system

Inventors: Tanguy Serrat (Saint-Cloud, FR); Ali Khachlouf (Paris, FR)
Assignee: SQUAREMIND
A61B34/30G06T17/205A61B2034/105A61B2034/107A61B2034/2055A61B2034/2063G06T2210/41
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,496,146
App. No.
17/438,197
Granted
Dec 16, 2025
Kind
B2
Abstract

A method for guiding in real time a robot arm for the processing of data of the surface of a body, includes generating a body model including a meshing of points; planning a treatment trajectory on the surface of the body model with a calculator; activating at least one transmission of a transmitter and/or acquisition of a sensor of an operator device, the operator device being arranged at the distal end of the robotised arm, the activation being carried out when the orientation of the axis of the sensor or the transmitter is merged with a predefined straight line passing through the target point, the target point being referenced on the generated body model.

Claims (34)

1 . A method for guiding in real time a robot arm for processing data of a surface of a body, comprising:

generating a 3D body model of all or part of a surface of a human body comprising a meshing of points;

planning a treatment trajectory on the surface of the body model with a calculator;

calculating a guiding trajectory for a distal end of the robot arm;

generating a kinematic of the robot arm such that a point of a head arranged at the distal end of the robot arm is enslaved on the guiding trajectory;

activating the kinematic of the robot arm to cover the guiding trajectory, said guiding trajectory being calculated in real time from the 3D model of the surface of the human body;

generating a new 3D body model of the surface of the human body at regular times ensuring the calculation of a new kinematic of the robot arm to manage its displacements automatically in real time, a new calculated surface of the 3D body model leading to a calculation of a new treatment trajectory and a calculation of a new guiding trajectory,

receiving at least one position of a target point of space;

activating at least one transmission of a transmitter and/or acquisition of a sensor of an operator device, said operator device being arranged at the distal end of the robot arm, the activation being carried out when an orientation of an axis of the sensor or the transmitter is merged with a predefined straight line passing through a target point, said target point being referenced on the generated 3D body model, wherein the treatment trajectory is used to establish a shot strategy of a laser beam from a laser transmitter, said laser transmitter being fixed to the operator device and wherein the body model comprises a homogeneous meshing so as to create a new meshing defined by an arrangement of circles, at least one circle defining a position of a target point of space.

2 . The guiding method according to claim 1 , wherein the treatment trajectory is generated within a treatment zone of a surface of the body model.

3 . The guiding method according to claim 2 , wherein the treatment trajectory is automatically generated from a definition of a treatment zone defined on a surface of the body model.

4 . The guiding method according to claim 1 , wherein the guiding trajectory is calculated from a predefined distance and orientation instruction so to generate a relative position of a distal end of the robot arm vis-à-vis the treatment trajectory.

5 . The guiding method according to claim 1 , comprising generating a new body model at regular times such that the robot arm is controllable in real time from the generation of a new trajectory of the robot arm, a new calculated surface of the body model leading to a modification of the treatment trajectory, the method comprising, further, calculating a new kinematic of the robot arm enslaved on the definition of the new trajectory.

6 . The guiding method according to claim 1 , wherein the new meshing is generated as a function of a shot power instruction and/or an instruction relative to an amount of overlap between two shots.

7 . The guiding method according to claim 1 , wherein the treatment trajectory is used to establish a shot strategy of an ultrasonic signal from an ultrasonic transmitter, said ultrasonic transmitter being fixed to the operator device.

8 . The guiding method according to claim 1 , wherein a set of images is produced from an optical device arranged on the operator device, each image being indexed with at least one node or mesh of the meshing of the body model as a function of the position of the target point on said body model and a viewing angle of the optical device.

9 . The guiding method according to claim 8 , wherein at least one pair of images is acquired simultaneously from an optical device comprising two sensors integral and arranged on different axes of the operator device, each image being indexed with at least one node or mesh of the meshing of the body model as a function of the position of the target point on said body model and a viewing angle of the optical device, said images being processed in such a way as to reconstitute a three-dimensional local image.

10 . The guiding method according to claim 9 , wherein the three-dimensional local image is superimposed in a 3D representation on a generated body model.

11 . The guiding method according to claim 1 , wherein a first image acquired by a first optical device of the operator device is compared with a set of images in real time, the comparison operation comprising, if appropriate, a generation of an indicator of interest, said indicator of interest making it possible to generate a digital control for managing the robot arm.

12 . The guiding method according to claim 11 , wherein a guiding instruction leads to a first management of the robot arm at a target position from where is extracted the first image and a second management of the operator device to activate a second optical device, the activation of the second optical device making it possible to produce a second image in near field of a zone comprising the target point.

13 . A system for guiding a robot arm comprising a device for acquiring an image of a body of a patient to produce a parameterised body model and a robot arm provided with an operator device for the implementation of the method of claim 1 .

14 . The guiding method according to claim 1 , wherein the 3D body model of all or part of the surface of the human body is a model of an outer surface of a skin of the human body.

15 . The guiding method according to claim 1 , wherein the 3D body model is generated from images captured by a first image acquisition system, the robot arm being mobile relative to the first image acquisition system.

16 . The guiding method according to claim 15 , wherein the activating comprises an acquisition of a local near field image of a zone containing the target point by a sensor of the operator device.

17 . A method for guiding in real time a robot arm for processing data of a surface of a body, comprising:

generating a 3D body model of all or part of a surface of a human body comprising a meshing of points;

planning a treatment trajectory on the surface of the body model with a calculator;

calculating a guiding trajectory for a distal end of the robot arm;

generating a kinematic of the robot arm such that a point of a head arranged at the distal end of the robot arm is enslaved on the guiding trajectory;

activating the kinematic of the robot arm to cover the guiding trajectory, said guiding trajectory being calculated in real time from the 3D model of the surface of the human body;

generating a new 3D body model of the surface of the human body at regular times ensuring the calculation of a new kinematic of the robot arm to manage its displacements automatically in real time, a new calculated surface of the 3D body model leading to a calculation of a new treatment trajectory and a calculation of a new guiding trajectory,

receiving at least one position of a target point of space;

“activating at least one transmission of a transmitter and/or acquisition of a sensor of an operator device, said operator device being arranged at the distal end of the robot arm, the activation being carried out when an orientation of an axis of the sensor or the transmitter is merged with a predefined straight line passing through a target point, said target point being referenced on the generated 3D body model

wherein a set of images is produced from an optical device arranged on the operator device, each image being indexed with at least one node or mesh of the meshing of the body model as a function of the position of the target point on said body model and a viewing angle of the optical device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 10, 2021
From: SERRAT, TANGUY; KHACHLOUF, ALI
To: SQUAREMIND
Reel/Frame 057447/0981 →
Priority Claims (1)
FR 1902944 · Mar 21, 2019 · national
Continuity (1)
Related Publication 20220183775A1 · Jun 16, 2022
References Cited (23)
US 7962192B2 · Bodduluri · 2011 [cited by examiner]
US 9436993B1 · Stolka · 2016 [cited by examiner]
US 11903659B2 · Blondel · 2024 [cited by examiner]
US 20030060810A1 · Syrowicz et al. · 2003 [cited by applicant]
US 20080033410A1 · Rastegar · 2008 [cited by examiner]
US 20080039713A1 · Thomson et al. · 2008 [cited by applicant]
US 20140222207A1 · Bowling et al. · 2014 [cited by applicant]
US 20170055940A1 · Shoham · 2017 [cited by examiner]
US 20180071032A1 · de Almeida Barreto · 2018 [cited by examiner]
US 20190021796A1 · Timperley · 2019 [cited by examiner]
US 20190167356A1 · Britton · 2019 [cited by examiner]
US 20190262084A1 · Roh · 2019 [cited by examiner]
US 20200406465A1 · Terasawa · 2020 [cited by examiner]
EP 1087716A1 · 2001 [cited by applicant]
EP 162407A1 · 2017 [cited by applicant]
JP 2018073393A · 2018 [cited by applicant]
KR 2018005684A · 2018 [cited by examiner]
KR 20180005684A · 2018 [cited by examiner]
WO WO0062700A1 · 2000 [cited by applicant]
WO WO2017183825A1 · 2017 [cited by applicant]
Mineo et al., “Introducing a novel mesh following technique for approximation-free robotic tool path trajectories,” Feb. 16, 2017 (Year: 2017). [cited by examiner]
Office Action as issued in Korean Patent Application No. 10-2021-7034032, dated Apr. 29, 2025. [cited by applicant]
International Search Report as issued in International Patent Application No. PCT/EP2020/057704, dated Jun. 17, 2020. [cited by applicant]