IP Library › Granted Patent US 12,016,697
Granted Patent B2
US 12,016,697 · App. 17/271,687 · Granted Jun 25, 2024

Detecting spinal shape from optical scan

Inventors: Ron Kimmel (Haifa, IL); Benjamin Groisser (Haifa, IL); Alon Wolf (Haifa, IL); Roger F. Widmann (New York, NY); Howard J. Hillstrom (New York, NY)
Assignees: TECHNION RESEARCH & DEVELOPMENT FOUNDATION LIMITED; NEW YORK SOCIETY FOR THE RELIEF OF THE RUPTURED AND CRIPPLED, MAINTAINING THE HOSPITAL FOR SPECIAL SURGERY
A61B5/4566G06T7/0012G06T17/20G06T2200/08G06T2207/10028G06T2207/20081G06T2207/20084G06T2207/20101G06T2207/30012G06T2210/41
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,016,697
App. No.
17/271,687
Granted
Jun 25, 2024
Kind
B2
Abstract

A method comprising: generating a parametrized three-dimensional (3D) body surface model on a training set comprising a plurality of 3D scans of subjects, wherein at least some of said 3D scans are of subjects having a skeletal deformity; receiving one or more target 3D scans of a target subject; optimizing said body surface model with respect to said one or more target 3D scans to calculate a target body surface model of said target subject; training a skeletal estimation model on a training set comprising: (i) body surface models of a plurality of subjects, and (ii) skeletal landmarks sets of said plurality of subjects; and applying said trained skeletal estimation model to said calculated target body surface model of said target subject, to estimate a skeletal shape of said target subject.

Claims (41)

1. A method comprising:

generating a parametrized three-dimensional (3D) body surface model, based, at least in part, on a training set comprising a plurality of 3D scans of subjects, wherein at least some of said 3D scans are of subjects having a skeletal deformity;

receiving one or more target 3D scans of a target subject;

optimizing said body surface model with respect to said one or more target 3D scans, based, at least in part, on minimizing a loss function which registers said body surface model to said target 3D scans, to calculate a target body surface model of said target subject;

training a skeletal estimation model, based, at least in part, on a training set comprising:

(i) body surface models of a plurality of subjects, and

(ii) skeletal landmarks sets of said plurality of subjects; and

applying said trained skeletal estimation model to said calculated target body surface model of said target subject, to estimate a skeletal shape of said target subject,

wherein at least some of said target 3D scans are labelled with a pose of said subject associated with a respective target 3D scan.

2. The method of claim 1 , wherein said training of said 3D body surface model is configured to encode a body type parameter, based, at least in part, on a labeling of said training set with said skeletal deformity.

3. The method of claim 2 , wherein said labelling is a scoliosis classification category selected from the group consisting of: main thoracic, double thoracic, double/triple major, and thoracolumbar/lumbar.

4. The method of claim 2 , wherein said encoding is a low-dimensional encoding.

5. The method of claim 1 , wherein said target 3D scans comprise at least one of: point clouds, triangulated meshes, and splined surfaces.

6. A system comprising:

at least one hardware processor; and

a non-transitory computer-readable storage medium having stored thereon program code, the program code executable by the at least one hardware processor to:

generate a parametrized three-dimensional (3D) body surface model, based, at least in part, on a training set comprising a plurality of 3D scans of subjects, wherein at least some of said 3D scans are of subjects having a skeletal deformity,

receive one or more target 3D scans of a target subject,

optimize said body surface model with respect to said one or more target 3D scans, based, at least in part, on minimizing a loss function which registers said body surface model to said target 3D scans, to calculate a target body surface model of said target subject,

train a skeletal estimation model, based, at least in part, on a training set comprising:

(i) body surface models of a plurality of subjects, and

(ii) skeletal landmarks sets of said plurality of subjects, and

apply said trained skeletal estimation model to said calculated target body surface model of said target subject, to estimate a skeletal shape of said target subject,

wherein at least some of said target 3D scans are labelled with a pose of said subject associated with a respective target 3D scan.

7. The system of claim 6 , wherein said training of said 3D body surface model is configured to encode a body type parameter, based, at least in part, on a labeling of said training set with said skeletal deformity.

8. The system of claim 7 , wherein said labelling is a scoliosis classification category selected from the group consisting of: main thoracic, double thoracic, double/triple major, and thoracolumbar/lumbar.

9. The system of claim 7 , wherein said encoding is a low-dimensional encoding.

10. The system of claim 6 , wherein said target 3D scans comprise at least one of: point clouds, triangulated meshes, and splined surfaces.

11. A computer program product comprising a non-transitory computer-readable storage medium having program code embodied therewith, the program code executable by at least one hardware processor to:

generate a parametrized three-dimensional (3D) body surface model, based, at least in part, on a training set comprising a plurality of 3D scans of subjects, wherein at least some of said 3D scans are of subjects having a skeletal deformity;

receive one or more target 3D scans of a target subject;

optimize said body surface model with respect to said one or more target 3D scans, based, at least in part, on minimizing a loss function which registers said body surface model to said target 3D scans, to calculate a target body surface model of said target subject;

train a skeletal estimation model, based, at least in part, on a training set comprising:

(i) body surface models of a plurality of subjects, and

(ii) skeletal landmarks sets of said plurality of subjects; and

apply said trained skeletal estimation model to said calculated target body surface model of said target subject, to estimate a skeletal shape of said target subject,

wherein at least some of said target 3D scans are labelled with a pose of said subject associated with a respective target 3D scan.

12. The computer program product of claim 11 , wherein said training of said 3D body surface model is configured to encode a body type parameter, based, at least in part, on a labeling of said training set with said skeletal deformity.

13. The computer program product of claim 12 , wherein said labelling is a scoliosis classification category selected from the group consisting of: main thoracic, double thoracic, double/triple major, and thoracolumbar/lumbar.

14. The computer program product of claim 12 , wherein said encoding is a low-dimensional encoding.

15. The computer program product of claim 11 , wherein said target 3D scans comprise at least one of: point clouds, triangulated meshes, and splined surfaces.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 26, 2021
From: KIMMEL, RON; GROISSER, BENJAMIN; WOLF, ALON
To: TECHNION RESEARCH & DEVELOPMENT FOUNDATION LIMITED
Reel/Frame 055420/0482 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 26, 2021
From: WIDMANN, ROGER F.; HILLSTROM, HOWARD J.
To: NEW YORK SOCIETY FOR THE RELIEF OF THE RUPTURED AND CRIPPLED, MAINTAINING THE HOSPITAL FOR SPECIAL SURGERY
Reel/Frame 055420/0616 →
Continuity (2)
Provisional Application 62723598 · Aug 28, 2018
Related Publication 20210345945A1 · Nov 11, 2021