IP Library Granted Patent US 10,512,321
Granted Patent B2
US 10,512,321 · App. 15/252,766 · Granted Dec 24, 2019

Methods, systems and instruments for creating partial model of a head for use in hair transplantation

Inventors: Franklin T. McArthur (Santa Clara, CA); Gabriele Zingaretti (Felton, CA); Ognjen Petrovic (San Jose, CA)
Assignee: Restoration Robotics, Inc.
A45D44/14G06K9/00362G06K9/4604G06K9/52G06T3/20G06T7/60G06T15/04G06T15/20G06T17/00G06T2200/04G06T2207/30196
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,512,321
App. No.
15/252,766
Granted
Dec 24, 2019
Kind
B2
Abstract

The present disclosure provides for methods, systems and instruments for creating a partial model of a head for use in planning or tracking a procedure, such as hair transplantation. The methodology allows for an accurate 3D representation to be quickly and efficiently generated of an identified portion of the head, not the entire head, from two or more 2D images, such as still images. According to the methodology of the present disclosure a 3D dome representation of the top portion of the head of a subject may be created based on the data extracted from one or more 2D images and/or a certain determined height dimension.

Claims (49)

1. A method for generating a 3D representation of a portion of a head, the method comprising:

determining a height dimension H from a 2D image of a front or a side of a head of a person, the height dimension H corresponding to a distance from a top of the head in the 2D image to a location approximately at or above a level of an eyebrow;

extracting data from the 2D image of the front or the side of the head of the person within the height dimension H and from at least one top view 2D image of the head, the top view 2D image of the head including portions of the head with hair and portions of the head without hair, the data extracted from the at least one top view 2D image of the head comprising a contour of the shape of the top of the head excluding the nose;

creating a 3D dome representation of the portion of the head based on the height dimension H and the extracted data from the 2D images; and

projecting the extracted data from the 2D top view image of the head, including portions of the head with hair and portions of the head without hair but excluding the nose, onto the 3D dome representation of the portion of the head.

2. The method of claim 1 , wherein the height dimension H is less than or equal to approximately 7 cm, or within a range between 6 and 12 cm.

3. The method of claim 1 , wherein the step of extracting data from the 2D image comprises extracting data or information about one or more of: a contour of the top 2D image of the head, an open-loop curve of the front 2D image of the head, an open-loop curve of the side 2D image of the head, or any combination of the above.

4. The method of claim 1 , wherein the step of extracting data from the 2D image comprises extracting data or information about one or more dimensions of the respective top view 2D image, a top portion of the front view 2D image or a top portion of the side view 2D image of the head, or any combination of the above.

5. The method of claim 1 , wherein creating the 3D dome representation comprises adjusting a generic 3D representation of a generic head or a portion of the generic head based on the extracted data.

6. The method of claim 5 , wherein the generic 3D representation of the generic head or the portion of the generic head comprises approximately half a sphere or a generic dome having a generic height Hg.

7. The method of claim 6 , wherein the generic height Hg is based on a historic or statistical data.

8. The method of claim 5 , wherein the generic 3D representation of the generic head or the portion of the generic head is selected from a collection of templates.

9. The method of claim 5 , wherein the adjusting step comprises normalizing the generic 3D representation to correspond to a contour of the 2D top view image of the head.

10. The method of claim 5 , wherein the adjusting step comprises one or more of scaling, translating or rotating of the generic 3D representation.

11. The method of claim 1 , wherein the height dimension H is determined such that data is extracted from portions of the head above the eyebrows that do not have a pronounced curvature or a sharp directional change.

12. The method of claim 1 , wherein the extracting data step comprises using a touch screen to trace one or more contours or open-loop curves of any one or more of the front, the side or the top 2D images.

13. The method of claim 1 , wherein the extracting data step is performed automatically using an image processor.

14. The method of claim 1 , comprising using the created 3D dome representation for planning or performing hair harvesting, hair implantation, site making, hair loss treatment, or hair tattooing procedure.

15. The method of claim 1 , further comprising simulating hair implantation sites or hair follicles.

16. A method for generating a 3D representation of a top dome portion of a head, the method comprising:

determining a height dimension (H) from a 2D image of a front or a side of a head of a person, the height dimension H corresponding to a distance from a top of the head in the 2D image to a location at or above a level of an eyebrow;

extracting data from the 2D image of the front or the side of the head of the person and from at least one more 2D image of a different view of the head of the person;

adjusting a 3D representation of a generic head or at least a top portion of a generic head to create a 3D dome representing a top portion of the head of the person based on: a) the height dimension H and b) extracted data from the 2D image of the front or the side of the head of the person and from the at least one more 2D image of the different view of the head of the person; and

projecting extracted data from a 2D top view image of the head, including portions of the head with hair and portions of the head without hair but excluding the nose, onto the 3D dome representation of the top portion of the head.

17. The method of claim 16 , wherein the at least one more 2D image is a top view image of the head of the person.

18. The method of claim 16 , wherein adjusting the 3D representation of the generic head or the at least top portion of the generic head is based on three 2D images of the head of the person, the three images comprising a top view, the front view and the side view.

19. The method of claim 17 , further comprising tessellating the top view 2D image of the head of the person and deforming it to conform to a top surface of the adjusted 3D representation.

20. The method of claim 16 , wherein the extracting data step comprises tracing one or more contours or open-loop curves of any one or more of the front, the side or the 2D image of a different view to identify a particular orientation of the head of the person.

21. A method for generating a 3D representation of a top dome portion of a head, the method comprising:

extracting data from a contour or a 2D image of a top view of a head of a person, and extracted data excluding the nose; and

adjusting a generic 3D representation of a generic head or at least a top portion of the generic head to create an adjusted 3D dome representing a top portion of the head of the person

wherein the adjusting is based on: a) the extracted data from the contour of the 2D image of the top view of the head of the person, and b) a scaling factor derived at least in part from the extracted data from the contour of the 2D image, and

wherein the scaling factor is applied to adjust a generic height dimension to reflect a distance from a top of the head in the 2D image to a location at or above a level of an eyebrow; and

projecting the extracted data from the 2D image of the top view of the head, including portions of the head with hair and portions of the head without hair but excluding the nose, onto the adjusted 3D dome representing a top portion of the head.

22. The method of claim 21 , wherein the scaling factor comprises an aspect ratio.

23. The method of claim 21 , wherein the scaling factor is constant.

24. The method of claim 21 , wherein the scaling factor is variable depending on a region of the 3D dome or a direction of a coordinate system.

25. The method of claim 21 , wherein the extracting data step comprises tracing one or more contours or open-loop curves of any one or more of the 2D image of the top view, a front view or a side view to identify a particular orientation of the head of the person.

26. A system for generating a 3D representation of a portion of a head, the system comprising:

at least one non-transitory storage medium storing instructions and one or more modules for executing operations on image data, the one or more modules comprising instructions for:

determining a height dimension H from a 2D image of a front or a side of a head of a person, the height dimension H corresponding to a distance from a top of the head in the 2D image to a location approximately at or above a level of an eyebrow;

extracting data from the 2D image of the front or the side of the head of the person within the height dimension H and from at least one top view 2D image of the head, the top view 2D image of the head including portions of the head with hair and portions of the head without hair, the data extracted from the at least one top view 2D image of the head comprising a contour of the shape of the top of the head excluding the nose;

creating a 3D dome representation of the portion of the head based on the height dimension H and the extracted data from the 2D images; and

projecting the extracted data from top view 2D image of the head, including portions of the head with hair and portions of the head without hair but excluding the nose, onto the 3D dome representation of the portion of the head.

27. A system for generating a 3D representation of a top dome portion of a head, the system comprising:

at least one non-transitory storage medium storing instructions, and one or more modules for executing operations on image data, the one or more modules comprising instructions for:

extracting data from a contour or a 2D image of a top view of a head of a person, the 2D image of the top view of the head including portions of the head with hair and portions of the head without hair; and

adjusting a generic 3D representation of a generic head or at least a top portion of the generic head to create an adjusted 3D dome representing a top portion of the head of the person based on: a) extracted data from the contour of the 2D image of the top view of the head of the person, the contour of the 2D image of the top view of the head excluding the nose, and b) a scaling factor derived at least in part from the extracted data from the contour of the 2D image, wherein the scaling factor is applied to adjust a generic height dimension to reflect a distance from a top of the head in the 2D image to a location at or above a level of an eyebrow; and

projecting the extracted data of the 2D image of the top view of the head, including portions of the head with hair and portions of the head without hair but excluding the nose, onto the adjusted 3D dome representing a top portion of the head.

Assignments (9)
SECURITY INTEREST Recorded Jan 19, 2024
From: VENUS CONCEPT INC.
To: EW HEALTHCARE PARTNERS, L.P.
Reel/Frame 066354/0565 →
SECURITY INTEREST Recorded Oct 6, 2023
From: VENUS CONCEPT INC.
To: CITY NATIONAL BANK OF FLORIDA
Reel/Frame 065146/0303 →
CHANGE OF NAME Recorded Oct 13, 2021
From: RESTORATION ROBOTICS, INC.
To: VENUS CONCEPT INC.
Reel/Frame 057788/0712 →
CHANGE OF NAME Recorded Oct 7, 2021
From: RESTORATION ROBOTICS, INC.
To: VENUS CONCEPT INC.
Reel/Frame 057843/0981 →
SECURITY INTEREST Recorded Dec 2, 2019
From: VENUS CONCEPT INC.
To: MADRYN HEALTH PARTNERS, LP
Reel/Frame 051156/0892 →
RELEASE OF SECURITY INTEREST Recorded Nov 7, 2019
From: SOLAR CAPITAL LTD.
To: RESTORATION ROBOTICS, INC.
Reel/Frame 050965/0765 →
TERMINATION OF PATENT SECURITY AGREEMENT Recorded Nov 7, 2019
From: SOLAR CAPITAL LTD.
To: RESTORATION ROBOTICS, INC.
Reel/Frame 050966/0741 →
SHORT-FORM PATENT SECURITY AGREEMENT Recorded May 10, 2018
From: RESTORATION ROBOTICS, INC.
To: SOLAR CAPITAL LTD.
Reel/Frame 046125/0518 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 31, 2016
From: MCARTHUR, FRANKLIN T.; ZINGARETTI, GABRIELE; PETROVIC, OGNJEN
To: RESTORATION ROBOTICS, INC.
Reel/Frame 039602/0479 →
Continuity (2)
Provisional Application 62214594 · Sep 4, 2015
Related Publication 20170065061A1 · Mar 9, 2017