IP Library › Granted Patent US 12,014,462
Granted Patent B2
US 12,014,462 · App. 17/736,010 · Granted Jun 18, 2024

Generation of a 3D model of a reference object to perform scaling of a model of a user's head

Inventors: Oleg Selivanov (San Mateo, CA); Trevor Noel Howarth (San Francisco, CA); Amruta Rajendra Kulkarni (Fremont, CA)
Assignee: DITTO TECHNOLOGIES, INC.
G06T17/20G06T7/55G06T7/74G06T7/75G06T19/20G06V40/171G06T2219/2004G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,014,462
App. No.
17/736,010
Granted
Jun 18, 2024
Kind
B2
Abstract

Methods and systems herein can include a processor configured to obtain a set of images that shows a user's head and a reference object, generate a user's head model of the user's head based at least in part on the set of images, and generate a reference object model of the reference object based at least in part on the set of images. The processor can further be configured to determine an orientation and a size of the reference object model based at least in part on a relative location of the reference object relative to the user's head in the set of images and use the reference object model, the orientation of the reference object model, the size of the reference object, and a known dimension of the reference object to determine scaling information. The processor can then be configured to apply the scaling information to the user's head model to obtain a scaled user's head model. The system can also include a memory coupled to the processor and configured to provide the processor with instructions.

Claims (50)

1. A system, comprising:

a memory including instructions; and

a processor, when accessing the instructions, is configured to:

obtain a set of images that shows a user's head and a reference object;

generate a user's head model based at least in part on the set of images;

generate a reference object model based at least in part on the set of images;

determine an orientation and a size of the reference object model based at least in part on a location of the reference object relative to the user's head in the set of images;

use the reference object model, the orientation of the reference object model, the size of the reference object, and a known dimension of the reference object to determine scaling information;

apply the scaling information to the user's head model to obtain a scaled user's head model; and

wherein to determine the orientation of the reference object model, the processor is further configured to:

generate a facial feature model of a portion of the user's head corresponding to the location of the reference object relative to the user's head in the set of images; and

determine the orientation of the reference object model using the facial feature model of the portion of the user's head.

2. The system of claim 1 , wherein:

the set of images comprises a first set of images;

the processor is further configured to receive a second set of images that shows the user's head but not the reference object; and

the user's head model is further generated based at least in part on the second set of images.

3. The system of claim 1 , wherein the reference object is associated with a standard size or known dimensions.

4. The system of claim 1 , wherein the location of the reference object relative to the user's head in the set of images is predetermined.

5. The system of claim 1 , wherein the processor is further configured to determine a location of the reference object in at least one image of the set of images.

6. The system of claim 1 , wherein the processor is further configured to determine a key facial point in at least one image of the set of images.

7. The system of claim 1 , wherein the user's head model and the reference object model are in the same coordinate system.

8. The system of claim 1 , wherein the processor is further configured to:

place a glasses frame model on the scaled user's head model; and

use stored measurement information associated with the glasses frame model and the placement of the glasses frame model on the scaled user's head model to determine a set of facial measurements associated with the user's head.

9. The system of claim 8 , wherein the processor further configured to determine a respective confidence level or a classification of accuracy corresponding to at least one facial measurement.

10. The system of claim 8 , wherein the processor is further configured to:

compare the set of facial measurements to stored dimensions of a set of glasses frames; and

output one or more recommended glasses frames at a user interface based at least in part on the comparisons.

11. The system of claim 8 , wherein the processor is further configured to:

input the set of facial measurements to a machine learning based model to obtain a set of recommended glasses frames; and

output the set of recommended glasses frames at a user interface.

12. A method for scaling a captured image of a user's head, comprising:

obtaining a set of images that shows a user's head and a reference object;

generating a user's head model based at least in part on the set of images;

generating a reference object model based at least in part on the set of images;

generating a facial feature model of a portion of the user's head corresponding to the location of the reference object relative to the user's head in the set of images;

determining the orientation of the reference object model using the facial feature model of the portion of the user's head;

determining an orientation and a size of the reference object model based at least in part on a location of the reference object relative to the user's head in the set of images;

using the reference object model, the orientation of the reference object model, the size of the reference object, and a known dimension of the reference object to determine scaling information; and

applying the scaling information to the user's head model to obtain a scaled user's head model.

13. The method of claim 12 , wherein:

the set of images comprises a first set of images;

the method further comprises receiving a second set of images that shows the user's head but not the reference object; and

generating the user's head model based at least in part on the second set of images.

14. The method of claim 12 , wherein the reference object is associated with a standard size or known dimensions.

15. The method of claim 12 , wherein the user's head model and the reference object model are in the same coordinate system.

16. The method of claim 12 , further comprising:

placing a glasses frame model on the scaled user's head model; and

using stored measurement information associated with the glasses frame model and the placement of the glasses frame model on the scaled user's head model to determine a set of facial measurements associated with the user's head.

17. The method of claim 12 , further comprising inputting a set of facial measurements to a machine learning based model to obtain a set of recommended glasses frames.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 14, 2024
From: SELIVANOV, OLEG; HOWARTH, TREVOR NOEL; KULKARNI, AMRUTA RAJENDRA
To: DITTO TECHNOLOGIES, INC.
Reel/Frame 067413/0103 →
Continuity (2)
Provisional Application 63183396 · May 3, 2021
Related Publication 20220351467A1 · Nov 3, 2022