IP Library Granted Patent US 10,157,503
Granted Patent B2
US 10,157,503 · App. 15/972,149 · Granted Dec 18, 2018

Augmented reality system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,157,503
App. No.
15/972,149
Granted
Dec 18, 2018
Kind
B2
Abstract

Systems and methods are disclosed for recommending products or services by receiving a three-dimensional (3D) model of one or more products; performing motion tracking and understanding an environment with points or planes using accelerometer sensor and estimating light or color in the environment using one video camera without a depth sensor in a mobile phone; acquiring sensor data from sensors and optimizing features extracted from each image and sensor data, where a feature conveys data unique to the image at a specific pixel location; and projecting the product in the environment.

Claims (56)

1. A method for recommending products, comprising:

receiving a three-dimensional (3D) model of one or more products;

performing motion tracking and understanding an environment with points or planes and estimating light or color in the environment;

acquiring sensor data from sensors and optimizing features extracted from each image and sensor data; and

iteratively changing product position until satisfied to identify a best fitting product;

setting each best fitting product's inside dimension with dimensions from the 3D model plus a predetermined gap;

correlating different manufacturer's product sizes and creating correspondences among different manufacturer products; and

recommending a new product by looking up the correspondences among different manufacturer products; and

projecting the product in the environment.

2. The method of claim 1 , comprising receiving images from an infrared camera.

3. The method of claim 1 , wherein the product comprises an appliance or furniture.

4. The method of claim 1 , wherein the product comprises a wearable item, a jean, or a shirt.

5. The method of claim 4 , comprising rendering an image of the product on a mannequin.

6. The method of claim 4 , comprising monitoring user health by analyzing changes in the 3D model over time.

7. The method of claim 4 , comprising analyzing a user anatomical portion and selecting a best fit from apparel variations.

8. The method of claim 1 , wherein the product comprises cosmetic product, a facial makeup product, a hair product.

9. The method of claim 1 , comprising motion tracking, area learning and depth sensing the product.

10. The method of claim 1 , comprising creating a 3D model using infrared images.

11. The method of claim 1 , comprising identifying one or more best fitting products to the environment and displaying recommendations with one or more best fitting products in the environment.

12. The method of claim 11 , wherein the best fitting products comprise clothing, shoes, cosmetics, appliances or furniture.

13. The method of claim 1 , comprising:

capturing 3D model of user's feet and identifying the subject's current best fitting shoe products;

setting each best fitting shoe product's inside dimension with dimensions from the 3D model plus a predetermined gap and correlating different manufacturer's shoe sizes and creating correspondences among different manufacturer shoe products.

14. A method for best fitting product variations to an environment, comprising:

receiving a three-dimensional (3D) model of one or more products;

performing motion tracking and understanding an and estimating light or color in the environment;

iteratively changing product position until satisfied to identify a best fitting product;

setting each best fitting product's inside dimension with dimensions from the 3D model plus a predetermined gap;

correlating different manufacturer's product sizes and creating correspondences among different manufacturer products;

recommending a new product by looking up the correspondences among different manufacturer products; and

generating an augmented or virtual reality display of the product in the environment.

15. A method for recommending a service, comprising:

receiving a three-dimensional (3D) model of a service to be applied to a target object;

performing motion tracking and understanding an and estimating light or color in the environment;

determining one or more dimensions of an environment of the target object;

generating the 3D model of the service as applied to the target object;

iteratively changing product position until satisfied to identify a best fitting product;

setting each best fitting product's inside dimension with dimensions from the 3D model plus a predetermined gap;

correlating different manufacturer's product sizes and creating correspondences among different manufacturer products; and

recommending a new product by looking up the correspondences among different manufacturer products;

creating correspondences among alternative services to apply the target object and scaling the 3D model of the generated 3D model based on dimensions of the environment and the service; and

generating an augmented or virtual reality display of the service as applied to the target object in the environment.

16. The method of claim 15 , comprising applying the service to a product from one of: a cosmetic product, a plastic surgery medical device, a facial makeup product, a hair product.

17. The method of claim 15 , comprising:

capturing images of a face and a reference object from a plurality of angles using a mobile camera;

creating a 3D model of the face from the images with dimensions based on dimensions of the reference object;

selecting a makeup pattern or color from a plurality of makeup product variations; and

blending the makeup pattern or color onto the 3D model; and

displaying the makeup color on the face.

18. The method of claim 15 , wherein the target object comprises a breast implant, comprising recommending a breast augmentation sizing to a patient.

19. The method of claim 15 , wherein the products are facial make-ups, comprising:

capturing images of a face from a plurality of angles using a mobile camera;

detecting a skin tone from the face images;

selecting a makeup pattern or color from a plurality of makeup product variations; and

modeling the makeup pattern or color interaction with the skin tone; and

displaying a makeup on the face.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 15, 2025
From: TRAN, BAO
To: ARBOR SYSTEMS LLC
Reel/Frame 073078/0900 →
Cited By (3)
US 12,189,915 US 12,211,161 US 12,307,587