Extended reality system

1. A method for recommending products, comprising:

receiving a three-dimensional (3D) model of one or more products;

performing motion tracking and understanding an environment with points or planes and estimating light or color in the environment;

optimizing points and color features extracted from each image of the environment;

correlating different manufacturer's product sizes and creating correspondences among different manufacturer products;

determining best fitting product based on dimensions of the 3D model plus one or more predetermined gaps;

recommending the best fitting product by looking up the correspondences among different manufacturer products; and

projecting the product in the environment.

2. The method of claim 1 , further comprising:

iteratively changing product position until satisfied;

identifying a best fitting product;

setting each best fitting product's inside dimension with dimensions from the 3D model plus a predetermined gap;

correlating different manufacturer's product sizes and creating correspondences among different manufacturer products; and

recommending the best fitting product by looking up the correspondences among different manufacturer products and generating an augmented or virtual reality display of the new product in the environment.

3. The method of claim 1 , comprising receiving images from an infrared camera.

4. The method of claim 1 , wherein the product comprises an appliance or furniture.

5. The method of claim 1 , wherein the product comprises a wearable item, a jean, or a shirt.

6. The method of claim 5 , comprising rendering an image of the product on a mannequin.

7. The method of claim 5 , comprising monitoring user health by analyzing changes in the 3D model over time.

8. The method of claim 5 , comprising analyzing a user anatomical portion and selecting a best fit from apparel variations.

9. The method of claim 1 , wherein the product comprises cosmetic product, a facial makeup product, a hair product.

10. The method of claim 1 , comprising motion tracking, area learning and depth sensing the product.

11. The method of claim 1 , comprising creating a 3D model using infrared images.

12. The method of claim 1 , comprising identifying one or more best fitting products to the environment and displaying recommendations with one or more best fitting products in the environment.

13. The method of claim 12 , wherein the best fitting products comprise clothing, shoes, cosmetics, appliances or furniture.

14. The method of claim 1 , comprising:

capturing 3D model of user's feet and identifying the subject's current best fitting shoe products;

setting each best fitting shoe product's inside dimension with dimensions from the 3D model plus a predetermined gap and correlating different manufacturer's shoe sizes and creating correspondences among different manufacturer shoe products.

15. The method of claim 1 , comprising:

capturing images of a face and a reference object from a plurality of angles using a mobile camera;

creating a 3D model of the face from the images with dimensions based on dimensions of the reference object;

selecting a makeup pattern or color from a plurality of makeup product variations;

blending the makeup pattern or color onto the 3D model; and

displaying the makeup color on the face.

16. The method of claim 1 , wherein the product comprises a breast implant, comprising recommending a breast augmentation sizing to a patient.

17. An augmented reality system, comprising:

a camera for performing motion tracking and understanding an environment with points or planes and estimating light or color in the environment;

a processor for acquiring sensor data from sensors and optimizing points and color features extracted from each image of the environment, the processor correlating different manufacturer's product sizes and creating correspondences among different manufacturer products and determining best fitting product based on dimensions of the 3D model plus one or more predetermined gaps; and projecting the product in the environment.

18. A method for product recommendation, comprising:

receiving a model of a person and one or more clothing products to be applied to the model;

performing motion tracking and understanding an environment with points or planes and estimating light or color in the environment;

optimizing points and color features extracted from each image of the environment;

correlating different product characteristics as applied to the person and creating correspondences among the one or more clothing products;

determining best fitting product based on color or dimension of a the model;

recommending the best fitting product by looking up the correspondences among the one or more clothing products; and

projecting one of the clothing products on the model in the environment.

19. The method of claim 18 , comprising applying the service to the product from one of: a cosmetic product, a plastic surgery medical device, a facial makeup product, a hair product.

20. A method for cosmetic recommendation, comprising:

performing motion tracking and understanding an environment with points or planes and estimating light or color in the environment;

optimizing points and color features extracted from each image of the environment;

determining best fitting product based on color or dimension of a face or body model;

recommending the best fitting product by looking up color correspondences among different products; and

projecting the product in the environment, wherein the products are facial make-ups, further comprising:

capturing images of a face or body from a plurality of angles using a mobile camera;

detecting a skin tone from the images;

selecting a makeup pattern or color from a plurality of makeup product variations;

modeling the makeup pattern or color interaction with the skin tone; and

displaying a makeup on the face or body.