Augmented reality product selection
Systems and methods are disclosed for recommending products or services by receiving a three-dimensional (3D) model of one or more products; performing motion tracking and understanding an environment with points or planes using accelerometer sensor and estimating light or color in the environment using one video camera without a depth sensor in a mobile phone; acquiring sensor data from sensors and optimizing features extracted from each image and sensor data, where a feature conveys data unique to the image at a specific pixel location; and projecting the product in the environment.
1. A method for recommending products, comprising:
with a camera and an accelerometer, performing motion tracking and understanding an environment with points or planes;
acquiring sensor data from sensors and optimizing features extracted from each image and sensor data;
selecting products each with dimensions from a 3D model plus a predetermined gap;
correlating different manufacturer's product sizes and creating correspondences among different manufacturer products;
recommending a new product by looking up the correspondences among different manufacturer products; and
rendering the product in an augmented reality environment.
2. The method of claim 1 , further comprising:
iteratively changing product position until satisfied;
identifying a best fitting product;
setting each best fitting product's inside dimension with dimensions from the 3D model plus a predetermined gap;
correlating different manufacturer's product sizes and creating correspondences among different manufacturer products; and
generating an augmented or virtual reality display of the new product in the environment.
3. The method of claim 1 , comprising receiving images from an infrared camera.
4. The method of claim 1 , wherein the product comprises an appliance or furniture.
5. The method of claim 1 , wherein the product comprises a wearable item, a jean, or a shirt.
6. The method of claim 5 , comprising rendering an image of the product on a mannequin.
7. The method of claim 5 , comprising monitoring user health by analyzing changes in the 3D model over time.
8. The method of claim 5 , comprising analyzing a user anatomical portion and selecting a best fit from apparel variations.
9. The method of claim 1 , wherein the product comprises cosmetic product, a facial makeup product, a hair product.
10. The method of claim 1 , comprising area learning and depth sensing the product.
11. The method of claim 1 , comprising creating a 3D model using infrared images.
12. The method of claim 1 , comprising identifying one or more best fitting products to the environment and displaying recommendations with one or more best fitting products in the environment.
13. The method of claim 12 , wherein the best fitting products comprise clothing, shoes, cosmetics, appliances or furniture.
14. The method of claim 1 , comprising:
capturing 3D model of user's feet and identifying the subject's current best fitting shoe products;
setting each best fitting shoe product's inside dimension with dimensions from the 3D model plus a predetermined gap and correlating different manufacturer's shoe sizes and creating correspondences among different manufacturer shoe products.
15. A system, comprising:
a camera and an accelerometer for performing motion tracking and understanding an environment with points or planes;
a processor for:
acquiring sensor data from sensors and optimizing features extracted from each image and sensor data;
selecting products each with dimensions from a 3D model plus a predetermined gap;
correlating different manufacturer's product sizes and creating correspondences among different manufacturer products;
recommending a new product by looking up the correspondences among different manufacturer products; and
rendering the product in an augmented reality environment.
16. A method for recommending a service, comprising:
with a camera and an accelerometer, performing motion tracking and understanding an environment with points or planes;
acquiring sensor data from sensors and optimizing features extracted from each image and sensor data;
selecting products each with dimensions from a 3D model plus a predetermined gap;
creating correspondences among different services;
recommending a service by looking up the correspondences among different service providers; and
rendering the resulting service in an augmented reality environment.
17. The method of claim 16 , comprising applying the service to a product from one of: a cosmetic product, a plastic surgery medical device, a facial makeup product, a hair product.
18. The method of claim 16 , comprising:
capturing images of a face and a reference object from a plurality of angles using a mobile camera;
creating a 3D model of the face from the images with dimensions based on dimensions of the reference object;
selecting a makeup pattern or color from a plurality of makeup product variations;
blending the makeup pattern or color onto the 3D model; and
displaying the makeup color on the face.
19. The method of claim 16 , wherein the target object comprises a breast implant, comprising recommending a breast augmentation sizing to a patient.
20. The method of claim 16 , wherein the products are facial make-ups, comprising:
capturing images of a face from a plurality of angles using a mobile camera;
detecting a skin tone from the face images;
selecting a makeup pattern or color from a plurality of makeup product variations;
modeling the makeup pattern or color interaction with the skin tone; and
displaying a makeup on the face.