IP Library Granted Patent US 10,067,500
Granted Patent B2
US 10,067,500 · App. 15/634,161 · Granted Sep 4, 2018

Generating of 3D-printed custom wearables

Inventors: Shamil Mahendra Hargovan (San Jose, CA); Enger Lasada Bewza (Surrey, CA); Colin Michael Lawson (Vancouver, CA); Ben Wynne (Escondido, CA); Manuj Aggarwal (Vancouver, CA); Louis-Victor Jadavji (West Vancouver, CA); Jamie Lynn Etcheson (San Diego, CA); Carlos Montalvo (Menlo Park, CA)
Assignee: Wiivv Wearables Inc.
G05B19/4099A43B17/00A43B17/003A43D1/025B29C64/386B29D35/122B33Y10/00B33Y30/00B33Y50/00B33Y50/02B33Y80/00G06T15/205G06T17/20B29L2031/50G05B2219/35134G05B2219/49007G06T2200/04G06T2200/08G06T2215/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,067,500
App. No.
15/634,161
Granted
Sep 4, 2018
Kind
B2
Abstract

Disclosed is a platform for generating and delivering 3-D printed wearables. The platform includes scanning, image processing, machine learning, computer vision, and user input to generate a printed wearable. Scanning occurs in a number of ways across a number of devices. The variability of scanning generates a number of scanning output types. Outputs from the scanning process are normalized into a single type during image processing. The computer vision and machine learning portions of the platform use the normalized body scan to develop models that may be used by a 3D printer to generate a wearable customized to the user. The platform further provides opportunities for the user to check the work of the scanning, image processing, computer vision, and machine learning. The user input enables the platform to improve and inform the machine learning aspects.

Claims (74)

1. A method comprising:

receiving, through a program interface, a top view image and a side view image of a bare foot, at least one of the top view image or the side view image of the bare foot including a reference object;

generating one or more two-dimensional (2D) coordinate graphs of the bare foot based on the top view image and the side view image of the bare foot, the one or more 2D coordinate graphs each including coordinates in only two dimensions;

deriving a size of the bare foot and a shape of an arch of the bare foot from the one or more 2D coordinate graphs and a known size of the reference object;

generating a 3D model of a wearable object corresponding to the bare foot based on the size of the bare foot and the shape of the arch of the bare foot derived from the one or more 2D coordinate graphs of the bare foot; and

sending, to a 3D printer, information for use in printing a physical wearable object based on the 3D model.

2. The method of claim 1 , further comprising:

receiving a message, by the program interface, from a user, the message accepting the 3D model of the wearable object; and

printing, by a 3D printer, a wearable object corresponding to the 3D model of the wearable object.

3. The method of claim 1 , further comprising:

receiving, by a mobile device application, a set of images of the bare foot from a mobile device camera;

filtering, by the mobile device application, the set of images of the bare foot into accepted images and rejected images based upon a computer vision comparison to reference images, wherein the reference images preexist the set of images of the bare foot; and

communicating, by the mobile device application, accepted images to the program interface as the image of the bare foot from the side view and the image of the bare foot from the top view.

4. The method of claim 1 , wherein the reference object is a sheet of standardized-size paper.

5. The method of claim 3 , further comprising:

issuing instructions, by the mobile device application, to a user of an associated mobile device depicting expected positioning of the bare foot.

6. The method of claim 1 , wherein the top view image and side view image comprises at least one of:

infrared imaging data;

confocal microscopy data;

lightfield imaging data; or

ultrasound imaging data.

7. The method of claim 1 , further comprising:

collecting, by a mobile application of a mobile device, video data of a bare foot, the video data including a video clip wherein a film perspective rotates about the part of the living body; and

extracting image frames from the video data, the image frames including the top view and the side view images of the bare foot, wherein the image frames are determined by comparing and matching each frame of the video data to reference frames, wherein the reference frames preexist the video data.

8. The method of claim 1 , wherein the program interface is an application program interface (API), and wherein said exposing step further comprises:

exposing for download or temporary access, through the API, the 3D model of the wearable object;

requiring a password to access the 3D model of the wearable object, the password associated with the view and side view images of the bare foot.

9. The method of claim 1 , further comprising:

printing, by a 3D printer, a wearable object corresponding to the 3D model of the wearable object;

generating a time-lapse video depicting said printing step; and

transmitting the time-lapse video to a web host for hosting.

10. The method of claim 1 , wherein said generating the 3D model of the wearable object further comprises:

identifying a tessellation kit that matches a predetermined wearable object class; and

modifying the identified tessellation kit based on the size of the bare foot and the shape of the arch.

11. The method of claim 10 , wherein said generating the 3D model of the wearable object further comprises:

determining the predetermined wearable object class based on categorization of the size of the bare foot and the shape of the arch.

12. A method comprising:

receiving, by a processor, video data of a part of a living body, the video data including a video clip wherein a camera perspective rotates about the part of the living body;

extracting image frames from the video data, the image frames including the part of the living body captured at a number of perspectives, wherein the extracted image frames are based on a matching comparison between each frame of the video data to one or more reference frames, wherein the reference frames preexist the video data;

generating, a digital model of the body part based on the extracted imaged frames; and

generating, a 3D model of a wearable corresponding to the part of the living body based on the digital model.

13. The method of claim 12 , further comprising:

exposing, through an API, the 3D model of the wearable.

14. The method of claim 13 , wherein said exposing step further comprises:

requiring a password to access the 3D model of the wearable, the password associated with the body part image data.

15. The method of claim 12 , wherein the body part of the living body is a foot, and the 3D model of a wearable is a footwear insert.

16. The method of claim 12 , further comprising:

printing, by a 3D printer, a wearable corresponding to the 3D model of the wearable;

generating a time-lapse video depicting said printing step; and

transmitting the time-lapse video to a web host for hosting.

17. The method of claim 12 , further comprising:

determining physical dimensions of the part of the living body using two or more frames of the video data as parallax viewpoints.

18. A system comprising:

a network-connected server configured to process a top view image and a side view image of a bare foot, wherein at least one of the top view image or side view image of the bare foot includes a reference object, the network-connected server further configured to generate one or more two-dimensional (2D) coordinate graphs of the bare foot based on the top view image and the side view image of the bare foot, the one or more 2D coordinate graphs each including coordinates in only two dimensions, and wherein the network-connected server is configured to derive a size of the bare foot and a shape of an arch of the bare foot from the one or more 2D coordinate graphs and a known size of the reference object, the network-connected server configured to generate a 3D model of a wearable object corresponding to the bare foot based on the size of the bare foot and the shape of the arch of the bare foot derived from the one or more 2D coordinate graphs of the bare foot; and

a program interface instantiated on a number of devices external to the network-connected server and configured to communicate with the network-connected server, the program interface configured to receive top and side view images on a first device of the external devices.

19. The system of claim 18 , further comprising:

a communication interface configured to output the 3D model of the wearable object to a 3D printer configured to print the wearable object from the 3D model of the wearable object.

20. The system of claim 18 , further comprising:

a mobile device application instanced on a mobile device, the mobile device application in communication with the web server via a mobile device network communicator and is integrated with the program interface, the mobile device application configured to interface with a mobile device camera and capture top and side view images of the bare foot.

21. The system of claim 19 , further comprising:

a video server that hosts time-lapse videos that are accessible from the Internet.

22. The system of claim 19 , wherein the network-connected server is, while generating the 3D model of the wearable object, further configured to:

identify a tessellation kit that matches a predetermined wearable object class;

modify the identified tessellation kit based on the size of the bare foot and the shape of the arch.

23. The system of claim 18 , wherein the network-connected server is, while generating the 3D model of the wearable object, further configured to:

determine the predetermined wearable object class based on categorization of the size of the bare foot and the shape of the arch.

24. A method comprising:

collecting, by a mobile device application of a mobile device, video data of a part of a living body, the video data including a video clip wherein a camera perspective rotates about the part of the living body;

determining, by the mobile device application of the mobile device, whether frames from the video data match stored reference frames within a predetermined margin of error, wherein the reference frames preexist the video data; and

transmitting, by the mobile device application of the mobile device, the frames of the video data that are determined within the predetermined margin of error to a network-connected server for further processing.

25. The method of claim 24 , further comprising:

receiving, by the mobile device application of the mobile device, a 3D model of a wearable corresponding to the body part specifically included in the video data.

26. The method of claim 25 , further comprising:

transmitting, by the mobile device application of the mobile device, a quality control message to the network-connected server indicating either approval or rejection of the 3D model of the wearable.

Assignments (2)
ENTITY CONVERSION Recorded Feb 14, 2023
From: BALDWIN, JOE
To: WIIVV WEARABLES INC.
Reel/Frame 062749/0504 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2018
From: AGGARWAL, MANUJ; BEWZA, ENGER LASADA; LAWSON, COLIN MICHAEL; WYNNE, BEN; HARGOVAN, SHAMIL MAHENDRA; JADAVJI, LOUIS-VICTOR; ETCHESON, JAMIE LYNN; MONTALVO, CARLOS
To: WIIVV WEARABLES INC.
Reel/Frame 045538/0566 →
Continuity (3)
Continuation 15390406 · Dec 23, 2016
Provisional Application 62275242 · Jan 6, 2016
Related Publication 20170293286A1 · Oct 12, 2017
Cited By (8)
US 12,211,076 US 12,285,080 US 12,373,870 US 12,408,730 US 12,468,289 US 12,635,753 US 12,700,118 US 12,727,783