IP Library › Granted Patent US 9,451,810
Granted Patent B2
US 9,451,810 · App. 13/299,856 · Granted Sep 27, 2016

Automated identification of shoe parts

Inventors: Patrick Conall Regan (Taichung, TW); Chang-Chu Liao (Yunlin County, TW); Chih-Chi Chang (Yunlin County, TW)
Assignee: NIKE, Inc.
A43D117/00A43D1/08A43D11/00A43D111/00A43D111/006A43D119/00B25J9/1687G06T7/0042A43D2200/10A43D2200/30A43D2200/50A43D2200/60G05B2219/37205G05B2219/37555G05B2219/39107G05B2219/45243G06T2207/30108
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,451,810
App. No.
13/299,856
Granted
Sep 27, 2016
Kind
B2
Abstract

Manufacturing of a shoe or a portion of a shoe is enhanced by automated placement of shoe parts. For example, a part-recognition system analyzes an image of a shoe part to identify the part and determine a location of the part. Once the part is identified and located, the part can be manipulated in an automated manner.

Claims (53)

1. A method for positioning a shoe part in an automated manner during a shoe-manufacturing process, the method comprising:

positioning an attachment shoe part which is to be attached to a base shoe part;

recording a first image of the attachment shoe part using at least one first camera, the first image depicting a two-dimensional representation of the attachment shoe part;

recording a second image of the base shoe part using at least one second camera, the second image depicting a two-dimensional representation of the base shoe part;

identifying at least one reference feature of the attachment shoe part in the first image depicting the two-dimensional representation of the attachment shoe part;

determining an identity of the attachment shoe part from the first image by matching the at least one reference feature of the first image to at least one pre-determined reference feature of a shoe-part reference image;

determining a first geometric coordinate of the attachment shoe part in a geometric coordinate system, which maps a three-dimensional space within which a part-transfer apparatus operates, from the first image;

determining an orientation of the attachment shoe part from the first image;

determining a second geometric coordinate of the base shoe part in the geometric coordinate system by analyzing the second image depicting the two-dimensional representation of the base shoe part;

determining a degree of rotation of the attachment shoe part required for alignment with the base shoe part for attachment; and

transferring, by the part-transfer apparatus, the attachment shoe part from the first geometric coordinate to the second geometric coordinate through the degree of rotation so that the attachment shoe part is aligned with the base shoe part for attachment.

2. The method of claim 1 , wherein when the first image is recorded, the attachment shoe part is held by the part-transfer apparatus.

3. The method of claim 1 , wherein when the first image is recorded, the attachment shoe part is maintained at a supply station from which the attachment shoe part is acquired by the part-transfer apparatus.

4. The method of claim 1 , wherein the two-dimensional representation of the attachment shoe part is comprised of a two-dimensional shape having a perimeter, and wherein the at least one reference feature of the two-dimensional representation of the attachment shoe part is associated with the perimeter.

5. The method of claim 1 , further comprising:

determining pixel coordinates of the first image that correspond to the at least one pre-determined reference feature; and

converting, by a computer processor, the pixel coordinates of the first image to the first geometric coordinate of the geometric coordinate system,

wherein the shoe-part reference image is stored in a datastore, and wherein the datastore stores a plurality of shoe-part reference images.

6. The method of claim 1 , wherein the orientation of the attachment shoe part is determined from the at least one reference feature of the first image.

7. The method of claim 6 , wherein the part transfer apparatus utilizes at least one of a gripping structure, suction, electromagnetic forces, and surface tack.

8. A system that positions a shoe part in an automated manner during a shoe-manufacturing process, the system comprising:

at least one image recorder that records a first image of an attachment shoe part and a second image of a base shoe part, the first image depicting a two-dimensional representation of the attachment shoe part and the second image depicting a two dimensional representation of the base shoe part;

computer storage media having stored thereon computer-executable instructions that, when executed, cause a computing device to:

identify at least one reference feature of the two-dimensional representation of the attachment shoe part to determine an identity of the attachment shoe part by matching the at least one reference feature to at least one predetermined reference feature of a shoe-part reference image;

determine a first geometric coordinate of the attachment shoe part in a geometric coordinate system, which maps a three-dimensional space within which the attachment shoe part is positioned and a part-transfer apparatus operates, from the first image;

determine an orientation of the attachment shoe part from the first image and determine a degree of rotation of the attachment shoe part required for alignment with the base shoe part for attachment; and

determine a second geometric coordinate of the base shoe part in the geometric coordinate system by analyzing the second image of the base shoe part; and

the part-transfer apparatus, wherein the part transfer apparatus is configured to:

receive the first geometric coordinate and the second geometric coordinate; and

transfer the attachment shoe part from the first geometric coordinate to the second geometric coordinate through the degree of rotation so the attachment shoe part is aligned with the base shoe part for attachment.

9. The system of claim 8 , wherein the at least one image recorder further comprises at least one first image recorder that records the first image and at least one second image recorder that records the second image.

10. The system of claim 9 , wherein the first image recorder is mounted onto the part-transfer apparatus, and wherein the attachment shoe part is provided at a part-supply apparatus when the first image is recorded.

11. The system of claim 9 , wherein the first image recorder is mounted remotely from the part-transfer apparatus, and wherein the part-transfer apparatus retains the attachment shoe part when the first image is recorded.

12. The system of claim 8 , further comprising a light-emitting device that provides a backlight to the attachment shoe part when the first image is recorded.

13. The system of claim 12 , wherein the light-emitting device is coupled to the part-transfer apparatus, such that when the part-transfer apparatus retains the attachment shoe part at a time instant the first image is recorded, the backlight is provided to the attachment shoe part.

14. The system of claim 12 , wherein the light-emitting device is coupled to a part-supply apparatus, such that when the part-supply apparatus retains the attachment shoe part at a time instant the first image is recorded, the backlight is provided to the attachment shoe part.

15. A method for positioning a shoe part in an automated manner during a shoe-manufacturing process, the method comprising:

providing an attachment shoe part and a base shoe part;

recording a first image of the attachment shoe part using at least one camera, the first image depicting a two-dimensional representation of the attachment shoe part;

recording a second image of the base shoe part using at least one camera, the second image depicting a two-dimensional representation of the base shoe part;

identifying at least one reference feature of the attachment shoe part in the two-dimensional representation of the attachment shoe part;

determining an identity of the attachment shoe part from the first image by matching the at least one reference feature of the first image with at least one pre-determined reference feature of a shoe-part reference image;

determining a first geometric coordinate of the attachment shoe part in a geometric coordinate system, which maps a three-dimensional space within which a part-transfer apparatus operates, from the first image;

determining an orientation of the attachment shoe part from the first image;

determining a second geometric coordinate of the base shoe part in the geometric coordinate system by analyzing the second image depicting the two dimensional representation of the base shoe part;

determining a degree of rotation of the attachment shoe part required for alignment with the base shoe part from the first image and the second image;

transferring, by the part-transfer apparatus, the attachment shoe part from the first geometric coordinate to the second geometric coordinate through the degree of rotation so the attachment shoe part is aligned with the base shoe part for attachment; and

attaching the attachment shoe part to the base shoe part at the second geometric coordinate.

16. The method of claim 15 , wherein the two-dimensional representation of the attachment shoe part is comprised of a two-dimensional shape having a perimeter, and wherein the at least one reference feature is associated with the perimeter.

17. The method of claim 15 , wherein the first image comprises a plurality of representations of attachment shoe parts, wherein each representation depicts a respective attachment shoe part that is positioned in the three dimensional space and that is to be transferred to the second geometric coordinate for attachment to the base shoe part.

18. The method of claim 17 , further comprising analyzing the plurality of representations to determine a respective geometric coordinate of each of the attachment shoe parts that are depicted in the first image.

19. The method of claim 17 , further comprising determining a placement order in which each of the attachment shoe parts is to be transferred to the second geometric coordinate for attachment to the base shoe part.

20. The method of claim 15 , wherein when the first image is recorded, the attachment shoe part is maintained at a supply station from which the attachment shoe part is acquired by the part-transfer apparatus, and wherein the at least one camera that records the first image is mounted to the part-transfer apparatus.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 23, 2012
From: REGAN, PATRICK CONALL
To: NIKE, INC.
Reel/Frame 028838/0671 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 23, 2012
From: LIAO, CHANG-CHU; CHANG, CHIH-CHI
To: FENG TAY ENTERPRISES CO., LTD.
Reel/Frame 028838/0704 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 23, 2012
From: FENG TAY ENTERPRISES CO., LTD.
To: NIKE, INC.
Reel/Frame 028838/0740 →
Continuity (1)
Related Publication 20130131853A1 · May 23, 2013