IP Library Granted Patent US 9,429,754
Granted Patent B2
US 9,429,754 · App. 13/962,276 · Granted Aug 30, 2016

Wearable assembly aid

Inventor: Timothy H. Robertson (Novi, MI)
Assignee: Nissan North America, Inc.
G02B27/017G06K9/00671G06K9/3216G06K9/78G02B2027/014G02B2027/0138G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,429,754
App. No.
13/962,276
Granted
Aug 30, 2016
Kind
B2
Abstract

Methods, devices and systems are provided for aiding an operator in performing an assembly operation by displaying the position of a component using a device worn by the operator. In one aspect, a method of aiding an operator in performing an assembly operation at an assembly station comprises: scanning the assembly station, using a camera, for the position of a component identified to be used in the assembly operation; and displaying, using a display worn by the operator, the position of the identified component within the assembly station to the operator.

Claims (58)

1. A computer-implemented method of aiding an operator at an assembly station, comprising:

identifying, using a wearable device by the operator, one of a plurality of assembly stations as an assembly station in which the operator is located based on a determined location of the wearable device;

determining, by a controller, an upcoming assembly operation of an assembly routine for the assembly station;

identifying, by the controller, a component to be selected by the operator to use in the upcoming assembly operation;

scanning the assembly station using a camera to capture at least one image of the assembly station;

identifying a match between the at least one captured image and an indicia that is representative of the identified component;

determining, by the controller based in part on the captured image, a position of the identified component within the assembly station; and

displaying, using a display worn by the operator, the position of the identified component within the assembly station to the operator.

2. The method of claim 1 , further comprising:

determining the position of the identified component within the assembly station based on the identified match.

3. The method of claim 2 , wherein the indicia representative of the identified component is one of a bar code, a part number or a depiction of the identified component.

4. The method of claim 1 , further comprising:

capturing, using the camera, at least one image of the operator selecting a stored component;

attempting to identify a match between the at least one captured image and an indicia that is representative of the identified component; and

if a match is not identified, transmitting a notification that the component selected by the operator to perform the assembly operation is not the identified component.

5. The method of claim 4 , wherein the notification comprises one notification to the operator and another notification to a supervisor.

6. The method of claim 1 , wherein determining the position of the identified component is further based on known configurations of the assembly station.

7. The method of claim 1 , further comprising:

collecting metrics of the operator's selections of identified components.

8. A device for aiding an operator at an assembly station, comprising:

a display adapted to be worn by the operator;

a camera adapted to be worn with the display by the operator; and

a controller in communication with the display, the controller programmed to:

identify one of a plurality of assembly stations as the assembly station in which the operator is located;

determine an upcoming assembly operation of an assembly routine for the assembly station;

operate the camera to capture at least one image of the assembly station;

identify a component to be selected by the operator to use in the upcoming assembly operation by identifying a match between the at least one captured image of the assembly station and an indicia that is representative of the identified component; and

in response to an identification of the identified component, and a determination, based on at least one captured image of the assembly station, of the position of the identified component within the assembly station, operate the display to display the position of the identified component within the assembly station to the operator.

9. The device of claim 8 , further comprising:

an eyewear frame configured for attachment to the operator's head, the display supported by the frame.

10. The device of claim 9 , further comprising:

a protective lens supported by the frame, wherein the display is positioned at the lens to display the position of the identified component within the assembly station to the operator.

11. The device of claim 8 , wherein the controller is programmed to:

determine the position of the identified component within the assembly station based on the identified match.

12. The device of claim 8 , wherein the indicia representative of the identified component is one of a bar code, a part number or a depiction of the identified component.

13. The device of claim 8 , wherein the device is a wearable device and the controller is programmed to:

identify the component to be used in the assembly operation based on an assembly routine for the identified assembly station.

14. The device of claim 8 , further comprising a transmitter, wherein the controller is programmed to:

operate the camera to capture at least one image of the operator performing the assembly operation;

attempt to identify a match between the at least one captured image of the operator performing the assembly operation and an indicia that is representative of the identified component; and

if a match is not identified, operate the transmitter to transmit a notification that the component used by the operator to perform the assembly operation is not the identified component.

15. A system for aiding an operator at an assembly station, comprising:

a display adapted to be worn by the operator;

a camera configured to capture images; and

at least one controller in communication with the display and the camera, the at least one controller programmed to:

identify one of a plurality of assembly stations as the assembly station at which the operator is located;

determine an upcoming assembly operation of an assembly routine for the assembly station;

identify a component to be selected by the operator to use in the upcoming assembly operation;

operate the camera to capture at least one image of the assembly station;

determine the position of the identified component within the assembly station based on the at least one captured image of the assembly station by identifying a match between the at least one captured image of the assembly station and an indicia that is representative of the identified component; and

operate the display to display the determined position of the identified component within the assembly station to the operator.

16. The system of claim 15 , wherein the at least one controller is programmed to:

determine the position of the identified component within the assembly station based on the identified match.

17. The system of claim 15 , wherein the indicia representative of the identified component is one of a bar code, a part number or a depiction of the identified component.

18. The system of claim 15 , further comprising a transmitter, wherein the at least one controller is programmed to:

operate the camera to capture at least one image of the operator performing the assembly operation;

attempt to identify a match between the at least one captured image of the operator performing the assembly operation and an indicia that is representative of the identified component; and

if a match is not identified, operate the transmitter to transmit a notification that the component used by the operator to perform the assembly operation is not the identified component.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 8, 2016
From: NISSAN NORTH AMERICA, INC.
To: NISSAN MOTOR CO., LTD.
Reel/Frame 040603/0637 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2013
From: ROBERTSON, TIMOTHY H.
To: NISSAN NORTH AMERICA, INC.
Reel/Frame 030970/0239 →
Continuity (1)
Related Publication 20150042785A1 · Feb 12, 2015