IP Library › Granted Patent US 11,307,411
Granted Patent B2
US 11,307,411 · App. 14/411,664 · Granted Apr 19, 2022

Support device and system for article picking or sorting work

Inventors: Kazuhito Watanabe (Tokyo, JP); Tadao Ito (Saitama, JP); Juji Yokoya (Chiba, JP); Norio Yagishita (Tokyo, JP); Norihiro Wada (Tokyo, JP); Yuka Tsushima (Tokyo, JP); Michio Yokoyama (Tokyo, JP); Hideaki Yonaga (Tokyo, JP); Yasuhide Matsumoto (Tokyo, JP); Rokuro Iwase (Tokyo, JP)
Assignees: TOYO KANETSU SOLUTIONS K.K.; M. SOFT CO., LTD.
G02B27/017B65G1/1375G06Q10/087G06Q50/28B65G2209/04B65G2209/06G02B2027/014G02B2027/0138G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,307,411
App. No.
14/411,664
Granted
Apr 19, 2022
Kind
B2
Abstract

Some embodiments are directed to a device that supports work of picking or sorting an article from a warehouse and the like, which allows the picking work to be carried out accurately and quickly. The device includes: a camera that photographs an automatically-readable identifier that is attached to a storage location of an article; an information processing unit that detects the identifier from an image photographed by the camera and processes the image of the identifier; and a display that displays information such as image information and text information. The information processing unit processes, based on the detected identifier and picking work order information, image on a specific identifier, and the processed image is displayed on the display at a location related to the identifier.

Claims (114)

1. An article picking or sorting work support device,

comprising:

A) an imaging unit that obtains image information including automatically-readable, optical feature information associated with an article or a storage location of an article or a location where an article is to be sorted;

B) an information processing unit that detects said optical feature information from the image information obtained by said imaging unit and processes image information about said optical feature information; and

C) a display that displays information such as said image information and text information, wherein

said information processing unit processes, based on said detected, optical feature information and predetermined, picking or sorting work order information, image information about specific, optical feature information and displays said processed image information from an aisle to a rack or further to housing frontage or image information of the aisle to the rack or further to the housing frontage themselves, on said display so that the displayed said processed image information or said image information of the aisle to the rack or further to the housing frontage themselves are emphasized superimposed on said image information obtained by said imaging unit or superimposed on actual visual scenery.

2. The article picking or sorting work support device according to claim 1 , further comprising:

D) a guidance unit that guides a worker to a storage location of an article, wherein

after said guidance unit guides the worker to said storage location of an article, said information processing unit processes, based on said detected, optical feature information and the predetermined picking or sorting work order information, image information about said specific, optical feature information and

said processed image information is displayed on said display at a location related to said specific, optical feature information.

3. The article picking or sorting work support device according to claim 2 , wherein

said guidance unit uses any one method of a method that uses automatically-readable, optical feature information similar to said automatically-readable, optical feature information associated with said article or said storage location of an article; a guidance method that uses radio waves; inertial navigation that uses a combination of an accelerometer and a gyro; and a method that recognizes, by using an external camera, an optical feature attached on a worker or an instrument moving with the worker; or any combination of two or more methods thereof.

4. The article picking or sorting work support device according to claim 1 , further comprising:

E) a memory unit that stores picking or sorting work order information associated with optical feature information, further wherein

said information processing unit processes, based on said detected, optical feature information and the picking or sorting work order information in said memory unit, image information about said specific, optical feature information, and

said processed image information is displayed on said display at a location related to said specific, optical feature information.

5. The article picking or sorting work support device according to claim 1 , further comprising:

F) an article quality inspection unit that inspects quality of an article to be picked or sorted, further wherein

if said article is not suitable for being picked or sorted, a predetermined, processing method is issued.

6. The article picking or sorting work support device according to claim 1 , wherein

said information processing unit processes image information about said specific, optical feature information,

said processed image information is displayed on said display at a location related to said specific, optical feature information, and

also picking or sorting work support information prepared by said information processing unit is displayed on said display.

7. The article picking or sorting work support device according to claim 1 , wherein

said display is a head-mounted display that can display both of actual, visual scenery information and prepared information, and

image information about said specific, optical feature information processed by said information processing unit is displayed on said display with the image information being associated with actual, visual scenery information at a location related to said specific, optical feature information.

8. The article picking or sorting work support device according to claim 1 , wherein

said display is a transportable display, and

image information about said processed, optical feature information is displayed on said display with the image information being associated with image information photographed by said imaging unit at a location related to said specific, optical feature information.

9. The article picking or sorting work support device according to claim 1 , wherein

said automatically-readable, optical feature information associated with an article or a storage location of an article is an identifier.

10. The article picking or sorting work support device according to claim 9 , wherein

base material of said identifier is printable base material.

11. The article picking or sorting work support device according to claim 9 , wherein

base material of said identifier is base material in which information is rewritable.

12. The article picking or sorting work support device according to claim 9 , wherein

a present position of a worker is grasped from image information on said identifier.

13. The article picking or sorting work support device according to claim 9 , wherein

said work order information or work support information is displayed superimposed on said identifier.

14. The article picking or sorting work support device according to claim 1 , wherein

for a picked article, or an article to be sorted, information that is attached on said article to identify said article is photographed by said imaging unit, and

whether said article agrees with the article specified by said picking or sorting work order or not is recognized.

15. The article picking or sorting work support device according to claim 1 , wherein

in a field of the view of said imaging unit, information about work and displaying is input by means of a gesture using hands and fingers of a worker.

16. The article picking or sorting work support device according to claim 1 , further comprising:

an audio response device including an audio input unit and/or an audio output unit.

17. The article picking or sorting work support device according to claim 1 , wherein

said information processing unit is provided remotely.

18. The article picking or sorting work support device according to claim 1 , wherein

a work history of a worker can be collected.

19. The article picking or sorting work support device according to claim 1 , wherein

a work indicator is displayed on said display.

20. The article picking or sorting work support device according to claim 1 , wherein

if said articles to be picked or sorted, are insufficient, said information processing unit issues an order for dealing with the trouble to a worker, according to a predetermined rule.

21. The article picking or sorting work support device according to claim 1 , wherein

based on the situation that said optical feature cannot be detected, a failure of said optical feature itself or a structural object where said optical feature is provide is detected.

22. The article picking or sorting work support device according to claim 1 , further comprising:

a management terminal having a display and a work ordering unit.

23. An article picking or sorting work support system, comprising:

A) automatically-readable, optical feature information associated with an article or a storage location of an article or a location where an article is to be sorted, and

B) a picking or sorting work support device including: an imaging unit that obtains image information about an article or a storage location of an article; an information processing unit that detects said optical feature information from the image information obtained by said imaging unit and processes image information about said optical feature information; and a display that displays information such as image information and text information, wherein

said information processing unit of said picking or sorting work support device processes, based on said detected, optical feature information and predetermined, picking or sorting work order information, image information about specific, optical feature information and displays said processed image information from an aisle to a rack or further to housing frontage or image information of the aisle to the rack or further to the housing frontage themselves, on said display so that the displayed said processed image information or said image information of the aisle to the rack or further to the housing frontage themselves are emphasized superimposed on said image information obtained by said imaging unit or superimposed on actual visual scenery.

24. The article picking or sorting work support system according to claim 23 , further comprising:

a guidance unit that guides a worker to a storage location of an article, wherein

after the guidance unit of said picking work support device guides the worker to the storage location of the article, said information processing unit processes, based on said detected, optical feature information and the predetermined picking or sorting work order information, image information about said specific, optical feature information and

said processed image information is displayed on said display at a location related to said specific, optical feature information.

25. The article picking or sorting work support system according to claim 24 , wherein

said guidance unit uses any one method of a method that uses automatically-readable, optical feature information similar to said automatically-readable, optical feature information associated with said article or said storage location of the article; a guidance method that uses radio waves; inertial navigation that uses a combination of an accelerometer and a gyro; and a method that recognizes, by using an external camera, an optical feature attached on a worker or an instrument moving with the worker; or any combination of two or more methods thereof.

26. The article picking or sorting work support system according to claim 23 , further comprising:

a memory unit that stores picking or sorting work order information associated with said optical feature information, wherein

said information processing unit processes, based on said detected, optical feature information and said picking or sorting work order information in said memory unit, image information about said specific, optical feature information and

said processed image information is displayed on said display at a location related said specific, optical feature information.

27. The article picking or sorting work support system according to claim 23 , further comprising:

an article quality inspection unit that inspects quality of an article to be picked or sorted, wherein

if said article is not suitable for being picked or sorted, a predetermined processing method is issued.

28. The article picking or sorting work support system according to claim 23 , wherein

said information processing unit processes image information about said specific, optical feature information,

said processed image information is displayed on said display at a location related to said specific, optical feature information, and

also picking or sorting work support information prepared by said information processing unit is displayed on said display.

29. The article picking or sorting work support system according to claim 23 , wherein

said display is a head-mounted display that can display both of actual, visual scenery information and prepared information, and

image information about said specific, optical feature information processed by said information processing unit is displayed on said display with the image information being associated with actual, visual scenery information at a location related to said specific, optical feature information.

30. The article picking or sorting work support system according to claim 23 , wherein

said display is a transportable display, and

image information about said processed, optical feature information is displayed on said display with the image information being associated with image information photographed by said imaging unit at a location related to said specific, optical feature information.

31. The article picking or sorting work support system according to claim 23 , wherein

said automatically-readable, optical feature information associated with an article or a storage location of an article is an identifier.

32. The article picking or sorting work support system according to claim 31 , wherein

base material of said identifier is printable base material.

33. The article picking or sorting work support system according to claim 31 , wherein

base material of said identifier is base material in which information is rewritable.

34. The article picking or sorting work support system according to claim 31 , wherein

a present position of a worker is grasped from image information on said identifier.

35. The article picking or sorting work support system according to claim 31 , wherein

said work order information or work support information is displayed superimposed on said identifier.

36. The article picking or sorting work support system according to claim 23 , wherein

for a picked article, or an article to be sorted, information attached on said article to identify said article is photographed by said imaging unit, and

whether said article agrees with the article specified by said picking or sorting work order or not is recognized.

37. The article picking or sorting work support system according to claim 23 , wherein

in a field of the view of said imaging unit, information about work and displaying is input by means of a gesture using hands and fingers of a worker.

38. The article picking or sorting work support system according to claim 23 , further comprising:

an audio response device including an audio input unit and/or an audio output unit.

39. The article picking or sorting work support system according to claim 23 , wherein

said information processing unit is provided remotely.

40. The article picking or sorting work support system according to claim 23 , wherein

a work history of a worker can be collected.

41. The article picking or sorting work support system according to claim 23 , wherein

a work indicator is displayed on said display.

42. The article picking or sorting work support system according to claim 23 , wherein

if said articles to be picked or sorted, are insufficient, said information processing unit issues an order for dealing with the trouble to a worker, according to a predetermined rule.

43. The article picking or sorting work support system according to claim 23 , wherein

based on the situation that said optical feature cannot be detected, a failure of said optical feature itself or a structural object where said optical feature is provide is detected.

44. The article picking or sorting work support system according to claim 23 , further comprising:

a management terminal having a display and a work ordering unit.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2017
From: WATANABE, KAZUHITO; YOKOYA, JUJI; YAGISHITA, NORIO; TSUSHIMA, YUKA; YOKOYAMA, MICHIO; YONOGA, HIDEAKI; MATSUMOTO, YASUHIDE; IWASE, ROKURO
To: TOYO KANETSU SOLUTIONS K.K.; M.SOFT CO., LTD.
Reel/Frame 043911/0762 →
Priority Claims (1)
JP 2012-147480 · Jun 29, 2012 · national
Continuity (1)
Related Publication 20150192774A1 · Jul 9, 2015