IP Library Granted Patent US 12,377,567
Granted Patent B1
US 12,377,567 · App. 18/957,448 · Granted Aug 5, 2025

Mushroom trimming and sorting system

Inventors: Peter Mankowski (Vernon, CA); Prashanth Haleyur Narayana Rao (Salmon Arm, CA); Mehfuz A. Rahman (Blind Bay, CA); James Boyd Gibson (Salmon Arm, CA)
Assignee: 4AG Robotics Inc.
B26D5/007B07C5/3422B25J11/0045B26D7/32B07C2501/0063B07C2501/0081B25J15/0028B25J15/0616B26D2210/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,377,567
App. No.
18/957,448
Granted
Aug 5, 2025
Kind
B1
Abstract

A mushroom trimming and sorting system comprises a stem trimming device, a positioning system, an imager set, and a controller operable to control the positioning system to move a single mushroom into view of the imager set, to generate an image set of the mushroom, and to process the image set (and optionally other sensor data) to determine mushroom properties of the mushroom. The positioning system may include a SCARA robot with suction-type end effector and single-mushroom elevator with gripping mandibles. The processing may employ a trained machine-learning model. The mushroom properties may include a length of an end portion of the stem bearing soil, and a sorting category of the mushroom based on parameters of the cap including degree of gill opening. The end portion is them trimmed to eliminate soil and other defects, and sorting the mushroom into one of a plurality of receptacles.

Claims (88)

1. A mushroom processing system comprising:

a stem trimming device;

a positioning system;

an imager set comprising at least one imager;

and a controller communicatively coupled with the stem trimming device, the positioning system, and the imager set, the controller comprising a memory storing computer-readable instructions and a processor operable to perform the computer-readable instructions, whereby the controller is operable:

to control the positioning system to move a single mushroom, having a stem and a cap, to bring the mushroom into view of the imager set;

to control the imager set to generate an image set of the mushroom comprising at least one image;

to process the image set to determine mushroom properties of the mushroom; and

to control the positioning system and/or the stem trimming device to process the mushroom based on the mushroom properties.

2. The mushroom processing system of claim 1 , wherein:

the imager set comprises a side imager subset comprising at least one side imager operable to image at least one side of the mushroom at a predetermined side imaging location;

the image set comprises a side image subset comprising at least one side image of the mushroom including the stem; and

the controller is operable:

to control the positioning system to bring the mushroom to the predetermined side imaging location;

to control the side imager subset to generate the side image subset of the mushroom at the predetermined side imaging location;

to determine an end portion of the stem for removal based on the mushroom properties; and

to control the positioning system to move the mushroom relative to the stem trimming device and to operate the stem trimming device to trim the end portion by the stem trimming device.

3. The mushroom processing system of claim 2 , wherein:

the mushroom properties comprise defects on the end portion of the stem.

4. The mushroom processing system of claim 3 , wherein:

the defects comprise a presence of soil on the end portion.

5. The mushroom processing system of claim 4 , wherein:

the defects comprise a discoloration or disfigurement on the end portion.

6. The mushroom processing system of claim 5 , wherein:

the side imager subset comprises two imagers having horizontally opposing side views bracketing the predetermined side imaging location.

7. The mushroom processing system of claim 6 , wherein:

the controller is operable to move the mushroom relative to the stem trimming device to trim the end portion by the stem trimming device, by lowering the stem into a cutting path of the stem trimming device.

8. The mushroom processing system of claim 7 , wherein:

the stem trimming device comprises a rotary cutter, a guillotine cutter, a leaf-blade cutter, a single-blade cutter, a dual-blade cutter, a laser cutter, or a water-jet cutter.

9. The mushroom processing system of claim 8 , wherein:

the positioning system comprises an elevator comprising a gripper supported by and coupled with a vertical rail system;

the gripper comprises a pair of mandibles selectively openable for positioning of the stem between the mandibles and selectively closeable about the stem for contacting an underside surface of the cap of the mushroom by respective upper surfaces of the mandibles to support the mushroom with the stem depending below the mandibles; and

the controller is operable:

to control the gripper to open the mandibles for positioning of the stem between the mandibles, and to close the mandibles about the stem;

to control the vertical rail system to move the gripper holding the mushroom vertically to bring the mushroom to the predetermined side imaging location; and

to control the vertical rail system to move the gripper holding the mushroom to move the mushroom relative to the stem trimming device to trim the end portion by the stem trimming device.

10. The mushroom processing system of claim 9 , wherein:

the positioning system further comprises a robotic arm having a suctioning end effector operable selectively to suction an overside surface of the cap of the mushroom to hold the mushroom in order to move the mushroom, and to reduce suction in order to release the mushroom; and

the controller is further operable:

to control the robotic arm to move the mushroom to position the stem between the mandibles of the gripper when open; and

the control the robotic arm to release the mushroom when the mandibles are closed about the stem.

11. The mushroom processing system of claim 10 , wherein:

the side imager subset is operable to image an underside of the cap of the mushroom at a predetermined cap underside imaging location;

the image set comprises a cap underside image subset comprising at least one cap underside image of the underside of the cap including gills of the mushroom; and

the controller is further operable:

after controlling the robotic arm to move the mushroom to position the stem between the mandibles of the gripper when open, and before closing the mandibles about the stem, to control the side imager subset to generate the cap underside image subset of the mushroom.

12. The mushroom processing system of claim 11 , wherein:

the imager set comprises a top imager subset comprising at least one top imager operable to image a top of the mushroom at a predetermined top imaging location;

the image set comprises a top image subset comprising at least one top image of the mushroom including the cap; and

the controller is operable:

to control the positioning system to bring the mushroom to the predetermined top imaging location;

to control the top imager subset to generate the top image subset of the mushroom at the predetermined top imaging location;

to determine sorting parameters of the mushroom based on the mushroom properties; and

to control the positioning system to move the mushroom based on the sorting parameters.

13. The mushroom processing system of claim 12 , further comprising:

a sensor set comprising at least one sensor, wherein each of the at least one sensor is at least one of a position sensor; a motion sensor; an orientation sensor; an air temperature sensor; an air humidity sensor; and a light sensor;

wherein:

the controller is further operable:

to operate the sensor set to generate sensor data of the mushroom; and

to process the sensor data to further determine the mushroom properties of the mushroom.

14. The mushroom processing system of claim 13 , wherein:

the controller is operable to control the positioning system to deposit the mushroom in one of a plurality of mushroom receptacles based on the sorting parameters.

15. The mushroom processing system of claim 14 , wherein:

the sorting parameters comprise at least one of:

dimensions of the cap;

shape of the cap;

colour of the cap;

dimensions of the stem;

orientation of the stem relative to the cap;

presence or quantity of soil on the stem;

discoloration or disfigurement on the stem; and

degree of gill opening.

16. The mushroom processing system of claim 15 , wherein:

the controller is operable to determine the mushroom properties of the mushroom using at least one trained machine-learning model.

17. The mushroom processing system of claim 16 , wherein:

at least one of the at least one imager comprises an optical imager.

18. The mushroom processing system of claim 17 , wherein:

the optical imager comprises a digital camera.

19. A method of mushroom processing performed by a controller comprising a memory storing computer-readable instructions and a processor operable to perform the computer-readable instructions to perform the method comprising:

controlling a positioning system to move a single mushroom, having a stem and a cap, to bring the mushroom into view of an imager set comprising at least one imager;

controlling the imager set to generate an image set of the mushroom comprising at least one image;

processing the image set to determine mushroom properties of the mushroom; and

controlling the positioning system and/or the stem trimming device to process the mushroom based on the mushroom properties.

20. A non-transient computer-readable medium storing computer-readable instructions performable by a processor to perform a method comprising:

controlling a positioning system to move a single mushroom, having a stem and a cap, to bring the mushroom into view of an imager set comprising at least one imager;

controlling the imager set to generate an image set of the mushroom comprising at least one image;

processing the image set to determine mushroom properties of the mushroom; and

controlling the positioning system and/or the stem trimming device to process the mushroom based on the mushroom properties.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2024
From: MANKOWSKI, PETER; RAO, PRASHANTH HALEYUR NARAYANA; GIBSON, JAMES; RAHMAN, MEHFUZ
To: 4AG ROBOTICS INC.
Reel/Frame 069378/0890 →
References Cited (117)
US 2853333A · Littell · 1958 [cited by applicant]
US 2940713A · Van Dusen · 1960 [cited by applicant]
US 3183640A · Eugene et al. · 1965 [cited by applicant]
US 3537495A · Pearson · 1970 [cited by applicant]
US 3568959A · Blaff · 1971 [cited by applicant]
US 3635005A · Persson · 1972 [cited by applicant]
US 3765408A · Kawai · 1973 [cited by applicant]
US 4453755A · Blatt et al. · 1984 [cited by applicant]
US 4472929A · MacCanna et al. · 1984 [cited by applicant]
US 4519193A · Yoshida et al. · 1985 [cited by applicant]
US 4545186A · MacCanna · 1985 [cited by applicant]
US 4600229A · Oten · 1986 [cited by applicant]
US 4768919A · Borgman et al. · 1988 [cited by applicant]
US 4828306A · Blatt · 1989 [cited by applicant]
US 4852926A · Littell · 1989 [cited by applicant]
US 4883939A · Sagi · 1989 [cited by applicant]
US 4975016A · Pellenc et al. · 1990 [cited by applicant]
US 5035109A · Van Den Top · 1991 [cited by applicant]
US 5058368A · Wheeler · 1991 [cited by applicant]
US 5185989A · Russell · 1993 [cited by examiner]
US 5201560A · Golden · 1993 [cited by applicant]
US 5234375A · Hendriks · 1993 [cited by applicant]
US 5344202A · Ramler et al. · 1994 [cited by applicant]
US 5471827A · Janssen · 1995 [cited by examiner]
US 5491965A · Wheeler et al. · 1996 [cited by applicant]
US 5935136A · Hulse et al. · 1999 [cited by applicant]
US 7185603B2 · Correa et al. · 2007 [cited by applicant]
US 7204792B2 · Hagihara et al. · 2007 [cited by applicant]
US 7207609B2 · Ilich · 2007 [cited by applicant]
US 7280890B2 · Seemann · 2007 [cited by applicant]
US 7281739B2 · Kniss · 2007 [cited by applicant]
US 7309089B2 · Perlman et al. · 2007 [cited by applicant]
US 7665783B2 · Nishio · 2010 [cited by applicant]
US 7854108B2 · Koselka et al. · 2010 [cited by applicant]
US 8005570B2 · Gloden et al. · 2011 [cited by applicant]
US 8033087B2 · Rapila · 2011 [cited by examiner]
US 9527115B2 · LaRose et al. · 2016 [cited by applicant]
US 9623570B1 · Krahn et al. · 2017 [cited by applicant]
US 9730394B2 · Van De Vegte et al. · 2017 [cited by applicant]
US 9974235B2 · Van De Vegte · 2018 [cited by examiner]
US 10654177B2 · Perlman et al. · 2020 [cited by applicant]
US 10674666B2 · Moore · 2020 [cited by applicant]
US 10785912B2 · Moore · 2020 [cited by applicant]
US 10814498B2 · Wagner et al. · 2020 [cited by applicant]
US 10850402B2 · Wagner et al. · 2020 [cited by applicant]
US 11154010B2 · Good · 2021 [cited by examiner]
US 11657488B2 · Kashkoush · 2023 [cited by examiner]
US 11889789B2 · Glibetic · 2024 [cited by examiner]
US 20050268587A1 · McKeown · 2005 [cited by applicant]
US 20090188771A1 · Van Den Top · 2009 [cited by applicant]
US 20090320430A1 · Rapila · 2009 [cited by examiner]
US 20120210553A1 · Chen · 2012 [cited by applicant]
US 20120279122A1 · Benne et al. · 2012 [cited by applicant]
US 20130115028A1 · Kremerman et al. · 2013 [cited by applicant]
US 20130149076A1 · Cox et al. · 2013 [cited by applicant]
US 20130272823A1 · Hudgens et al. · 2013 [cited by applicant]
US 20140064886A1 · Toshima · 2014 [cited by applicant]
US 20170042095A1 · Van De Vegte · 2017 [cited by examiner]
US 20170265392A1 · Van De Vegte · 2017 [cited by examiner]
US 20190240813A1 · Nakayama et al. · 2019 [cited by applicant]
US 20200404845A1 · Good · 2020 [cited by examiner]
US 20210082104A1 · Kashkoush · 2021 [cited by examiner]
US 20230044563A1 · Boudreau et al. · 2023 [cited by applicant]
US 20230081119A1 · Rohanimanesh et al. · 2023 [cited by applicant]
US 20230150764A1 · Ruehr · 2023 [cited by applicant]
US 20230255153A1 · Counne · 2023 [cited by applicant]
CA 2041824A1 · 1991 [cited by applicant]
CA 2609122A1 · 2006 [cited by applicant]
CA 3111952A1 · 2022 [cited by applicant]
CN 107046933A · 2017 [cited by applicant]
CN 109081036A · 2018 [cited by applicant]
CN 108812086B · 2020 [cited by applicant]
CN 113079954A1 · 2021 [cited by applicant]
DE 10335021B3 · 2004 [cited by applicant]
EP 0428284A1 · 1991 [cited by applicant]
EP 0596189A1 · 1994 [cited by applicant]
EP 3081071A1 · 2016 [cited by applicant]
GB 1336393A · 1973 [cited by applicant]
JP H0787829A · 1995 [cited by applicant]
JP H0957213A · 1997 [cited by applicant]
JP 5338984B2 · 2013 [cited by applicant]
JP 6300571B2 · 2018 [cited by applicant]
KR 100926534B1 · 2009 [cited by applicant]
KR 20210035948A · 2021 [cited by applicant]
NL 8600887A · 1987 [cited by applicant]
WO 9111902A1 · 1991 [cited by applicant]
WO 9300793A1 · 1993 [cited by applicant]
WO 2006111619A1 · 2006 [cited by applicant]
WO 2012161567A1 · 2012 [cited by applicant]
WO 2019113691A1 · 2019 [cited by applicant]
WO 2020097727A1 · 2020 [cited by applicant]
WO 2020191483A1 · 2020 [cited by applicant]
Azoyan, “Feasibility Analysis of an Automated Mushroom Harvesting System,” 2004, Athens, Georgia. [cited by applicant]
Cordis EU Project Champi-on 262037 Report, “Fully Automatic System for Picking and Handling Mushrooms for the Fresh Market: From the Growing Bed to the Cooling Storage,” 2013, 5 pages. https://cordis.europa.eu/project/i… [cited by applicant]
Galley, et al., “Pneumatic Hyperelastic Robotic End-Effector for Grasping Soft Curved Organic Objects,” Electronic Thesis and Dissertation Repository, 2019, 143 pages. https://ir.lib.uwo.ca/etd/6392. [cited by applicant]
International Patent Application No. PCT/CA2021/000057, International Preliminary Report on Patentability, dated Feb. 15, 2024. [cited by applicant]
International Patent Application No. PCT/CA2021/000057, International Search Report and Written Opinion, dated Apr. 25, 2022. [cited by applicant]
Mushroom Technological Research Center of La Rioja (CTICH) Web page extract (English version), European Projects, Autol (La Rioja) Spain. https://www.ctich.com/. [cited by applicant]
New Zealand Patent Application No. 808264, Examination Report dated Mar. 5, 2024. [cited by applicant]
New Zealand Patent Application No. 813080, Patent Examination Report 1 dated Aug. 28, 2024. [cited by applicant]
Reed, et al., “AE—Automation and Emerging Technologies: Automatic Mushroom Harvester Development,” Journal of Agricultural Engineering Research, 2001, vol. 78 (1), pp. 15-23. [cited by applicant]
Reliability, Safety, and Strength Realized in ATI's New PatentInnovative Robotic Tool Changer Design, ATI Industrial Automation, 2024. 02 Pages. [cited by applicant]
Screen Capture from YouTube Video Clip Entitled “Champi-ON Demo Video”, 2 pages, uploaded on Sep. 17, 2013 by user Champi-ON Project Project. Retrieved from Internet: https://youtu.be/y44MyQ39d00. [cited by applicant]
TechBrew, “Changing the Mushroom Harvesting Business”, made public by TechBrew Robotics on Apr. 21, 2021 (date verified by Google Wayback Machine), URL: https://web.archive.org/web/20210421150750/https://techbrew.com/mu… [cited by applicant]
U.S. Appl. No. 18/512,597, Non-Final Office Action dated Aug. 7, 2024. [cited by applicant]
U.S. Appl. No. 18/512,597, Notice of Allowance dated Sep. 11, 2024. [cited by applicant]
European Patent Application No. 21095213.5, Extended European Search Report dated Nov. 13, 2024. [cited by applicant]
International Patent Application No. PCT/CA2024/051175, International Preliminary Report on Patentability, dated Nov. 8, 2024. [cited by applicant]
European Patent Application No. 24208796.3, Extended European Search Report dated Apr. 15, 2025. [cited by applicant]
European Patent Application No. 24209254.0, Extended European Search Report dated Apr. 15, 2025. [cited by applicant]
International Patent Application No. PCT/CA2024/051244, International Search Report and Written Opinion, dated Feb. 3, 2025. [cited by applicant]
International Patent Application No. PCT/CA2024/051246, International Search Report and Written Opinion, dated Dec. 17, 2024. [cited by applicant]
U.S. Appl. No. 18/512,597, Corrected Notice of Allowance dated Feb. 13, 2025. [cited by applicant]
U.S. Appl. No. 18/512,597, Notice of Allowance dated Dec. 4, 2024. [cited by applicant]
U.S. Appl. No. 18/512,597, Notice of Allowance dated Jan. 23, 2025. [cited by applicant]
U.S. Appl. No. 18/512,597, Notice of Allowance dated Nov. 7, 2024. [cited by applicant]
U.S. Appl. No. 18/904,925, Non-Final office Action dated Jan. 15, 2025. [cited by applicant]