Perception-based robotic manipulation system and method for robotic truck unloader that unloads/unpacks product from trailers and containers
A robotic truck unloader for unloading/unpacking product, such as boxes or cases, from trailers and containers is disclosed. In one embodiment, a mobile base structure provides a support framework for a drive subassembly, a conveyance subassembly, an industrial robot, a pivoting front conveyor, a distance measurement subassembly, and a control subassembly. The control subassembly coordinates the selective articulated movement of the industrial robot and the pivoting front conveyor as well as the activation of the drive subassembly based upon a perception-based robotic manipulation system. The robotic truck unloader executes pick-and-scoop operations utilizing the industrial robot and the pivoting front conveyor. Automated error handling is also provided.
1 . A robotic truck unloader for unloading/unpacking a plurality of product, the robotic truck unloader comprising:
a mobile base structure having first and second ends;
a drive subassembly coupled to the mobile base, the drive subassembly including a plurality of wheels for steering and driving the mobile base;
a conveyance subassembly disposed on the mobile base, the conveyance subassembly including a powered transportation path configured for transporting the plurality of product between the first end and the second end;
a pivoting front conveyor disposed at the second end of the mobile base, the pivoting front conveyor having a deck conveyor unit integrated therewith, the deck conveyor unit configured for transporting the plurality of product to the conveyance subassembly, the pivoting front conveyor configured to handle the plurality of product;
the deck conveyor unit including a plurality of conveyor subassemblies;
a plurality of lateral skirt plates located on the pivoting front conveyor, the plurality of lateral skirt plates configured to guide the plurality of product through the deck conveyor unit;
a plurality of sensors positioned to monitor the pivoting front conveyor;
a control subassembly located in communication with the pivoting front conveyor, the deck conveyor unit, and the plurality of sensors, the control subassembly coordinating selective articulated movement of the pivoting front conveyor, the control subassembly coordinating selective actuation of each of the plurality of conveyor subassemblies of the deck conveyor unit; and
the control subassembly including a memory accessible to a processor, the memory including processor-executable instructions that, when executed cause the processor to:
specify a search operation within the pivoting front conveyor via the plurality of sensors to identify a product in-handling located on the pivoting front conveyor, and
specify, in response to the product in-handling located on the pivoting front conveyor, an automatic error handling operation, the automatic error handling operation including the selective actuation of each of the plurality of conveyor subassemblies of the deck conveyor unit.
2 . The robotic truck unloader as recited in claim 1 , wherein the pivoting front conveyor is fixedly secured to the robotic truck unloader for each of pivoting, extension, and retraction relative to the robotic truck unloader.
3 . The robotic truck unloader as recited in claim 1 , wherein the pivoting front conveyor further comprises a frame secured to the second end of the mobile base by an actuated subassembly.
4 . The robotic truck unloader as recited in claim 1 , wherein the pivoting front conveyor further comprises:
a frame secured to the second end of the mobile base, the frame being inflexible;
a planar, elongated blade exhibiting a rear portion connected to the frame, and a front portion extending a length from the rear portion along an transverse axis between first and second lateral sides;
the planar, elongated blade, in response to applied pressure, flexing about the transverse axis.
5 . The robotic truck unloader as recited in claim 4 , wherein the planar, elongated blade further comprises spring steel.
6 . The robotic truck unloader as recited in claim 4 , wherein the planar, elongated blade further comprises ultra-high-molecular-weight polyethylene.
7 . The robotic truck unloader as recited in claim 4 , wherein the planar, elongated blade further comprises a flexible material providing abrasion, impact, and chemical resistance.
8 . The robotic truck unloader as recited in claim 4 , wherein the planar, elongated blade, in response to applied pressure, flexes about the transverse axis to comply with a shape of an object applying the pressure thereat.
9 . The robotic truck unloader as recited in claim 1 , wherein the automatic error handling operation further comprises an agitation of the pivoting front conveyor beneath the product in-handling.
10 . The robotic truck unloader as recited in claim 1 , wherein the processor-executable instructions that, when executed, cause the processor to specify, in response to the product in-handling located on the pivoting front conveyor, an automatic error handling operation, further comprise processor-executable instructions that, when executed, cause the processor to:
specify, in response to the product in-handling located on the pivoting front conveyor, a command operation to selectively alternate at least one of the plurality of conveyor subassemblies forward and reverse.
11 . The robotic truck unloader as recited in claim 1 , wherein the processor-executable instructions that, when executed, cause the processor to specify, in response to the product in-handling located on the pivoting front conveyor, an automatic error handling operation, further comprise processor-executable instructions that, when executed, cause the processor to:
specify, in response to the product in-handling located on the pivoting front conveyor, a command operation to selectively move the pivoting front conveyor up and down.
12 . The robotic truck unloader as recited in claim 1 , further comprising processor-executable instructions that, when executed, cause the processor, prior to specifying the search operation, to:
specify a deep scoop removal operation to unload the plurality of product with the pivoting front conveyor, and
specify a shallow scoop removal operation to unload the plurality of product with the pivoting front conveyor.
13 . The robotic truck unloader as recited in claim 1 , further comprising processor-executable instructions that, when executed, cause the processor, prior to specifying the search operation, to:
specify a deep scoop removal operation to unload the plurality of product with the pivoting front conveyor at an evacuated front area, the evacuated front area being subjacent to the candidate product contact face, and
specify a shallow scoop removal operation to unload the plurality of product with the pivoting front conveyor at the evacuated front area.
14 . The robotic truck unloader as recited in claim 1 , further comprising:
an industrial robot disposed proximate the second end of the mobile base, the industrial robot being configured to handle the plurality of product, the industrial robot having a robot reachable space;
a camera; and
the control subassembly being located in communication with the industrial robot, the camera, the control subassembly coordinating selective articulated movement of the industrial robot.
15 . The robotic truck unloader as recited in claim 14 , further comprising processor-executable instructions that, when executed, cause the processor to:
specify a removal operation to unload the plurality of product with the industrial robot.
16 . The robotic truck unloader as recited in claim 14 , wherein the processor-executable instructions that, when executed, cause the processor to specify, in response to the product in-handling located on the pivoting front conveyor, an automatic error handling operation, further comprise processor-executable instructions that, when executed, cause the processor to:
specify, in response to the product in-handling located on the pivoting front conveyor, a handling operation to selectively handle the product in-handling on the pivoting front conveyor via the industrial robot.
17 . The robotic truck unloader as recited in claim 14 , wherein the processor-executable instructions that, when executed, cause the processor to specify, in response to the product in-handling located on the pivoting front conveyor, an automatic error handling operation, further comprise processor-executable instructions that, when executed, cause the processor to:
specify, in response to the product in-handling located on the pivoting front conveyor, a command operation to selectively move the pivoting front conveyor up and down, and
specify, in response to the product in-handling located on the pivoting front conveyor, a handling operation to selectively handle the product in-handling on the pivoting front conveyor via the industrial robot.
18 . The robotic truck unloader as recited in claim 11 , wherein the processor-executable instructions that, when executed, cause the processor to specify a search operation within the pivoting front conveyor via the plurality of sensors to identify a product in-handling located on the pivoting front conveyor, further comprise processor-executable instructions that, when executed, cause the processor to:
utilize the camera to identify the product in-handling located on the pivoting front conveyor.
19 . A robotic truck unloader for unloading/unpacking a plurality of product, the robotic truck unloader comprising:
a mobile base structure having first and second ends;
a drive subassembly coupled to the mobile base, the drive subassembly including a plurality of wheels for steering and driving the mobile base;
a conveyance subassembly disposed on the mobile base, the conveyance subassembly including a powered transportation path configured for transporting the plurality of product between the first end and the second end;
a pivoting front conveyor disposed at the second end of the mobile base, the pivoting front conveyor having a deck conveyor unit integrated therewith, the deck conveyor unit configured for transporting the plurality of product to the conveyance subassembly, the pivoting front conveyor configured to handle the plurality of product;
the pivoting front conveyor being fixedly secured to the robotic truck unloader for each of pivoting, extension, and retraction relative to the robotic truck unloader;
the deck conveyor unit including a plurality of conveyor subassemblies;
a plurality of sensors positioned to monitor the pivoting front conveyor;
a control subassembly located in communication with the pivoting front conveyor, the deck conveyor unit, and the plurality of sensors, the control subassembly coordinating selective articulated movement of the pivoting front conveyor, the control subassembly coordinating selective actuation of each of the plurality of conveyor subassemblies of the deck conveyor unit; and
the control subassembly including a memory accessible to a processor, the memory including processor-executable instructions that, when executed cause the processor to:
specify a search operation within the pivoting front conveyor via the plurality of sensors to identify a product in-handling located on the pivoting front conveyor, and
specify, in response to the product in-handling located on the pivoting front conveyor, an automatic error handling operation, the automatic error handling operation including the selective actuation of each of the plurality of conveyor subassemblies of the deck conveyor unit.
20 . A robotic truck unloader for unloading/unpacking a plurality of product, the robotic truck unloader comprising:
a mobile base structure having first and second ends;
a drive subassembly coupled to the mobile base, the drive subassembly including a plurality of wheels for steering and driving the mobile base;
a conveyance subassembly disposed on the mobile base, the conveyance subassembly including a powered transportation path configured for transporting the plurality of product between the first end and the second end;
a pivoting front conveyor disposed at the second end of the mobile base, the pivoting front conveyor having a deck conveyor unit integrated therewith, the deck conveyor unit configured for transporting the plurality of product to the conveyance subassembly, the pivoting front conveyor configured to handle the plurality of product;
the pivoting front conveyor being fixedly secured to the robotic truck unloader for each of pivoting, extension, and retraction relative to the robotic truck unloader;
the deck conveyor unit including a plurality of conveyor subassemblies;
a control subassembly located in communication with the pivoting front conveyor, the deck conveyor unit, and the plurality of sensors, the control subassembly coordinating selective articulated movement of the pivoting front conveyor, the control subassembly coordinating selective actuation of each of the plurality of conveyor subassemblies of the deck conveyor unit; and
the control subassembly including a memory accessible to a processor, the memory including processor-executable instructions that, when executed cause the processor to:
specify a search operation within the pivoting front conveyor via the plurality of sensors to identify a product in-handling located on the pivoting front conveyor, and
specify, in response to the product in-handling located on the pivoting front conveyor, an automatic error handling operation, the automatic error handling operation including the selective actuation of each of the plurality of conveyor subassemblies of the deck conveyor unit.