IP Library Granted Patent US 12,481,941
Granted Patent B2
US 12,481,941 · App. 18/584,835 · Granted Nov 25, 2025

Methods and systems for task execution in a workplace

Inventor: Hazem Nizar An Nashif (Oakland, CA)
Assignee: Intelligrated Headquarters, LLC
G06Q10/06311B65G1/1373G06Q10/063114G06Q10/08G06K7/1413
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,481,941
App. No.
18/584,835
Granted
Nov 25, 2025
Kind
B2
Abstract

According to the embodiments illustrated herein, a method is disclosed. The method comprises receiving, by a computing device comprising a processor, an input from an operator device, wherein the input facilitates determining a task to be performed. Further, the method comprises activating, by the computing device, a first light device associated with a first location in a workplace in response to receiving the input, wherein the first location is associated with the task to be performed. Furthermore, the method comprises receiving, by the computing device, a first voice input from the operator device, indicative of an exception encountered during execution of the task. Additionally, the method includes modifying the task, in response to determining that the first voice input is indicative of the exception encountered during execution of the task.

Claims (57)

1 . A method comprising:

receiving, by a computing device comprising a processor, an input from an operator device, wherein the input facilitates determining a task to be performed, the task involving picking a first quantity of an item from a first location in a workplace;

activating, by the computing device, a first light panel installed at the first location in response to receiving the input, the activating comprising causing the first light panel to display the first quantity of the item to be picked from the first location;

receiving, by the computing device, a first voice input from the operator device that is indicative of an exception encountered during execution of the task;

controlling, by the computing device, a display screen of the first light panel to display a query in response to the first voice input from the operator device, wherein the query is associated with the exception encountered during the execution of the task;

receiving, by the computing device, a second voice input from the operator device in response to the displayed query; and

in response to determining that the first voice input is indicative of the exception encountered during execution of the task:

determining, by the computing device, a third quantity of the item based on comparing the first quantity and a second quantity of the item picked during execution of the task;

determining, by the computing device, a new task different from the task, based on the first and second voice inputs, wherein the new task corresponds to handling the exception encountered during execution of the task and is associated with picking the third quantity of the item from a second location; and

activating, by the computing device, a second light panel associated with the second location.

2 . The method of claim 1 , wherein the operator device comprises a barcode scanner and a voice input device.

3 . The method of claim 1 , wherein the first voice input is indicative of at least the second quantity of the item picked during executing of the task.

4 . The method of claim 3 further comprising:

determining, by the computing device, whether the first quantity of the item is equal to the second quantity of the item, and

in response to the determining that the first quantity of the item is equal to the second quantity of the item, determining, by the computing device, a status of the task as complete.

5 . The method of claim 3 further comprising:

determining, by the computing device, whether the first quantity of the item is different from the second quantity of the item, and

in response to the determining that the first quantity of the item is different from the second quantity of the item, determining, by the computing device, that the first voice input indicates the exception during execution of the task.

6 . The method of claim 1 , wherein the determining the new task comprises modifying, by the computing device, an orientation of the first light panel with respect to the second location in the workplace where the task is to be completed.

7 . The method of claim 6 , further comprising determining the first location of the task based on a metadata associated with the task.

8 . The method of claim 7 , wherein the metadata includes at least one of a quantity of items to be picked or a location where the task is to be performed.

9 . The method of claim 7 , wherein the orientation of the first light panel is controlled based on the metadata associated with the task to be performed.

10 . A system comprising:

an operator device;

a first light panel installed at a first location in a workplace, wherein a task is to be performed at the first location, the task involving picking a first quantity of an item from the first location;

a second light panel associated with a second location in the workplace;

a computing device communicatively coupled to the operator device and the first light panel, wherein the computing device comprises a processor configured to:

receive an input from the operator device, wherein the input facilitates determining the task to be performed;

activate the first light panel in response to receiving the input, wherein the activated first light panel indicates the first location at which the task is to be performed, the activating comprising causing the first light panel to display the first quantity of the item to be picked from the first location;

receive a first voice input from the operator device that is indicative of an exception encountered during execution of the task;

control a display screen of the first light panel to display a query in response to the first voice input from the operator device, wherein the query is associated with the exception encountered during the execution of the task;

receive a second voice input from the operator device in response to the displayed query; and

in response to determining that the first voice input is indicative of the exception encountered during execution of the task:

determining, by the computing device, a third quantity of the item based on comparing the first quantity and a second quantity of the item picked during execution of the task;

determining, by the computing device, a new task different from the task, based on the first and second voice inputs, wherein the new task corresponds to handling the exception encountered during execution of the task and is associated with picking the third quantity of the item at the second location; and

activating, by the computing device, the second light panel.

11 . The system of claim 10 , wherein the operator device comprises a barcode scanner and a voice input device.

12 . The system of claim 11 , wherein the input from the operator device corresponds to a decoded data received from the barcode scanner.

13 . The system of claim 12 , wherein the input from the operator device corresponds to the second voice input from the voice input device, wherein the second voice input facilitates determining the task.

14 . The system of claim 10 , wherein the processor is further configured to cause the first light panel to display the first quantity of the item to be picked from the first location, wherein the task is associated with picking the first quantity of the item.

15 . The system of claim 10 , wherein, to determine the new task, the processor is further configured to: modify, by the computing device, an orientation of the first light panel with respect to the second location in the workplace where the task is to be completed.

16 . The system of claim 15 , wherein the processor is further configured to determine the first location of the task based on a metadata associated with the task.

17 . The system of claim 16 , wherein the metadata includes at least one of a quantity of items to be picked or a location where the task is to be performed.

18 . The system of claim 17 , wherein the orientation of the first light panel is controlled based on the metadata associated with the task to be performed.

19 . A computing device, comprising:

a non-transitory memory device configured to store a set of instructions;

a processor communicatively coupled to the non-transitory memory device, wherein the processor is configured to execute the set of instructions to:

receive an input from an operator device, wherein the input facilitates determining a task to be performed, the task involving picking a first quantity of an item from a first location in a workplace;

control an orientation of a light panel with respect to the first location in the workplace in response to receiving the input, wherein the first location is associated with the task to be performed;

receive a first voice input from the operator device indicative of an exception encountered during execution of the task;

control a display screen of the light panel to display a query in response to the first voice input from the operator device, wherein the query is associated with the exception encountered during the execution of the task;

receive a second voice input from the operator device in response to the displayed query; and

in response to determining that the first voice input is indicative of the exception encountered during execution of the task:

determine a third quantity of the item based on comparing the first quantity and a second quantity of the item picked during execution of the task;

determine a new task different from the task, based on the first and second voice inputs, wherein the new task corresponds to handling the exception encountered during execution of the task and is associated with picking the third quantity of the item from a second location; and

activate a second light panel associated with the second location.

20 . The computing device of claim 19 , wherein the processor is further configured to determine the first location of the task based on metadata associated with the task, wherein the metadata includes at least one quantity of items to be picked or a location where the task is to be performed.

Assignments (2)
SECURITY AGREEMENT Recorded Jul 29, 2026
From: INTELLIGRATED HEADQUARTERS, LLC; TRANSNORM SYSTEM INC.; HILMOT, LLC; TREW, LLC; UNITED SORTATION SOLUTIONS LLC; TECH KING OPERATIONS, LLC
To: ALLY BANK, AS COLLATERAL AGENT
Reel/Frame 076077/0385 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 26, 2024
From: NASHIF, HAZEM NIZAR AN
To: INTELLIGRATED HEADQUARTERS, LLC
Reel/Frame 066558/0097 →
Continuity (3)
Continuation 18150731 · Jan 5, 2023
Continuation 16690672 · Nov 21, 2019
Related Publication 20240311710A1 · Sep 19, 2024
References Cited (59)
US 6775588B1 · Peck · 2004 [cited by applicant]
US 7084738B2 · Bastian, II · 2006 [cited by applicant]
US 8755931B2 · Issing · 2014 [cited by applicant]
US 11001445B2 · Hoffman · 2021 [cited by applicant]
US 20020087231A1 · Lewis et al. · 2002 [cited by applicant]
US 20040153207A1 · Peck · 2004 [cited by applicant]
US 20040207512A1 · Bastian · 2004 [cited by applicant]
US 20050222889A1 · Lai et al. · 2005 [cited by applicant]
US 20070080930A1 · Logan et al. · 2007 [cited by applicant]
US 20080121168A1 · Ryznar et al. · 2008 [cited by applicant]
US 20090012836A1 · Weissbach et al. · 2009 [cited by applicant]
US 20090129902A1 · Schafer · 2009 [cited by applicant]
US 20130253697A1 · Issing · 2013 [cited by applicant]
US 20130312371A1 · Ambrose · 2013 [cited by applicant]
US 20140258882A1 · Latzina et al. · 2014 [cited by applicant]
US 20170015502A1 · Engel et al. · 2017 [cited by applicant]
US 20170083179A1 · Gruber et al. · 2017 [cited by applicant]
US 20170345247A1 · Torresani et al. · 2017 [cited by applicant]
US 20180286002A1 · Peck · 2018 [cited by applicant]
US 20180342031A1 · Tada et al. · 2018 [cited by applicant]
US 20180354719A1 · Hoffman · 2018 [cited by applicant]
US 20180376243A1 · Nagel et al. · 2018 [cited by applicant]
US 20190114572A1 · Gold et al. · 2019 [cited by applicant]
US 20190137968A1 · Ryznar et al. · 2019 [cited by applicant]
US 20200371629A1 · Hauenstein et al. · 2020 [cited by applicant]
US 20210245956A1 · Douglas et al. · 2021 [cited by applicant]
CN 1926507A · 2007 [cited by applicant]
CN 104335205A · 2015 [cited by applicant]
CN 109643217A · 2019 [cited by applicant]
WO 2019100979A1 · 2019 [cited by applicant]
Bond, Josh (Year: 2019). [cited by examiner]
Advisory Action (PTOL-303) Mailed on Jul. 20, 2022 for U.S. Appl. No. 16/690,672. [cited by applicant]
CN Notice of Allowance, including Search Report Mailed on Apr. 12, 2024 for CN Application No. 202011192601, 5 page(s). [cited by applicant]
CN Office Action Mailed on Aug. 24, 2023 for CN Application No. 202011192601, 8 page(s). [cited by applicant]
CN Office Action Mailed on Mar. 28, 2023 for CN Application No. 202011192601, 9 page(s). [cited by applicant]
CN Office Action Mailed on Nov. 16, 2023 for CN Application No. 202011192601, 3 page(s). [cited by applicant]
English Translation of CN Office Action dated Aug. 24, 2023 for CN Application No. 202011192601, 7 page(s). [cited by applicant]
English Translation of CN Office Action dated Mar. 28, 2023 for CN Application No. 202011192601, 12 page(s). [cited by applicant]
English Translation of CN Office Action dated Nov. 16, 2023 for CN Application No. 202011192601, 1 page(s). [cited by applicant]
English translation of CN Search report dated Aug. 24, 2023 for CN Application No. 202011192601, 2 page(s). [cited by applicant]
European search opinion Mailed on Jan. 20, 2021 for EP Application No. 20207052, 4 page(s). [cited by applicant]
European search report Mailed on Jan. 20, 2021 for EP Application No. 20207052, 2 page(s). [cited by applicant]
European Search Report Mailed on Jan. 21, 2021for EP Application No. 20207052, 8 page(s). [cited by applicant]
Examiner Interview Summary Record (PTOL—413) Mailed on Jul. 20, 2022 for U.S. Appl. No. 16/690,672, 1 page(s). [cited by applicant]
Final Rejection Mailed on Mar. 29, 2022 for U.S. Appl. No. 16/690,672, 19 page(s). [cited by applicant]
Final Rejection Mailed on Sep. 28, 2023 for U.S. Appl. No. 18/150,731, 7 page(s). [cited by applicant]
Glynn, Fergal. What is a Pick to Light System? May 8, 2018 (Year: 2018). [cited by applicant]
Glynn, Fergal. What is Voice Picking? May 10, 2018 (Year: 2018). [cited by applicant]
Non-Final Office Action Mailed on Dec. 14, 2021 for U.S. Appl. No. 16/690,672. [cited by applicant]
Non-Final Rejection Mailed on Jul. 5, 2023 for U.S. Appl. No. 18/150,731, 19 page(s). [cited by applicant]
Notice of Allowance and Fees Due (PTOL-85) Mailed on Dec. 22, 2023 for U.S. Appl. No. 18/150,731, 2 page(s). [cited by applicant]
Notice of Allowance and Fees Due (PTOL-85) Mailed on Nov. 22, 2023 for U.S. Appl. No. 18/150,731, 8 page(s). [cited by applicant]
Notice of Allowance and Fees Due (PTOL-85) Mailed on Oct. 5, 2022 for U.S. Appl. No. 16/690,672. [cited by applicant]
EP Office Action Mailed on Oct. 31, 2024 for EP Application No. 20207052, 7 page(s). [cited by applicant]
Communication about intention to grant a European patent Mailed on Mar. 17, 2025 for EP Application No. 20207052, 6 page(s). [cited by applicant]
U.S. Appl. No. 18/150,731, filed Jan. 5, 2023, U.S. Pat. No. 11,941,557, Issued. [cited by applicant]
U.S. Appl. No. 16/690,672, filed Nov. 21, 2019, U.S. Pat. No. 11,580,465, Issued. [cited by applicant]
Decision to grant a European patent Mailed on Jul. 24, 2025 for EP Application No. 20207052, 2 page(s). [cited by applicant]
Extended European Search Report Mailed on Jul. 15, 2025 for EP Application No. 25186576, 8 page(s). [cited by applicant]