IP Library Granted Patent US 12,420,408
Granted Patent B1
US 12,420,408 · App. 17/380,000 · Granted Sep 23, 2025

Human machine interface recipe building system for a robotic manufacturing system

Inventors: Lira Nikolovska (Jamaica Plain, MA); Tatjana Dzambazova (Mill Valley, CA); Benyamin Zinshtein (Hod Hasharon, IL); Nimrod Fridlin (Kfar Saba, IL); Ryan Werth (San Francisco, CA); Sagi Shoffer (Beit Arye, IL); Yaron Bental (Yakum, IL); Yaniv Knany (Yakum, IL); Shay Galperin (Yakum, IL); Sharon Goldstein (Yakum, IL); Calanit Ozeri (Yakum, IL)
Assignee: Bright Machines, Inc.
B25J9/1656B25J9/0081B25J9/1697B25J13/08G05B19/4155B25J9/08G05B2219/50391
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,420,408
App. No.
17/380,000
Granted
Sep 23, 2025
Kind
B1
Abstract

A recipe builder system, enabling control recipes for a robotic assembly system. The recipe builder system includes a visual interface for a recipe builder, and feedback on execution of the program on the visual interface.

Claims (54)

1. A method to build a recipe to control a software controlled robotic cell, the method comprising:

prompting selection of a component, the component representing a device in a robotic cell;

when the component has parameters, displaying the parameters in response to the selection, and enabling setting of the parameters;

prompting selection of an action on the component;

validating the recipe, to verify that all recipe actions are supported by components of the robotic cell;

packaging the recipe including identification of the components and the parameters of the components, and the actions, into a packaged recipe; and

saving the recipe, the recipe designed to be run on a virtual device and on the robotic cell.

2. The method of claim 1 , wherein one of the parameters is a target position, and the target position is entered via one of: coordinates and a teach pendant.

3. The method of claim 1 , wherein one of the parameters is a target position, and the target position is entered by selection from a list.

4. The method of claim 3 , wherein the list of parameters is a set of relative parameters.

5. The method of claim 1 , wherein one of the parameters is a target position, and the target position is selected based on vision, the vision comprising data from a camera.

6. The method of claim 1 , wherein one of the parameters is a target position, and the target position is selected based on a part being assembled by the robotic cell, wherein a position of the part is identified using one of: coordinates, list, and vision.

7. The method of claim 1 , further comprising:

identifying that the component has a plurality of sub-parts;

determining a removed sub-part of the component;

identifying dependent elements of the removed sub-part of the component; and

removing the dependent elements.

8. The method of claim 1 , further comprising:

determining that one or more of the recipe actions are not supported the robotic cell; and

flagging a failure of the recipe.

9. The method of claim 8 , further comprising:

determining whether a correction can be applied to the recipe, wherein the flagging of the failure occurs when the recipe cannot be automatically corrected.

10. The method of claim 9 , wherein the correction comprises one or both of: updating the one or more recipe actions to be supported by the components of the robotic cell and reconfiguring the robotic cell to support the one or more recipe actions.

11. The method of claim 1 , wherein the saving comprises one or more of:

saving the recipe on the robotic cell;

duplicating the recipe to an edge device;

duplicating the recipe to a cloud system; and

exporting the recipe.

12. The method of claim 1 , further comprising:

adding a recovery option to the action, the recovery option enabling recovery from a failed action.

13. The method of claim 12 , wherein the recovery option comprises a set of one or more actions, to reset the robotic cell after the failed action.

14. The method of claim 1 , further comprising:

selecting a plurality of recipe steps; and

adjusting an order of execution of the plurality of recipe steps, wherein the adjusting comprises: running in parallel, running asynchronously, and running conditionally.

15. A method to create software to control a physical robotic cell, the method executed on a computer and comprising:

receiving selection of a component, the component representing an item in a robotic cell;

when the component has parameters, automatically displaying the parameters in response to the selection;

receiving selection of an action to be executed by the component;

receiving an indication that a recipe comprising at least one action is complete;

validating the recipe to verify that the at least one or more actions of the recipe are supported by components of the robotic cell;

packaging the recipe including identification of the components and the parameters of the components, and the actions, into a packaged recipe; and

saving the recipe, the recipe designed to be run on a virtual device and on the physical robotic cell.

16. The method of claim 15 , wherein one of the parameters is a target position, and the target position is entered via one of: coordinates, a teach pendant, selection from a list.

17. The method of claim 16 , wherein the list of parameter is one or more of: set of relative parameters, and a target position, and wherein the target position is selected based on one of: vision data from a camera in the robotic cell, a part being assembled by the robotic cell, wherein a position of the part is identified using one of: coordinates, list, and vision.

18. The method of claim 15 , further comprising:

receiving a command to remove a selected sub-part of the component from the robotic cell;

identifying dependent elements of the removed sub-part of the component; and

removing the dependent elements.

19. The method of claim 15 , further comprising:

determining that one or more of the recipe actions are not supported by the robotic cell;

determining whether a correction can be applied to the recipe, wherein the correction comprises one or both of: updating the one or more recipe actions to have the robotic cell components support the recipe action, and reconfiguring the robotic cell components to support the one or more recipe actions; and

wherein the recipe is flagged as a failed recipe when the recipe cannot be automatically corrected.

20. The method of claim 15 , further comprising:

adding a recovery option to the action, the recovery option enabling recovery from a failed action, wherein the recovery option comprises a set of one or more actions to reset the robotic cell after the failed action.

Assignments (6)
RELEASE OF SECURITY INTEREST IN INTELLECTUAL PROPERTY COLLATERAL AT REEL/FRAME NO. 67201/0797 Recorded Jun 2, 2025
From: JPMORGAN CHASE BANK, N.A.
To: BRIGHT MACHINES, INC.
Reel/Frame 071851/0097 →
SECURITY INTEREST Recorded Jun 2, 2025
From: BRIGHT MACHINES, INC.; BRIGHT MACHINES AUTOMATION CORP.
To: STIFEL BANK
Reel/Frame 071467/0419 →
TERMINATION AND RELEASE OF INTELLECTUAL PROPERTY SECURITY AGREEMENT AT REEL 061361 FRAME 0151 Recorded Apr 25, 2024
From: SILICON VALLEY BANK, A DIVISION OF FIRST CITIZENS BANK & TRUST COMPANY (SUCCESSOR TO SILICON VALLEY BANK)
To: BRIGHT MACHINES, INC.
Reel/Frame 067238/0943 →
SECURITY INTEREST Recorded Apr 23, 2024
From: BRIGHT MACHINES, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 067201/0797 →
SECURITY INTEREST Recorded Oct 10, 2022
From: BRIGHT MACHINES AUTOMATION CORP.; BRIGHT MACHINES, INC.
To: SILICON VALLEY BANK
Reel/Frame 061361/0151 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 11, 2021
From: NIKOLOVSKA, LIRA; DZAMBAZOVA, TATJANA; ZINSHTEIN, BENYAMIN; FRIDLIN, NIMROD; WERTH, RYAN; SHOFFER, SAGI; BENTAL, YARON; KNANY, YANIV; GALPERIN, SHAY; GOLDSTEIN, SHARON; OZERI, CALANIT
To: BRIGHT MACHINES, INC.
Reel/Frame 058092/0462 →
Continuity (2)
Provisional Application 63203325 · Jul 16, 2021
Provisional Application 62705861 · Jul 17, 2020
References Cited (41)
US 6507945B1 · Rust · 2003 [cited by examiner]
US 7047099B2 · Shanmugasundram et al. · 2006 [cited by applicant]
US 7248936B1 · Holmes et al. · 2007 [cited by applicant]
US 7738983B2 · Yamaji et al. · 2010 [cited by applicant]
US 7787992B2 · Pretlove et al. · 2010 [cited by applicant]
US 7904817B2 · Bergantino · 2011 [cited by examiner]
US 8555206B2 · Pederson et al. · 2013 [cited by applicant]
US 8589874B2 · Ralls et al. · 2013 [cited by applicant]
US 8825189B2 · Moore et al. · 2014 [cited by applicant]
US 8942840B2 · Chen et al. · 2015 [cited by applicant]
US 9285799B2 · Zhou et al. · 2016 [cited by applicant]
US 9387589B2 · Payton et al. · 2016 [cited by applicant]
US 9465384B1 · Jain · 2016 [cited by examiner]
US 10048851B2 · Yui et al. · 2018 [cited by applicant]
US 10518409B2 · Oleynik · 2019 [cited by applicant]
US 20080097630A1 · Weatherhead · 2008 [cited by examiner]
US 20130046403A1 · Nakagawa · 2013 [cited by applicant]
US 20170282374A1 · Matula · 2017 [cited by examiner]
US 20170348854A1 · Oleynik · 2017 [cited by examiner]
US 20190291277A1 · Oleynik · 2019 [cited by examiner]
US 20190380794A1 · Al Jewad · 2019 [cited by examiner]
US 20200016758A1 · Keller · 2020 [cited by examiner]
US 20200171671A1 · Huang · 2020 [cited by examiner]
US 20200310394A1 · Wouhaybi · 2020 [cited by examiner]
US 20200319630A1 · Rudnitsky et al. · 2020 [cited by applicant]
US 20210138651A1 · Mcgregor · 2021 [cited by examiner]
US 20210141870A1 · McGregor · 2021 [cited by examiner]
US 20210149655A1 · Mathews · 2021 [cited by examiner]
US 20220016780A1 · McDaniel · 2022 [cited by examiner]
EP 3705239A1 · 2020 [cited by examiner]
JP 2011029324A · 2011 [cited by applicant]
WO WO2018176025A1 · 2018 [cited by examiner]
WO WO2019021045A1 · 2019 [cited by examiner]
WO 2020208267A2 · 2020 [cited by applicant]
Wang, Lingfeng, and Kay Chen Tan. Modern Industrial Automation Software Design. John Wiley & Sons, 2006. (Year: 2006). [cited by examiner]
A. Angerer, A. Hoffmann, A. Schierl, M. Vistein and W. Reif, “The Robotics API: An object-oriented framework for modeling industrial robotics applications,” 2010 IEEE/RSJ International Conference on Intelligent Robots a… [cited by examiner]
S. Hart, P. Dinh and K. Hambuchen, “The Affordance Template ROS package for robot task programming,” 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA, 2015, pp. 6227-6234, doi: 10.1… [cited by examiner]
C. Schlette et al., “3D simulation-based user interfaces for a highly-reconfigurable industrial assembly cell,” 2016 IEEE 21st International Conference on Emerging Technologies and Factory Automation (ETFA), Berlin, Ger… [cited by examiner]
M. Priggemeyer, D. Losch and J. Roßmann, “Interactive Calibration and Visual Programming of Reconfigurable Robotic Workcells,” 2018 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), Auckland… [cited by examiner]
S. Profanter, A. Breitkreuz, M. Rickert and A. Knoll, “A Hardware-Agnostic OPC UA Skill Model for Robot Manipulators and Tools,” 2019 24th IEEE International Conference on Emerging Technologies and Factory Automation (E… [cited by examiner]
R. Wang et al., “A Formal Model-Based Design Method for Robotic Systems,” in IEEE Systems Journal, vol. 13, No. 1, pp. 1096-1107, Mar. 2019, doi: 10.1109/JSYST.2018.2867285. (Year: 2019). [cited by examiner]