IP Library Granted Patent US 10,334,226
Granted Patent B2
US 10,334,226 · App. 15/743,843 · Granted Jun 25, 2019

Vision system with automatic calibration

Inventor: Aliaksandr Burakou (Troy, MI)
Assignee: APEX BRANDS, INC.
H04N13/239B25J9/1692B25J9/1697G05B19/401H04N13/246G05B2219/37074G05B2219/37559G05B2219/40557H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,334,226
App. No.
15/743,843
Granted
Jun 25, 2019
Kind
B2
Abstract

A vision system may include a first camera and a second camera mounted for stereoscopic monitoring of a work environment, a support platform for support of a workpiece in the work environment, a first reference plate operably coupled to the support platform to provide a first frame of reference for three dimensional location of objects in the work environment, a power tool operable in the work environment under control of a tool controller, and a motion monitor operably coupled to the first and second cameras to determine location of the tool in the work environment based on a comparison of a reference point on the tool to a position of reference points on the reference plate. A perspective view of the support platform by the first and second cameras may be changeable, and the system may further include a second reference plate to define a second frame of reference for three dimensional location of objects responsive to the perspective view of the support platform being changed.

Claims (40)

1. A vision system comprising:

a first camera and a second camera mounted for stereoscopic monitoring of a work environment;

a support platform for support of a workpiece in the work environment;

a first reference plate operably coupled to the support platform to provide a first frame of reference for three dimensional location of objects in the work environment;

a power tool operable in the work environment under control of a tool controller; and

a motion monitor operably coupled to the first and second cameras to determine location of the tool in the work environment based on a comparison of a reference point on the tool to a position of reference points on the reference plate,

wherein a perspective view of the support platform by the first and second cameras is changeable, and

wherein the system further comprises a second reference plate to define a second frame of reference for three dimensional location of objects responsive to the perspective view of the support platform being changed.

2. The vision system of claim 1 , wherein the first and second cameras are static and the support platform is dynamic.

3. The vision system of claim 2 , wherein the first reference plate lies in a first plane and the second reference plate lies in a second plane, and wherein an angular difference between the first and second planes is substantially equal to an amount of rotation of the support platform to change the perspective view.

4. The vision system of claim 1 , wherein the first reference plate includes a first pattern of reference points thereon and the second reference plate includes a second pattern of reference points thereon, the first and second patterns being different.

5. The vision system of claim 4 , wherein the first and second patterns are defined by different geometric shapes.

6. The vision system of claim 5 , wherein the different geometric shapes comprise different types of triangles.

7. A vision system comprising:

a first camera and a second camera mounted for stereoscopic monitoring of a work environment;

a support platform for support of a workpiece in the work environment;

a reference plate operably coupled to the support platform to provide a frame of reference for three dimensional location of objects in the work environment;

a power tool operable in the work environment under control of a tool controller; and

a motion monitor operably coupled to the first and second cameras to determine location of the tool in the work environment based on a comparison of a reference point on the tool to a position of reference points on the reference plate,

wherein the reference plate comprises at least four reference points distributed thereon, and

wherein the motion monitor is configured to perform automatic configuration based on the at least four reference points using the same spectrum used to determine the location of the tool.

8. The vision system of claim 7 , wherein the same spectrum comprises infrared spectrum.

9. The vision system of claim 7 , wherein the automatic configuration is performed during object tracking associated with determining the location of the tool.

10. The vision system of claim 7 , wherein three of the reference points form a triangle, and a fourth reference point is located spaced apart from a nearest leg of the triangle such that the at least four reference points form a quadrilateral.

11. A vision system comprising:

a first camera and a second camera mounted for stereoscopic monitoring of a work environment;

a support platform for support of a workpiece in the work environment;

a reference plate operably coupled to the support platform to provide a frame of reference for three dimensional location of objects in the work environment;

a power tool operable in the work environment under control of a tool controller; and

a motion monitor operably coupled to the first and second cameras to determine location of the power tool in the work environment based on a comparison of a reference point on the tool to a position of reference points on the reference plate,

wherein the motion monitor is configured to monitor the location of the power tool relative to a movement zone defining a volume in three dimensional space.

12. The vision system of claim 11 , wherein the movement zone defines a cylindrical volume of permissible tool locations as the power tool approaches an object on the workpiece.

13. The vision system of claim 11 , wherein the movement zone is generated base on a learning mode in which the movement zone is defined based on a plurality of monitored tool movements.

14. The vision system of claim 13 , wherein the learning mode has a quality threshold relative to data monitored prior to allowing the movement zone to be generated.

15. The vision system of claim 13 , wherein the learning mode has a quantity threshold relative to data monitored prior to allowing the movement zone to be generated.

16. The vision system of claim 11 , wherein the power tool is disabled responsive to a determination that the power tool violates a boundary of the movement zone.

17. The vision system of claim 11 , wherein feedback regarding operation of the power tool is provided to an operator responsive to a determination that the power tool violates a boundary of the movement zone.

18. The vision system of claim 17 , wherein the boundary is defined as a maximum allowable deviation from an average or best fit path of the power tool.

19. The vision system of claim 11 , wherein selected data stored during determining tool location is used for determining the movement zone.

20. The vision system of claim 11 , wherein a linear indicator is provided on the power tool, the linear indicator being detectable by the first and second cameras to define a direction of extension of a socket or adapter of the power tool.

Assignments (9)
SECURITY INTEREST Recorded May 20, 2026
From: BARCLAYS BANK PLC
To: ALTER DOMUS (US) LLC
Reel/Frame 075613/0150 →
SECURITY INTEREST Recorded May 20, 2026
From: BARCLAYS BANK PLC
To: ALTER DOMUS (US) LLC
Reel/Frame 075612/0935 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVAL OF PATENT NUMBER PREVIOUSLY RECORDED AT REEL: 58991 FRAME: 442. ASSIGNOR(S) HEREBY CONFIRMS THE SECOND LIEN GRANT OF SECURITY INTEREST IN PATENTS. Recorded Oct 10, 2025
From: APEX BRANDS, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 073077/0584 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENT NO. 11203070 WHICH WAS INCORRECTLY INCLUDED AND SHOULD BE REMOVED FROM THE RECORD PREVIOUSLY RECORDED ON REEL 58991 FRAME 556. ASSIGNOR(S) HEREBY CONFIRMS THE FIRST LIEN GRANT OF SECURITY INTEREST IN PATENTS. Recorded Oct 10, 2025
From: APEX BRANDS, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 073078/0327 →
CORRECTIVE ASSIGNMENT TO CORRECT THE CORRECT THE APPLICATION NO. 16/672703 PAT NO. 11191173 WHICH WAS INCORRECTLY INCLUDED AND SHOULD BE REMOVED FROM THE RECORDS PREVIOUSLY RECORDED AT REEL: 58991 FRAME: 556. ASSIGNOR(S) HEREBY CONFIRMS THE FIRST LIEN GRANT OF SECURITY INTEREST IN PATENTS. Recorded Aug 22, 2024
From: APEX BRANDS, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 068769/0309 →
CORRECTIVE ASSIGNMENT TO CORRECT THE CORRECT THE APPLICATION NO. 16/672703 PAT NO. 11191173 WHICH WAS INCORRECTLY INCLUDED AND SHOULD BE REMOVED FROM THE RECORDS PREVIOUSLY RECORDED AT REEL: 58991 FRAME: 442. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 22, 2024
From: APEX BRANDS, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 068753/0687 →
SECOND LIEN GRANT OF SECURITY INTEREST IN PATENTS Recorded Feb 8, 2022
From: APEX BRANDS, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 058991/0442 →
FIRST LIEN GRANT OF SECURITY INTEREST IN PATENTS Recorded Feb 8, 2022
From: APEX BRANDS, INC.
To: BARCLAYS BANK PLC, AS COLLATERAL AGENT
Reel/Frame 058991/0556 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2018
From: BURAKOU, ALIAKSANDR
To: APEX BRANDS, INC.
Reel/Frame 045520/0507 →
Continuity (2)
Provisional Application 62193804 · Jul 17, 2015
Related Publication 20180205935A1 · Jul 19, 2018