IP Library Granted Patent US 10,887,579
Granted Patent B2
US 10,887,579 · App. 16/553,727 · Granted Jan 5, 2021

Depth-sensing computer vision system

Inventors: Scott Denenberg (Newton, MA); Lev Persits (Cambridge, MA); Clara Vu (Cambridge, MA); Robert Craig Randall (Newton, MA); Patrick Sobalvarro (Harvard, MA); Valentina Chamorro (Somerville, MA); Gene Malkin (Brookline, MA); Alberto Moel (Cambridge, MA)
Assignee: VEO ROBOTICS, INC.
H04N13/246G06T7/85H04N5/357H04N13/194H04N13/204H04N13/254H04N13/271G01K13/00H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,887,579
App. No.
16/553,727
Granted
Jan 5, 2021
Kind
B2
Abstract

Systems and methods for calibrating a sensor array for 3D depth sensing include the steps of providing multiple 3D sensors each for (i) illuminating a field of view of the sensor and (ii) generating an output array of pixelwise values indicative of distances to objects within the illuminated a field of view; sequentially causing each of the 3D sensors to generate an output array while other 3D sensors are illuminating their fields of view; and creating an interference matrix from the generated output arrays, the interference matrix indicating, for each of the 3D sensors, a degree of interference by other 3D sensors simultaneously active therewith.

Claims (20)

1. An image-processing system comprising:

a plurality of 3D sensors each for (i) illuminating a field of view of the sensor and (ii) generating an output array of pixelwise values indicative of distances to objects within the illuminated field of view; and

a calibration unit for (i) sequentially causing each of the 3D sensors to generate an output array while other 3D sensors are illuminating their fields of view and (ii) creating and computationally storing an interference matrix from the generated output arrays, the interference matrix indicating, for each of the 3D sensors, a degree of interference by other 3D sensors simultaneously active therewith.

2. The system of claim 1 , further comprising a processor for operating the 3D sensors in accordance with the interference matrix, the processor being configured to suppress, during operation of one of the 3D sensors, simultaneous operation of one or more other 3D sensors.

3. The system of claim 1 , further comprising a processor for operating the 3D sensors in accordance with the interference matrix, the processor being configured to cause correction of the values obtained by one of the sensors during simultaneous operation of one or more other 3D sensors.

4. The system of claim 1 , further comprising an external sync for operating the 3D sensors individually without interference.

5. The system of claim 1 , further comprising a timer for storing a total cumulative operating time of the system, the calibration unit being responsive to the total cumulative operating time and configured to adjust the pixelwise values indicative of distances based thereon.

6. The system of claim 1 , further comprising at least one temperature sensor, the calibration unit being responsive to the at least one temperature sensor and configured to adjust the pixelwise values indicative of distances based thereon.

7. The system of claim 1 , further comprising at least one humidity sensor, the calibration unit being responsive to the at least one humidity sensor and configured to adjust the pixelwise values indicative of distances based thereon.

8. The system of claim 1 , further comprising a voltage monitor for over/under monitoring of all voltage rails of the system and interrupting system power upon detection of a failure condition.

9. A method of calibrating a sensor array for 3D depth sensing, the method comprising the steps of:

providing a plurality of 3D sensors each for (i) illuminating a field of view of the sensor and (ii) generating an output array of pixelwise values indicative of distances to objects within the illuminated a field of view;

sequentially causing each of the 3D sensors to generate an output array while other 3D sensors are illuminating their fields of view; and

creating and computationally storing an interference matrix from the generated output arrays, the interference matrix indicating, for each of the 3D sensors, a degree of interference by other 3D sensors simultaneously active therewith.

10. The method of claim 9 , further comprising the step of operating the 3D sensors in accordance with the interference matrix and suppressing, during operation of one of the 3D sensors, simultaneous operation of one or more other 3D sensors.

11. The method of claim 9 , further comprising the step of operating the 3D sensors in accordance with the interference matrix and causing correction of the values obtained by one of the sensors during simultaneous operation of one or more other 3D sensors.

12. The method of claim 9 , further comprising the step of externally synchronizing the 3D sensors so as to operate them individually without interference.

13. The method of claim 9 , further comprising the step of storing a total cumulative operating time of the system and adjusting the pixelwise values based thereon.

14. The method of claim 9 , further comprising the step of sensing a temperature and adjusting the pixelwise values based thereon.

15. The method of claim 9 , further comprising the step of sensing a humidity and adjusting the pixelwise values based thereon.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2024
From: VEO ROBOTICS, INC.
To: SYMBOTIC LLC
Reel/Frame 068839/0710 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 25, 2020
From: DENENBERG, SCOTT; PERSITS, LEV; VU, CLARA; RANDALL, ROBERT CRAIG; SOBALVARRO, PATRICK; CHAMORRO, VALENTINA; MALKIN, GENE; MOEL, ALBERTO
To: VEO ROBOTICS, INC.
Reel/Frame 054468/0812 →
Continuity (2)
Provisional Application 62724941 · Aug 30, 2018
Related Publication 20200077074A1 · Mar 5, 2020