IP Library Granted Patent US 9,674,504
Granted Patent B1
US 9,674,504 · App. 15/147,879 · Granted Jun 6, 2017

Depth perceptive trinocular camera system

Inventors: Pietro Salvagnini (Sunnyvale, CA); Michele Stoppa (Sunnyvale, CA); Abbas Rafii (Palo Alto, CA)
Assignee: Aquifi, Inc.
H04N13/0246G06K9/6215
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,674,504
App. No.
15/147,879
Granted
Jun 6, 2017
Kind
B1
Abstract

A method for detecting decalibration of a depth camera system including a first, second, and third cameras having overlapping fields of view in a direction includes: detecting a feature in a first image captured by the first camera; detecting the feature in a second image captured by the second camera; detecting the feature in a third image captured by the third camera, the third camera being non-collinear with the first and second cameras; identifying a first conjugate epipolar line in the second image in accordance with a detected location of the feature in the first image and calibration parameters; identifying a second conjugate epipolar line in the second image in accordance with a detected location of the feature in the third image and the calibration parameters; and calculating a difference between a detected location of the feature in the second image and the first and second conjugate epipolar lines.

Claims (17)

1. A method for detecting decalibration of a depth camera system comprising a first camera, a second camera, and a third camera, the first, second, and third cameras having substantially overlapping fields of view in a direction, the method comprising:

detecting a feature in a first image captured by the first camera;

detecting the feature in a second image captured by the second camera;

detecting the feature in a third image captured by the third camera, the third camera being non-collinear with the first and second cameras;

identifying a first conjugate epipolar line in the second image in accordance with a detected location of the feature in the first image and a plurality of calibration parameters;

identifying a second conjugate epipolar line in the second image in accordance with a detected location of the feature in the third image and the plurality of calibration parameters;

calculating a difference between a detected location of the feature in the second image and the first and second conjugate epipolar lines; and

outputting an indication that the depth camera system is decalibrated in response to the difference exceeding a threshold.

2. The method of claim 1 , wherein the difference comprises a first difference and a second difference, and

wherein the calculating the difference comprises:

calculating a first difference between the detected location of the feature in the second image and the first conjugate epipolar line; and

calculating a second difference between the detected location of the feature in the second image and the second conjugate epipolar line.

3. The method of claim 1 , further comprising calculating a location of an intersection of the first conjugate epipolar line and the second conjugate epipolar line, and

wherein calculating the difference comprises calculating a distance between the detected location of the feature in the second image and the location of the intersection.

4. The method of claim 1 , wherein the first camera and the second camera are configured to capture invisible light, and

wherein the third camera is configured to capture visible light.

5. The method of claim 4 , further comprising emitting, by a projection device located between the first camera and the second camera, a textured pattern of invisible light in the direction of the overlapping fields of view.

Assignments (6)
SECURITY INTEREST Recorded May 15, 2025
From: PACKSIZE LLC
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 071282/0082 →
SECURITY INTEREST Recorded Aug 21, 2024
From: PACKSIZE LLC
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 068730/0393 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 3, 2020
From: PACKSIZE INTERNATIONAL, LLC
To: PACKSIZE, LLC
Reel/Frame 054255/0378 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 29, 2020
From: AQUIFI, INC.
To: PACKSIZE INTERNATIONAL, LLC
Reel/Frame 052791/0441 →
SECURITY INTEREST Recorded Aug 20, 2019
From: AQUIFI, INC.
To: COMERICA BANK
Reel/Frame 050111/0671 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2016
From: SALVAGNINI, PIETRO; STOPPA, MICHELE; RAFII, ABBAS
To: AQUIFI, INC.
Reel/Frame 038490/0407 →
Continuity (1)
Provisional Application 62271212 · Dec 22, 2015