IP Library Granted Patent US 11,688,033
Granted Patent B2
US 11,688,033 · App. 17/504,419 · Granted Jun 27, 2023

Method of plane tracking

Inventors: Ozi Egri (Yassur, IL); Eyal Zak (Megiddo, IL)
Assignee: SNAP INC.
G06T3/0006G06T7/246G06T7/33G06T7/74
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,688,033
App. No.
17/504,419
Granted
Jun 27, 2023
Kind
B2
Abstract

A method of plane tracking comprising: capturing by a camera a reference frame of a given plane from a first angle; capturing by the camera a destination frame of the given plane from a second angle different than the first angle; defining coordinates of matching points in the reference frame and the destination frame; calculating, using the first and second angles, first and second respective rotation transformations to a simulated plane parallel to the given plane; applying an affine transformation between the reference frame coordinate on the simulated plane and the destination frame coordinate on the simulated plane; and applying a projective transformation on the simulated plane destination frame coordinate to calculate the destination frame coordinate.

Claims (27)

1. A method comprising:

defining coordinates for a set of reference frame tracking points based on a reference frame of a given plane from a first angle;

defining coordinates for a set of destination frame tracking points based on a destination frame of the given plane from a second angle, wherein the set of destination frame tracking points match an orientation of the reference frame tracking points;

calculating, using the first angle and the set of reference frame tracking points, a first rotation transformation to a simulated plane parallel to the given plane;

calculating, using the second angle and the set of destination frame tracking points, a second rotation transformation to the simulated plane parallel to the given plane and the second rotation transformation is an inverse rotation transformation;

applying an affine transformation to the set of reference frame coordinates;

applying the affine transformation to the set of destination frame coordinates after applying the affine transformation to the set of reference frame coordinates; and

applying a projective transformation to the simulated plane to calculate a set of destination frame coordinates, the projective transformation comprising applying the affine transformation to the first rotation transformation of the reference frame and the inverse rotation transformation of the destination frame.

2. The method of claim 1 , wherein the reference frame and the destination frame are captured by a same camera.

3. The method of claim 2 , wherein the first angle and the second angle are provided by at least one inertial measurement unit attached to the same camera.

4. The method of claim 1 , wherein the calculating of the first rotation transformation to the simulated plane to the given plane comprises calculating an Euler angle.

5. The method of claim 1 , wherein the calculating of the second rotation transformation to the simulated plane to the given plane comprises calculating an Euler angle.

6. A device comprising:

a processor configured to perform operations comprising:

defining coordinates for a set of reference frame tracking points based on a reference frame of a given plane from a first angle;

defining coordinates for a set of destination frame tracking points based on a destination frame of the given plane from a second angle, wherein the set of destination frame tracking points match an orientation of the reference frame tracking points;

calculating, using the first angle and the set of reference frame tracking points, a first rotation transformation to a simulated plane parallel to the given plane;

calculating, using the second angle and the set of destination frame tracking points, a second rotation transformation to the simulated plane parallel to the given plane and the second rotation transformation is an inverse rotation transformation;

applying an affine transformation to the set of reference frame coordinates;

applying the affine transformation to the set of destination frame coordinates after applying the affine transformation to the set of reference frame coordinates; and

applying a projective transformation to the simulated plane to calculate a set of destination frame coordinates, the projective transformation comprising applying the affine transformation to the first rotation transformation of the reference frame and the inverse rotation transformation of the destination frame.

7. The device of claim 6 , wherein the first angle and the second angle are provided by at least one inertial measurement unit attached to a first camera used to capture the reference frame or a second camera user to capture the destination frame.

8. The device of claim 6 , comprising a single camera, the reference frame and the destination frame being captured by the single camera.

9. The device of claim 8 , wherein the first angle and the second angle are provided by at least one inertial measurement unit attached to the single camera.

10. The device of claim 9 , comprising the at least one inertial measurement unit.

11. The device of claim 6 , wherein the calculating of the first rotation transformation to the simulated plane to the given plane comprises calculating an Euler angle.

12. The device of claim 6 , wherein the calculating of the second rotation transformation to the simulated plane to the given plane comprises calculating an Euler angle.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 26, 2022
From: EGRI, OZI; ZAK, EYAL
To: CIMAGINE MEDIA LTD.
Reel/Frame 060910/0844 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 26, 2022
From: CIMAGINE MEDIA LTD.
To: C3D AUGMENTED REALITY SOLUTIONS LTD
Reel/Frame 060910/0914 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 26, 2022
From: SNAPCHAT GROUP LIMITED
To: SNAP INC.
Reel/Frame 060911/0031 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 26, 2022
From: CIMAGINE MEDIA LTD.
To: SNAPCHAT GROUP LIMITED
Reel/Frame 061328/0001 →
Continuity (4)
Continuation 16881924 · May 22, 2020
Continuation 16067506
Provisional Application 62272717 · Dec 30, 2015
Related Publication 20220036502A1 · Feb 3, 2022