IP Library Granted Patent US 11,954,817
Granted Patent B2
US 11,954,817 · App. 18/318,472 · Granted Apr 9, 2024

Method of plane tracking

Inventors: Ozi Egri (Yassur, IL); Eyal Zak (Megiddo, IL)
Assignee: SNAP INC.
G06T3/0006G06T7/246G06T7/33G06T7/74
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,954,817
App. No.
18/318,472
Granted
Apr 9, 2024
Kind
B2
Abstract

A method of plane tracking comprising: capturing by a camera a reference frame of a given plane from a first angle; capturing by the camera a destination frame of the given plane from a second angle different than the first angle; defining coordinates of matching points in the reference frame and the destination frame; calculating, using the first and second angles, first and second respective rotation transformations to a simulated plane parallel to the given plane; applying an affine transformation between the reference frame coordinate on the simulated plane and the destination frame coordinate on the simulated plane; and applying a projective transformation on the simulated plane destination frame coordinate to calculate the destination frame coordinate.

Claims (34)

1. A method comprising:

receiving a reference frame of a given plane from a first angle;

receiving a destination frame of the given plane from a second angle different than the first angle;

determining a set of matching tracking points based on the reference frame and the destination frame;

calculating, using the first angle, a first rotation transformation to a simulated plane parallel to the given plane;

calculating, using the second angle, a second rotation transformation to the simulated plane parallel to the given plane and the second rotation transformation is an inverse rotation transformation;

calculating, based on the set of matching tracking points, an affine transformation between a first set of coordinates of the reference frame on the simulated plane and a second set of coordinates of the destination frame on the simulated plane; and

applying a projective transformation to the simulated plane to calculate a set of destination frame coordinates, the projective transformation comprising:

generating a first result by applying the first rotation transformation to the first set of coordinates of the reference frame;

generating a second result by applying the affine transformation to the first result; and

generating a third result by applying the second rotation transformation to the second result, the third result comprising the set of destination frame coordinates.

2. The method of claim 1 , wherein the reference frame and the destination frame are captured by a same camera.

3. The method of claim 2 , wherein the first angle and the second angle are provided by at least one inertial measurement unit attached to the same camera.

4. The method of claim 1 , wherein the first angle and the second angle are provided by at least one inertial measurement unit attached to a first camera used to capture the reference frame or a second camera user to capture the destination frame.

5. The method of claim 1 , wherein the calculating of the first rotation transformation to the simulated plane to the given plane comprises calculating an Euler angle.

6. The method of claim 1 , wherein the calculating of the second rotation transformation to the simulated plane to the given plane comprises calculating an Euler angle.

7. A device comprising:

a processor configured to perform operations comprising:

receiving a reference frame of a given plane from a first angle;

receiving a destination frame of the given plane from a second angle different than the first angle;

determining a set of matching tracking points based on the reference frame and the destination frame;

calculating, using the first angle, a first rotation transformation to a simulated plane parallel to the given plane;

calculating, using the second angle, a second rotation transformation to the simulated plane parallel to the given plane and the second rotation transformation is an inverse rotation transformation;

calculating, based on the set of matching tracking points, an affine transformation between a first set of coordinates of the reference frame on the simulated plane and a second set of coordinates of the destination frame on the simulated plane; and

applying a projective transformation to the simulated plane to calculate a set of destination frame coordinates, the projective transformation comprising:

generating a first result by applying the first rotation transformation to the first set of coordinates of the reference frame;

generating a second result by applying the affine transformation to the first result; and

generating a third result by applying the second rotation transformation to the second result, the third result comprising the set of destination frame coordinates.

8. The device of claim 7 , wherein the first angle and the second angle are provided by at least one inertial measurement unit attached to a first camera used to capture the reference frame or a second camera user to capture the destination frame.

9. The device of claim 7 , comprising a single camera, the reference frame and the destination frame being captured by the single camera.

10. The device of claim 9 , wherein the first angle and the second angle are provided by at least one inertial measurement unit attached to the single camera.

11. The device of claim 10 , comprising the at least one inertial measurement unit.

12. The device of claim 7 , wherein the calculating of the first rotation transformation to the simulated plane to the given plane comprises calculating an Euler angle.

13. The device of claim 7 , wherein the calculating of the second rotation transformation to the simulated plane to the given plane comprises calculating an Euler angle.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 20, 2023
From: CIMAGINE MEDIA LTD.
To: SNAPCHAT LIMITED
Reel/Frame 066338/0416 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 20, 2023
From: SNAPCHAT GROUP LIMITED
To: SNAP INC.
Reel/Frame 065618/0809 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 20, 2023
From: EGRI, OZI; ZAK, EYAL
To: CIMAGINE MEDIA LTD.
Reel/Frame 065629/0324 →
CHANGE OF NAME Recorded Nov 20, 2023
From: CIMAGINE MEDIA LTD.
To: C3D AUGMENTED REALITY SOLUTIONS LTD
Reel/Frame 065629/0359 →
Continuity (5)
Continuation 17504419 · Oct 18, 2021
Continuation 16881924 · May 22, 2020
Continuation 16067506
Provisional Application 62272717 · Dec 30, 2015
Related Publication 20230281750A1 · Sep 7, 2023