IP Library Granted Patent US 11,769,293
Granted Patent B2
US 11,769,293 · App. 17/992,915 · Granted Sep 26, 2023

Camera motion estimation method for augmented reality tracking algorithm and system therefor

Inventors: Ki Young Kim (Seoul, KR); Benjamin Holler (Wien, KR)
Assignee: VIRNECT CO., LTD.
G06T15/20G06T7/20G06T7/70G06T19/006G06T2207/30241G06T2207/30244G06T2215/16
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,769,293
App. No.
17/992,915
Granted
Sep 26, 2023
Kind
B2
Abstract

A camera motion estimation method for an augmented reality tracking algorithm according to an embodiment is a camera motion estimation method for an augmented reality tracking algorithm performed by a sequence production application executed by a processor of a computing device, which includes a step of displaying a target object on a sequence production interface, a step of setting a virtual camera trajectory on the displayed target object, a step of generating an image sequence by rendering images obtained when the target object is viewed along the set virtual camera trajectory, and a step of reproducing the generated image sequence.

Claims (28)

1. A camera motion estimation method for an augmented reality tracking algorithm performed by a sequence production application executed by a processor of a computing device, comprising:

displaying a target object on a sequence production interface;

setting a virtual viewpoint trajectory on the displayed target object;

generating an image sequence by rendering images obtained when the target object is viewed along the set virtual viewpoint trajectory; and

reproducing the generated image sequence,

wherein the displaying the target object on the sequence production interface comprises determining the target object, which is a pre-designed three-dimensional (3D) model corresponding to a real object, according to a user input,

further comprising setting the generated virtual image sequence as a predetermined ground-truth serving as a benchmark;

receiving a real image sequence obtained by photographing and tracking a real object corresponding to the target object from an object tracking application of a terminal; and

comparing the received real image sequence with the predetermined ground-truth to calculate an accuracy parameter of the object tracking application, and

wherein the displaying the target object on the sequence production interface comprises:

importing a pre-designed 3D model corresponding to the target object and placing the imported 3D model at an origin of 3D spatial coordinates.

2. The camera motion estimation method of claim 1 , wherein the setting the virtual viewpoint trajectory on the displayed target object comprises:

placing a virtual camera according to a user input through the sequence production interface;

moving the placed virtual camera; and

setting a trajectory of movement of the virtual camera as the virtual viewpoint trajectory.

3. The camera motion estimation method of claim 1 , wherein the setting the virtual viewpoint trajectory on the displayed target object comprises:

receiving a real viewpoint trajectory generated by photographing and tracking a real object from a camera device;

generating a virtual viewpoint trajectory corresponding to the real viewpoint trajectory; and

setting the generated virtual viewpoint trajectory as the virtual viewpoint trajectory for the target object.

4. The camera motion estimation method of claim 3 , wherein the receiving the real viewpoint trajectory generated by photographing and tracking the real object from the camera device comprises:

photographing the real object by the camera device while moving the camera device;

calculating, by a real camera of the camera device, a pose value for the real object for each viewpoint at which the real object is photographed; and

determining a real viewpoint trajectory including changes of the pose value of the real camera.

5. The camera motion estimation method of claim 4 , wherein the generating the virtual viewpoint trajectory corresponding to the real viewpoint trajectory comprises converting the pose value of the real camera for the real object into a pose value of the virtual camera for the target object.

6. The camera motion estimation method of claim 1 , wherein the generating the image sequence by rendering images obtained when the target object is viewed along the set virtual viewpoint trajectory comprises:

moving the virtual camera along the virtual viewpoint trajectory; and

generating a frame image by rendering a frame image obtained when the target object is viewed from a virtual camera pose at one viewpoint of the moving virtual camera.

7. The camera motion estimation method of claim 6 , wherein the generating the image sequence by rendering images obtained when the target object is viewed along the set virtual viewpoint trajectory comprises matching a virtual camera pose value at the time of capturing each of the rendered frame images and the corresponding frame image and including the matched virtual camera pose value and the frame image in a virtual image sequence.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 11, 2023
From: VIRNECT INC.
To: VIRNECT CO., LTD.
Reel/Frame 064252/0252 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2022
From: KIM, KI YOUNG; HOLLER, BENJAMIN
To: VIRNECT INC.
Reel/Frame 061859/0942 →
Priority Claims (2)
KR 10-2021-0161957 · Nov 23, 2021 · national
KR 10-2021-0194396 · Dec 31, 2021 · national
Continuity (1)
Related Publication 20230162434A1 · May 25, 2023