IP Library Granted Patent US 8,374,395
Granted Patent B2
US 8,374,395 · App. 13/606,978 · Granted Feb 12, 2013

Augmented reality method and devices using a real time automatic tracking of marker-free textured planar geometrical objects in a video stream

Inventors: Valentin Lefevre (Puteaux, FR); Nicolas Livet (Paris, FR)
Assignee: Total Immersion
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,374,395
App. No.
13/606,978
Granted
Feb 12, 2013
Kind
B2
Abstract

Methods and devices for the real-time tracking of an object in a video stream for an augmented-reality application are disclosed herein.

Claims (29)

1. A method for tracking in real time an object from a real scene in a video stream, the method comprising:

receiving a first image from said video stream, wherein the first image includes an object to be tracked;

determining a pose of the object being tracked in the first image based on a comparison between the pose of the object being tracked and a plurality of image blocks, wherein each image block of the plurality of image blocks is associated with a unique pose;

receiving a second image from the video stream, wherein the second image includes the object to be tracked; and

evaluating the pose of the object to be tracked in the second image based on the plurality of the image blocks.

2. The method according to claim 1 , wherein the object being tracked includes an area of uniform color adapted to use chromakey technology.

3. The method according to claim 1 , further comprising inserting an element in the received image according to the evaluated pose of the object being tracked, wherein the element is selected from a list comprising at least one representation of at least one virtual object and at least one second video stream.

4. The method according to claim 1 , further comprising determining at least one control command, wherein the at least one control command is determined according to a variation of the pose of the object being tracked.

5. The method according to claim 1 , further comprising transmitting at least one indication relating to a variation of the pose of the object being tracked.

6. The method according to claim 1 , further comprising:

acquiring the first and second images; and

at least partially displaying the first and second images.

7. A computer program stored on a non-transitory computer readable storage medium that when executed by a computer causes the computer to perform a method for real-time tracking of an object from a real scene in a video stream, the method comprising:

receiving a first image from said video stream, wherein the first image includes an object to be tracked;

determining a pose of the object being tracked in the first image based on a comparison between the pose of the object being tracked and a plurality of image blocks, wherein each image block of the plurality of image blocks is associated with a unique pose;

receiving a second image from the video stream, wherein the second image includes the object to be tracked; and

evaluating the pose of the object to be tracked in the second image based on the plurality of the image blocks.

8. A device for real time tracking of an object from a real scene in a video stream, comprising:

a processor;

a memory coupled to the processor, wherein the processor executes a program code stored in the memory to:

receive a first image from said video stream; wherein the first image includes an object to be tracked;

determine a pose of the object being tracked in the first image based on a comparison between the pose of the object being tracked and a plurality of image blocks, wherein each image block of the plurality of image blocks is associated with a unique pose;

receive a second image from the video stream, wherein the second image includes the object to be tracked; and

evaluate the pose of the object to be tracked in the second image based on the plurality of the image blocks.

9. The device according to claim 8 , wherein the processor is further configured to execute the program code stored in the memory to determine whether the pose of the object being tracked can be evaluated in the second image based on data stored in a first storage means.

10. The device according to claim 8 , wherein the processor is further configured to execute the program code stored in the memory to store the second image and the pose of the object being tracked in the second image in a first storage means.

11. The device according to claim 8 , wherein the processor is further configured to execute the program code stored in the memory to determine the pose of the object being tracked from which said at least one video stream is obtained in one of the frames of reference linked to said real scene or to said at least one object to be tracked.

12. The device according to claim 8 , wherein the processor is further configured to execute the program code stored in the memory to insert an element into the at least one of said received images according to the evaluated pose of the object being tracked in said received image, wherein the at least one element is contained in a list comprising at least one representation of at least one virtual object and at least one second video stream.

13. The device according to claim 8 , wherein the processor is further configured to execute the program code stored in the memory to receive the first and second images from at least one mobile telephone.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 23, 2016
From: QUALCOMM CONNECTED EXPERIENCES, INC.
To: QUALCOMM INCORPORATED
Reel/Frame 038689/0718 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 25, 2014
From: TOTAL IMMERSION, SA
To: QUALCOMM CONNECTED EXPERIENCES, INC.
Reel/Frame 034260/0297 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2014
From: LEFEVRE, VALENTIN; LIVET, NICOLAS
To: TOTAL IMMERSION
Reel/Frame 033496/0526 →
Priority Claims (1)
FR 07 52809 · Jan 22, 2007 · national
Continuity (2)
Continuation 12524101
Related Publication 20120328158A1 · Dec 27, 2012