IP Library › Granted Patent US 11,043,019
Granted Patent B2
US 11,043,019 · App. 16/630,625 · Granted Jun 22, 2021

Method of displaying a wide-format augmented reality object

Inventors: Andrey Valeryevich Komissarov (Tula, RU); Vitaly Vitalyevich Averyanov (Tula, RU)
Assignee: DEVAR ENTERTAINMENT LIMITED
G06T15/04G06T17/00G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,043,019
App. No.
16/630,625
Granted
Jun 22, 2021
Kind
B2
Abstract

The invention relates to computer data processing, and more particularly to methods of displaying an augmented reality object based on an original image, which involves generating a 3D model of an augmented reality object; obtaining a plurality of individual fragments of an image of a real-world object, where each fragment is a partial photographic image of the real-world object, obtained using a camera; generating a two-dimensional image of the real-world object by aligning the obtained image fragments; generating a transformation matrix for transforming the coordinates of the two-dimensional image of the real-world object into intrinsic coordinates corresponding to coordinates of the 3D model; and, using the coordinate transformation matrix, coloring elements of the 3D model of the augmented reality object in accordance with the colors of the corresponding elements of the real-world object, where coloring is carried out by texturing areas of the 3D model of the augmented reality object.

Claims (18)

1. A method of displaying an augmented reality object on a display of a computing device equipped with a camera and communication means, the method comprising the following steps:

forming a 3D model of the augmented reality object;

receiving a plurality of separate fragments of an image of a real object, wherein each fragment is a partial photo image of the real object obtained from the camera or extracted from a video stream taken by the camera;

forming a two-dimensional image of the real object by combining said received image fragments;

forming a transformation matrix of coordinates of the two-dimensional image of the real object corresponding to coordinates of the 3D model; and

coloring elements of the 3D model using said matrix of coordinate transformation, by applying colors and/or textures of the corresponding elements of the real object represented by the two-dimensional image to the corresponding regions of the 3D model of the augmented reality object or by applying texture or color to the entire 3D model as a whole;

characterized in that forming of the two-dimensional image of the real object based on the received fragments further comprises:

determining if one or more fragments are missing to form said two-dimensional image, and

sending a request to the device to obtain an additional photo or video image of the fragments that are missing.

2. The method according to claim 1 , wherein applying texture to the corresponding regions of the 3D model of the augmented reality object is performed by superimposing textures of the corresponding elements of the real object on the corresponding regions of the 3D model.

3. The method according to claim 1 , wherein texture mapping is performed and the regions of the 3D are textured with an indication for each such region which texture area of the two-dimensional image it corresponds to, wherein said texture mapping is performed using Tile and Offset parameters.

4. The method according to claim 1 , where texture is applied to the entire 3D model of the augmented reality object at once by creating an empty image having a size corresponding to the whole real object and applying thereafter scanned regions with “gluing” separate texturized fragments.

5. The method according to claim 2 , further comprising combining separate texturized fragments into one image and “mashing” seams between said fragments.

6. The method according to claim 5 , where the “mashing” of the seams comprises the following steps:

determining pixels of a joint line between the texturized fragments,

selecting pixels located at a distance N pixels to a right side and a left side for each of the joint pixels, and

coloring pixels between said left and right pixels with a smooth gradient.

7. The method according to claim 3 , wherein the regions are texturized by imposing the texture using Tile/Offset parameters, while “pseudo-texture” is generated for each image element, which, from an object's point of view, is equivalent to a large image, but only significant for said region.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2025
From: DEVAR ENTERTAINMENT LIMITED
To: DEVAR AI INC.
Reel/Frame 072458/0361 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 18, 2021
From: KOMISSAROV, ANDREY VALERYEVICH; AVERYANOV, VITALY VITALYEVICH
To: DEVAR ENTERTAINMENT LIMITED
Reel/Frame 056274/0559 →
Continuity (1)
Related Publication 20210118216A1 · Apr 22, 2021