IP Library Granted Patent US 10,643,071
Granted Patent B2
US 10,643,071 · App. 15/933,485 · Granted May 5, 2020

System and method for augmenting an image with stylized features

Inventors: Anton Viktorovich Slesarev (Bugulma, RU); Anton Vasilyevich Korzunov (Podolsk, RU); Roman Borisovich Tokarev (Moscow, RU)
Assignee: YANDEX EUROPE AG
G06K9/00637G06F16/29G06K9/00704G06K9/342G06K9/4604G06K9/4671G06T7/11G06T7/174G06T11/00G06T2207/10032G06T2207/20081G06T2207/20084G06T2207/30184
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,643,071
App. No.
15/933,485
Granted
May 5, 2020
Kind
B2
Abstract

A system and method is provided for augmenting an image with stylized features. An exemplary method includes identifying, in a first image, a first version of an object having a first set of graphical features and identifying, in a second image, a second version of the object having a second set of graphical features. Moreover, the method includes extracting the first and second sets of graphical features from the first and second images, respectively, and generating a third set of graphical features by calculating differences between the first and second sets of graphical features. Finally, using the third set of graphical features, the method includes augmenting the first version of the object in the first image.

Claims (36)

1. A method for augmenting an image, the method comprising:

identifying, in a first image, a first version of an object having a first set of graphical features;

identifying, in a second image, a second version of the object having a second set of graphical features, wherein the first and second version of the object represent a same object;

extracting the first and second sets of graphical features from the first and second images, respectively;

generating a third set of graphical features by calculating differences between the first set of graphical features of the first version of the object and the second set of graphical features of the second version of the object;

providing a graphical filter based on a stylization of a graphical view of the first image;

transforming the third set of graphical features based on the graphical filter to render a transformed third set of graphical features; and

augmenting the first version of the object in the first image based on the transformed third set of graphical features.

2. The method according to claim 1 , further comprising causing the first image to be displayed after the augmenting of the first version of the object in the first image.

3. The method according to claim 1 , wherein the generating of the third set of graphical features comprises generating a null third set of graphical features if the second version of the object is not included in the second image.

4. The method according to claim 3 , wherein the augmenting of the first version of the object in the first image comprises removing the object from the first image in response to the null third set of graphical features.

5. The method according to claim 1 , further comprising determining changes in at least one of a color, shape, size and texture of the object between the first version and the second version of the object based on the third set of graphical features.

6. The method according to claim 5 , wherein the augmenting of the first version of the object in the first image comprises stylizing the object based on the determined changes in the at least one of a color, shape, size and texture of the object.

7. A system for augmenting a digital image, the system comprising:

a database configured to store a first image including a first version of an object having a first set of graphical features; and

a processor configured to:

receive a second image including a second version of the object having a second set of graphical features, wherein the first and second version of the object represent a same object,

extract the first and second sets of graphical features from the first and second images, respectively;

generate a third set of graphical features by calculating differences between the first set of graphical features of the first version of the object and the second set of graphical features of the second version of the object;

generate a graphical filter based on a stylization of a graphical view of the first image;

transform the third set of graphical features based on the graphical filter to render a transformed third set of graphical features; and

augment the first version of the object in the first image based on the transformed third set of graphical features.

8. The system according to claim 7 , wherein the processor is further configured to cause the first image to be displayed after the augmenting of the first version of the object in the first image.

9. The system according to claim 7 , wherein the processor is further configured to generate the third set of graphical features as a null third set of graphical features if the second version of the object is not included in the second image.

10. The system according to claim 9 , wherein the processor is further configured to augment the first version of the object in the first image by removing the object from the first image in response to the null third set of graphical features.

11. The system according to claim 7 , wherein the processor is further configured to determine changes in at least one of a color, shape, size and texture of the object between the first version and the second version of the object based on the third set of graphical features.

12. The system according to claim 11 , wherein the processor is further configured to augment the first version of the object in the first image by stylizing the object based on the determined changes in the at least one of a color, shape, size and texture of the object.

13. The system according to claim 7 , wherein the second image is generated based on image data obtained by a satellite.

14. A non-transitory computer readable medium comprising computer executable instructions for augmenting an image, including instructions for:

identifying, in a first image, a first version of an object having a first set of graphical features;

identifying, in a second image, a second version of the object having a second set of graphical features, wherein the first and second version of the object represent a same object;

extracting the first and second sets of graphical features from the first and second images, respectively;

generating a third set of graphical features by calculating differences between the first set of graphical features of the first version of the object and the second set of graphical features of the second version of the object;

providing a graphical filter based on a stylization of a graphical view of the first image;

transforming the third set of graphical features based on the graphical filter to render a transformed third set of graphical features; and

augmenting the first version of the object in the first image based on the transformed third set of graphical features.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 9, 2024
From: DIRECT CURSUS TECHNOLOGY L.L.C
To: Y.E. HUB ARMENIA LLC
Reel/Frame 068525/0349 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2023
From: YANDEX EUROPE AG
To: DIRECT CURSUS TECHNOLOGY L.L.C
Reel/Frame 065692/0720 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2018
From: SLESAREV, ANTON VIKTOROVICH; KORZUNOV, ANTON VASILYEVICH; TOKAREV, ROMAN BORISOVICH
To: YANDEX LLC
Reel/Frame 045323/0323 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2018
From: YANDEX LLC
To: YANDEX EUROPE AG
Reel/Frame 045323/0354 →