IP Library Granted Patent US 11,025,837
Granted Patent B2
US 11,025,837 · App. 16/366,872 · Granted Jun 1, 2021

Replacing a background portion of an image

Inventors: Deviprasad Punja (Bangalore, IN); Aditya Rautray (Bangalore, IN)
Assignee: ROVl GUIDES, INC.
H04N5/272
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,025,837
App. No.
16/366,872
Granted
Jun 1, 2021
Kind
B2
Abstract

Systems and methods are described for replacing a background portion of an image. An illustrative method includes receiving a first image, identifying a background portion of the first image and a subject portion of the first image, identifying a geographic location corresponding to the background portion of the first image, retrieving a plurality of other images depicting the geographic location, selecting a second image from the plurality of other images, wherein the second image is associated with metadata indicating that the second image was captured during a predetermined time period, and generating for display a third image comprising the subject portion of the first image placed over the second image.

Claims (101)

1. A method for replacing a background portion of an image, the method comprising:

receiving a first image;

identifying a background portion of the first image and a subject portion of the first image;

identifying a geographic location corresponding to the background portion of the first image;

retrieving a plurality of other images depicting the geographic location;

selecting a second image from the plurality of other images, wherein the second image is associated with metadata indicating that the second image was captured during a predetermined time period; and

generating for display a third image comprising the subject portion of the first image placed over the second image,

wherein identifying the geographic location corresponding to the background portion of the first image comprises:

identifying an object in the background portion of the first image; and

determining a geographic location of the object; and

wherein determining the geographic location of the object comprises:

comparing an area of the background portion of the first image, the area including the object, to a plurality of images of objects; and

in response to determining that an object in a given image of the plurality of images of objects matches the object in the area of the background portion of the first image, identifying, based on metadata associated with the given image of the plurality of images, the geographic location of the object.

2. The method of claim 1 , wherein identifying the object in the background portion of the first image further comprises:

identifying a pattern in the background portion of the first image;

comparing the identified pattern to a database of known patterns; and

in response to determining that the identified pattern matches a given pattern in the database of known patterns, identifying the object based on data corresponding to the given pattern.

3. The method of claim 1 , wherein selecting the second image from the plurality of other images comprises:

determining a parameter of the first image;

determining a parameter of the second image;

determining whether the parameter of the first image matches the parameter of the second image; and

in response to determining that the parameter of the first image matches the parameter of the second image, selecting the second image.

4. The method of claim 1 , wherein selecting the second image from the plurality of other images comprises:

determining a first parameter of the first image and a second parameter of the first image, wherein the first parameter has a higher ranking than the second parameter;

determining the first parameter of each of the plurality of other images and determining the second parameter of each of the plurality of other images;

determining a first degree of matching between the first parameter of the first image and the first parameter of each of the plurality of other images;

determining a second degree of matching between the second parameter of the first image and the second parameter of each of the plurality of other images; and

in response to determining that the first degree of matching for a given image of the plurality of other images is equal to or greater than a predetermined value, selecting the given image as the second image.

5. The method of claim 1 , further comprising:

determining a first parameter of the first image and a second parameter of the first image, wherein the first parameter has a higher ranking than the second parameter;

determining the first parameter of each of the plurality of other images and determining the second parameter of each of the plurality of other images;

determining a first degree of matching between the first parameter of the first image and the first parameter of each of the plurality of other images;

determining a second degree of matching between the second parameter of the first image and the second parameter of each of the plurality of other images;

in response to determining that the first degree of matching for each of the plurality of other images is lower than a first predetermined value, determining whether the second degree of matching for a given image of the plurality of other images is equal to or greater than a second predetermined value; and

in response to determining that the second degree of matching for the given image of the plurality of other images is equal to or greater than the second predetermined value, selecting the given image as the second image.

6. The method of claim 1 , wherein selecting the second image from the plurality of other images comprises:

determining a time of day associated with the first image;

determining whether a given image of the plurality of other images is associated with the time of day; and

in response to determining that the given image is associated with the time of day, selecting the given image as the second image.

7. The method of claim 1 , wherein selecting the second image from the plurality of other images comprises:

identifying the object in the background portion of the first image;

determining a point of view of the first image relative to the object;

determining whether a given image of the plurality of other images was captured from the point of view; and

in response to determining that the given image was captured from the point of view, selecting the given image as the second image.

8. The method of claim 1 , wherein generating for display the third image comprises:

identifying the object in the background portion of the first image;

identifying the object in the second image;

determining a size of the subject portion of the first image relative to the size of the object in the background portion of the first image;

determining a size of the object in the second image; and

adjusting the size of the subject portion of the first image such that the size of the subject portion of the first image relative to the size of the object in the background portion of the first image and the size of the subject portion of the first image relative to the size of the object in the second image are equal.

9. A system for replacing a background portion of an image, the system comprising:

control circuitry configured to:

receive a first image;

identify a background portion of the first image and a subject portion of the first image;

identify a geographic location corresponding to the background portion of the first image;

retrieve a plurality of other images depicting the geographic location;

select a second image from the plurality of other images, wherein the second image is associated with metadata indicating that the second image was captured during a predetermined time period; and

generate for display a third image comprising the subject portion of the first image placed over the second image,

wherein the control circuitry is configured to identify the geographic location corresponding to the background portion of the first image by:

identifying an object in the background portion of the first image; and

determining a geographic location of the object; and

wherein the control circuitry is configured to determine the geographic location of the object by:

comparing an area of the background portion of the first image, the area including the object, to a plurality of images of objects; and

in response to determining that an object in a given image of the plurality of images of objects matches the object in the area of the background portion of the first image, identifying, based on metadata associated with the given image of the plurality of images, the geographic location of the object.

10. The system of claim 9 , wherein the control circuitry is further configured to identify the object in the background portion of the first image by:

identifying a pattern in the background portion of the first image;

comparing the identified pattern to a database of known patterns; and

in response to determining that the identified pattern matches a given pattern in the database of known patterns, identifying the object based on data corresponding to the given pattern.

11. The system of claim 9 , wherein the control circuitry is configured to select the second image from the plurality of other images by:

determining a parameter of the first image;

determining a parameter of the second image;

determining whether the parameter of the first image matches the parameter of the second image; and

in response to determining that the parameter of the first image matches the parameter of the second image, selecting the second image.

12. The system of claim 9 , wherein the control circuitry is configured to select the second image from the plurality of other images by:

determining a first parameter of the first image and a second parameter of the first image, wherein the first parameter has a higher ranking than the second parameter;

determining the first parameter of each of the plurality of other images and determining the second parameter of each of the plurality of other images;

determining a first degree of matching between the first parameter of the first image and the first parameter of each of the plurality of other images;

determining a second degree of matching between the second parameter of the first image and the second parameter of each of the plurality of other images; and

in response to determining that the first degree of matching for a given image of the plurality of other images is equal to or greater than a predetermined value, selecting the given image as the second image.

13. The system of claim 9 , wherein the control circuitry is further configured to:

determine a first parameter of the first image and a second parameter of the first image, wherein the first parameter has a higher ranking than the second parameter;

determine the first parameter of each of the plurality of other images and determine the second parameter of each of the plurality of other images;

determine a first degree of matching between the first parameter of the first image and the first parameter of each of the plurality of other images;

determine a second degree of matching between the second parameter of the first image and the second parameter of each of the plurality of other images;

in response to determining that the first degree of matching for each of the plurality of other images is lower than a first predetermined value, determine whether the second degree of matching for a given image of the plurality of other images is equal to or greater than a second predetermined value; and

in response to determining that the second degree of matching for the given image of the plurality of other images is equal to or greater than the second predetermined value, select the given image as the second image.

14. The system of claim 9 , wherein the control circuitry is configured to select the second image from the plurality of other images by:

determining a time of day associated with the first image;

determining whether a given image of the plurality of other images is associated with the time of day; and

in response to determining that the given image is associated with the time of day, selecting the given image as the second image.

15. The system of claim 9 , wherein the control circuitry is configured to select the second image from the plurality of other images by:

identifying the object in the background portion of the first image;

determining a point of view of the first image relative to the object;

determining whether a given image of the plurality of other images was captured from the point of view; and

in response to determining that the given image was captured from the point of view, selecting the given image as the second image.

16. The system of claim 9 , wherein the control circuitry is configured to generate for display the third image by:

identifying the object in the background portion of the first image;

identifying the object in the second image;

determining a size of the subject portion of the first image relative to the size of the object in the background portion of the first image;

determining a size of the object in the second image; and

adjusting the size of the subject portion of the first image such that the size of the subject portion of the first image relative to the size of the object in the background portion of the first image and the size of the subject portion of the first image relative to the size of the object in the second image are equal.

Assignments (7)
CHANGE OF NAME Recorded Oct 3, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069106/0178 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053481/0790 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: HPS INVESTMENT PARTNERS, LLC
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053458/0749 →
SECURITY INTEREST Recorded Jun 1, 2020
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS INC.; VEVEO, INC.; INVENSAS CORPORATION; INVENSAS BONDING TECHNOLOGIES, INC.; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: BANK OF AMERICA, N.A.
Reel/Frame 053468/0001 →
PATENT SECURITY AGREEMENT Recorded Nov 25, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 051110/0006 →
SECURITY INTEREST Recorded Nov 22, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: HPS INVESTMENT PARTNERS, LLC, AS COLLATERAL AGENT
Reel/Frame 051143/0468 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 14, 2019
From: PUNJA, DEVIPRASAD; RAUTRAY, ADITYA
To: ROVI GUIDES, INC.
Reel/Frame 049477/0623 →
Continuity (1)
Related Publication 20200314352A1 · Oct 1, 2020
Cited By (2)
US 12,452,386 US 12,477,080