IP Library Granted Patent US 10,607,110
Granted Patent B2
US 10,607,110 · App. 15/829,995 · Granted Mar 31, 2020

Generating a reference digital image based on an indicated time frame and searching for other images using the reference digital image

Inventors: Alaa Abou Mahmoud (Dracut, MA); Paul R. Bastide (Boxford, MA); Fang Lu (Billerica, MA)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G06K9/6215G06F17/27G06F17/28G06K9/00536G06K9/00677G06K9/52G06K9/62G06K9/6201G06K9/66G06K9/726G06T2207/20076
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,607,110
App. No.
15/829,995
Granted
Mar 31, 2020
Kind
B2
Abstract

A digital image and an indication of a time frame is received. Whether the time frame is a future time frame or a past time frame can be determined. How at least one element of the first digital image will change or has changed during the time frame can be predicted. At least one reference digital image can be generated, the reference digital image including at least one change to the at least one element corresponding to how the at least one element will change or has changed during the time frame. The reference digital image to each of a plurality of other digital images. A correlation parameter can be assigned to each of the plurality of other digital images. A portion of the plurality of other digital images having highest correlation parameters can be output for presentation to a user.

Claims (63)

1. A method comprising:

receiving a first digital image;

receiving an indication of at least a time frame;

determining whether the time frame is a future time frame or a past time frame;

responsive to determining whether the time frame is the future time frame or the past time frame, predicting how at least one element of the first digital image will change or has changed during the time frame;

responsive to predicting how the at least one element of the first digital image will change or has changed during the time frame, generating, using a processor, at least one reference digital image that is a revised version of the first digital image, the reference digital image including at least one change to the at least one element corresponding to how the at least one element will change or has changed during the time frame;

comparing the reference digital image to each of a plurality of other digital images;

based on comparing the reference digital image to each of the plurality of other digital images, assigning a correlation parameter to each of the plurality of other digital images, each correlation parameter indicating how closely a respective other digital image matches the reference digital image; and

outputting for presentation to a user a portion of the plurality of other digital images having highest correlation parameters.

2. The method of claim 1 , further comprising:

receiving a name of a person;

wherein the correlation parameter assigned to a respective other digital image is based, at least in part, on whether the other digital image is associated with the name of the person.

3. The method of claim 1 , further comprising:

receiving a name of a location;

wherein the correlation parameter assigned to a respective other digital image is based, at least in part, on whether the other digital image is associated with the location.

4. The method of claim 1 , wherein the indication of the time frame is a text string, the method further comprising processing the text string to identify at least the time frame and determining whether the time frame is the future time frame or the past time frame using natural language processing.

5. The method of claim 1 , wherein outputting for presentation to the user the portion of the plurality of other digital images having highest correlation parameters comprises presenting the portion of the plurality of other digital images having highest correlation parameters in an order based the correlation parameters.

6. The method of claim 1 , further comprising:

assigning a ranking to each of the portion of the plurality of other digital images having highest correlation parameters;

wherein outputting for presentation to the user the portion of the plurality of other digital images having highest correlation parameters comprises presenting the portion of the plurality of other digital images having highest correlation parameters in an order based the assigned rankings.

7. The method of claim 1 , wherein the other digital images are accessed from a social networking system.

8. A system, comprising:

a processor programmed to initiate executable operations comprising:

receiving a first digital image;

receiving an indication of at least a time frame;

determining whether the time frame is a future time frame or a past time frame;

responsive to determining whether the time frame is the future time frame or the past time frame, predicting how at least one element of the first digital image will change or has changed during the time frame;

responsive to predicting how the at least one element of the first digital image will change or has changed during the time frame, generating at least one reference digital image that is a revised version of the first digital image, the reference digital image including at least one change to the at least one element corresponding to how the at least one element will change or has changed during the time frame;

comparing the reference digital image to each of a plurality of other digital images;

based on comparing the reference digital image to each of the plurality of other digital images, assigning a correlation parameter to each of the plurality of other digital images, each correlation parameter indicating how closely a respective other digital image matches the reference digital image; and

outputting for presentation to a user a portion of the plurality of other digital images having highest correlation parameters.

9. The system of claim 8 , the executable operations further comprising:

receiving a name of a person;

wherein the correlation parameter assigned to a respective other digital image is based, at least in part, on whether the other digital image is associated with the name of the person.

10. The system of claim 8 , the executable operations further comprising:

receiving a name of a location;

wherein the correlation parameter assigned to a respective other digital image is based, at least in part, on whether the other digital image is associated with the location.

11. The system of claim 8 , wherein the indication of the time frame is a text string, the executable operations further comprising processing the text string to identify at least the time frame and determining whether the time frame is the future time frame or the past time frame using natural language processing.

12. The system of claim 8 , wherein outputting for presentation to the user the portion of the plurality of other digital images having highest correlation parameters comprises presenting the portion of the plurality of other digital images having highest correlation parameters in an order based the correlation parameters.

13. The system of claim 8 , the executable operations further comprising:

assigning a ranking to each of the portion of the plurality of other digital images having highest correlation parameters;

wherein outputting for presentation to the user the portion of the plurality of other digital images having highest correlation parameters comprises presenting the portion of the plurality of other digital images having highest correlation parameters in an order based the assigned rankings.

14. The system of claim 8 , wherein the other digital images are accessed from a social networking system.

15. A computer program product comprising a computer readable storage medium having program code stored thereon, the program code executable by a processor to perform a method comprising:

receiving, by the processor, a first digital image;

receiving, by the processor, an indication of at least a time frame;

determining, by the processor, whether the time frame is a future time frame or a past time frame;

responsive to determining whether the time frame is the future time frame or the past time frame, predicting, by the processor, how at least one element of the first digital image will change or has changed during the time frame;

responsive to predicting how the at least one element of the first digital image will change or has changed during the time frame, generating, by the processor, at least one reference digital image that is a revised version of the first digital image, the reference digital image including at least one change to the at least one element corresponding to how the at least one element will change or has changed during the time frame;

comparing, by the processor, the reference digital image to each of a plurality of other digital images;

based on comparing the reference digital image to each of the plurality of other digital images, assigning, by the processor, a correlation parameter to each of the plurality of other digital images, each correlation parameter indicating how closely a respective other digital image matches the reference digital image; and

outputting, by the processor, for presentation to a user a portion of the plurality of other digital images having highest correlation parameters.

16. The computer program product of claim 15 , the method further comprising:

receiving a name of a person;

wherein the correlation parameter assigned to a respective other digital image is based, at least in part, on whether the other digital image is associated with the name of the person.

17. The computer program product of claim 15 , the method further comprising:

receiving a name of a location;

wherein the correlation parameter assigned to a respective other digital image is based, at least in part, on whether the other digital image is associated with the location.

18. The computer program product of claim 15 , wherein the indication of the time frame is a text string, the method further comprising processing the text string to identify at least the time frame and determining whether the time frame is the future time frame or the past time frame using natural language processing.

19. The computer program product of claim 15 , wherein outputting for presentation to the user the portion of the plurality of other digital images having highest correlation parameters comprises presenting the portion of the plurality of other digital images having highest correlation parameters in an order based the correlation parameters.

20. The computer program product of claim 15 , the method further comprising:

assigning a ranking to each of the portion of the plurality of other digital images having highest correlation parameters;

wherein outputting for presentation to the user the portion of the plurality of other digital images having highest correlation parameters comprises presenting the portion of the plurality of other digital images having highest correlation parameters in an order based the assigned rankings.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2021
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: AIRBNB, INC.
Reel/Frame 056427/0193 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 4, 2017
From: ABOU MAHMOUD, ALAA; BASTIDE, PAUL R.; LU, FANG
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 044282/0311 →