IP Library Granted Patent US 9,727,565
Granted Patent B2
US 9,727,565 · App. 14/290,214 · Granted Aug 8, 2017

Photo and video search

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,727,565
App. No.
14/290,214
Granted
Aug 8, 2017
Kind
B2
Abstract

In one embodiment, a set of tags that has been generated by performing computer vision analysis of image content of a visual media item may be obtained, where each tag of the set of tags has a corresponding probability. In addition, a set of information that is independent from the image content of the visual media item may be obtained. The probability of at least a portion of the set of tags may be modified based, at least in part, upon the set of information.

Claims (59)

1. A method, comprising:

ascertaining, from a database, a set of tags that has been generated by performing computer vision analysis of image content of a visual media item, each tag of the set of tags having a corresponding probability, wherein the probability indicates a likelihood that the tag accurately describes the image content of the visual media item;

obtaining, by a processor, a set of information that is independent from the image content of the visual media item, wherein obtaining the set of information includes performing a look up in a calendar to obtain at least a portion of the set of information using at least one of a date or time at which the visual media item was captured via a mobile device, wherein the portion of the set of information identifies an event that occurred on at least one of the date or time at which the visual media item was captured via the mobile device; and

modifying in the database the probability of at least a portion of the set of tags based, at least in part, upon the set of information, wherein modifying the probability of at least a portion of the set of tags includes increasing or decreasing the probability of a tag in the set of tags based, at least in part, upon whether the event corresponds to the tag.

2. The method as recited in claim 1 , further comprising:

capturing the visual media item by a mobile device;

detecting, via one or more sensors of the mobile device, an identity of an object or individual in a vicinity of the mobile device;

wherein the set of information includes an indication of the identity of the object or individual in the vicinity of the mobile device at the time that the mobile device captured the visual media item.

3. The method as recited in claim 1 , wherein the set of information comprises an indication of an identity of an object or individual in a vicinity of a mobile device, wherein the identity of the object or individual is detected by the mobile device at the time that the mobile device captured the visual media item.

4. The method as recited in claim 1 , further comprising:

performing similarity analysis with respect to the visual media item and other visual media items to identify a set of visual media items that are similar to the visual media item;

wherein obtaining a set of information that is independent from the image content of the visual media item includes ascertaining a set of tags associated with each similar visual media item in the set of media items, each tag of the set of tags associated with each similar visual media item having a corresponding probability.

5. The method as recited in claim 1 , further comprising:

ascertaining a date or time at which the visual media item was captured;

wherein the at least a portion of the set of information comprises a set of tags associated with at least one other visual media item captured within a threshold period of time from the date or time at which the visual media item was captured.

6. The method as recited in claim 1 , wherein the set of information comprises a comment that has been posted with respect to the visual media item.

7. A system, comprising:

one or more processors; and

one or more memories, at least one of processors or the memories being adapted for:

ascertaining, from a database, a set of tags that has been generated by performing computer vision analysis of image content of a visual media item, each tag of the set of tags having a corresponding probability, wherein the probability indicates a likelihood that the tag accurately describes the image content of the visual media item;

obtaining a set of information that is independent from the image content of the visual media item, wherein obtaining the set of information includes performing a look up in a calendar to obtain at least a portion of the set of information using at least one of a date or time at which the visual media item was captured via a mobile device, wherein the portion of the set of information identifies an event that occurred on at least one of the date or time at which the visual media item was captured via the mobile device; and

modifying in the database, the probability of at least a portion of the set of tags based, at least in part, upon the set of information, wherein modifying the probability of at least a portion of the set of tags includes increasing or decreasing the probability of a tag in the set of tags based, at least in part, upon whether the event corresponds to the tag.

8. The system as recited in claim 7 , wherein the set of information comprises:

an indication of an identity of an object or individual in a vicinity of a mobile device at a time that the mobile device captured the visual media item.

9. The system as recited in claim 8 , wherein the system is the mobile device.

10. The system as recited in claim 7 , at least one of the processors or the memories being configured for performing operations, further comprising:

performing similarity analysis with respect to the visual media item and other visual media items to identify a set of visual media items that are similar to the visual media item;

wherein obtaining a set of information that is independent from the image content of the visual media item includes ascertaining a set of tags associated with each similar visual media item in the set of media items, each tag of the set of tags associated with each similar visual media item having a corresponding probability.

11. The system as recited in claim 7 , wherein the set of information comprises a comment that has been posted with respect to the visual media item.

12. A non-transitory computer-readable storage medium storing thereon computer-readable instructions for performing operations, comprising:

ascertaining, from a database a set of tags that has been generated by performing computer vision analysis of image content of a visual media item, each tag of the set of tags having a corresponding probability, wherein the probability indicates a likelihood that the tag accurately describes the image content of the visual media item;

obtaining a set of information that is independent from the image content of the visual media item, wherein obtaining the set of information includes performing a look up in a calendar to obtain at least a portion of the set of information using at least one of a date or time at which the visual media item was captured via a mobile device, wherein the portion of the set of information identifies an event that occurred on at least one of the date or time at which the visual media item was captured via the mobile device; and

modifying, in the database, the probability of at least a portion of the set of tags based, at least in part, upon the set of information, wherein modifying the probability of at least a portion of the set of tags includes increasing or decreasing the probability of a tag in the set of tags based, at least in part, upon whether the event corresponds to the tag.

13. The non-transitory computer-readable storage medium as recited in claim 12 , further comprising:

detecting, via one or more sensors of a mobile device, an identity of an object or individual in a vicinity of the mobile device;

wherein the set of information includes an indication of the identity of the object or individual in the vicinity of the mobile device at a time that the mobile device captured the visual media item.

14. The non-transitory computer-readable storage medium as recited in claim 12 , wherein the set of information comprises an indication of an object or individual in a vicinity of a mobile device at the time that the mobile device captured the visual media item.

15. The non-transitory computer-readable storage medium as recited in claim 12 , further comprising:

performing similarity analysis with respect to the visual media item and other visual media items to identify a set of visual media items that are similar to the visual media item;

wherein obtaining a set of information that is independent from the image content of the visual media item includes ascertaining a set of tags associated with each similar visual media item in the set of media items, each tag of the set of tags associated with each similar visual media item having a corresponding probability.

16. The non-transitory computer-readable storage medium as recited in claim 12 , wherein the set of information comprises a comment that has been posted with respect to the visual media item.

17. The method as recited in claim 1 , further comprising:

receiving a search query;

identifying a plurality of visual media items that are relevant to the search query based, at least in part, upon probabilities associated with tags of the plurality of visual media items; and

providing the plurality of visual media items for display via a mobile device;

wherein the plurality of visual media items include the visual media item.

18. The method as recited in claim 1 , further comprising:

identifying a plurality of visual media items stored on a mobile device;

organizing, by a processor of the mobile device, the plurality of visual media items in a plurality of folders based, at least in part, on tags associated with the plurality of visual media items and corresponding probabilities;

wherein the plurality of visual media items include the visual media item.

19. The method as recited in claim 1 , wherein the calendar is associated with a particular user or is publicly available.

20. The method as recited in claim 3 , wherein obtaining the set of information comprises detecting the identity of the object or individual via one or more sensors of a mobile device via which the visual media item was captured, wherein the sensors include a Radio Frequency Identifier (RFID) sensor or an Infra-red (IR) sensor.

21. The method as recited in claim 18 , further comprising:

receiving a selection, via the mobile device, of one of the plurality of folders.

22. The method as recited in claim 1 , wherein the visual media item is a photograph.

23. The method as recited in claim 1 , further comprising:

capturing the visual media item by a mobile device;

detecting, via one or more sensors of the mobile device, an identity of an object in a vicinity of the mobile device;

wherein the set of information includes an indication of the identity of the object in the vicinity of the mobile device at the time that the mobile device captured the visual media item.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2021
From: VERIZON MEDIA INC.
To: VERIZON PATENT AND LICENSING INC.
Reel/Frame 057453/0431 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2020
From: OATH INC.
To: VERIZON MEDIA INC.
Reel/Frame 054258/0635 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 2, 2018
From: YAHOO HOLDINGS, INC.
To: OATH INC.
Reel/Frame 045240/0310 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2017
From: YAHOO! INC.
To: YAHOO HOLDINGS, INC.
Reel/Frame 042963/0211 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 4, 2014
From: PESAVENTO, GERRY; NGUYEN, HUY X.
To: YAHOO! INC.
Reel/Frame 033029/0671 →