IP Library › Granted Patent US 7,548,936
Granted Patent B2
US 7,548,936 · App. 11/034,443 · Granted Jun 16, 2009

Systems and methods to present web image search results for effective image browsing

Assignee: Microsoft Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,548,936
App. No.
11/034,443
Granted
Jun 16, 2009
Kind
B2
Abstract

Systems and methods to present web image search results for effective image browsing are described. In one aspect, task-based attention objects for each of multiple images associated with image search results are generated. Thumbnail images from respective ones of the images are created as a function of at least the task-based attention objects. The thumbnail images emphasize image region(s) of greater priority to a user in view of a keyword or expanded keyword associated with the search results.

Claims (52)

1. A computer implemented method executed by a processor for presenting web image search results, the method comprising:

generating task-based attention objects for each of multiple images associated with image search results returned by a search engine;

creating thumbnail images from respective ones of the images as a function of at least the task-based attention objects to emphasize image region(s) of greater priority to a user in view of a keyword or an expanded keyword associated with the search results;

calculating similarity measurements between the images as a function of one or more of content of the task-based attention objects and features associated with the images as a whole, the features comprising one or more of features extracted from the images and context associated with the images; and

mapping the thumbnail images to a 2-D layout space for presentation to the user as a function of the similarity measurements,

wherein the mapping comprises positioning thumbnail images with similar task-based attention objects in close proximity to one another and positioning thumbnail images with a higher search engine rank in front of thumbnail images with a lower search engine rank; and

wherein the similarity is measured by: VM ij =αRM ij +(1−α)IM ij , wherein IM is an image similarity matrix between an ith image (I i ) and a jth image (I j ), RM is a region similarity matrix between an attention region of I i and I j , and α is a weight to factor in overall similarity and attention region similarity, wherein the overall similarity represents content of a mined image.

2. A method as recited in claim 1 , wherein the mapping is configurable as a function of image overlap ratio.

3. A method as recited in claim 1 , wherein the mapping is configurable as a function of a user specified image overlap ratio.

4. A method as recited in claim 1 , further comprising:

receiving an indication that a user has selected a particular thumbnail image of the thumbnail images to view with respect to local detail and global context; and

responsive to receiving the indication:

identifying an original image of the images corresponding to the particular thumbnail image; and

mapping the original image and remaining ones of the image thumbnails to the 2-D space using a distorted polar coordinate system in view of a configurable distortion rate.

5. A tangible computer-readable data storage medium comprising computer-program instructions for presenting web image search results, wherein the computer-program instructions, are executed by a processor for:

generating task-based attention objects for each of multiple images associated with image search results returned by a search engine;

creating thumbnail images from respective ones of the images as a function of at least the task-based attention objects to emphasize image region(s) of greater priority to a user in view of a keyword or an expanded keyword associated with the search results;

calculating similarity measurements between the images as a function of one or more of content of the task-based attention objects and features associated with the images as a whole, the features comprising one or more of features extracted from the images and context associated with the images; and

mapping the thumbnail images to a 2-D layout space for presentation to the user as a function of the similarity measurements,

wherein the similarity is measured by: VM ij =αRM ij +(1−α)IM ij , wherein IM is an image similarity matrix between an ith image (I i ) and a jth image (I j ), RM is a region similarity matrix between an attention region of I i and I j ,and α is a weight to factor in overall similarity and attention region similarity, wherein the overall similarity represents content of a mined image.

6. The tangible computer-readable data storage medium of claim 5 , further comprising computer-program instructions executable by the processor for presenting the thumbnail images to the user for browsing.

7. The tangible computer-readable data storage medium of claim 5 , wherein results of the computer-program instructions for mapping are configurable as a function of image overlap ratio.

8. The tangible computer-readable data storage medium of claim 5 , wherein results of the computer-program instructions for mapping are configurable as a function of a user specified image overlap ratio.

9. The tangible computer-readable data storage medium of claim 5 , further comprising computer-program instructions executable by the processor for:

receiving an indication that a user has selected a particular thumbnail image of the thumbnail images to view with respect to local detail and global context; and

responsive to receiving the indication:

identifying an original image of the images corresponding to the particular thumbnail image; and

mapping the original image and remaining ones of the image thumbnails to the 2-D space using a distorted polar coordinate system in view of a configurable distortion rate.

10. A computing device for presenting web image search results, the computing device comprising:

a processor; and

a memory coupled to the processor, the memory comprising computer-program instructions executable by the processor for:

generating task-based attention objects for each of multiple images associated with image search results returned by a search engine;

creating thumbnail images from respective ones of the images as a function of at least the task-based attention objects to emphasize image region(s) of greater priority to a user in view of a keyword or expanded keyword associated with the search results;

mapping the thumbnail images to a 2-D layout space for presentation to the user,

wherein the mapping comprises positioning thumbnail images with similar task-based attention objects in close proximity to one another and positioning thumbnail images with a higher search engine rank in front of thumbnail images with a lower search engine rank;

calculating similarity measurements between the images as a function of one or more of content of the task-based attention objects and features associated with the images as a whole, the features comprising one or more of features extracted from the images and context associated with the images; and

mapping the thumbnail images to a 2-D layout space for presentation to the user as a function of the similarity measurements,

wherein the is similarity measured by: VM ij =αRM ij +(1−α)IM ij , wherein IM is an image similarity matrix between an ith image (I i ) and a jth image (I j ), RM is a region similarity matrix between an attention region of I i and I j , and α is a weight to factor in overall similarity and attention region similarity, wherein the overall similarity represents content of a mined image.

11. A computing device as recited in claim 10 , wherein results of the computer-program instructions for mapping are configurable as a function of image overlap ratio.

12. A computing device as recited in claim 10 , wherein results of the computer-program instructions for mapping are configurable as a function of a user specified image overlap ratio.

13. A computing device as recited in claim 10 , further comprising computer-program instructions executable by the processor for:

receiving an indication that a user has selected a particular thumbnail image of the thumbnail images to view with respect to local detail and global context; and

responsive to receiving the indication:

identifying an original image of the images corresponding to the particular thumbnail image; and

mapping the original image and remaining ones of the image thumbnails to the 2-D space using a distorted polar coordinate system in view of a configurable distortion rate.

14. A computer implemented method executed by a processor for presenting web image search results, the method comprising:

generating task-based attention objects for each of multiple images associated with image search results from a search engine;

creating thumbnail images from respective ones of the images as a function of at least the task-based attention objects to emphasize image region(s) of greater priority to a user in view of a keyword or an expanded keyword associated with the search results;

calculating similarity measurements between the images as a function of one or more of content of the task-based attention objects and features associated with the images as a whole, the features comprising one or more of features extracted from the images and context associated with the images; and

mapping the thumbnail images to a 2-D layout space for presentation to the user as a function of the similarity measurements,

wherein each of the thumbnail images are fit into a grid while substantially maximizing original similarity relationships, and

wherein the similarity is measured by: VM ij =αRM ij +(1−α)IM ij , wherein IM is an image similarity matrix between an ith image (I i ) and a jth image (I j ), RM is a region similarity matrix between an attention region of I i and I j , and α is a weight to factor in overall similarity and attention region similarity, wherein the overall similarity represents content of a mined image.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2014
From: MICROSOFT CORPORATION
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 034543/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2007
From: LIU, HAO; MA, WEI-YING; XIE, XING; LI, ZHIWEI; TANG, XIAOOU
To: MICROSOFT CORPORATION
Reel/Frame 019729/0527 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 11, 2005
From: LIU, HAO; MA, WEI-YING; XIE, XING; LI, ZHIWEI
To: MICROSOFT CORPORATION
Reel/Frame 015710/0362 →
Continuity (1)
Related Publication 20060155684A1 · Jul 13, 2006