IP Library Granted Patent US 11,403,352
Granted Patent B2
US 11,403,352 · App. 16/139,298 · Granted Aug 2, 2022

Multi-touch gesture search

Inventors: Jonathan Paris (Palo Alto, CA); Leili Baghaei Rad (Menlo Park, CA); Benoit Schillings (Los Altos Hills, VA); Yuhuan Tang (Santa Clara, CA)
Assignee: YAHOO ASSETS LLC
G06F16/9535G06F3/0482G06F3/04842G06F3/04883G06F16/434G06F2203/04803G06F2203/04808
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,403,352
App. No.
16/139,298
Granted
Aug 2, 2022
Kind
B2
Abstract

One or more systems and/or methods for providing related content associated with a multi-touch gesture to a user are provided. A multi-touch gesture (e.g., a pinch-in gesture, a pinch-out gesture, etc.) may be received through a user interface of a client device (e.g., smartphone, tablet, television, virtual wall, etc.) associated with a user. The multi-touch gesture may be evaluated to identify an area of interest of the user interface (e.g., a portion of user interface containing content of interest to the user). The area of interest may be evaluated to identify context (e.g., keywords, phrases, associated content, etc.) associated with the area of interest. A search of content may be performed based upon the context to identify related content (e.g., news articles, wide-area network search results, local device search results, etc.) associated with the context. The related content may be provided to the user through the client device.

Claims (91)

1. A method, comprising:

utilizing a visual effect to indicate an area of interest of a user interface of a client device, wherein utilizing the visual effect comprises distorting a secondary area, of the user interface, not included in the area of interest but not distorting the area of interest;

evaluating the area of interest, wherein the area of interest comprises an image of an entity performing an activity, wherein the evaluating comprises (i) evaluating the image, utilizing facial recognition, to identify an identity of the entity in the image and (ii) evaluating the image, utilizing image recognition, to identify the activity being performed in the image by the entity in the image;

identifying context associated with the area of interest based upon a link between the identity of the entity and the activity being performed by the entity, wherein the context is based upon the image;

performing a search of content based upon the context to identify a first set of search results;

at least one of:

responsive to determining that the first set of search results comprises less than a first threshold number of search results:

expanding the search by at least one of adding one or more optional keywords to search parameters or making one or more required keywords in the search parameters optional; and

determining a second set of search results based upon the expanding; or

responsive to determining that the first set of search results comprises more than a second threshold number of search results:

narrowing the search by adding one or more required keywords to the search parameters; and

determining the second set of search results based upon the narrowing;

identifying a plurality of potential query search terms, comprising a first potential query search term and a second potential query search term, based upon the context;

providing the second set of search results and the plurality of potential query search terms through the client device;

responsive to receiving a selection of the first potential query search term of the plurality of potential query search terms, filtering the second set of search results based upon the first potential query search term to generate a filtered set of search results; and

providing the filtered set of search results through the client device.

2. The method of claim 1 , wherein the distorting the secondary area comprises at least one of fading the secondary area, dimming the secondary area, blurring the secondary area or blacking out the secondary area.

3. The method of claim 1 , comprising:

receiving feedback associated with identification of the area of interest based upon the visual effect; and

responsive to the feedback indicating an improper identification for the area of interest, adjusting the area of interest and utilizing the visual effect to indicate the adjusted area of interest by distorting a first portion of the secondary area of the user interface but not distorting a second portion of the secondary area of the user interface, wherein the first portion of the secondary area is not included in the adjusted area of interest but the second portion of the secondary area is included in the adjusted area of interest.

4. The method of claim 1 , comprising:

providing a second user interface comprising search results corresponding to related content; and

responsive to a user selecting a search result for a related content item, displaying a third user interface comprising the related content item.

5. The method of claim 1 , the identifying the context based upon a location of a sender of a message.

6. The method of claim 5 , the location of the sender of the message determined based upon an IP address associated with the sender.

7. The method of claim 1 , the filtering the second set of search results comprising:

adding the first potential query search term to a search query associated with the second set of search results.

8. The method of claim 1 , the filtered set of search results comprising a local network search result.

9. The method of claim 1 , comprising:

defining the area of interest based upon one or more multi-touch hands-off gestures detected, via at least one of a sensor or a range camera, in association with a projection of the user interface via a projector.

10. The method of claim 1 , comprising:

responsive to determining that the first set of search results comprises less than the first threshold number of search results:

expanding the search by adding the one or more optional keywords to the search parameters of the first set of search results; and

determining the second set of search results based upon the expanding.

11. The method of claim 1 , comprising:

responsive to determining that the first set of search results comprises less than the first threshold number of search results:

expanding the search by making the one or more required keywords in the search parameters of the first set of search results optional; and

determining the second set of search results based upon the expanding.

12. The method of claim 1 , comprising:

performing a search based upon a user interest associated with the context to identify related content associated with the user interest.

13. The method of claim 1 , comprising:

responsive to determining that the first set of search results comprises more than the second threshold number of search results:

narrowing the search by adding the one or more required keywords to the search parameters; and

determining the second set of search results based upon the narrowing.

14. The method of claim 5 , the location of the sender of the message determined based upon an address book entry associated with at least one of the sender or a recipient of the message.

15. A system, comprising:

a processor; and

memory comprising processor-executable instructions that when executed by the processor cause the processor to implement a search component configured to:

utilize a visual effect to indicate an area of interest of a user interface of a client device, wherein utilizing the visual effect comprises distorting a secondary area, of the user interface, not included in the area of interest but not distorting the area of interest;

evaluate the area of interest of a first user interface of a client device, wherein the area of interest comprises an image of an entity performing an activity, wherein the evaluating comprises evaluating the image, utilizing image recognition, to identify the activity being performed in the image;

identify context associated with the area of interest based upon a link between an identity of the entity and the activity being performed by the entity, wherein the context is based upon the image;

perform a search of content based upon the context to identify a first set of search results;

at least one of:

responsive to determining that the first set of search results comprises less than a first threshold number of search results:

expanding the search by at least one of adding one or more optional keywords to search parameters or making one or more required keywords in the search parameters optional; and

determining a second set of search results based upon the expanding; or

responsive to determining that the first set of search results comprises more than a second threshold number of search results:

narrowing the search by adding one or more required keywords to the search parameters; and

determining the second set of search results based upon the narrowing;

identify a plurality of potential query search terms, comprising a first potential query search term and a second potential query search term, based upon the context;

provide the second set of search results and the plurality of potential query search terms through a second user interface of the client device;

responsive to receiving a selection of the first potential query search term of the plurality of potential query search terms, filter the second set of search results based upon the first potential query search term to generate a filtered set of search results; and

provide the filtered set of search results through the second user interface of the client device.

16. The system of claim 15 , wherein the distorting the secondary area comprises at least one of fading the secondary area, dimming the secondary area, blurring the secondary area or blacking out the secondary area.

17. The system of claim 15 , the processor-executable instructions, when executed by the processor, causing the processor to implement a visualization component configured to:

receive feedback associated with the identification of the area of interest based upon the visual effect provided; and

responsive to the feedback indicating an improper identification for the area of interest, provide a second visual effect in response to an adjustment to the area of interest.

18. The system of claim 15 , the search component configured to:

add the first potential query search term to a search query associated with the second set of search results.

19. The system of claim 15 , the search component configured to:

display a text input box through the second user interface;

prompt a user to enter at least one of a keyword or a phrase associated with the context into the text input box; and

utilize at least one of the keyword or the phrase as a secondary input to perform a second search.

20. A non-transitory computer readable medium comprising computer executable instructions that when executed by a processor perform a method, comprising:

utilizing a visual effect to indicate an area of interest of a user interface of a client device, wherein utilizing the visual effect comprises distorting a secondary area, of the user interface, not included in the area of interest but not distorting the area of interest;

receiving feedback associated with identification of the area of interest based upon the visual effect;

responsive to the feedback indicating an improper identification for the area of interest, adjusting the area of interest and utilizing the visual effect to indicate the adjusted area of interest by distorting a first portion of the secondary area of the user interface but not distorting a second portion of the secondary area of the user interface, wherein the first portion of the secondary area is not included in the adjusted area of interest but the second portion of the secondary area is included in the adjusted area of interest;

evaluating the adjusted area of interest, wherein the adjusted area of interest comprises an image of an entity performing an activity, wherein the evaluating comprises (i) evaluating the image to identify an identity of the entity in the image and (ii) evaluating the image, utilizing image recognition, to identify the activity being performed in the image by the entity in the image;

identifying context associated with the adjusted area of interest based upon a link between the identity of the entity and the activity being performed by the entity, wherein the context is based upon the image;

performing a search of content based upon the context to identify a first set of search results;

at least one of:

responsive to determining that the first set of search results comprises less than a first threshold number of search results:

expanding the search by at least one of adding one or more optional keywords to search parameters or making one or more required keywords in the search parameters optional; and

determining a second set of search results based upon the expanding; or

responsive to determining that the first set of search results comprises more than a second threshold number of search results:

narrowing the search by adding one or more required keywords to the search parameters; and

determining the second set of search results based upon the narrowing;

identifying a plurality of potential query search terms, comprising a first potential query search term and a second potential query search term, based upon the context;

providing the second set of search results and the plurality of potential query search terms through a second user interface;

responsive to receiving a selection of the first potential query search term of the plurality of potential query search terms, filtering the second set of search results based upon the first potential query search term to generate a filtered set of search results; and

providing the filtered set of search results.

Assignments (3)
PATENT SECURITY AGREEMENT (FIRST LIEN) Recorded Sep 29, 2022
From: YAHOO ASSETS LLC
To: ROYAL BANK OF CANADA, AS COLLATERAL AGENT
Reel/Frame 061571/0773 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 16, 2021
From: YAHOO AD TECH LLC (FORMERLY VERIZON MEDIA INC.)
To: YAHOO ASSETS LLC
Reel/Frame 058982/0282 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2020
From: OATH INC.
To: VERIZON MEDIA INC.
Reel/Frame 054258/0635 →
Continuity (2)
Continuation 14867695 · Sep 28, 2015
Related Publication 20190026377A1 · Jan 24, 2019