IP Library Granted Patent US 10,976,920
Granted Patent B2
US 10,976,920 · App. 15/918,050 · Granted Apr 13, 2021

Techniques for image-based search using touch controls

Inventors: Junmin Zhu (Shanghai, CN); Hongbo Min (Shanghai, CN); Ningxin Patrick Hu (Shanghai, CN); Yongsheng Zhu (Shanghai, CN); Zhiqiang Nelson Yu (Shanghai, CN)
Assignee: INTEL CORPORATION
G06F3/04883G06F3/0412G06F3/0481G06F3/04842G06F16/532G06F16/951G06K9/00671G06K9/2081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,976,920
App. No.
15/918,050
Granted
Apr 13, 2021
Kind
B2
Abstract

Techniques for image-based search using touch controls are described. An apparatus may comprise: a processor circuit; a gesture component operative on the processor circuit to receive gesture information from a touch-sensitive screen displaying an image and generate a selection area corresponding to the gesture information; a capture component operative on the processor circuit to extract an image portion of the image corresponding to the selection area; and a search component operative on the processor circuit to perform an image-based search using the extracted image portion. Other embodiments are described and claimed.

Claims (48)

1. An apparatus, comprising:

a processor; and

memory coupled to the processor, the memory comprising instructions that when executed by the processor, cause the processor to:

receive an information element comprising an indication of a gesture, the gesture associated with a display displaying a scene comprising an image and a user interface element;

determine a bounding based on the gesture; and

crop the scene based on the bounding, the cropped scene to include at least a part of the image and to exclude the user interface element.

2. The apparatus of claim 1 , the instructions, which when executed by the processor, cause the processor to set the cropped scene as a selection area.

3. The apparatus of claim 1 , the gesture comprising a scratch gesture.

4. The apparatus of claim 3 , the scratch gesture comprising a swipe of a plurality of points across the display.

5. The apparatus of claim 4 , the instructions, which when executed by the processor, cause the processor to determine the bounding as a rectangle, the rectangle having an area traversing a portion of the display that bounds the plurality of points.

6. The apparatus of claim 4 , each swipe of the plurality of points represented by a pair of points corresponding to points recorded for a beginning and an end of each swipe, each of the pair of points comprising an x-coordinate and a y-coordinate.

7. The apparatus of claim 4 , the instructions, which when executed by the processor, further cause the processor to:

determine a horizontal extent of a triangle to span from a minimum x-coordinate of a plurality of x-coordinates of pairs of points for the scratch gesture to a maximum x-coordinate for the plurality of x-coordinates,

determine a vertical extent of the triangle to span from a minimum y-coordinate of a plurality of y-coordinates of the pairs of points for the scratch gesture to a maximum y-coordinate for the plurality of y-coordinates; and

determine the bounding at the triangle.

8. The apparatus of claim 1 , the instructions, which when executed by the processor, further cause the processor to identify the gesture based on the indication of the gesture.

9. The apparatus of claim 1 , the image comprising a frame from a video, the image presented as part of a playback of the video.

10. A system comprising:

a display displaying a scene, the scene comprising an image and a user interface element;

a processor coupled to the display; and

memory coupled to the processor, the memory comprising instructions that when executed by the processor, cause the processor to:

receive an information element comprising an indication of a gesture, the gesture associated with the display;

determine a bounding based on the gesture; and

crop the scene based on the bounding, the cropped scene to include at least a part of the image and to exclude the user interface element.

11. The system of claim 10 , the instructions, which when executed by the processor, cause the processor to set the cropped scene as a selection area.

12. The system of claim 10 , the gesture comprising a scratch gesture.

13. The system of claim 12 , the scratch gesture comprising a swipe of a plurality of points across the display.

14. The system of claim 13 , the instructions, which when executed by the processor, cause the processor to determine the bounding as a rectangle, the rectangle having an area traversing a portion of the display that bounds the plurality of points.

15. The system of claim 13 , each swipe of the plurality of points represented by a pair of points corresponding to points recorded for a beginning and an end of each swipe, each of the pair of points comprising an x-coordinate and a y-coordinate.

16. The system of claim 13 , the instructions, which when executed by the processor, further cause the processor to:

determine a horizontal extent of a triangle to span from a minimum x-coordinate of a plurality of x-coordinates of pairs of points for the scratch gesture to a maximum x-coordinate for the plurality of x-coordinates,

determine a vertical extent of the triangle to span from a minimum y-coordinate of a plurality of y-coordinates of the pairs of points for the scratch gesture to a maximum y-coordinate for the plurality of y-coordinates; and

determine the bounding at the triangle.

17. The system of claim 13 , the display comprising a touch-sensitive display, the plurality of points a plurality of touch-points on the touch-sensitive display.

18. The system of claim 10 , the instructions, which when executed by the processor, further cause the processor to identify the gesture based on the indication of the gesture.

19. The system of claim 10 , the image comprising a frame from a video, the image presented as part of a playback of the video.

20. At least one non-transitory computer-readable storage medium comprising instructions that, when executed, cause a system to:

receive an information element comprising an indication of a gesture, the gesture associated with a display, the display displaying a scene comprising an image and a user interface element;

determine a bounding based on the gesture; and

crop the scene based on the bounding, the cropped scene to include at least a part of the image and to exclude the user interface element.

21. The at least one non-transitory computer-readable storage medium of claim 20 , comprising instructions that when executed cause the system to set the cropped scene as a selection area.

22. The at least one non-transitory computer-readable storage medium of claim 20 , the gesture a swipe gesture and comprising a swipe of a plurality of points across the display.

23. The at least one non-transitory computer-readable storage medium of claim 22 , comprising instructions that when executed cause the system to determine the bounding as a rectangle, the rectangle having an area traversing a portion of the display that bounds the plurality of points.

24. The at least one non-transitory computer-readable storage medium of claim 23 , each swipe of the plurality of points represented by a pair of points corresponding to points recorded for a beginning and an end of each swipe, each of the pair of points comprising an x-coordinate and a y-coordinate.

25. The at least one non-transitory computer-readable storage medium of claim 22 , comprising instructions that when executed cause the system to:

determine a horizontal extent of a triangle to span from a minimum x-coordinate of a plurality of x-coordinates of pairs of points for the swipe gesture to a maximum x-coordinate for the plurality of x-coordinates,

determine a vertical extent of the triangle to span from a minimum y-coordinate of a plurality of y-coordinates of the pairs of points for the swipe gesture to a maximum y-coordinate for the plurality of y-coordinates; and

determine the bounding at the triangle.

Continuity (2)
Continuation 13997225
Related Publication 20180335938A1 · Nov 22, 2018
Cited By (1)
US 12,321,545