IP Library › Granted Patent US 11,176,193
Granted Patent B2
US 11,176,193 · App. 16/663,191 · Granted Nov 16, 2021

Search input generation for image search

Inventors: Ajay Bedi (Hamirpur, IN); Sunil Rawat (Faridabad, IN); Rishu Aggarwal (Rohini, IN)
Assignee: Adobe Inc.
G06F16/5854G06F3/0482G06F16/535G06F16/538G06K9/00671G06K9/2081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,176,193
App. No.
16/663,191
Granted
Nov 16, 2021
Kind
B2
Abstract

In implementations of search input generation for an image search, a computing device can capture image data of an environment scene that includes multiple objects. The computing device implements a search input module that can detect the multiple objects in the image data, and initiate a display of a selectable indication for each of the multiple objects. The search input module can then determine a subject object from the detected multiple objects, and generate the subject object as the search input for the image search.

Claims (44)

1. In a digital medium environment to generate a search input for an image search, a method implemented by a computing device, the method comprising:

capturing image data of an environment scene that includes one or more objects using an image capture device included with or coupled to the computing device;

receiving device data describing a field of view, a focus region, and a focus point of the image capture device;

detecting the objects in the image data and generating a mask for each of the detected objects;

determining a default object of the detected objects by intersecting the mask for each of the detected objects with the focus region of the image capture device;

displaying a selectable indication for each of the detected objects including the default object;

determining a subject object from the detected objects; and

generating the subject object as the search input for the image search.

2. One or more computer-readable storage media comprising instructions stored thereon that, responsive to execution by a computing device, cause operations of the computing device including:

capturing image data of an environment scene that includes multiple objects using an image capture device of the computing device;

receiving device data describing a field of view, a focus region, and a focus point of the image capture device;

detecting the multiple objects in the image data and generating a mask for each of the detected multiple objects;

determining a default object of the detected multiple objects by intersecting the mask for each of the detected multiple objects with the focus region of the image capture device;

displaying a selectable indication for each of the detected multiple objects;

determining a subject object of the detected multiple objects; and

generating the subject object as a search input for an image search.

3. The one or more computer-readable storage media as described in claim 2 , wherein the operations of the computing device further include receiving image search results corresponding to the subject object.

4. In a digital medium environment to generate a search input for an image search, a system comprising:

a display device to display image data of an environment scene that includes multiple objects, the image data is captured using an image capture device included with a computing device;

a search input module implemented at least partially in computer hardware of the computing device to:

receive device data describing a field of view, a focus region, and a focus point of the image capture device;

detect the multiple objects from the image data of the environment scene and generate a mask for each of the detected multiple objects;

determine a default object of the detected multiple objects by intersecting the mask for each of the detected multiple objects with the focus region of the image capture device;

initiate a display of a selectable indication for each of the detected multiple objects over the image data of the environment scene;

determine a subject object from the detected multiple objects; and

generate the subject object as the search input for the image search.

5. The system as described in claim 4 , wherein the search input module is further implemented to:

identify a point of reference in the environment scene; and

determine the subject object based on the subject object being a nearest detected object of the detected multiple objects to the point of reference.

6. The method as described in claim 1 , wherein the default object is determined based on the focus point of the image capture device.

7. The method as described in claim 1 , wherein the default object is determined based on the field of view of the image capture device.

8. The method as described in claim 1 , wherein the default object is determined based on a centroid of the default object and a center of the focus region of the image capture device.

9. The method as described in claim 1 , further comprising receiving image search results corresponding to the subject object.

10. The method as described in claim 1 , wherein the subject object is the default object.

11. The method as described in claim 1 , wherein the subject object is not the default object.

12. The one or more computer-readable storage media as described in claim 2 , wherein the subject object is the default object.

13. The one or more computer-readable storage media as described in claim 2 , wherein the subject object is not the default object.

14. The one or more computer-readable storage media as described in claim 2 , wherein the default object is determined based on the focus point of the image capture device.

15. The one or more computer-readable storage media as described in claim 2 , wherein the default object is determined based on the field of view of the image capture device.

16. The one or more computer-readable storage media as described in claim 2 , wherein the default object is determined based on a centroid of the default object and a center of the focus region of the image capture device.

17. The system as described in claim 4 , wherein the subject object is the default object.

18. The system as described in claim 4 , wherein the subject object is not the default object.

19. The system as described in claim 4 , wherein the default object is determined based on the field of view of the image capture device.

20. The system as described in claim 4 , wherein the default object is determined based on the focus point of the image capture device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2019
From: BEDI, AJAY; RAWAT, SUNIL; AGGARWAL, RISHU
To: ADOBE INC.
Reel/Frame 051011/0260 →
Continuity (1)
Related Publication 20210124774A1 · Apr 29, 2021