Granted Patent B2

US 12,229,813 · App. 17/698,172 · Granted Feb 18, 2025

Inventors: Fouad Bousetouane (Vernon Hills, IL); Srikanth Ojasve (Lake Forest, IL); Nirav Saraiya (Lake Forest, IL)

Assignee: W.W. Grainger, Inc.

G06Q30/0623G06F16/532G06V10/74G06V20/64

Abstract

Claims (28)

1. A non-transitory, computer-readable media having stored thereon instructions, the instructions, when executed by a computing device, cause the computing device to perform steps comprising:

using data within an image frame being captured via use of an imaging element associated with the computing device to detect that an object within the image frame is a most prominently detected object within the image frame;

and

in response to an expiration of a predetermined amount of time with the object continually being the most prominently detected object within the image frame, automatically providing at least a part of a three-dimensional (3D) information for the most prominently detected object within the image frame obtained via use of a 3D data obtaining system associated with the computing device to a cloud-based visual search process for the purpose of locating one or more matching products from within a product database for the most prominently detected object within the image frame with the located one or more matching products being returned to a customer as a product search result.

2. The non-transitory, computer-readable media as recited in claim 1 , wherein the 3D data obtaining system comprises a LiDAR sensor associated with the computing device.

3. The non-transitory, computer-readable media as recited in claim 1 , wherein the 3D data obtaining system comprises one or more cameras and processing for creating a stereoscopic image from image data captured via use of the one or more cameras.

4. The non-transitory, computer-readable media as recited in claim 1 , wherein the 3D information for the most prominently detected object within the image frame comprises shape data and size estimation data for one or more portions of the most prominently detected object within the image frame.

5. The non-transitory, computer-readable media as recited in claim 1 , wherein the instructions further cause a two-dimensional (2D) data associated with the most prominently detected object within the image frame as extracted from the image frame to be provided to the cloud-based visual search process for additional use in locating one or more matching products from within the product database for most prominently detected object within the image frame.

6. A method for providing search results, comprising:

using data within an image frame being captured via use of an imaging element associated with the computing device to detect that an object within the image frame is a most prominently detected object within the image frame;

and

in response to an expiration of a predetermined amount of time with the object continually being the most prominently detected object within the image frame, automatically providing at least a part of a three-dimensional (3D) information for the most prominently detected object within the image frame obtained via use of a 3D data obtaining system associated with the computing device to a cloud-based visual search process for the purpose of locating one or more matching products from within a product database for the most prominently detected object within the image frame with the located one or more matching products being returned to a customer as a product search result.

7. The method as recited in claim 6 , wherein the 3D data obtaining system comprises a LiDAR sensor associated with the computing device.

8. The method as recited in claim 6 , wherein the 3D data obtaining system comprises one or more cameras and processing for creating a stereoscopic image from image data captured via use of the one or more cameras.

9. The method as recited in claim 6 , wherein the 3D information for the most prominently detected object within the image frame comprises shape data and size estimation data for one or more portions of the most prominently detected object within the image frame.

10. The method as recited in claim 6 , further comprising causing a two-dimensional (2D) data associated with most prominently detected object within the image frame as extracted from the image frame to be provided to the cloud-based visual search process for additional use in locating one or more matching products from within the product database for the most prominently detected object within the image frame.

11. A computing device, comprising:

a processor;

an imaging system coupled to the processor;

a display element; and

memory including instructions that, when executed by the processor, enable the computing device to:

use data within an image frame being captured via use of an imaging element associated with the computing device to detect that an object within the image frame is a most prominently detected object within the image frame;

and

in response to an expiration of a predetermined amount of time with the object continually being the most prominently detected object within the image frame, automatically provide at least a part of a three-dimensional (3D) information for the most prominently detected object within the image frame obtained via use of a 3D data obtaining system associated with the computing device to a cloud-based visual search process for the purpose of locating one or more matching products from within a product database for the most prominently detected object within the image frame with the located one or more matching products being returned to a customer as a product search result.

12. The computing device as recited in claim 11 , wherein the 3D data obtaining component comprises a LiDAR sensor associated with the computing device.

13. The computing device as recited in claim 11 , wherein the 3D data obtaining component comprises one or more cameras and processing for creating a stereoscopic image from image data captured via use of the one or more cameras.

14. The computing device as recited in claim 11 , wherein the 3D information for the most prominently detected object within the image frame comprises shape data and size estimation data for one or more portions of the most prominently detected object within the image frame.

15. The computing device as recited in claim 11 , wherein the instructions further cause a two-dimensional (2D) data associated with the most prominently detected object within the image frame as extracted from the image frame to be provided to the cloud-based visual search process for additional use in locating one or more matching products from within the product database for the most prominently detected object within the image frame.

Assignments (1)

Continuity (5)

References Cited (59)