IP Library › Granted Patent US 11,836,977
Granted Patent B2
US 11,836,977 · App. 17/113,377 · Granted Dec 5, 2023

System and method for hybrid visual searches and augmented reality

Inventors: Ojasve Srikanth (Lake Forest, IL); Fouad Bousetouane (Vernon Hills, IL); Nirav Saraiya (Lake Forest, IL)
Assignee: W.W. Grainger, Inc.
G06V20/20G06Q30/0643G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,836,977
App. No.
17/113,377
Granted
Dec 5, 2023
Kind
B2
Abstract

A search processing system receives a search query having information indicative of an object of interest, such as an image. The search processing system uses the received search query to locate data for use in creating a computer-generated model of a product determined to be a match for the object of interest. A display generating device uses the data to create the computer-generated model of the product and causes the computer-generated model of the product to be displayed a display associated with the display generating device and/or to be projected onto a surface whereby the computer-generated model of the product can be accurately compared with an image of the object of interest or the object of interest itself.

Claims (21)

1. A non-transitory, computer-readable media having stored thereon instructions, the instructions, when executing by a display generating device, causing the display generating device to perform steps comprising:

capturing an image of an object of interest;

providing at least a portion of the image of the object of interest to a search processing system to allow the search processing system to locate data for use in creating a computer-generated model of a product determined by the search processing system to be a match for the object of interest;

receiving from the search processing system the data;

using the data to create the computer-generated model of the product determined by the search processing system to be a match for the object of interest;

causing the computer-generated model of the product to be displayed in a display associated with the display generating device whereby the computer-generated model of the product can be accurately compared with the object of interest.

2. The non-transitory, computer-readable media method as recited in claim 1 , wherein the computer-generated model of the product comprises a three-dimensional image that is capable of being repositioned and reoriented when displayed in the display associated with the display generating device.

3. The non-transitory, computer-readable media method as recited in claim 1 , wherein the captured image of the object of interest is displayed in the display with the computer-generated model.

4. The non-transitory, computer-readable media method as recited in claim 1 , wherein the display generating device comprises a smart phone or tablet computing device.

5. The non-transitory, computer-readable media method as recited in claim 1 , wherein the instructions, when executing by the display generating device, cause the display generating device to pre-process the at least the portion of the image of the object of interest prior to providing the at least the portion of the image of the object of interest to the search processing system.

6. The non-transitory, computer-readable media method as recited in claim 1 , wherein the instructions, when executing by the display generating device, cause the display generating device to use information associated with a capturing of the image of the object of interest to scale the computer-generated model of the product to the object of interest so that the computer-generated model of the product can be accurately compared with the object of interest.

7. A non-transitory, computer-readable media having stored thereon instructions, the instructions, when executing by a display generating device, causing the display generating device to perform steps comprising:

capturing an image of an object of interest;

providing at least a portion of the image of the object of interest to a search processing system to allow the search processing system to locate data for use in creating a computer-generated model of a product determined by the search processing system to be a match for the object of interest;

receiving from the search processing system the data;

using the data to create the computer-generated model of the product determined by the search processing system to be a match for the object of interest;

causing the computer-generated model of the product to be projected onto a surface whereby the computer-generated model of the product can be accurately compared with the object of interest.

8. The non-transitory, computer-readable media method as recited in claim 7 , wherein the computer-generated model of the product comprises a three-dimensional image that is capable of being repositioned and reoriented when projected onto the surface.

9. The non-transitory, computer-readable media method as recited in claim 7 , wherein the display generating device comprises a smart phone or tablet computing device.

10. The non-transitory, computer-readable media method as recited in claim 7 , wherein the instructions, when executing by the display generating device, cause the display generating device to pre-process the at least the portion of the image of the object of interest prior to providing the at least the portion of the image of the object of interest to the search processing system.

11. The non-transitory, computer-readable media method as recited in claim 7 , wherein the instructions, when executing by the display generating device, cause the display generating device to use information associated with projecting the model of the product onto the surface to scale the computer-generated model of the product to the object of interest so that the computer-generated model of the product can be accurately compared with the object of interest.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 20, 2021
From: SRIKANTH, OJASVE; BOUSETOUANE, FOUAD; SARAIYA, NIRAV
To: W.W. GRAINGER, INC.
Reel/Frame 056911/0246 →
Continuity (2)
Provisional Application 62944055 · Dec 5, 2019
Related Publication 20210174087A1 · Jun 10, 2021