IN-STORE OBJECT HIGHLIGHTING BY A REAL WORLD USER INTERFACE
Systems and methods according to present principles involved highlighting objects such as on a store shelf. Highlighting is displayed by projecting a light directly on the object by means of a light source or may alternatively be indicated by displaying an indicator or image of the object on a display screen. Information about the targeted object may appear in a headmounted display, on a user's mobile device, or may be projected on a surface via the projector. Information provided to a user may include comparison product data, data about potential allergens, and the like. Highlighting can also be employed to suggest items of interest to the user. For example, products may be recommended to a user through analysis of user data and such products illuminated by a projector as a user walks through a store. Other highlighted objects may be those on a user grocery list or the like.
1 . An application, constituted of instructions stored on a non-transitory computer-readable medium, for causing a computing environment to perform the following steps:
a. receiving a file representing an image;
b. causing detection of an object pictured in the image;
c. causing identification of the detected object; and
i. causing light to be projected on the identified object; or
ii. causing an indicator of the identified object to be rendered on a device display.
2 . The application of claim 1 , wherein the file represents a single image or a video series of images.
3 . The application of claim 1 , wherein the computing environment includes a mobile device, wherein a camera on the mobile device captures the image, and wherein the indicator is rendered on a display of the mobile device.
4 . The application of claim 1 , wherein the computing environment includes a CAP device, and wherein a camera on the CAP device captures the image.
5 . The application of claim 1 , wherein the computing environment includes a server.
6 . The application of claim 1 , wherein the object represents an image of text in a first language, and wherein the causing identification about the detected object includes:
a. causing a performing of optical character recognition on the image to determine a text string;
b. causing a performing of a translation of the text string into a second language;
c. and wherein the causing light to be projected or causing an indicator to be rendered includes rendering the translated text.
7 . The application of claim 1 , wherein the detecting further comprises receiving an indication from a user, the indication selecting the object.
8 . The application of claim 7 , wherein the indication includes picking up or handling the object.
9 . The application of claim 7 , wherein the indication is received using analysis of the received image.
10 . The application of claim 7 , wherein the indication is received from a user interface on which a user has indicated the object.
11 . The application of claim 10 , wherein the user interface is associated with the device or wherein the user interface is associated with a camera and where the user indication corresponds to a gesture indicating the object.
12 . The application of claim 1 , wherein the causing identification includes causing detection of an object image, an object color or shape, a brand name or logo, an object identifying number, an object identifying QR code, or an object identifying bar code, and causing comparison of the image, color or shape, brand name or logo, number, QR code, or bar code, respectively, to respective quantities in a look-up table, and wherein an object is identified when the object is found in the look-up table corresponding to the respective quantity.
13 . The application of claim 12 , further comprising determining if the identified object is on a user list.
14 . The application of claim 13 , wherein if the identified object is on a user list, then causing a light source to project light onto the identified object or causing the indication of the identified object to be rendered on the device.
15 . The application of claim 12 , wherein the identified object is an entry on a list or menu.
16 . The application of claim 13 , wherein if the identified object is on a user list, then causing a light source to project information pertaining to the identified object or causing information pertaining to the identified object to be rendered on a device.
17 . The application of claim 16 , wherein the information pertaining to the identified object is selected from the group consisting of: nutritional information, ingredient information, comparison shopping information about other products similar to the identified object, comparison shopping information about other quantities available of the identified object, including a price per unit, or an indication of a best value product, either of a particular quantity of the identified object or of a quantity and type of a product similar to the identified object.
18 . The application of claim 12 , wherein the identified object is at a given store, and wherein the comparison shopping information is with respect to the given store, with respect to neighboring stores and/or the given store, or with respect to online retailers and/or the given store.
19 . The application of claim 13 , wherein if the identified object is on a user list, then further comprising causing an audio indication to be rendered about the identified object.
20 . The application of claim 13 , wherein the user list is a shopping list, a wish list, a product avoidance list, a home inventory list, or is a potential interest list created from a user profile, a user shopping or purchasing history, or one or more user-created or user-determined rules.
21 . The application of claim 20 , wherein the user list is a product avoidance list, and wherein the projected light projects a warning onto the identified object or wherein a warning about the identified object is rendered on the device.
22 . The application of claim 12 , further comprising receiving data about objects identified by other users and corresponding to the identified object, or about purchases made by other users and corresponding to the identified object, and causing a light source to project information, or causing an indication to be rendered on a mobile device, about the identified object and about the data about objects identified or purchased by other users.
23 . The application of claim 1 , further comprising:
a. causing the reception of a location of a user;
b. causing a pre-loading of data about objects in or corresponding to the location,
c. such that if the detected object corresponds to one of the objects in the location, data about the detected object is retrievable in a more rapid manner than in the absence of the pre-loading.
24 . The application of claim 6 , wherein the causing a performing steps are performed by a server.
25 . The application of claim 9 , wherein the analysis is performed on a server.
26 . The application of claim 12 , wherein the causing identification step is performed by a server.
27 . The application of claim 22 , wherein the receiving data step is performed by a server.
28 . The application of claim 23 , wherein the causing the reception and causing a preloading steps are performed by a server.
29 . An application, constituted of instructions stored on a non-transitory computer-readable medium, for causing a computing environment to perform the following steps:
a. receiving a file representing an image;
b. attempting to detect or identify an object pictured in the image;
c. if the attempting is unsuccessful, then receiving a file representing another image, the another image portraying the object from another view;
d. detecting or identifying the object from the another image or from a combination of the image and the another image.
30 . An application, constituted of instructions stored on a non-transitory computer-readable medium, for causing a computing environment to perform the following steps:
a. receiving a file representing an image;
b. determining an object pictured in the image, wherein the determining includes one or both of:
i. detecting an object pictured in the image; or
ii. recognizing a selection of an object pictured in the image, the selection performed by a user performing a gesture; and
c. adding the determined object to a user list.