IP Library Granted Patent US 11,093,748
Granted Patent B2
US 11,093,748 · App. 16/773,763 · Granted Aug 17, 2021

Visual feedback of process state

Inventors: Peiqi Tang (Santa Clara, CA); Andrea Zehr (Palo Alto, CA); Rupa Chaturvedi (Menlo Park, CA); Yu Lou (Mountain View, CA); Colin Jon Taylor (Orinda, CA); Mark Scott Waldo (Richmond, CA); Shaun Michael Post (San Mateo, CA)
Assignee: A9.COM, INC.
G06K9/00671G06F16/532G06F16/5838G06K9/22G06K9/46G06K9/6232G06T7/248G06T13/80G06T19/006G06K2009/3291G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,093,748
App. No.
16/773,763
Granted
Aug 17, 2021
Kind
B2
Abstract

Various embodiments of the present disclosure provide systems and method for visual search and augmented reality, in which an onscreen body of visual markers overlayed on the interface signals the current state of an image recognition process. Specifically, the body of visual markers may take on a plurality of behaviors, in which a particular behavior is indicative of a particular state. Thus, the user can tell what the current state of the scanning process is by the behavior of the body of visual markers. The behavior of the body of visual markers may also indicate to the user recommended actions that can be taken to improve the scanning condition or otherwise facilitate the process. In various embodiments, as the scanning process goes from one state to another state, the onscreen body of visual markers may move or seamlessly transition from one behavior to another behavior, accordingly.

Claims (45)

1. A system, comprising:

at least one computing device processor;

a camera;

a display; and

a memory device including instructions that, when executed by the at least one computing device processor, cause the system to:

receive image data including a representation of a scene captured by the camera;

cause the representation of the scene to be displayed in a graphical interface on the display;

perform an image recognition process on the image data;

detect an error during the image recognition process;

display a group of visual markers on the graphical interface;

determine animation for the group of visual markers based at least in part on the detected error, the animation of the group of visual markers providing a visual indication of the error; and

change the animation of the visual marker based at least in part on a change in the error.

2. The system of claim 1 , wherein the group of visual markers include a plurality of distinct graphical elements, and the animation includes change in an appearance, motion, physics, shape, opacity, or color of the plurality of distinct graphical elements.

3. The system of claim 1 , wherein the image recognition process is a part of an augmented reality process or an image search process.

4. The system of claim 1 , wherein the error is a connectivity or service availability error.

5. The system of claim 1 , wherein the error is a user or client side error.

6. The system of claim 5 , wherein the user or client side error is correctable by the user, and wherein the animation of the visual markers provides visual guidance for how to correct the error.

7. The system of claim 5 , wherein the user or client side error includes at least one of insufficient lighting, unstable camera position, too many objects in view, poor background, camera access by an application, or motion calibration.

8. A computer-implemented method, comprising:

receiving image data including a representation of a scene;

causing the representation of the scene to be displayed in a graphical interface on a display device;

performing an image recognition process on the image data;

detecting an error during the image recognition process;

displaying a group of visual markers on the graphical interface;

determining animation for the group of visual markers based at least in part on the detected error, the animation of the group of visual markers providing a visual indication of the error; and

changing the animation of the visual marker based at least in part on a change in the error.

9. The method of claim 8 , wherein the group of visual markers include a plurality of distinct graphical elements, and the animation includes change in an appearance, motion, physics, shape, opacity, or color of the plurality of distinct graphical elements.

10. The method of claim 8 , wherein the image recognition process is a part of an augmented reality process or an image search process.

11. The method of claim 8 , wherein the error is a connectivity or service availability error.

12. The method of claim 8 , wherein the error is a user or client side error.

13. The method of claim 12 , wherein the user or client side error is correctable by the user, and wherein the animation of the visual markers provides visual guidance for how to correct the error.

14. The method of claim 12 , wherein the user or client side error includes at least one of insufficient lighting, unstable camera position, too many objects in view, poor background, camera access by an application, or motion calibration.

15. A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor of a computing system, cause the computing system to at least:

receive image data including a representation of a scene;

cause the representation of the scene to be displayed in a graphical interface on a display device;

perform an image recognition process on the image data;

detect an error during the image recognition process;

display a group of visual markers on the graphical interface;

determine animation for the group of visual markers based at least in part on the detected error, the animation of the group of visual markers providing a visual indication of the error; and

change the animation of the visual marker based at least in part on a change in the error.

16. The system of claim 15 , wherein the group of visual markers include a plurality of distinct graphical elements, and the animation includes change in an appearance, motion, physics, shape, opacity, or color of the plurality of distinct graphical elements.

17. The system of claim 15 , wherein the image recognition process is a part of an augmented reality process or an image search process.

18. The system of claim 15 , wherein the error is a connectivity or service availability error.

19. The system of claim 15 , wherein the error is a user or client side error correctable by the user, and wherein the animation of the visual markers provides visual guidance for how to correct the error.

20. The system of claim 19 , wherein the user or client side error includes at least one of insufficient lighting, unstable camera position, too many objects in view, poor background, camera access by an application, or motion calibration.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 13, 2024
From: A9.COM, INC.
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 069167/0493 →
Continuity (2)
Continuation 15911850 · Mar 5, 2018
Related Publication 20200160058A1 · May 21, 2020