IP Library Granted Patent US 10,699,087
Granted Patent B1
US 10,699,087 · App. 16/507,900 · Granted Jun 30, 2020

Alternative method to interact with a user interface using standard barcode scanners paired up with an augmented reality heads up display

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,699,087
App. No.
16/507,900
Granted
Jun 30, 2020
Kind
B1
Abstract

A system configured to display an augmented-reality user interface for a barcode reader using a heads-up display assembly is provided. An augmented reality adapter having a camera and a presentation generator is configured to identify a unique identifier associated with a handheld barcode reader and provide an augmented reality display based on data captured by the handheld barcode reader. The presentation generator may position the augmented reality display based on a location of the unique identifier within the field of view (FOV) of the camera.

Claims (64)

1. A system, comprising:

a handheld barcode reader, the handheld barcode reader having an identifier unique to the handheld barcode reader; and

an augmented reality adapter having:

a camera having a field of view (FOV);

a presentation generator configured to provide an augmented reality display based on first data captured by the handheld barcode reader, wherein the position of the augmented reality display on the presentation generator is based on a location of the identifier within the FOV;

a memory configured to store non-transitory computer executable instructions; and

a processor configured to interface with the presentation generator, the camera, and the memory, and configured to execute the non-transitory computer executable instructions to cause the processor to:

analyze images captured by the camera to identify the identifier of the handheld barcode reader;

receive second data, based on first data captured by the handheld barcode reader associated with the identifier; and

cause the presentation generator to display, via the augmented reality display, third data, based on the second data, wherein the presentation generator is configured to display the third data at a display time that is substantially simultaneous to a capture time at which the first data is captured by the handheld barcode reader.

2. The system of claim 1 , wherein the handheld barcode reader and the augmented reality adapter communicate via a short range wireless connection.

3. The system of claim 1 , wherein the non-transitory computer executable instructions further cause the processor to:

analyze the images captured by the camera to detect a movement of the identifier;

determine that the movement of the identifier indicates a user selection; and

modify the augmented reality display based on the user selection.

4. The system of claim 3 , wherein detecting the movement of the identifier includes detecting a direction of the movement of the identifier, and wherein the user selection is determined based on the direction of the movement of the identifier.

5. The system of claim 1 , wherein the non-transitory computer executable instructions further cause the processor to:

analyze the images captured by the camera to detect a light emitted by the handheld barcode reader;

determine that the light emitted by the handheld barcode reader indicates a user selection; and

modify the augmented reality display based on the user selection.

6. The system of claim 5 , wherein determining that the light emitted by the handheld barcode reader indicates a user selection includes analyzing the images captured by the camera to determine that the light emitted by the handheld barcode reader does not impinge on a barcode.

7. The system of claim 5 , wherein detecting the light emitted by the handheld barcode reader includes detecting a location of the light relative to the location of the identifier, and wherein the user selection is determined based on the location of the light relative to the location of the identifier.

8. The system of claim 1 , wherein the non-transitory computer executable instructions further cause the processor to:

analyze the images captured by the camera to identify a first target associated with the handheld barcode reader and a second target associated with the handheld barcode reader;

analyze the images captured by the camera to determine that one of the first target or the second target is obstructed within the FOV;

determine that the obstructed first target or second target indicates a user selection; and

modify the augmented reality display based on the user selection.

9. The system of claim 1 , wherein the first target is a first LED of the handheld barcode reader and the second target is a second LED of the handheld barcode reader.

10. An augmented reality adapter comprising:

a camera having a field of view (FOV);

a presentation generator configured to provide an augmented reality display based on first data captured by a handheld barcode reader having a unique identifier, wherein the position of the augmented reality display on the presentation generator is based on a location of the identifier within the FOV;

a memory configured to store non-transitory computer executable instructions; and

a processor configured to interface with the presentation generator, the camera, and the memory, and configured to execute the non-transitory computer executable instructions to cause the processor to:

analyze images captured by the camera to identify the identifier of the handheld barcode reader;

receive second data, based on first data captured by the handheld barcode reader associated with the identifier; and

cause the presentation generator to display, via the augmented reality display, third data, based on the second data, wherein the presentation generator is configured to display the third data at a display time that is substantially simultaneous to a capture time at which the first data is captured by the handheld barcode reader.

11. The augmented reality adapter of claim 10 , wherein the non-transitory computer executable instructions further cause the processor to:

analyze the images captured by the camera to detect a movement of the identifier;

determine that the movement of the identifier indicates a user selection; and

modify the augmented reality display based on the user selection.

12. A computer-implemented method, comprising:

analyzing, by a processor, images captured by a camera of an augmented reality adapter, the camera having a field of view (FOV), to identify an identifier unique to a handheld barcode reader and a location of the identifier within the FOV;

receiving, by the processor, second data, based on first data captured by the handheld barcode reader associated with the identifier; and

causing, by the processor, a presentation generator of the augmented reality adapter to display, via an augmented reality display, third data, based on the second data,

wherein the position of the augmented reality display on the presentation generator is based on the location of the identifier within the FOV, and

wherein the presentation generator is configured to display the third data at a display time that is substantially simultaneous to a capture time at which the first data is captured by the handheld barcode reader.

13. The computer-implemented method of claim 12 , wherein the handheld barcode reader and the augmented reality adapter communicate via a short range wireless connection.

14. The computer-implemented method of claim 12 , further comprising:

analyzing, by the processor, the images captured by the camera to detect a movement of the identifier;

determining, by the processor, that the movement of the identifier indicates a user selection; and

modifying, by the processor, the augmented reality display based on the user selection.

15. The computer-implemented method of claim 14 , wherein detecting the movement of the identifier includes detecting a direction of the movement of the identifier, and wherein the user selection is determined based on the direction of the movement of the identifier.

16. The computer-implemented method of claim 12 , further comprising:

analyzing, by the processor, the images captured by the camera to detect a light emitted by the handheld barcode reader;

determining, by the processor, that the light emitted by the handheld barcode reader indicates a user selection; and

modifying, by the processor, the augmented reality display based on the user selection.

17. The computer-implemented method of claim 16 , wherein determining that the light emitted by the handheld barcode reader indicates a user selection includes analyzing the images captured by the camera to determine that the light emitted by the handheld barcode reader does not impinge on a barcode.

18. The computer-implemented method of claim 16 , wherein detecting the light emitted by the handheld barcode reader includes detecting a location of the light relative to the location of the identifier, and wherein the user selection is determined based on the location of the light relative to the location of the identifier.

19. The computer-implemented method of claim 12 , further comprising:

analyzing, by the processor, the images captured by the camera to identify a first target associated with the handheld barcode reader and a second target associated with the handheld barcode reader;

analyzing, by the processor, the images captured by the camera to determine that one of the first target or the second target is obstructed within the FOV;

determining, by the processor, that the obstructed first target or second target indicates a user selection; and

modifying, by the processor, the augmented reality display based on the user selection.

20. The computer-implemented method of claim 19 , wherein the first target is a first LED of the handheld barcode reader and the second target is a second LED of the handheld barcode reader.

Assignments (4)
SECURITY INTEREST Recorded Apr 12, 2021
From: ZEBRA TECHNOLOGIES CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 056471/0906 →
RELEASE OF SECURITY INTEREST - 364 - DAY Recorded Mar 5, 2021
From: JPMORGAN CHASE BANK, N.A.
To: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
Reel/Frame 056036/0590 →
SECURITY INTEREST Recorded Sep 1, 2020
From: ZEBRA TECHNOLOGIES CORPORATION; LASER BAND, LLC; TEMPTIME CORPORATION
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 053841/0212 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2020
From: OZSERIN, OZGUR; MORLEY-SMITH, JAMES ROGER
To: ZEBRA TECHNOLOGIES CORPORATION
Reel/Frame 052675/0897 →