IP Library Granted Patent US 10,115,030
Granted Patent B2
US 10,115,030 · App. 15/488,309 · Granted Oct 30, 2018

Viewing aid with tracking system, and method of use

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,115,030
App. No.
15/488,309
Granted
Oct 30, 2018
Kind
B2
Abstract

A viewing aid includes a camera, a viewing surface within a field of view of the camera, a memory, a display, and software programmed to track a tracking element within the field of view. Viewing material is placed on the viewing surface. The camera, viewing surface, and material all remain substantially stationary. The camera captures and stores an initial image of the material in the memory. The software then tracks the location of a tracking element within the field of view then maps the location to a portion of the initial image in memory using an X-Y coordinate system, and/or identifies character elements of the material adjacent the tracking element then maps the character elements to corresponding character elements of the initial image in memory. An enhanced image is then displayed on the display corresponding to the mapped portion of the initial image.

Claims (58)

1. A viewing aid comprising:

a camera;

a viewing surface within a field of view of the camera, and substantially fixed relative to the camera;

a memory in data communication with the camera; and

a display in data communication with the memory;

wherein the camera is configured to capture an initial image of viewing material on the viewing surface and to store the initial image in the memory;

the viewing aid further comprising software configured to program the viewing aid to perform a process comprising:

1) determine a first location of a tracking element within the field of view by identifying X-Y coordinates of the first location based on an X-Y reference frame associated with the field of view;

2) map the location to a corresponding first mapped portion of the initial image in the memory which is less than the full initial image;

3) display on the display a first enhanced image generated from the initial image stored in the memory, the first enhanced image corresponding only to the first mapped portion of the initial image;

4) continuously track a motion of the tracking element within the field of view using the camera; and

5) pan the initial image to display on the display successive enhanced images generated from the initial image stored in the memory based on the tracked motion of the tracking element.

2. The viewing aid of claim 1 , wherein the camera has a fixed field of view.

3. The viewing aid of claim 2 , wherein the successive enhanced images comprise OCR-converted text from the initial image.

4. The viewing aid of claim 1 , wherein the successive enhanced images comprise OCR-converted text from the successive mapped portions of the initial image.

5. The viewing aid of claim 1 , further comprising adjustability controls configured to adjust characteristics of the first enhanced image.

6. A viewing aid comprising:

a camera;

a viewing surface within a field of view of the camera, and substantially fixed relative to the camera;

a memory in data communication with the camera; and

a display in data communication with the memory;

wherein the camera is configured to capture an initial image of viewing material on the viewing surface and to store the initial image in the memory;

the viewing aid further comprising software configured to program the viewing aid to perform a process comprising:

1) identify character elements of the viewing material within the field of view adjacent a tracking element in a first location;

2) map the character elements to corresponding character elements of the initial image in the memory to determine a first mapped portion of the initial image corresponding to a portion of the viewing material adjacent the tracking element in which the first mapped portion is less than the full initial image;

3) display on the display a first enhanced image generated from the initial image and corresponding only to the first mapped portion of the initial image;

4) identify successive character elements of the viewing material within the field of view adjacent the tracking element in successive locations different than the first location;

5) map the successive character elements to corresponding character elements of the initial image in the memory to determine successive mapped portions of the initial image corresponding to a portion of the viewing material adjacent the successive location in which the successive mapped portions are less than the full initial image;

6) pan the initial image to display on the display successive enhanced images generated from the initial image stored in the memory corresponding to the successive mapped portions.

7. The viewing aid of claim 6 , wherein the enhanced images comprise a magnification of the initial image.

8. The viewing aid of claim 6 , wherein the successive enhanced images comprise OCR-converted text from the successive mapped portions of the initial image.

9. The viewing aid of claim 6 , wherein the first enhanced image comprises OCR-converted text from the initial image.

10. The viewing aid of claim 6 , further comprising adjustability controls configured to adjust characteristics of the enhanced image.

11. A method of viewing an image, using a viewing aid comprising a camera, a viewing surface within a field of view of the camera and substantially fixed relative to the camera, a memory in data communication with the camera, and a display in data communication with the memory, the method comprising:

capturing, with the camera, an initial image of viewing material on the viewing surface;

storing the initial image of the material in the memory;

determining a first location of a tracking element within the field of view by identifying X-Y coordinates of the first location based on an X-Y reference frame associated with the field of view;

mapping the location to a corresponding first mapped portion of the initial image in the memory which is less than the full initial image;

displaying on the display a first enhanced image generated from the initial image stored in the memory, the first enhanced image corresponding only to the first mapped portion of the initial image;

continuously tracking a motion of the tracking element within the field of view using the camera; and

panning the initial image to display on the display successive enhanced images generated from the initial image stored in the memory based on the tracked motion of the tracking element.

12. The method of claim 11 , wherein the camera has a fixed field of view.

13. The method of claim 11 , wherein displaying the successive enhanced images on the display comprises displaying OCR-converted text from the successive mapped portions of the initial image.

14. The method of claim 12 , wherein displaying the successive enhanced images on the display comprises displaying OCR-converted text from the initial image.

15. The method of claim 11 , further comprising using adjustability controls to adjust characteristics of the enhanced image.

16. A method of viewing an image, using a viewing aid comprising a camera, a viewing surface within a field of view of the camera and substantially fixed relative to the camera, a memory in data communication with the camera, and a display in data communication with the memory, the method comprising:

capturing, with the camera, an initial image of viewing material on the viewing surface;

storing the initial image of the material in the memory;

identifying character elements of the viewing material within the field of view adjacent a tracking element in a first location;

mapping the character elements to corresponding character elements of the initial image in the memory to determine a first mapped portion of the initial image corresponding to a portion of the viewing material adjacent the tracking element in which the first mapped portion is less than the full initial image;

displaying on the display a first enhanced image generated from the initial image and corresponding only to the first mapped portion of the initial image;

identifying successive character elements of the viewing material within the field of view adjacent the tracking element in successive locations different than the first location;

mapping the successive character elements to corresponding character elements of the initial image in the memory to determine successive mapped portions of the initial image corresponding to a portion of the viewing material adjacent the successive location in which the successive mapped portions are less than the full initial image; and

panning the initial image to display on the display successive enhanced images generated from the initial image stored in the memory corresponding to the successive mapped portions.

17. The method of claim 16 , wherein the enhanced images comprise a magnification of the initial image.

18. The method of claim 17 , wherein displaying the successive enhanced images on the display comprises displaying OCR-converted text from the successive mapped portions of the initial image.

19. The method of claim 16 , wherein displaying the enhanced images on the display comprises displaying OCR-converted text from the initial image.

20. The method of claim 16 , further comprising using adjustability controls to adjust characteristics of the enhanced image.

Assignments (8)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 3, 2025
From: FREEDOM SCIENTIFIC INC.
To: ENHANCED VISIONS SYSTEMS, INC.
Reel/Frame 070738/0323 →
RELEASE OF SECURITY INTEREST IN INTELLECTUAL PROPERTY AT REEL/FRAME NO. 45914/0117 Recorded Sep 29, 2024
From: THE GOVERNOR AND COMPANY OF THE BANK OF IRELAND, AS COLLATERAL AGENT
To: ENHANCED VISION SYSTEMS, INC.
Reel/Frame 069070/0885 →
SECURITY INTEREST Recorded Sep 29, 2024
From: FREEDOM SCIENTIFIC INC.
To: MONROE CAPITAL MANAGEMENT ADVISORS, LLC, AS COLLATERAL AGENT
Reel/Frame 069070/0530 →
RELEASE OF SECURITY INTEREST Recorded Mar 16, 2020
From: THE GOVERNOR AND COMPANY OF THE BANK OF IRELAND
To: ENHANCED VISION SYSTEMS, INC.
Reel/Frame 052126/0122 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2018
From: ENHANCED VISION SYSTEMS, INC.
To: FREEDOM SCIENTIFIC, INC.
Reel/Frame 046992/0668 →
FIRST LIEN INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Apr 10, 2018
From: ENHANCED VISION SYSTEMS, INC.
To: THE GOVERNOR AND COMPANY OF THE BANK OF IRELAND, AS COLLATERAL AGENT
Reel/Frame 045914/0117 →
SECOND LIEN INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Apr 10, 2018
From: ENHANCED VISION SYSTEMS, INC.
To: THE GOVERNOR AND COMPANY OF THE BANK OF IRELAND, AS COLLATERAL AGENT
Reel/Frame 045914/0125 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 20, 2017
From: SIMINOU, KAMRAN
To: ENHANCED VISION SYSTEMS, INC.
Reel/Frame 044454/0541 →