IP Library › Granted Patent US 11,933,986
Granted Patent B2
US 11,933,986 · App. 17/692,283 · Granted Mar 19, 2024

Apparatus and methods to extract data with smart glasses

Inventors: Sandeep Verma (Gurugram, IN); Nandini Rathaur (Hyderabad, IN); Pavan Chayanam (Alamo, CA); Srinivas Dundigalla (Waxhaw, NC)
Assignee: Bank of America Corporation
G02B27/0172G06T11/60G06T19/006G06V30/18019G02B2027/0141G02B2027/0178
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,933,986
App. No.
17/692,283
Granted
Mar 19, 2024
Kind
B2
Abstract

Apparatus and methods are provided for extracting and displaying information and data from a stream of information on a pair of smart glasses. One or more content filters describing the desired information and data may be communicated to a content filtering module. The content filtering module may process the stream of information to search for the desired information and data. When the desired information is found within the stream of information, the content filtering module may highlight the desired information, while blurring all other information, within a display on the pair of smart glasses.

Claims (82)

1. An apparatus for extracting and displaying key information on a pair of smart glasses comprising:

the smart glasses comprising:

a display;

a camera;

an input/output (“I/O”) module;

a network interface card (“NIC”);

a non-transitory memory configured to store an operating system; and

a processor configured to operate at least:

the operating system,

the NIC; and

the I/O module; and

a backend computer comprising:

a backend input/output (“bI/O”) module;

a backend network interface card (“bNIC”);

a backend non-transitory memory configured to store at least:

a backend operating system; and

a content filtering module; and

a backend processor configured to operate at least:

the backend operating system;

the content filtering module;

the bNIC; and

the bI/O module;

wherein:

one or more content filters are communicated to the content filtering module by a mining module configured to automatically mine a user's emails and text messages with one or more artificial intelligence/machine learning (“AI/ML”) algorithms;

the camera captures a stream of information; and

the content filtering module:

converts the one or more content filters into one or more keys;

converts the stream of information into an array of images;

processes each image in the array of images to convert each image into text;

searches the text for the one or more keys;

when the module discovers one of the one or more keys in the text:

displays a corresponding image from the array of images on the display; and

blurs all remaining images from the array of images and displays the blurred images on the display.

2. The apparatus of claim 1 wherein the backend computer is a server.

3. The apparatus of claim 1 wherein the backend computer is a mobile device located proximate to the user.

4. The apparatus of claim 1 wherein the backend computer is wired to the pair of smart glasses.

5. The apparatus of claim 1 wherein the backend computer communicates wirelessly with the pair of smart glasses.

6. The apparatus of claim 1 wherein the content filtering module converts non-text inputs from the user into text via natural language processing.

7. The apparatus of claim 1 wherein the stream of information is a livestream visible to the user through the pair of smart glasses.

8. The apparatus of claim 7 wherein the content filtering module provides one or more updates to the user after the user moves away from the livestream.

9. A method for extracting and displaying key information on a pair of smart glasses, the method comprising:

communicating one or more filter terms to a content filtering module wherein the one or more filter terms are determined automatically by a mining module configured to mine a user's emails and text messages with one or more artificial intelligence/machine learning (“AI/ML”) algorithms;

converting, by the content filtering module, the one or more filter terms into one or more keys;

capturing a stream of information with a camera located on the smart glasses;

converting, by the content filtering module, the stream of information into an array of images;

processing, by the content filtering module, the array of images;

extracting, by the content filtering module, all textual characters, numbers, and symbols from the processed array of images;

searching, by the content filtering module, the extracted textual characters, numbers, and symbols for a match between the extracted textual characters, numbers, and symbols and the one or more keys;

when the content filtering module finds the match:

displaying, on the smart glasses, a corresponding image from the array of images; and

blurring all remaining images from the array of images and displaying the blurred images on the smart glasses.

10. The method of claim 9 wherein the content filtering module is located at a mobile device proximate to the smart glasses.

11. The method of claim 9 wherein the content filtering module is located at a server remote from the smart glasses.

12. The method of claim 9 wherein the wherein the stream of information is a livestream visible to a user wearing the smart glasses.

13. The method of claim 12 further comprising providing updates, from the content filtering module to the user, after the user moves away from the livestream.

14. An apparatus for extracting and displaying key information on a pair of smart glasses comprising:

the smart glasses comprising:

a display;

a camera;

an input/output (“I/O”) module;

a network interface card (“NIC”);

a non-transitory memory configured to store:

an operating system; and

a content filtering module; and

a processor configured to operate at least:

the operating system,

the NIC;

the content filtering module; and

the I/O module;

wherein:

one or more content filters determined automatically by a mining module configured to mine a user's emails and text messages with one or more artificial intelligence/machine learning (“AI/ML”) algorithms are communicated to the content filtering module;

the camera captures a stream of information; and

the content filtering module:

converts the one or more content filters into one or more keys;

converts the stream of information into an array of images;

processes each image in the array of images to convert each image into text;

searches the text for the one or more keys; and

when the module discovers one of the one or more keys in the text:

creates a virtual view within the display;

cuts a key image corresponding to the discovered key; and

displays the key image within the virtual view.

15. The apparatus of claim 14 wherein the content filtering module automatically finds and highlights one or more anomalies within the array of images.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2022
From: VERMA, SANDEEP; RATHAUR, NANDINI; CHAYANAM, PAVAN; DUNDIGALLA, SRINIVAS
To: BANK OF AMERICA CORPORATION
Reel/Frame 059234/0152 →
Continuity (1)
Related Publication 20230288704A1 · Sep 14, 2023