IP Library Granted Patent US 10,963,277
Granted Patent B2
US 10,963,277 · App. 16/823,589 · Granted Mar 30, 2021

Network error detection using virtual reality display devices

Inventors: James M. Thomas (Charlotte, NC); Alan W. Shields (Charlotte, NC)
Assignee: Bank of America Corporation
G06F9/45533G06F3/017G06K9/00335G06T19/006H04L43/06H04L43/0823
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,963,277
App. No.
16/823,589
Granted
Mar 30, 2021
Kind
B2
Abstract

The device that includes a normalization engine configured to populate data fields in a normalized data structure with network information in accordance with normalization rules. The device further includes a virtualization engine configured to generate virtual data defining one or more virtual objects in accordance with virtualization rules that map data fields from the normalized data structure to physical attributes of virtual objects and to transmit the virtual data defining the one or more virtual objects for display on a user device. The virtualization engine is further configured to receive user feedback that identifies a selected virtual object, to identify data field values in the normalized data structure for the physical attributes of the selected virtual object, and to generate an error report comprising at least a portion of the identified data fields values. The virtualization engine is further configured to send the error report to the user device.

Claims (133)

1. A network error detection device, comprising:

a network interface configured to receive network information from a plurality of data sources;

a memory configured to store:

virtualization rules configured to map data fields from a normalized data structure to physical attributes of virtual objects within a virtual reality environment, wherein:

the virtual reality environment is a geographical map comprising a landmark; and

the virtualization rules map:

internal IP addresses to a virtual object type and a starting location on the landmark within the virtual reality environment;

external IP addresses to a target location on the landmark within the virtual reality environment; and

hardware settings to virtual objects configured to obstruct the movement of other virtual objects within the virtual reality environment;

a virtualization engine implemented by one or more processors, configured to generate virtual data defining a virtual object for the virtual reality environment, wherein generating the virtual object comprises:

selecting an entry linked with a plurality of data fields in the normalized data structure;

identifying an internal IP address associated with the entry;

determining a virtual object type based on the identified internal IP address, wherein the virtual object type identifies a physical representation of a physical object;

determining a starting location on the landmark within the virtual reality environment based on the identified internal IP address;

identifying an external IP address associated with the entry;

determining a target location on the landmark within the virtual reality environment based on the identified external IP address; and

configuring the virtual object to traverse the landmark within the virtual reality environment from the determined starting location to the target location.

2. The device of claim 1 , wherein:

the memory is further configured to store:

normalization rules configured to map received network information to data fields in the normalized data structure; and

further comprising a normalization engine implemented by the one or more processors, configured to populate data fields in the normalized data structure with received network information in accordance with the normalization rules.

3. The device of claim 1 , wherein:

the network interface is further configured to:

transmit the virtual data defining the virtual object for display on a user device in response to generating the virtual object;

receive user feedback from the user device, wherein the user feedback identifies a selected virtual object.

the virtualization engine further configured to:

identify physical attributes of the selected virtual object;

identify data fields and corresponding data field values in the normalized data structure for the identified physical attributes of the selected virtual object based on the virtualization rules;

generate an error report comprising at least a portion of the identified data fields values; and

the network interface further configured to send the error report to the user device.

4. The device of claim 1 , further comprising the user device, wherein the user device comprises:

a display configured to present virtual objects in the virtual reality environment;

a virtual overlay engine implemented by the one or more processors, configured to:

receive the virtual data defining the virtual object;

render the virtual object in the virtual reality environment on the display;

a camera configured to capture gestures performed by a user; and

a gesture recognition engine configured to:

detect a gesture performed by the user interacting with the virtual object in the virtual reality environment using the camera; and

send the user feedback to the virtualization engine identifying the virtual object as the selected virtual object.

5. The device of claim 4 , wherein detecting the gesture performed by the user interacting with the virtual object the virtual environment comprises detecting the user repositioning the virtual object within the virtual reality environment.

6. The device of claim 1 , further comprising the user device, wherein the user device comprises:

a display configured to present virtual objects in the virtual reality environment;

a virtual overlay engine implemented by the one or more processors, configured to:

receive the virtual data defining the virtual object;

render the virtual object in the virtual reality environment on the display;

a microphone configured to capture audio signals; and

a voice recognition engine configured to:

detect an audio signal identifying the virtual object in the virtual reality environment using the microphone; and

send the user feedback to the virtualization engine identifying the virtual object as the selected virtual object.

7. The device of claim 1 , wherein receiving network information from the plurality of data sources comprises:

receiving a first portion of network information from a first data source in a first format; and

receiving a second portion of the network information from a second data source in a second format, wherein the second format is different than the first format.

8. The device of claim 1 , wherein the user device is configured to display at least a portion of the error report in the virtual reality environment.

9. A network error detection method, comprising:

receiving, by a network interface, network information from a plurality of data sources; and

generating, by a virtualization engine, virtual data defining one or more virtual objects for a virtual reality environment using virtualization rules, wherein:

the virtual reality environment is a geographical map comprising a landmark;

the virtualization rules are configured to map data fields from a normalized data structure to physical attributes of virtual objects, wherein the virtualization rules map:

internal IP addresses to a virtual object type and a starting location on the landmark within the virtual reality environment;

external IP addresses to a target location on the landmark within the virtual reality environment; and

hardware settings to virtual objects configured to obstruct the movement of other virtual objects within the virtual reality environment;

and

generating the virtual object comprises:

selecting an entry linked with a plurality of data fields in the normalized data structure;

identifying an internal IP address associated with the entry;

determining a virtual object type based on the identified internal IP address, wherein the virtual object type identifies a physical representation of a physical object;

determining a starting location on the landmark within the virtual reality environment based on the identified internal IP address;

identifying an external IP address associated with the entry;

determining a target location on the landmark within the virtual reality environment based on the identified external IP address; and

configuring the virtual object to traverse the landmark within the virtual reality environment from the determined starting location to the target location.

10. The method of claim 9 , further comprising:

populating, by a normalization engine, data fields in a normalized data structure with received network information in accordance with normalization rules, wherein:

the normalized data structure comprising a plurality of data fields; and

the normalization rules are configured to map received network information to data fields in the normalized data structure.

11. The method of claim 9 , further comprising:

transmitting, by the network interface, the virtual data defining the virtual object-for display on a user device in response to generating the virtual object;

receiving, by the network interface, user feedback from the user device, wherein the user feedback identifies a selected virtual object;

identifying, by the virtualization engine, physical attributes of the selected virtual object;

identifying, by the virtualization engine, data fields and corresponding data field values in the normalized data structure for the identified physical attributes of the selected virtual object based on the virtualization rules;

generating, by the virtualization engine, an error report comprising at least a portion of the identified data fields values; and

sending, by the network interface, the error report to the user device.

12. The method of claim 9 , further comprising:

receiving, by a virtual overlay engine, the virtual data defining the virtual object;

rendering, by the virtual overlay engine, the virtual object in the virtual reality environment on a display;

detecting, by a gesture recognition engine, a gesture performed by the user interacting with the virtual object in the virtual reality environment; and

sending, by the virtual overlay engine, the user feedback to the virtualization engine identifying the virtual object as the selected virtual object.

13. The method of claim 12 , wherein detecting the gesture performed by the user interacting with the virtual object in the virtual environment comprises detecting the user repositioning the virtual object within the virtual reality environment.

14. The method of claim 9 , further comprising:

receiving, by a virtual overlay engine, the virtual data defining the virtual object;

rendering, by the virtual overlay engine, the virtual object in the virtual reality environment on the display;

detecting, by a voice recognition engine, an audio signal identifying the virtual object in the virtual reality environment; and

sending, by the virtual overlay engine, the user feedback to the virtualization engine identifying the virtual object as the selected virtual object.

15. The method of claim 9 , wherein receiving network information from the plurality of data sources comprises:

receiving a first portion of network information from a first data source in a first format; and

receiving a second portion of the network information from a second data source in a second format, wherein the second format is different than the first format.

16. The method of claim 9 , further comprising displaying, by the virtual overlay engine, at least a portion of the error report in the virtual reality environment.

17. A network error detection device, comprising:

a network interface configured to receive network information from a plurality of data sources;

a memory configured to store:

a normalized data structure comprising a plurality of data fields;

normalization rules configured to map received network information to data fields in the normalized data structure; and

virtualization rules configured to map data fields from the normalized data structure to physical attributes of virtual objects within virtual reality environment, wherein:

the virtual reality environment is a geographical map comprising a landmark;

the virtualization rules map:

internal IP addresses to a virtual object type and a starting location on the landmark within the virtual reality environment;

external IP addresses to a target location on the landmark within the virtual reality environment; and

hardware settings to virtual objects configured to obstruct the movement of other virtual objects within the virtual reality environment;

a normalization engine implemented by one or more processors, configured to populate data fields in the normalized data structure with received network information in accordance with the normalization rules;

a virtualization engine implemented by the one or more processors, configured to:

generate virtual data defining a virtual object for the virtual reality environment, wherein generating the virtual object comprises:

selecting an entry linked with a plurality of data fields in the normalized data structure;

identifying an internal IP address associated with the entry;

determining a virtual object type based on the identified internal IP address, wherein the virtual object type identifies a physical representation of a physical object;

determining a starting location on the landmark within the virtual reality environment based on the identified internal IP address;

identifying an external IP address associated with the entry;

determining a target location on the landmark within the virtual reality environment based on the identified external IP address; and

configuring the virtual object to traverse the landmark within the virtual reality environment from the determined starting location to the target location.

18. The device of claim 17 , further comprising:

a camera configured to capture gestures performed by a user; and

a gesture recognition engine configured to:

detect a gesture performed by the user interacting with the virtual object in the virtual reality environment using the camera; and

send the user feedback to the virtualization engine identifying the virtual object as the selected virtual object.

19. The device of claim 18 , wherein detecting the gesture performed by the user interacting with the virtual object in the virtual environment comprises detecting the user repositioning the virtual object within the virtual reality environment.

20. The device of claim 18 , further comprising:

a virtual overlay engine implemented by the one or more processors, configured to:

receive the virtual data defining the virtual object;

render the virtual object in the virtual reality environment on a display; and

receive user feedback, wherein the user feedback identifies a selected virtual object from among one or more virtual objects;

the virtualization engine further configured to:

identify physical attributes of the selected virtual object;

identify data fields and corresponding data field values in the normalized data structure for the identified physical attributes of the selected virtual object based on the virtualization rules;

generate an error report comprising at least a portion of the identified data fields values; and

the virtual overlay engine further configured to display the error report.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2020
From: THOMAS, JAMES M.; SHIELDS, ALAN W.
To: BANK OF AMERICA CORPORATION
Reel/Frame 052165/0387 →
Continuity (2)
Continuation 15916706 · Mar 9, 2018
Related Publication 20200218555A1 · Jul 9, 2020