IP Library Granted Patent US 11,050,797
Granted Patent B2
US 11,050,797 · App. 16/183,525 · Granted Jun 29, 2021

Systems and methods for remote control in information technology infrastructure

Inventors: Jake Morgan (Raleigh, NC); Mayfield Reynolds (Raleigh, NC)
Assignee: Connecwise, LLC
H04L65/1069G06F16/9558H04L63/10H04L65/605H04L67/02H04L67/146H04L69/18H04N5/23206H04N5/23296H04W12/08G06F3/04817
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,050,797
App. No.
16/183,525
Granted
Jun 29, 2021
Kind
B2
Abstract

Systems and methods of the present disclosure are directed to providing remote control capabilities in information technology infrastructure. In particular, systems and methods of the present disclosure can provide remotely control capabilities to facilitate the management, configuration, or maintenance of information technology infrastructure.

Claims (45)

1. A system to manage information technology infrastructure, comprising:

a remote view system comprising memory and one or more processors to:

establish, responsive to a request to access a link via a web browser executed by a mobile telecommunications device, via a web socket over a network protocol, a real-time communication session between the mobile telecommunications device and a remote support technician device, the real-time communication session comprising a plurality of data frames comprising data detected by a sensor of the mobile telecommunications device;

receive, via the real-time communication session, the plurality of data frames, each of the plurality of data frames comprising a plurality of image pixels and a predetermined plurality of pixels selected from the plurality of image pixels, wherein the predetermined plurality of pixels are generated by the mobile telecommunications device to encode metadata comprising at least one of position information, camera depth information, or object detection information determined from one or more sensors of the mobile telecommunications device;

process the predetermined plurality of pixels to retrieve the metadata encoded by the mobile telecommunications device into the predetermined plurality of pixels;

remove the predetermined plurality of pixels from each of the plurality of data frames; and

provide, to the remote support technician device, the plurality of data frames for rendering based on the metadata retrieved from and encoded in the predetermined plurality of pixels, the plurality of data frames rendered without the predetermined plurality of pixels encoded with the metadata.

2. The system of claim 1 , wherein a script executing within a browser executed by the mobile telecommunications device requests, for each frame of the plurality of data frames, from the one or more sensors of the mobile telecommunications device, the metadata associated with the one or more sensors.

3. The system of claim 1 , wherein the predetermined plurality of pixels are selected to prevent a compression protocol from removing the predetermined plurality of pixels prior to receipt by the remote view system.

4. The system of claim 1 , wherein the one or more sensors comprise at least one of an accelerometer, a location sensor, or a camera depth sensor.

5. The system of claim 1 , comprising the remote view system to:

use the metadata associated with the one or more sensors to stabilize one or more images of the plurality of data frames provided rendering on the remote support technician device.

6. The system of claim 1 , comprising the remote view system to:

use the metadata associated with the one or more sensors to generate a three-dimensional environment for the plurality of data frames provided for rendering on the remote support technician device.

7. The system of claim 1 , comprising the remote view system to:

receive, from the remote support technician device, an indication to guide a camera of the mobile telecommunications device towards a position;

determine, based on the metadata from the one or more sensors and the position, an instruction to zoom; and

provide, for display on a display device of the mobile telecommunications device, an icon corresponding to the instruction to zoom.

8. The system of claim 1 , comprising the remote view system to:

receive, from the remote support technician device, an indication to guide a camera of the mobile telecommunications device;

determine, based on the metadata from the one or more sensors and the position information, an instruction to pan; and

provide, for display on a display device of the mobile telecommunications device, an icon corresponding to the instruction to pan.

9. The system of claim 1 , wherein the metadata encoded in the predetermined plurality of pixels is different for each of the plurality of data frames.

10. A method of managing information technology infrastructure, comprising:

establishing, by a remote view system comprising memory and one or more processors responsive to a request to access a link via a web browser executed by a mobile telecommunications device, via a web socket over a network protocol, a real-time communication session between the mobile telecommunications device and a remote support technician device, the real-time communication session comprising a plurality of data frames comprising data detected by a sensor of the mobile telecommunications device;

receiving, by the remote view system, via the real-time communication session, the plurality of data frames, each of the plurality of data frames comprising a plurality of image pixels and a predetermined plurality of pixels selected from the plurality of image pixels, wherein the predetermined plurality of pixels are generated by the mobile telecommunications device to encode metadata comprising at least one of position information, camera depth information, or object detection information determined from one or more sensors of the mobile telecommunications device;

processing, by the remote view system, the predetermined plurality of pixels to retrieve the metadata encoded by the mobile telecommunications device into the predetermined plurality of pixels;

removing, by the remote view system, the predetermined plurality of pixels from each of the plurality of data frames; and

providing, by the remote view system to the remote support technician device, the plurality of data frames for rendering based on the metadata retrieved from and encoded in the predetermined plurality of pixels, the plurality of data frames rendered without the predetermined plurality of pixels encoded with the metadata.

11. The method of claim 10 , wherein a script executing within a browser executed by the mobile telecommunications device requests, for each frame of the plurality of data frames, from the one or more sensors of the mobile telecommunications device, the metadata associated with the one or more sensors.

12. The method of claim 10 , wherein the predetermined plurality of pixels are selected to prevent a compression protocol from removing the predetermined plurality of pixels prior to receipt by the remote view system.

13. The method of claim 10 , wherein the one or more sensors comprise at least one of an accelerometer, a location sensor, or a camera depth sensor.

14. The method of claim 10 , comprising:

using, by the remote view system, the metadata associated with the one or more sensors to stabilize one or more images of the plurality of data frames provided rendering on the remote support technician device.

15. The method of claim 10 , comprising:

using, by the remote view system, the metadata associated with the one or more sensors to generate a three-dimensional environment for the plurality of data frames provided for rendering on the remote support technician device.

16. The method of claim 10 , comprising:

receiving, by the remote view system, from the remote support technician device, an indication to guide a camera of the mobile telecommunications device towards a position;

determining, by the remote view system, based on the metadata from the one or more sensors and the position, an instruction to zoom; and

providing, by the remote view system, for display on a display device of the mobile telecommunications device, an icon corresponding to the instruction to zoom.

17. The method of claim 10 , comprising:

receiving, by the remote view system from the remote support technician device, an indication to guide a camera of the mobile telecommunications device;

determining, by the remote view system based on the metadata from the one or more sensors and the position information, an instruction to pan; and

providing, by the remote view system, for display on a display device of the mobile telecommunications device, an icon corresponding to the instruction to pan.

18. The method of claim 10 , wherein the metadata encoded in the predetermined plurality of pixels is different for each of the plurality of data frames.

Assignments (5)
RELEASE OF SECURITY INTEREST Recorded Oct 6, 2021
From: OWL ROCK CAPITAL CORPORATION
To: CONNECTWISE, LLC; CONTINUUM MANAGED SERVICES HOLDCO, LLC
Reel/Frame 057718/0617 →
SECURITY INTEREST Recorded Oct 5, 2021
From: CONNECTWISE, LLC; DIPPELL & ASSOCIATES, INC.
To: BANK OF AMERICA, N.A.
Reel/Frame 057771/0004 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2020
From: MORGAN, JAKE
To: CONNECTWISE INC.
Reel/Frame 053877/0491 →
SECURITY INTEREST Recorded Mar 5, 2019
From: CONNECTWISE, LLC
To: OWL ROCK CAPITAL CORPORATION, AS COLLATERAL AGENT
Reel/Frame 048509/0936 →
CERTIFICATE OF CONVERSION Recorded Feb 27, 2019
From: CONNECTWISE, INC.
To: CONNECTWISE, LLC
Reel/Frame 048453/0416 →
Continuity (2)
Provisional Application 62582833 · Nov 7, 2017
Related Publication 20190141088A1 · May 9, 2019
Cited By (2)
US 12,641,133 US 12,701,150