Virtual reality (VR) controlled system for remote wiring and measurement of electronic circuits on a trainer
A method includes receiving, by a computing device, multiple camera frames from a first location. The method includes stitching, by the computing device, the multiple camera frames in real time. The method includes transmitting, by the computing device, the stitched multiple camera frames to a user device. The user device located at a second location is configured to control a device at the first location.
1 . A method, comprising:
sending, by a computing device, electronic communications to a first linear slider at a first location, and a second linear slider at second location, wherein the electronic communications include:
a first set of electronic communications configured to control the first linear slider that moves along an x-axis and control the second linear slider that moves along the y-axis of an electronic circuit board, wherein the first set of electronic communications are sent by pushing a button one time,
a second set of electronic communications configured to increase or decrease voltage power being provided to the electronic circuit board, wherein the second set of electronic communications are sent by pushing the button two times,
a third set of electronic communications configured to increase or decrease voltages from a secondary power source provided to the electronic circuit board,
a fourth set of electronic communications configured to adjust potentiometers throughout the electronic circuit board;
receiving, by the computing device, multiple camera frames from a first location, wherein the first location includes first electronic imagery of an electronic circuit board and wherein the first electronic imagery is at a first angle view of the electronic circuit board;
receiving, by the computing device, additional multiple camera frames from the first location, wherein the first location includes second electronic imagery of the electronic circuit board, wherein the second electronic imagery is at second angle view of the electronic circuit board;
stitching, by the computing device, the multiple frames of a video in real time, wherein
the stitching does not include frame blending, wherein the stitching includes:
determining, by the computing device, keypoints of varying scales based on scale-space filtering, wherein the first and second imagery include the keypoints;
performing, by the computing device, keypoint localization, wherein the keypoint localization is based on a Taylor series expansion of scale space;
determining, by the computing device, an orientation assignment for each of the keypoints, wherein the keypoints remain invariant during image rotation, wherein the orientation assignment is based on:
determining an area, of the electronic circuit board, around the keypoint location,
determining gradient magnitude and direction for the area,
generating an orientation histogram with 36 bins encompassing 360 degrees that is weighted by a gradient magnitude and a Gaussian-weighted circular window with σ equal to 1.5 times a scale of the keypoint, wherein the highest peak in the histogram is used to compute the orientation;
transmitting, by the computing device, stitched video frames to a user device, wherein the user device located at a second location is configured to control a device at the first location and wherein the user device is a virtual reality headset; and
sending, by the computing device, additional electronic communications to three motors, wherein:
one of the three motors is used by a z-axis linear actuator to determine wire and connection placements on the electronic circuit board.
2 . The method of claim 1 , wherein the computing device is a robotic device.
3 . The method of claim 1 , wherein the stitching of the multiple video frames includes keypoint matching.
4 . The method of claim 1 , wherein the stitching of the multiple video frames includes frame wrapping.
5 . The method of claim 1 , further comprising:
identifying, by the computing device, specific locations within the multiple camera frames.
6 . The method of claim 1 , wherein the stitching of the multiple camera frames includes border blending, wherein the border blending smooths out variations in light and color across a stitching seam.
7 . The method of claim 1 , further comprising:
generating, by the computing device, a 360-degree view after the stitching of the multiple camera frames.
8 . The method of claim 1 , wherein each of the keypoints has descriptor vectors and wherein the descriptor vectors are used to match keypoints on different images.