Intelligent actuated and adjustable glasses nose pad arms
Systems and methods herein describe an actuator control system for controlling intelligent actuated nose pad arms of a pair of eyeglasses. The proposed systems and methods receive a set of position data corresponding to a position of nose pad arms, generate a predicted set of position data for the position of the nose pad arms, transmit the predicted set of position data to pneumatic actuators coupled to the nose pad arms, capture a set of images comprising a plurality of views of the nose pad arms, generate an augmented set of position data of the nose pad arms based on the set of images, generate an adjusted set of position data based on the predicted set of position data and the augmented set of position data, and transmit the adjusted set of position data to the pneumatic actuators coupled to the nose pad arms.
1 . A method comprising:
receiving a set of position data corresponding to a position of eyeglass nose pad arms on a pair of eyeglasses;
based on the set of position data, generating a predicted set of position data for the position of the eyeglass nose pad arms;
transmitting the predicted set of position data to pneumatic actuators coupled to the eyeglass nose pad arms;
capturing a first set of images by one or more image sensors coupled to the pair of eyeglasses, the first set of images comprising a plurality of views of the eyeglass nose pad arms;
capturing a second set of images by the one or more image sensors coupled to the pair of eyeglasses, the second set of images comprising a depiction of a face of a user;
determining an amount of pressure applied by the eyeglass nose pad arms to the user based on the second set of images;
augmenting the set of position data of the eyeglass nose pad arms based on the first set of images and the determined amount of pressure;
based on the predicted set of position data and the augmented set of position data, generating an adjusted set of position data, the adjusted set of position data comprising a modification to the predicted set of position data; and
transmitting the adjusted set of position data to the pneumatic actuators coupled to the eyeglass nose pad arms.
2 . The method of claim 1 , wherein transmitting the predicted set of position data further comprises:
generating a notification comprising instructions to modify a position status of the pair of eyeglasses;
causing display of the notification on a display device coupled to the pair of eyeglasses;
receiving an indication from one or more position sensors of the pair of eyeglasses, the indication comprising updated position status data of the pair of eyeglasses; and
causing the pneumatic actuators to modify the position of the eyeglass nose pad arms based on the predicted set of position data.
3 . The method of claim 1 , further comprising:
causing display of a set of prescription image data on a display device coupled to the pair of eyeglasses;
receiving user feedback based on the displayed set of prescription image data; and
generating an updated set of position data for the position of the eyeglass nose pad arms.
4 . The method of claim 3 , wherein the user feedback is received as audio feedback from a microphone coupled to the pair of eyeglasses.
5 . The method of claim 1 , wherein the predicted set of position data is generated using a first machine learning model trained on historical user data, the historical user data comprising at least one of: eyeglass nose pad position data, user face measurements, and eyeglass lenses sizes.
6 . The method of claim 1 , wherein the augmented set of position data is generated using a second machine learning model trained to analyze the first set of images.
7 . The method of claim 1 , wherein the eyeglass nose pad arms are a pair of eyeglass nose pad arms, and wherein a first eyeglass nose pad of the pair of eyeglass nose pad arms comprises a first actuator system and a second eyeglass nose pad of the pair of eyeglass nose pad arms comprises a second actuator system.
8 . The method of claim 7 , wherein the first actuator system and the second actuator system are physically coupled to an air tank via an air line.
9 . The method of claim 7 , wherein the first actuator system comprises a first set of pneumatic actuators and the second actuator system comprises a second set of pneumatic actuators.
10 . The method of claim 1 , wherein transmitting the predicted set of position data to the pneumatic actuators coupled to the eyeglass nose pad arms, causes the pneumatic actuators to modify the position of the eyeglass nose pad arms.
11 . A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to:
receive a set of position data corresponding to a position of eyeglass nose pad arms on a pair of eyeglasses;
based on the set of position data, generate a predicted set of position data for the position of the eyeglass nose pad arms;
transmit the predicted set of position data to pneumatic actuators coupled to the eyeglass nose pad arms;
capture a first set of images by one or more image sensors coupled to the pair of eyeglasses, the first set of images comprising a plurality of views of the eyeglass nose pad arms;
capture a second set of images by one or more image sensors coupled to the pair of eyeglasses, the second set of images comprising a depiction of a face of a user;
determine an amount of pressure applied by the eyeglass nose pad arms to the user based on the second set of images;
augment the set of position data of the eyeglass nose pad arms based on the first set of images and the determined amount of pressure;
based on the predicted set of position data and the augmented set of position data, generate an adjusted set of position data, the adjusted set of position data comprising a modification to the predicted set of position data; and
transmit the adjusted set of position data to the pneumatic actuators coupled to the eyeglass nose pad arms.
12 . The computer-readable storage medium of claim 11 , wherein after transmitting the predicted set of position data, the instructions further configure the computer to:
generate a notification comprising instructions to modify a position status of the pair of eyeglasses;
cause display of the notification on a display device coupled to the pair of eyeglasses; and
receive an indication from one or more position sensors of the pair of eyeglasses, the indication comprising updated position status data of the pair of eyeglasses.
13 . The computer-readable storage medium of claim 11 , wherein the instructions further configure the computer to:
cause display of a set of prescription image data on a display device coupled to the pair of eyeglasses;
receive user feedback based on the displayed set of prescription image data; and
generate an updated set of position data for the position of the eyeglass nose pad arms.
14 . The computer-readable storage medium of claim 13 , wherein the user feedback is received as audio feedback from a microphone coupled to the pair of eyeglasses.
15 . The computer-readable storage medium of claim 11 , wherein the predicted set of position data is generated use a first machine learning model trained on historical user data, the historical user data comprising at least one of: eyeglass nose pad position data, user face measurements, and eyeglass lenses sizes.
16 . The computer-readable storage medium of claim 11 , wherein the augmented set of position data is generated use a second machine learning model trained to analyze the first set of images.
17 . The computer-readable storage medium of claim 11 , wherein the eyeglass nose pad arms are a pair of eyeglass nose pad arms, and wherein a first eyeglass nose pad of the pair of eyeglass nose pad arms comprises a first actuator system and a second eyeglass nose pad of the pair of eyeglass nose pad arms comprises a second actuator system.
18 . The computer-readable storage medium of claim 17 , wherein the first actuator system and the second actuator system are physically coupled to an air tank via an air line.