Variable focus liquid lens optical assembly for value chain networks
A dynamic vision system includes a variable focus liquid lens optical assembly. The dynamic vision system includes a control system configured to adjust one or more optical parameters and data collected from the variable focus liquid lens optical assembly in real time. The dynamic vision system includes a processing system that dynamically learns on a training set of outcomes, parameters, and data collected from the variable focus liquid lens optical assembly to train one or more machine learning models to recognize an object.
1. A dynamic vision system comprising:
a variable focus liquid lens optical assembly;
a control system configured to adjust one or more optical parameters of the variable focus liquid lens optical assembly and data collected from the variable focus liquid lens optical assembly in real time; and
a processing system that dynamically learns on a training set comprising: (a) at least one of outcomes or optical parameters, and (b) data collected from the variable focus liquid lens optical assembly to train one or more machine learning models to recognize an object, wherein the one or more machine learning models are embodied on a semiconductor chip that is integrated into a device or a system that houses the variable focus liquid lens optical assembly.
2. The dynamic vision system of claim 1 wherein the variable focus liquid lens optical assembly is continuously adjusted by the control system based on at least one of environment factors or on feedback from the processing system to generate an object concept.
3. The dynamic vision system of claim 2 wherein the object concept includes contextual intelligence about at least one of the object or its environment and provides superior object recognition by the dynamic vision system.
4. The dynamic vision system of claim 1 wherein a first machine learning model is used to optimize collection of signals by the variable focus liquid lens optical assembly and a second machine learning model is used to operate on the signals to achieve a desired vision outcome.
5. The dynamic vision system of claim 1 wherein the processing system receives real-time adjustable data streams from the variable focus liquid lens optical assembly to at least one of: generate situational awareness or create out-of-focus images of the object so as to capture at least one of rich metadata or contextual intelligence about at least one of the object or its environment.
6. The dynamic vision system of claim 1 wherein the control system and the processing system are integrated with the variable focus liquid lens optical assembly.
7. The dynamic vision system of claim 1 wherein the optical parameters adjusted by the control system include at least one of: focal length, specularity, color, environment, or lens shape.
8. The dynamic vision system of claim 7 wherein the adjustment of the optical parameters results in a change to at least one of: spherical aberration, field curvature, coma, chromatic aberration, distortion, vignetting, ghosting, flaring, or diffraction.
9. The dynamic vision system of claim 1 wherein:
the processing system is configured to train the one or more machine learning models to derive a configuration of the variable focus liquid lens optical assembly; and
the configuration includes at least one of: liquid lens material, geometry, shape, optical properties, performance, or design.
10. The dynamic vision system of claim 1 wherein:
the one or more machine learning models are pre-trained on a separate system, such as in a cloud computing environment, such as using at least one of: a large training data set of visual information or outcomes, to perform a set of machine vision tasks, and
the one or more pre-trained machine learning models are deployed on a device or a system that includes the variable focus liquid lens optical assembly.
11. A dynamic vision system comprising:
an image processing system configured to collect data from a variable focus liquid lens optical assembly; and
an artificial intelligence system configured to learn on a training set of at least one of: outcomes, parameters, or data collected from the variable focus liquid lens optical assembly to recognize an object and to control the variable focus liquid lens optical assembly to optimize the collection of data for processing by the artificial intelligence system.
12. A vision system for dynamically learning an object concept about an object of interest, the vision system comprising:
a variable focus liquid lens assembly;
a control system configured to adjust one or more optical parameters of the variable focus liquid lens assembly in real time;
one or more vision sensors configured to capture a real-time pixel array based on data received from the variable focus liquid lens assembly in response to adjustments by the control system, wherein the real-time pixel array represents the object concept;
an adaptive intelligence system configured to process the object concept to build a three-dimensional representation of the object, wherein the adaptive intelligence system includes: a machine learning system configured to input the object concept into one or more machine learning models, and wherein the object concept is used as training data for the one or more machine learning models; and
an artificial intelligence system configured to make at least one of: classifications, predictions, or
one or more decisions relating to the object, including determining at least one of: position, orientation, or motion of the object.
13. The vision system of claim 12 , wherein the object concept includes contextual data about one or more of: the object or an environment of the object.
14. The vision system of claim 12 , wherein the adaptive intelligence system is configured to build the three-dimensional representation of the object directly from the object concept without generating an intermediate image.
15. A dynamic vision system comprising:
a variable focus liquid lens optical assembly;
a control system configured to adjust one or more optical parameters of the variable focus liquid lens optical assembly and data collected from the variable focus liquid lens optical assembly in real time; and
a processing system that dynamically learns on a training set comprising (a) at least one of outcomes or optical parameters, and (b) data collected from the variable focus liquid lens optical assembly to train one or more machine learning models to recognize an object, wherein a first machine learning model of the one or more machine learning models is used to optimize collection of signals by the variable focus liquid lens optical assembly and a second machine learning model of the one or more machine learning models is used to operate on the signals to achieve a desired vision outcome.
16. The dynamic vision system of claim 15 , wherein the desired vision outcome comprises at least one of: a recognition outcome, a classification outcome, or a prediction outcome.
17. The dynamic vision system of claim 15 , wherein the first machine learning model or the second machine learning model comprises a convolutional neural network (CNN).
18. A dynamic vision system comprising:
a variable focus liquid lens optical assembly;
a control system configured to adjust one or more optical parameters of the variable focus liquid lens optical assembly and data collected from the variable focus liquid lens optical assembly in real time; and
a processing system that dynamically learns on a training set comprising (a) at least one of outcomes or optical parameters, and (b) data collected from the variable focus liquid lens optical assembly to train one or more machine learning models to recognize an object, wherein the processing system receives real-time adjustable data streams from the variable focus liquid lens optical assembly to at least one of: generate situational awareness or create out-of-focus images of the object so as to capture at least one of rich metadata or contextual intelligence about at least one of the object or its environment.
19. The dynamic vision system of claim 18 , wherein the situational awareness includes data indicating one or more of: an environment of the object, a motion of the object, a location of the object, an orientation of the object, or a defect of the object.
20. The dynamic vision system of claim 18 , wherein the out-of-focus images are used to infer at least one of: depth information or distance information related to the object.
21. A dynamic vision system comprising:
a variable focus liquid lens optical assembly;
a control system configured to adjust one or more optical parameters of the variable focus liquid lens optical assembly and data collected from the variable focus liquid lens optical assembly in real time; and
a processing system that dynamically learns on a training set comprising (a) at least one of outcomes or optical parameters, and (b) data collected from the variable focus liquid lens optical assembly to train one or more machine learning models to recognize an object,
wherein the optical parameters adjusted by the control system include at least one of: focal length, specularity, color, environment, or lens shape, and wherein the adjustment of the optical parameters results in a change to at least one of: spherical aberration, field curvature, coma, chromatic aberration, distortion, vignetting, ghosting, flaring, or diffraction.
22. The dynamic vision system of claim 21 , wherein the control system adjusts the one or more optical parameters using actuators coupled to the variable focus liquid lens optical assembly.
23. The dynamic vision system of claim 21 , wherein the control system adjusts the one or more optical parameters by applying an electrical voltage to a fluid within the variable focus liquid lens optical assembly to change a shape of the fluid.
24. A dynamic vision system comprising:
a variable focus liquid lens optical assembly;
a control system configured to adjust one or more optical parameters of the variable focus liquid lens optical assembly and to collect data from the variable focus liquid lens optical assembly in real time; and
a processing system that dynamically learns on a training set comprising (a) at least one of outcomes or optical parameters, and (b) data collected from the variable focus liquid lens optical assembly to train one or more machine learning models to recognize an object and to derive a configuration of the variable focus liquid lens optical assembly, wherein the configuration includes at least one of: liquid lens material, geometry, shape, optical properties, performance, or design.
25. The dynamic vision system of claim 24 , wherein the processing system derives the configuration using simulations involving one or more digital twins representing the variable focus liquid lens optical assembly.
26. The dynamic vision system of claim 25 , wherein the one or more digital twins further represent one or more of: the object or an environment of the object.
27. A dynamic vision system comprising:
a variable focus liquid lens optical assembly;
a control system configured to adjust one or more optical parameters of the variable focus liquid lens optical assembly and data collected from the variable focus liquid lens optical assembly in real time; and
a processing system that dynamically learns on a training set comprising (a) at least one of outcomes or optical parameters, and (b) data collected from the variable focus liquid lens optical assembly to train one or more machine learning models to recognize an object,
wherein the one or more machine learning models are pre-trained on a separate system, such as in a cloud computing environment, such as using at least one of: a large training data set of visual information or outcomes, to perform a set of machine vision tasks, and
wherein the pre-trained one or more machine learning models are deployed on a device or system that includes the variable focus liquid lens optical assembly.
28. The dynamic vision system of claim 27 , wherein the device or system comprises an edge computing device.
29. The dynamic vision system of claim 27 , wherein the device or system that includes the variable focus liquid lens optical assembly is part of at least one of: a robotic system, an autonomous vehicle system, a head-mounted device, or a third-party system.
30. The dynamic vision system of claim 11 , wherein the artificial intelligence system is configured to control the variable focus liquid lens optical assembly based on the recognition of the object.
31. The dynamic vision system of claim 11 , wherein the artificial intelligence system is configured to control the variable focus liquid lens optical assembly in response to detecting a change in at least one of: environmental factors or source lighting associated with the object.