Sensor system based on stacked sensor layers
A sensor assembly for determining one or more features of a local area is presented herein. The sensor assembly includes a plurality of stacked sensor layers. A first sensor layer of the plurality of stacked sensor layers located on top of the sensor assembly includes an array of pixels. The top sensor layer can be configured to capture one or more images of light reflected from one or more objects in the local area. The sensor assembly further includes one or more sensor layers located beneath the top sensor layer. The one or more sensor layers can be configured to process data related to the captured one or more images. A plurality of sensor assemblies can be integrated into an artificial reality system, e.g., a head-mounted display.
1. A system comprising:
a first camera positioned to capture images of a first field of view;
a second camera positioned to capture images of a second field of view that is non-overlapping with the first field of view; and
a controller communicatively coupled to the first camera and the second camera, the controller being configured to:
activate the first camera to capture the images of the first field of view;
detect an event, wherein the event involves a movement of a physical object from the first field of view to the second field of view, and wherein the first camera and the second camera are configured to track the movement of the physical object; and
in response to detecting the event:
deactivate the first camera; and
activate the second camera to capture the images of the second field of view.
2. The system of claim 1 , wherein the event is associated with a simulation.
3. The system of claim 1 , wherein the first camera and the second camera are positioned on a head-mounted display.
4. The system of claim 1 , wherein the first camera is configured to:
capture images of at least one physical object in the first field of view;
perform feature extraction on the captured images to identify a feature of the at least one physical object; and
transmit data about the feature to the second camera.
5. The system of claim 4 , wherein the second camera is configured to track the feature of the physical object based on the data.
6. The system of claim 1 , wherein the controller is configured to:
predict that a particular camera, among a group of cameras that includes the first camera and the second camera, will be able to capture a feature of at least one physical object at a future point in time; and
in response to predicting that the particular camera will be able to capture the feature of the at least one physical object at the future point in time, activate the particular camera.
7. The system of claim 6 , wherein the controller is configured to, in response to predicting that the particular camera will be able to capture the feature of the physical object at the future point in time:
deactivate at least one camera in the group of cameras, the at least one camera being different from the particular camera.
8. A method comprising:
activating, by a controller, a first camera to capture images of a first field of view, wherein the first camera is configured to:
capture images of a physical object in the first field of view;
perform feature extraction on the captured images to identify a feature of the physical object; and
transmit data about the feature for use by a second camera;
detecting, by the controller, an event; and
in response to detecting the event:
deactivating, by the controller, the first camera; and
activating, by the controller, the second camera to capture images of a second field of view that is non-overlapping with the first field of view.
9. The method of claim 8 , wherein the event involves an execution of a simulation.
10. The method of claim 8 , wherein the event involves a movement of at least one physical object from the first field of view to the second field of view, and wherein the first camera and the second camera are configured to track the movement of the at least one physical object.
11. The method of claim 8 , wherein the first camera and the second camera are positioned on a head-mounted display.
12. The method of claim 8 , wherein the second camera is configured to track the feature of the physical object based on the data.
13. The method of claim 8 , wherein the controller is configured to:
predict that a particular camera, among a group of cameras that includes the first camera and the second camera, will be able to capture a feature of at least one physical object at a future point in time; and
in response to predicting that the particular camera will be able to capture the feature of the at least one physical object at the future point in time, activate the particular camera.
14. The method of claim 13 , wherein the controller is configured to, in response to predicting that the particular camera will be able to capture the feature of the physical object at the future point in time:
deactivate at least one camera in the group of cameras, the at least one camera being different from the particular camera.
15. A non-transitory computer-readable medium comprising program code that is executable by a processor to cause the processor to:
activate a first camera to capture images of a first field of view;
activate a second camera to capture images of a second field of view that is non-overlapping with the first field of view;
predict that a particular camera, among a group of cameras that includes the first camera and the second camera, will be able to capture a feature of a physical object at a future point in time; and
in response to predicting that the particular camera will be able to capture the feature of the physical object at the future point in time, activate the particular camera.
16. The non-transitory computer-readable medium of claim 15 , wherein the first camera is configured to:
capture images of at least one physical object in the first field of view;
perform feature extraction on the captured images to identify a feature of the at least one physical object; and
transmit data about the feature for use by the second camera.
17. The non-transitory computer-readable medium of claim 16 , wherein the second camera is configured to track the feature of the physical object based on the data.
18. The non-transitory computer-readable medium of claim 15 , further comprising program code that is executable by the processor to cause the processor to:
detect an event; and
in response to detecting the event, deactivate the first camera.
19. The non-transitory computer-readable medium of claim 18 , wherein the event involves an execution of a simulation.
20. The non-transitory computer-readable medium of claim 18 , wherein the event involves a movement of at least one physical object from the first field of view to the second field of view, and wherein the first camera and the second camera are configured to track the movement of the at least one physical object.