Neuromorphic sensor implementation in aircraft cabin environments
Systems and methods for implementing neuromorphic sensor technology in aircraft cabin environments including smart devices to improve and/or expand the use and functionality of the smart devices. In some embodiments, neuromorphic sensors and smart devices are communicatively coupled to a controller operative to analyze object movements and instruct smart devices to operate according to preprogrammed instructions. Non-limiting examples include detecting passenger movements in passenger seating areas and lavatories associated with smart devices, detecting movements of smart devices configured to traverse aircraft aisles, etc. The neuromorphic sensors are incapable of capturing visually recognizable passenger identities and therefore satisfy privacy concerns.
1. A system for implementation in an aircraft passenger cabin, comprising:
a smart device including communication circuitry and a sensor, having a first range of detection relative to the smart device, configured to detect a condition change proximate the smart device, within the first range of detection;
a neuromorphic event-based camera sensor, being a sensor that does not capture and report color information or report visually recognizable information, positioned apart from the smart device, the neuromorphic event-based camera sensor including communication circuitry, and the neuromorphic event-based camera sensor configured to detect a condition change apart from the smart device in a second range of detection greater than or outside of the first range of detection; and
a controller communicatively coupled to each of the smart device and the neuromorphic event-based camera sensor, the controller including a processor configured to receive condition change information from each of the smart device and the neuromorphic event-based camera sensor, coordinate the received condition change information, and instruct the smart device to operate an actuator or an aircraft lighting system, according to preprogrammed instructions, based on the received and coordinated condition change information.
2. The system according to claim 1 , wherein:
the sensor of the smart device is a proximity sensor configured to detect object movement proximate the smart device; and
the neuromorphic event-based camera sensor is configured to detect object movement in the aircraft passenger cabin, the detected object movement of the neuromorphic event-based camera sensor out of a range of detection of the sensor of the smart device.
3. The system according to claim 1 , wherein:
the aircraft passenger cabin is a passenger seating area including a passenger seat;
the condition change associated with each of the sensor of the smart device and the neuromorphic event-based camera sensor comprises passenger movement within the passenger seating area;
the smart device is one of a lighting device, a seat control device, a climatization device, and a media device; and
the neuromorphic event-based camera sensor is positioned in the passenger seating area such that an imaging area of the neuromorphic event based camera sensor includes the passenger seat.
4. The system according to claim 1 , wherein:
the aircraft passenger cabin is a lavatory;
the condition change associated with each of the smart device and the neuromorphic event-based camera sensor comprises passenger movement;
the smart device is one of a lighting device, a toilet, a climatization device, a ventilation device, a disinfection device, a faucet, and a soap dispenser; and
the neuromorphic event-based camera sensor is positioned to image the lavatory.
5. The system according to claim 1 , wherein:
the condition change associated with each of the smart device and the neuromorphic event-based camera sensor comprises inanimate object movement;
the smart device is an inanimate object configured to traverse at least one aisle of the aircraft passenger cabin; and
the neuromorphic event-based camera sensor is positioned in the aircraft passenger cabin such that an imaging area of the at least one neuromorphic event-based camera sensor includes the at least one aisle.
6. The system according to claim 5 , wherein the smart device is a galley cart.
7. The system according to claim 1 , wherein:
the smart device is communicatively coupled to at least one other smart device; and
the at least one other smart device is communicatively coupled to the controller.
8. The system according to claim 1 , wherein:
the neuromorphic event-based camera sensor is communicatively coupled to at least one other neuromorphic event-based camera sensor;
the at least one other neuromorphic event-based camera sensor is communicatively coupled to the controller; and
each neuromorphic event-based camera sensor is configured to image a predetermined area of the aircraft passenger cabin, wherein each predetermined area may or may not overlap at least one other predetermined area.
9. The system according to claim 1 , wherein the condition change comprises passenger movement.
10. A method of operating a smart device in an aircraft passenger cabin, comprising:
providing a smart device in the aircraft passenger cabin, the smart device including a sensor configured to detect object movement proximate the smart device within a first range of detection relative to the smart device;
providing a neuromorphic event-based camera sensor in the aircraft passenger cabin, the neuromorphic event-based camera sensor being a sensor that does not capture and report color information or report visually recognizable information and configured to detect object movement in the aircraft passenger cabin out of range of detection of the sensor of the smart device;
providing a controller communicatively coupled to each of the smart device and the neuromorphic event-based camera sensor;
detecting, by the neuromorphic event-based camera sensor, object movement in the aircraft passenger cabin;
analyzing, by the controller, the detected object movement;
determining, by the controller, if the analyzed object movement is associated with use of the smart device; and
if the object movement is determined to be associated with the use of the smart device then, by the controller, instructing the smart device to operate an actuator or an aircraft lighting system according to preprogrammed instructions of the smart device.
11. The method according to claim 10 , wherein the step of analyzing comprises confirming object movement into or out of an imaging area of the neuromorphic event-based camera sensor and/or confirming object movement toward or away from the smart device.
12. The method according to claim 10 , wherein:
the aircraft passenger cabin is a passenger seating area including a passenger seat;
the smart device is one of a lighting device, a seat control device, a climatization device, and a media device; and
the neuromorphic event-based camera sensor is positioned in the passenger seating area such that an imaging area of the neuromorphic event-based camera sensor includes the passenger seat.
13. The method according to claim 10 , wherein:
the aircraft passenger cabin is a lavatory;
the smart device is one of a lighting device, a toilet, a climatization device, a ventilation device, a disinfection device, a faucet, and a soap dispenser; and
the neuromorphic event-based camera sensor is positioned overhead in the lavatory.
14. The method according to claim 10 , wherein:
the smart device is networked with at least one other smart device communicatively coupled to the controller; and
use of the smart device and the at least one other smart device is coordinated according to preprogrammed instructions.
15. The method according to claim 10 , wherein:
the neuromorphic event-based camera sensor is networked with at least one other neuromorphic event-based camera sensor;
each of the neuromorphic event-based camera sensor and the at least one other neuromorphic event-based camera sensor is configured to image a predetermined area of the aircraft passenger cabin; and
each predetermined area may or may not overlap at least one other predetermined area.