Digital camera system for acoustic modeling
A digital camera with audio, visual and motion analysis includes a digital processor, an input processing system, and one or more imaging sensors, sound sensors, and motion sensors. In a non-limiting embodiment, the input processing system including non-transitory computer readable media including code segments, executable by the digital processor, for real-time audio, visual and motion analysis to develop a digital model of an ambient environment of the digital camera from data derived from the imaging sensor(s), sound sensor(s) and motion sensor(s).
1. A digital camera system for acoustic modeling comprising:
a camera body;
a lens supported by the camera body;
an imaging sensor supported by the camera body in alignment with the lens;
a sound sensor supported by the camera body;
an input processing system supported by the camera body including
(a) a system bus;
(b) a digital processor coupled to the bus;
(c) a sound sensor subsystem coupling an output of the sound sensor to the bus;
(d) a high precision clock, separate from a system clock, coupled to the sound sensor subsystem; and
(e) non-transitory digital memory coupled to the bus including code segments, executable by the digital processor, for real-time audio analysis to develop a digital model of an ambient environment of the digital camera including the synthesis of both motion signals and imaging signals from data derived from the sound sensor subsystem, wherein the code segments include:
code segments to collect raw image data from an imaging sensor of a digital camera;
code segments to collect raw sound data from a sound sensor of the digital camera;
code segments to derive metadata including the synthesis of both motion signals and imaging signals from the raw image data and the raw sound data;
code segments to process the metadata and the raw sound data to develop a model of the ambient environment of the digital camera based upon the raw sound data by implementing at least one of a Structure from Motion (SfM) process and a Simultaneous Localization And Mapping (SLAM) process.
2. A digital camera system for acoustic modeling as recited in claim 1 further comprising an environmental sensor and an environmental sensor subsystem coupling the environmental sensor to the system bus, wherein the digital model of the ambient environment is also derived from data from the environmental sensor subsystem.
3. A digital camera system for acoustic modeling as recited in claim 1 further comprising a global positioning sensor and a global positioning sensor subsystem coupling the global positioning sensor to the system bus, wherein the digital model of the ambient environment is also derived from data from the global positioning subsystem.
4. A digital camera system for acoustic modeling as recited in claim 1 further comprising code segments deriving metadata from raw input data from a plurality of sensors used to develop the digital model of the ambient environment.
5. A digital camera system for acoustic modeling as recited in claim 1 further comprising a display supported by the camera body capable of displaying an image of the ambient environment.
6. A digital camera system for acoustic modeling as recited in claim 1 further comprising an imaging sensor subsystem coupling an output of the imaging sensor to the bus, wherein the imaging sensor subsystem is coupled to the high precision clock.
7. A digital camera system for acoustic modeling as recited in claim 1 further comprising a motion sensor supported by the camera body and a motion sensor subsystem coupling an output of the motion sensor to the bus, wherein the motion sensor subsystem is coupled to the high precision clock.