Audio/video methods and systems
Audio and or video data is structurally and persistently associated with auxiliary sensor data (e.g., relating to acceleration, orientation or tilt) through use of a unitary data object, such as a modified MPEG file or data stream. In this form, different rendering devices can employ co-conveyed sensor data to alter the audio or video content. Such use of the sensor data may be personalized to different users, e.g., through preference data. For example, accelerometer data can be associated with video data, allowing some users to view a shake-stabilized version of a video, and other users to view the video with such motion artifacts undisturbed. In like fashion, camera parameters, such as focal plane distance, can be co-conveyed with audio/video content—allowing the volume to be diminished (or not, again depending on user preference) when a camera captures audio/video from a distant subject. Some arrangements employ multiple image sensors and/or multiple audio sensors—each also collecting auxiliary data. A great number of other features and arrangements are also detailed.
1. A method comprising the acts:
obtaining preference data from a user, about shake-compensation, through a user interface; receiving a unitary data object comprising video data that has been previously edited; recovering both video data and sensor data from the unitary data object, the sensor data comprising a parameter relating to acceleration, orientation and tilt; and processing the video data in accordance with the sensor data, in accordance with the user preference data, to yield altered video data for rendering to a user, said processing comprising shake-compensating the video; and
rendering the shake-compensated video to a user; wherein at least one of said acts is performed by a hardware processor.
2. A non-transitory computer readable medium containing software instructions for configuring a hardware processing system to perform acts including:
obtaining preference data from a user, about shake-compensation, through a user interface; receiving a unitary data object comprising video data that has been previously edited; recovering both video data and sensor data from the unitary data object, the sensor data comprising a parameter relating to acceleration, orientation and tilt;
processing the video data with the sensor data, in accordance with the user preference data, to yield altered video data for rendering to a user, said processing comprising shake-compensating the video; and rendering the shake-compensated video to a user.
3. A system including at least one processor and memory, the memory containing instructions configuring the system to perform acts including: obtaining preference data from a user, about shake-compensation, through a user interface; receiving a unitary data object comprising video data that has been previously edited; recovering both video data and sensor data from the unitary data object, the sensor data comprising a parameter relating to acceleration, orientation and tilt;
processing the video data with the sensor data, in accordance with the user preference data, to yield altered video data for rendering to a user, said processing comprising shake-compensating the video; and rendering the shake-compensated video to a user.
4. The method of claim 1 in which the unitary data object also comprises audio data, and said act of recovering sensor data from the unitary data object comprises applying a steganographic decoding process to the audio data to extract the sensor data therefrom.
5. The method of claim 1 in which the sensor data comprises a parameter relating to acceleration.
6. The non-transitory computer readable medium of claim 2 in which the unitary data object also comprises audio data, and in which the software instructions for configuring the hardware processing system to recover sensor data from the unitary data object comprise software instructions for applying a steganographic decoding process to the audio data to extract the sensor data therefrom.
7. The non-transitory computer readable medium of claim 2 in which said sensor data comprises a parameter relating to acceleration.
8. The system of claim 3 in which the unitary data object also comprises audio data, and in which said instructions configuring the system to recover sensor data from the unitary data object comprise instructions for applying a steganographic decoding process to the audio data to extract the sensor data therefrom.
9. The system of claim 3 in which the sensor data comprises a parameter relating to acceleration.